[Ieee_vis] Second (updated) call for papers: BELIV 2012 Workshop

[Tobias Isenberg]

BELIV 2012:
Beyond Time and Errors - Novel Evaluation Methods for Visualization

A workshop at the VisWeek 2012 Conference on October 14(/15), 2012 in 
Seattle, WA, USA

http://www.beliv.org/wiki/BELIV2012

DESCRIPTION

Visualization has recently gained much relevance for its ability to cope 
with complex data analysis tasks and communication. While the overall 
use visualizations is accelerating, the growth of techniques for the 
evaluation of these systems has been slow. To understand these complex 
behaviors, evaluation efforts should be targeted at the component level, 
the system level, and the work environment level. The commonly used 
evaluation metrics such as task time completion and number of errors 
appear insufficient to quantify the quality of a visualization system; 
thus the name of the workshop: "beyond time and errors ...".

The BELIV workshop series is a bi-annual event focusing on the 
challenges of evaluation in visualization. While it has been focused on 
information visualization in the past, BELIV 2012 aims at gathering 
researchers in all fields of visualization to continue the exploration 
of novel evaluation methods, and to structure the knowledge on 
evaluation in visualization around a schema, where researchers can 
easily identify unsolved problems and research gaps.

This is the fourth edition of the BELIV workshop series. It will be held 
as an open full-day workshop with paper presentations and discussions on 
October 14th and continue on the 15th with focused discussion for 
attendees interested to follow-up on topics and challenges raised during 
the first day. The second day is meant as an extended opportunity for 
participants and organizers to re-engage most active discussion topics 
of the first day.

DATES

Deadline for submissions:   September 1, 2012
Notification of acceptance: September 24, 2012
Camera ready papers due:    October 1, 2012
Workshop:                   October 14/(15), 2012

HOW TO PARTICIPATE

All registered attendees of VisWeek will be able to attend the workshop. 
In order to present a paper and participate as a panelist in the 
discussions, it is necessary to have a paper accepted. The panel 
discussion itself is open to everybody.

PAPER TYPES

We accept 2 types of submissions—research papers and position papers:

* Research papers present new work and unpublished results on the topic 
areas of the workshop. Research papers will be selected according to 
their novelty, quality and relevance.

* Position papers are problem discussions or statements describing the 
author's relevant experience and ideas that can contribute to the debate 
during the workshop. Position papers will be selected according to their 
importance and relevance of their issues and the quality of their 
discussion.

Both types of papers can be up to eight pages long but the length of a 
submission needs to correspond to its contribution. All papers will be 
peer-reviewed by members of the program committee as well as the 
organizers. We are currently working on making sure that we will be able 
to publish all accepted papers in the ACM digital library including the 
assignment of DOIs to the papers. We also plan to invite a selected 
subset of the papers to contribute to a special issue in a major 
visualization journal venue. For past BELIV workshops and papers see 
these links:

BELIV 2006: published in the ACM DL http://doi.acm.org/10.1145/1168149
BELIV 2008: published in the ACM DL http://doi.acm.org/10.1145/1377966
BELIV 2010: published in the ACM DL http://doi.acm.org/10.1145/2110192

SUBMISSION

To submit a paper create an account and submit the paper to the 
submission system at:

https://cmt.research.microsoft.com/BELIV2012/

Please clarify whether you are submitting a position or research paper.

FORMAT

All the submissions should be formatted in the ACM style. Suitable 
templates, in LaTeX and Word, can be downloaded from: 
http://www.acm.org/sigs/pubs/proceed/template.html. Submission, however, 
must be made in PDF format.

TOPICS OF INTEREST

Topics include, but are not limited to:
* Evaluation in the visualization development lifecycle,
* Utility characterization,
* Evaluation metrics,
* Insight characterization,
* Synthetic data sets and benchmarks,
* Taxonomy of tasks,
* Computational evaluation,
* Benchmark development and repositories,
* Methods for longitudinal studies and adoption,
* Evaluation of early prototypes, and
* Evaluation heuristics and guidelines.

ORGANIZERS

Enrico Bertini: University of Konstanz
Adam Perer: IBM Research
Heidi Lam: Google Inc.
Petra Isenberg: INRIA
Tobias Isenberg: INRIA, CNRS, University of Groningen