<div dir="ltr">BELIV 2014, Nov. 10, Paris, France<br>co-located with IEEE VIS 2014<br><br><a href="http://beliv.cs.univie.ac.at/">http://beliv.cs.univie.ac.at/</a><br><br><br>CALL FOR PAPERS (RESEARCH & POSITION)<div><br>
We invite you to contribute to BELIV 2014, the international workshop on evaluation in visualization.<br><br>Even though established scientific methods like controlled experiments and standard metrics like time and error continue to be the workhorse of evaluation in visualization, there is a growing need in the community to develop special approaches and metrics for evaluation at all stages of the development life cycle that address specific needs in visualization. The goal of the workshop is to continue the discussion and spread the word on alternative and novel evaluation methods and methodologies for visualization.<br>
<br><br>Paper Types<br><br>We accept two types of submissions—research papers and position papers. The workshop focuses on contributions from all areas of visualization, including visual analytics, information visualization, and scientific visualization.<br>
<br><b>Research papers</b> aim to make progress toward novel evaluation methods in visualization and to discuss their benefits and limitations compared to traditional methodologies. As in past editions of BELIV, we will not accept papers that merely report on the evaluation of a system or technique unless the focus of the contribution is on lessons learned about applying a novel evaluation method or methodology and new insights on the evaluation itself are presented. Research papers present new work and unpublished results on the topic areas of the workshop. Research papers will be selected according to their novelty, quality, and relevance.<br>
<br><b>Position papers</b> are problem discussions or statements describing the author's relevant experience and ideas in regards to evaluation methods and methodologies for visualization. Position papers will be selected according to their importance and relevance for the workshop topics and how well they will fit the planned discussions.<br>
<br>Both types of papers can be up to eight pages long but the length of a submission needs to correspond to its contribution. All papers will be peer-reviewed by members of the program committee as well as the organizers.<br>
<br>We are currently working on making sure that we will be able to publish all accepted papers in the ACM digital library including the assignment of DOIs to the papers. We also plan to invite a selected subset of the papers to contribute to a special issue in a major visualization journal venue such as the Information Visualization Journal.<br>
<br><br></div><div>Important Dates<br><br>June 30, 2014: Paper submission due<br>Aug 1, 2014: First notification<br>Sept 1, 2014: Revisions due<br>Sept 15, 2014: Final notification<br>Nov 10, 2014: BELIV workshop (1-day)<br>
<br><br></div><div>Submission<br><br>To submit a paper create an account and submit the paper to the submission system at: <a href="https://cmt.research.microsoft.com/BELIV2014/">https://cmt.research.microsoft.com/BELIV2014/</a>. Please clarify whether you are submitting a position or research paper.<br>
<br>For additional questions, email the organizers at <a href="mailto:beliv.workshop@gmail.com">beliv.workshop@gmail.com</a><br><br><br></div><div>Format<br><br>All the submissions should be formatted in the ACM style. Suitable templates, in LaTeX and Word, can be downloaded from: <a href="http://www.acm.org/sigs/publications/proceedings-templates">http://www.acm.org/sigs/publications/proceedings-templates</a>. The submission, however, must be made in PDF format.<br>
<br><br></div><div>Topics of Interest<br><br>Topics include, but are not limited to:<br>Evaluation in the visualization development lifecycle,<br>Utility characterization,<br>Evaluation metrics,<br>Insight characterization,<br>
Synthetic data sets and benchmarks,<br>Taxonomy of tasks,<br>Computational evaluation,<br>Benchmark development and repositories,<br>Methods for longitudinal studies and adoption,<br>Evaluation of early prototypes,<br>Evaluation heuristics and guidelines, and<br>
Reflections on evaluation practice in visualization in the past, present, and future.<br><br><br>Topics of Non-Interest<br><br>Evaluation results of a visualization system or technique<br><br><br>Organizers:<br><br>Heidi Lam, Google<br>
Petra Isenberg, INRIA<br>Tobias Isenberg, INRIA<br>Michael Sedlmair, University of Vienna<br><br><br>Papers from previous BELIVs<br><br>For past BELIV workshops and papers see these links:<br><span id="docs-internal-guid-0f09fc12-7903-e460-97c8-0a5c399b2e5b"><p dir="ltr" style="line-height:1.15;margin-top:0pt;margin-bottom:0pt">
<span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">BELIV 2006:</span><a href="http://doi.acm.org/10.1145/1168149" style="text-decoration:none"><span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><span style="font-family:Arial;background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">published in the ACM DL</span></a></p>
<p dir="ltr" style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">BELIV 2008:</span><a href="http://doi.acm.org/10.1145/1377966" style="text-decoration:none"><span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><span style="font-family:Arial;background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">published in the ACM DL</span></a></p>
<p dir="ltr" style="line-height:1.15;margin-top:0pt;margin-bottom:0pt"><span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">BELIV 2010:</span><a href="http://doi.acm.org/10.1145/2110192" style="text-decoration:none"><span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><span style="font-family:Arial;background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">published in the ACM DL</span></a></p>
<span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">BELIV 2012:</span><a href="http://doi.acm.org/10.1145/2442576" style="text-decoration:none"><span style="font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"> </span><span style="font-family:Arial;background-color:transparent;text-decoration:underline;vertical-align:baseline;white-space:pre-wrap">published in the ACM DL</span></a></span><br>
</div></div>