Midwest Uncertainty Collective

Paper

Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering

Jessica Hullman, Paul Resnick, Eytan Adar PLOS ONE 2015
A) Representations of uncertainty compared in our study, B) HOPs limiting case, C) HOPs can express properties of a joint distribution.

A) Representations of uncertainty compared in our study, B) HOPs limiting case, C) HOPs can express properties of a joint distribution.

Abstract

Many visual depictions of probability distributions, such as error bars, are difficult for users to accurately interpret. We present and study an alternative representation, Hypothetical Outcome Plots (HOPs), that animates a finite set of individual draws. In contrast to the statistical background required to interpret many static representations of distributions, HOPs require relatively little background knowledge to interpret. Instead, HOPs enables viewers to infer properties of the distribution using mental processes like counting and integration. We conducted an experiment comparing HOPs to error bars and violin plots. With HOPs, people made much more accurate judgments about plots of two and three quantities. Accuracy was similar with all three representations for most questions about distributions of a single quantity.

Citation

BibTeX

@article{hops-2015,
	title        = {Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering},
	author       = {Hullman, Jessica AND Resnick, Paul AND Adar, Eytan},
	year         = 2015,
	journal      = {PLOS ONE},
	publisher    = {Public Library of Science},
	volume       = 10,
	number       = 11,
	pages        = {1--25},
	doi          = {10.1371/journal.pone.0142444}
}