MU Collective

What's Driving Conflicts Around Differential Privacy for the US Census

Priyanka Nanayakkara, Jessica Hullman IEEE Security & Privacy Magazine | PDF

The Risks of Ranking: Revisiting Graphical Perception to Model Individual Differences in Visualization Performance

Russell Davis, Xiaoying Pu, Yiren Ding, Brian D. Hall, Karen Bonilla, Mi Feng, Matthew Kay, Lane Harrison IEEE Transactions on Visualization and Computer Graphics | PDF | Supplementary Material

Evaluating the Use of Uncertainty Visualisations forImputations of Data Missing At Random in Scatterplots

Abhraneel Sarma, Shunan Guo, Jane Hoffswell, Ryan Rossi, Fan Du, Eunyee Koh, and Matthew Kay IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2022 | PDF | Supplementary Material

The Worst of Both Worlds: A Comparative Analysis of Errors in Learning from Data in Psychology and Machine Learning

Jessica Hullman, Sayash Kapoor, Priyanka Nanayakkara, Andrew Gelman, Arvind Narayanan AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES '22) | PDF

Examining Responsibility and Deliberation in AI Impact Statements and Ethics Reviews

David Liu, Priyanka Nanayakkara, Sarah Ariyan Sakha, Grace Abuhamad, Su Lin Blodgett, Nicholas Diakopoulos, Jessica R. Hullman, Tina Eliassi-Rad AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES '22) | PDF

A Survey of Tasks and Visualizations in Multiverse Analysis Reports

Brian D. Hall, Yang Liu, Yvonne Jansen, Pierre Dragicevic, Fanny Chevalier, Matthew Kay Computer Graphics Forum | PDF

Cicero: A Declarative Grammar for Responsive Visualization

Hyeok Kim, Ryan Rossi, Fan Du, Eunyee Koh, Shunan Guo, Jessica Hullman, Jane Hoffswell ACM Human Factors in Computing Systems (CHI) 2022 | PDF | Supplementary Material | Gallery

Visualizing Privacy-Utility Trade-Offs in Differentially Private Data Releases

Priyanka Nanayakkara, Johes Bater, Xi He, Jessica Hullman, and Jennie Rogers Proceedings on Privacy Enhancing Technologies 2022 | PDF

Designing for interactive exploratory data analysis requires theories of graphical inference

Jessica Hullman and Andrew Gelman Harvard Data Science Review 2021 | PDF | Open Access

Visualization Equilibrium

Paula Kayongo, Glenn Sun, Jason Hartline, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2021 | PDF

Visualizing Uncertainty in Probabilistic Graphs with Network Hypothetical Outcome Plots (NetHOPs)

Dongping Zhang, Eytan Adar, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2021 | PDF | GitHub

Causal Support: Modeling Causal Inferences with Visualizations

Alex Kale, Yifan Wu, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2021 | PDF | Supplementary Material | GitHub

An Automated Approach to Reasoning About Task-Oriented Insights in Responsive Visualization

Hyeok Kim, Ryan Rossi, Abhraneel Sarma, Dominik Moritz, and Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2021 | PDF | Supplementary Material

Unpacking the Expressed Consequences of AI Research in Broader Impact Statements

Priyanka Nanayakkara, Jessica Hullman, Nicholas Diakopoulos AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society 2021 (AIES '21) | PDF | Blog post

Design Patterns and Trade-Offs in Responsive Visualization for Communication

Hyeok Kim, Dominik Moritz, Jessica Hullman Computer Graphics Forum (Proc. EUROVIS 2021) | PDF | Supplementary Material | Gallery

Information, incentives, and goals in election forecasts

Andrew Gelman, Jessica Hullman, Christopher Wlezien, George Elliott Morris Judgment and Decision Making 2020 | PDF

Revealing Perceptual Proxies with Adversarial Examples

Brian D. Ondov, Fumeng Yang, Matthew Kay, Niklas Elmqvist, Steven Franconeri IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2020 | PDF

Bayesian-Assisted Inference from Visualized Data

Yea-Seul Kim, Paula Kayongo, Madeleine Grunde-McLaughlin, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2020 | PDF

Visual Reasoning Strategies for Effect Size Judgments and Decisions

Alex Kale, Matthew Kay, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2020 | Best Paper | PDF | GitHub

Human Factors in Model Interpretability: Industry Practices, Challenges, and Needs

Sungsoo Ray Hong, Jessica Hullman, Enrico Bertini ACM Computer Supported Coopoerative Work (CSCW) 2020 | PDF

Prior Setting in Practice: Strategies and Rationales Used in Choosing Prior Distributions for Bayesian Analysis

Abhraneel Sarma, Matthew Kay ACM Human Factors in Computing Systems (CHI) 2020 | PDF | GitHub

A Probabilistic Grammar of Graphics

Xiaoying Pu, Matthew Kay ACM Human Factors in Computing Systems (CHI) 2020 | Best Paper Honorable Mention | PDF | GitHub

How Visualizing Inferential Uncertainty Can Mislead Readers About Treatment Effects in Scientific Results

Jake M. Hofman, Daniel G. Goldstein, Jessica Hullman ACM Human Factors in Computing Systems (CHI) 2020 | Best Paper Honorable Mention | PDF

Exploring the Effects of Aggregation Choices on Untrained Visualization Users’ Generalizations from Data

Francis Nguyen, Xiaoli Qiao, Jeffrey Heer, Jessica Hullman Computer Graphics Forum 2020 | PDF | GitHub

Why Authors Don't Visualize Uncertainty

Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2019 | PDF

Illusion of Causality in Visualized Data

Cindy Xiong, Joel Shapiro, Jessica Hullman, Steve Franconeri IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2019 | PDF

Increasing the Transparency of Research Papers with Explorable Multiverse Analyses

Pierre Dragicevic, Yvonne Jansen, Abhraneel Sarma, Matthew Kay, and Fanny Chevalier ACM Human Factors in Computing Systems (CHI) 2019 | Best Paper | PDF | GitHub | Website

A Bayesian Cognition Approach to Improve Data Visualization

Yea-Seul Kim, Logan A Walls, Peter Krafft, Jessica Hullman ACM Human Factors in Computing Systems (CHI) 2019 | PDF | GitHub

Decision-Making Under Uncertainty in Research Synthesis: Designing for the Garden of Forking Paths

Alex Kale, Matthew Kay, Jessica Hullman ACM Human Factors in Computing Systems (CHI) 2019 | PDF | GitHub

Vocal Shortcuts for Creative Experts

Yea-Seul Kim, Mira Dontcheva, Eytan Adar, Jessica Hullman ACM Human Factors in Computing Systems (CHI) 2019 | PDF

Some Prior(s) Experience Necessary: Templates for Getting Started With Bayesian Analysis

Chanda Phelan, Jessica Hullman, Matthew Kay, Paul Resnick ACM Human Factors in Computing Systems (CHI) 2019 | PDF

Belief-Driven Data Journalism

Francis Nguyen, Samana Shrestha, Joe Germuska, Yea-Seul Kim, Jessica Hullman Computation + Journalism Symposium 2019 | PDF | Medium post | Code

Hypothetical Outcome Plots Help Untrained Observers Judge Trends in Ambiguous Data

Alex Kale, Francis Nguyen, Matthew Kay, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2018 | PDF | GitHub

In Pursuit of Error: A Survey of Uncertainty Visualization Evaluation

Jessica Hullman, Xiaoli Qiao, Michael Correll, Alex Kale, Matthew Kay IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2018 | PDF | GitHub | Website

The Garden of Forking Paths in Visualization: A Design Space for Reliable Exploratory Visual Analytics

Xiaoying Pu, Matthew Kay BELIV 2018 | PDF

Improving Comprehension of Measurements Using Concrete Re-expression Strategies

Jessica Hullman, Yea-Seul Kim, Francis Nguyen, Lauren Speers, Maneesh Agrawala ACM Human Factors in Computing Systems (CHI) 2018 | PDF | GitHub | Website

Uncertainty Displays Using Quantile Dotplots or CDFs Improve Transit Decision-Making

Michael Fernandes, Logan Walls, Sean Munson, Jessica Hullman, Matthew Kay ACM Human Factors in Computing Systems (CHI) 2018 | Best Paper Honorable Mention | PDF

Keeping Multiple Views Consistent: Constraints, Validations, and Exceptions in Visualization Authoring

Zening Qu, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2017 | Best Paper Honorable Mention | PDF

Data Through Others' Eyes: The Impact of Visualizing Others' Expectations on Visualization Interpretation

Yea-Seul Kim, Katharina Reinecke, Jessica Hullman IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2017 | PDF

Imagining Replications: Graphical Prediction & Discrete Visualizations Improve Recall & Estimation of Effect Uncertainty

Jessica Hullman, Matthew Kay, Yea-Seul Kim, Samana Shrestha IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2017 | PDF | GitHub

Finding a Clear Path: Structuring Strategies for Visualization Sequences

Jessica Hullman, Robert Kosara, Heidi Lam Computer Graphics Forum (Proc. EUROVIS) 2017 | PDF

GraphScape: A Model for Automated Reasoning about Visualization Similarity and Sequencing

Younghoon Kim, Kanit Wongsuphasawat, Jessica Hullman, Jeffrey Heer ACM Human Factors in Computing Systems (CHI) 2017 | Best Paper Honorable Mention | PDF | GitHub

Explaining the Gap: Visualizing One's Predictions Improves Recall and Comprehension of Data

Yea-Seul Kim, Katharina Reinecke, Jessica Hullman ACM Human Factors in Computing Systems (CHI) 2017 | Best Paper | PDF

Why Evaluating Uncertainty Visualization is Error Prone

Jessica Hullman BELIV 2016 | PDF

Evaluating Visualization Sets: Trade-offs Between Local Effectiveness and Global Consistency

Zening Qu, Jessica Hullman BELIV 2016 | PDF

Researcher-centered design of statistics: Why Bayesian statistics better fit the culture and incentives of HCI

Matthew Kay, Gregory Nelson, Eric Hekler ACM Human Factors in Computing Systems (CHI) 2016 | Best Paper Honorable Mention | PDF | GitHub

Generating Personalized Spatial Analogies for Distances and Areas

Yea-Seul Kim, Jessica Hullman, Maneesh Agrawala ACM Human Factors in Computing Systems (CHI) 2016 | PDF | GitHub

When(ish) is My Bus? User-centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems

Matthew Kay, Tara Kola, Jessica Hullman, Sean Munson ACM Human Factors in Computing Systems (CHI) 2016 | PDF | GitHub

Content, Context, and Critique: Commenting on a Data Visualization Blog

Jessica Hullman, Nicholas Diakopoulos, Elaheh Momeni Roochi, Eytan Adar ACM Computer-Supported Cooperative Work (CSCW) 2015 | PDF

Beyond Weber’s Law: A Second Look at Ranking Visualizations of Correlation

Matthew Kay, Jeffery Heer IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2015 | Best Paper Honorable Mention | PDF | GitHub

How Good is 85%? A Survey Tool to Connect Classifier Evaluation to Acceptability of Accuracy

Matthew Kay, Shwetak N. Patel, Julie A. Kientz ACM Human Factors in Computing Systems (CHI) 2015 | PDF | GitHub

Hypothetical Outcome Plots Outperform Error Bars and Violin Plots for Inferences about Reliability of Variable Ordering

Jessica Hullman, Paul Resnick, Eytan Adar PLOS ONE 2015 | PDF

NewsViews: An Automated Pipeline for Creating Custom Geovisualizations for News

Tong Gao, Jessica Hullman, Eytan Adar, Brent Hecht, Nicholas Diakopoulos ACM Human Factors in Computing Systems (CHI) 2014 | PDF

There’s No Such Thing As Gaining a Pound: Reconsidering the Bathroom Scale User Interface

Matthew Kay, Dan Morris, mc schraefel, Julie A. Kientz ACM SIGCHI UbiComp 2013 | Best Paper | PDF

A Deeper Understanding of Sequence in Narrative Visualization

Jessica Hullman, Steven Drucker, Nathalie Henry Riche, Bongshin Lee, Danyel Fisher, Eytan Adar IEEE Trans. Visualization & Comp. Graphics (Proc. INFOVIS) 2013 | PDF