Midwest Uncertainty Collective

Paper

Unpacking the Expressed Consequences of AI Research in Broader Impact Statements

Priyanka Nanayakkara, Jessica Hullman, Nicholas Diakopoulos AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society 2021 (AIES '21)
Prevalence of types of impacts written about in our sample of NeurIPS 2020 broader impact statements. The graphic originally appeared in a Technically Social blog post about the paper.

Prevalence of types of impacts written about in our sample of NeurIPS 2020 broader impact statements. The graphic originally appeared in a Technically Social blog post about the paper.

Abstract

The computer science research community and the broader public have become increasingly aware of negative consequences of algorithmic systems. In response, the top-tier Neural Information Processing Systems (NeurIPS) conference for machine learning and artificial intelligence research required that authors include a statement of broader impact to reflect on potential positive and negative consequences of their work. We present the results of a qualitative thematic analysis of a sample of statements written for the 2020 conference. The themes we identify broadly fall into categories related to how consequences are expressed (e.g., valence, specificity, uncertainty), areas of impacts expressed (e.g., bias, the environment, labor, privacy), and researchers’ recommendations for mitigating negative consequences in the future. In light of our results, we offer perspectives on how the broader impact statement can be implemented in future iterations to better align with potential goals.

Citation

BibTeX

@inproceedings{ai-research-broader-impact-statements-2021,
	title        = {Unpacking the Expressed Consequences of AI Research in Broader Impact Statements},
	author       = {Nanayakkara, Priyanka and Hullman, Jessica and Diakopoulos, Nicholas},
	year         = 2021,
	booktitle    = {Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society},
	publisher    = {ACM},
	series       = {AIES '21},
	pages        = {795–806},
	doi          = {10.1145/3461702.3462608}
}