Reliance on metrics is a fundamental challenge for AI

Summary: Through a series of case studies, we review how the unthinking pursuit of metric optimization can lead to real-world harms, including recommendation systems promoting radicalization, well-loved teachers fired by an algorithm, and essay grading software that rewards sophisticated garbage. Th...

Full description

Bibliographic Details
Published in:	Patterns
Main Authors:	Rachel L. Thomas, David Uminsky
Format:	Article
Language:	English
Published:	Elsevier 2022-05-01
Subjects:	DSML 1: Concept: Basic principles of a new data science output observed and reported
Online Access:	http://www.sciencedirect.com/science/article/pii/S2666389922000563

Similar Items

BlockNet: Beyond reliable spatial Digital Twins to Parallel Metaverse
by: Zhihan Lv, et al.
Published: (2022-05-01)

Reproducibility Starts from You Today
by: Yasemin Turkyilmaz-van der Velden, et al.
Published: (2020-09-01)

High Tech, High Risk: Tech Ethics Lessons for the COVID-19 Pandemic Response
by: Emanuel Moss, et al.
Published: (2020-10-01)

A fine-grained network for human identification using panoramic dental images
by: Hu Chen, et al.
Published: (2022-05-01)

Stabilizing deep tomographic reconstruction: Part A. Hybrid framework and experimental results
by: Weiwen Wu, et al.
Published: (2022-05-01)

Explainability and human intervention in autonomous scanning probe microscopy
by: Yongtao Liu, et al.
Published: (2023-11-01)

EXSCLAIM!: Harnessing materials science literature for self-labeled microscopy datasets
by: Eric Schwenker, et al.
Published: (2023-11-01)

MERGE: A model for multi-input biomedical federated learning
by: Bruno Casella, et al.
Published: (2023-11-01)

A multi-scale unified model of human mobility in urban agglomerations
by: Yong Chen, et al.
Published: (2023-11-01)

Systematic indication extension for drugs using patient stratification insights generated by combinatorial analytics
by: Sayoni Das, et al.
Published: (2022-06-01)

Backpropagation with biologically plausible spatiotemporal adjustment for training deep spiking neural networks
by: Guobin Shen, et al.
Published: (2022-06-01)

Long-sequence voltage series forecasting for internal short circuit early detection of lithium-ion batteries
by: Binghan Cui, et al.
Published: (2023-06-01)

CALANGO: A phylogeny-aware comparative genomics tool for discovering quantitative genotype-phenotype associations across species
by: Jorge Augusto Hongo, et al.
Published: (2023-06-01)

Evaluating vaccine allocation strategies using simulation-assisted causal modeling
by: Armin Kekić, et al.
Published: (2023-06-01)

Zero-shot personalization of speech foundation models for depressed mood monitoring
by: Maurice Gerczuk, et al.
Published: (2023-11-01)

An artificial intelligence life cycle: From conception to production
by: Daswin De Silva, et al.
Published: (2022-06-01)

MANGEM: A web app for multimodal analysis of neuronal gene expression, electrophysiology, and morphology
by: Robert Hermod Olson, et al.
Published: (2023-11-01)

Privacy-preserving federated neural network learning for disease-associated cell classification
by: Sinem Sav, et al.
Published: (2022-05-01)

Deep forecasting of translational impact in medical research
by: Amy P.K. Nelson, et al.
Published: (2022-05-01)

Improving reduced-order models through nonlinear decoding of projection-dependent outputs
by: Kamila Zdybał, et al.
Published: (2023-11-01)

Optimal decision-making in high-throughput virtual screening pipelines
by: Hyun-Myung Woo, et al.
Published: (2023-11-01)

Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction
by: Jiayi Pan, et al.
Published: (2022-06-01)

Multi-input convolutional network for ultrafast simulation of field evolvement
by: Zhuo Wang, et al.
Published: (2022-06-01)

Federated learning of molecular properties with graph neural networks in a heterogeneous setting
by: Wei Zhu, et al.
Published: (2022-06-01)

Application of Aligned-UMAP to longitudinal biomedical studies
by: Anant Dadu, et al.
Published: (2023-06-01)

Information about immune cell proportions and tumor stage improves the prediction of recurrence in patients with colorectal cancer
by: JungHo Kong, et al.
Published: (2023-06-01)

Network embedding unveils the hidden interactions in the mammalian virome
by: Timothée Poisot, et al.
Published: (2023-06-01)

A universal workflow for creation, validation, and generalization of detailed neuronal models
by: Maria Reva, et al.
Published: (2023-11-01)

Separation Principle for Linear Sampled-Data Control Systems Under Observer-Based Output Feedback With Aperiodic Sampling
by: Do Wan Kim
Published: (2020-01-01)

A Bibliometric Analysis and Review on Performance Modeling Literature
by: Barbara Livieri, et al.
Published: (2015-04-01)

THE DEVELOPMENT OF BASIC CONCEPT SCIENCE MODULE WITH SETS (SCIENCE ENVIRONMENT TECHNOLOGY SOCIETY) VISION BASED ON SCIENCE LITERACY
by: Yuni Arfiani, et al.
Published: (2019-08-01)

Student Perceptions of the Basic Concepts of Islamic Education
by: Wawan Purnama, et al.
Published: (2024-12-01)

KONSEP DASAR IPA BERBASIS STEM PJBL PADA KETERCAPAIAN DOMAIN AFEKTIF MAHASISWA PGMI STIT SUNAN GIRI BIMA
by: Relly Prihatin
Published: (2020-03-01)

Application of Science Process Skills in Courses of Basic Science Concepts
by: Farida Istianah, et al.
Published: (2025-02-01)

ACADEMIES OF SCIENCES IN THE CONTEMPORARY WORLD
by: Jüri Engelbrecht, et al.
Published: (2022-05-01)

A New International Law
by: E. T. Baildinov
Published: (2013-06-01)

The System of Concepts As a Metalanguage of Forensic Science
by: V. O. Kuznetsov
Published: (2021-04-01)

Philosophical examination of the fundamental concepts of counseling knowledge with an emphasis on the opinions of Sadrul Mutalahin
by: Hadi Hemmatyan, et al.
Published: (2024-03-01)

Development of the Conceptual Basis for Enterprise Integrated Reporting
by: Budko Oksana V.
Published: (2017-09-01)

Fundamental principles of the concept of health-forming technologies in the process of physical education of primary-school aged children
by: Nataliia Goncharova
Published: (2017-01-01)