upcarta
  • Sign In
  • Sign Up
  • Explore
  • Search

Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?

  • Paper
  • Nov 15, 2022
  • #ComputerScience #Philosophyofcomputerscience #ArtificialIntelligence #Naturallanguageprocessing
Kathleen Creel
@KathleenACreel
(Author)
Rishi Bommasani
@RishiBommasani
(Author)
Ananya Kumar
@ananyaku
(Author)
Dan Jurafsky
@jurafsky
(Author)
Percy Liang
@percyliang
(Author)
arxiv.org
Read on arxiv.org
1 Recommender
1 Mention
As the scope of machine learning broadens, we observe a recurring theme of algorithmic monoculture: the same systems, or systems that share components (e.g. training data), are depl... Show More

As the scope of machine learning broadens, we observe a recurring theme of algorithmic monoculture: the same systems, or systems that share components (e.g. training data), are deployed by multiple decision-makers. While sharing offers clear advantages (e.g. amortizing costs), does it bear risks? We introduce and formalize one such risk, outcome homogenization: the extent to which particular individuals or groups experience negative outcomes from all decision-makers. If the same individuals or groups exclusively experience undesirable outcomes, this may institutionalize systemic exclusion and reinscribe social hierarchy. To relate algorithmic monoculture and outcome homogenization, we propose the component-sharing hypothesis: if decision-makers share components like training data or specific models, then they will produce more homogeneous outcomes. We test this hypothesis on algorithmic fairness benchmarks, demonstrating that sharing training data reliably exacerbates homogenization, with individual-level effects generally exceeding group-level effects. Further, given the dominant paradigm in AI of foundation models, i.e. models that can be adapted for myriad downstream tasks, we test whether model sharing homogenizes outcomes across tasks. We observe mixed results: we find that for both vision and language settings, the specific methods for adapting a foundation model significantly influence the degree of outcome homogenization. We conclude with philosophical analyses of and societal challenges for outcome homogenization, with an eye towards implications for deployed machine learning systems.

Show Less
Recommend
Post
Save
Complete
Collect
Mentions
See All
Iason Gabriel @IasonGabriel · Nov 28, 2022
  • Post
  • From Twitter
Great work by @RishiBommasani, @KathleenACreel and others highlighting the risk posed by algorithmic monocultures, whereby certain people are systematically unable to access the goods, opportunities and services provide through AI systems ⚖️
  • upcarta ©2025
  • Home
  • About
  • Terms
  • Privacy
  • Cookies
  • @upcarta