DARR
MR-001 Model & system behaviour Both scope

Biased or discriminatory outputs and decisions

The system produces unfair or discriminatory outputs or decisions (e.g. in hiring, lending, services) that disadvantage individuals or groups, often from biased training data.

Risk family
Model & system behaviour
MIT domain
1. Discrimination & Toxicity
MIT subdomain
1.1 > Unfair discrimination and misrepresentation
AI type
GPAI, Agentic, Classical_ML
Scope
Both
Source standard
MIT AI Risk Repository v4

Provenance

Source standard
MIT AI Risk Repository v4
MIT source entries
71 entries across 34 papers
  • Abercrombie2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms58.05.07 58.06.01 58.06.03 58.06.06 58.06.09 58.06.10
  • AIVerify2023Summary Report: Binary Classification Model for Credit Risk26.07.00
  • Critch2023TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI01.04.00
  • Cui2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems02.01.01
  • G'sell2024Regulating under Uncertainty: Governance Options for Generative AI47.01.01 47.02.08 47.02.09
  • Giarmoleo2024What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review37.01.01
  • Gipiškis2024Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems62.04.01 62.10.01 62.16.04 62.18.04 62.31.06
  • GOS2023Future Risks of Frontier AI56.01.00 56.02.00 56.10.00
  • Habbal2024Artificial Intelligence Trust, Risk and Security Management (AI TRiSM): Frameworks, Applications, Challenges and Future Research Directions29.01.01
  • Hammond2025Multi-Agent Risks from Advanced AI63.06.02
  • Hogenhout2021A framework for ethical Ai at the United Nations06.01.00 06.03.00 06.04.00
  • IBM2025IBM202565.19.02
  • Kumar2023Ethical Issues in the Development of Artificial Intelligence: Recognizing the Risks38.02.00
  • Li2025A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents66.08.04 66.10.01 66.10.02
  • Liu2024Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment30.03.01 30.03.03 30.07.03
  • Meek2016Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review09.02.01
  • Paes2023Social Impacts of Artificial Intelligence and Mitigation Recommendations: An Exploratory Study10.01.00 10.07.00
  • Perlo2025Embodied AI: Emerging Risks and Opportunities for Policy Action70.04.01
  • Saghiri2022A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions39.03.00 39.08.00
  • Schnitzer2024AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks59.09.00 59.26.02
  • Shelby2023Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction11.02.00 11.02.01 11.02.02
  • Sherman2023AI Risk Profiles: A Standards Proposal for Pre-Deployment AI Risk Disclosures12.05.00
  • Stanley2024Emerging Risks and Mitigations for Public Chatbots: LILAC v169.06.02 69.07.00
  • Steimers2022Sources of Risk of AI Systems14.01.00
  • Sun2023Safety Assessment of Chinese Large Language Models27.01.02 27.01.04
  • TC2602024AI Safety Governance Framework45.01.02 45.01.09 45.02.11
  • Teixeira2022An Exploratory Diagnosis of Artificial Intelligence Risks for a Responsible Governance42.05.00 42.14.00
  • Uuk2025A Taxonomy of Systemic Risks from General-Purpose AI61.01.03 61.02.29
  • Weidinger2021Ethical and social risks of harm from language models17.01.00 17.01.02
  • Weidinger2022Taxonomy of Risks posed by Language Models16.01.02 16.01.03
  • Wirtz2020The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration20.02.04 20.03.02
  • Wirtz2022Governance of artificial intelligence: A risk and guideline-based integrative framework19.01.03 19.05.00 19.05.02
  • Zeng2024AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies50.01.04 50.04.02 50.04.03
  • Zhang2023SafetyBench: Evaluating the Safety of Large Language Models with Multiple Choice Questions28.02.00

Ev IDs of the entries consolidated into this risk in the MIT AI Risk Repository (V4); the source sheet row appears on hover.

ISO/IEC references
23894 obj A.6; src 6, 7; mech B.5 | 42001 ctrl A.5.4, A.7.4, A.6.2.4
EU AI Act articles
Art. 10 | Art. 5(c)

Framework crosswalk

Every framework item mapped to this risk. Items marked partial overlap only in part; definitions appear on hover where the source licence permits.

Sourcesframeworks that contributed to the register
1
  • A.6 ISO/IEC 23894 Annex A A.6
3
  • A.5.4 ISO/IEC 42001 Annex A A.5.4
  • A.6.2.4 ISO/IEC 42001 Annex A A.6.2.4
  • A.7.4 ISO/IEC 42001 Annex A A.7.4
2
  • Art. 10
  • Art. 5(c)
Cross-checksframeworks mapped in to test coverage
3
  • ibm-data-bias Data bias
  • ibm-decision-bias Decision bias
  • ibm-discriminatory-actions Discriminatory actions
1
  • GENAI.6 Harmful Bias or Homogenization

Part of the Deployer AI Risk Register, an open-source resource powered by MindXO. Version 1.0, 3 July 2026. Derived from the MIT AI Risk Repository (V4, December 2025) under CC BY 4.0; an independent derivative work, not endorsed by or affiliated with MIT. Sub-risk decomposition references MITRE ATLAS™ v5.6.0 (© 2021-2026 The MITRE Corporation, reproduced and distributed with permission). ISO/IEC and EU AI Act references are by number only. License: CC BY 4.0. Full attribution and licensing.