Biased or discriminatory outputs and decisions
The system produces unfair or discriminatory outputs or decisions (e.g. in hiring, lending, services) that disadvantage individuals or groups, often from biased training data.
- Risk family
- Model & system behaviour
- MIT domain
- 1. Discrimination & Toxicity
- MIT subdomain
- 1.1 > Unfair discrimination and misrepresentation
- AI type
- GPAI, Agentic, Classical_ML
- Scope
- Both
- Source standard
- MIT AI Risk Repository v4
Provenance
71 entries across 34 papers
- Abercrombie2024A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms58.05.07 58.06.01 58.06.03 58.06.06 58.06.09 58.06.10
- AIVerify2023Summary Report: Binary Classification Model for Credit Risk26.07.00
- Critch2023TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI01.04.00
- Cui2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems02.01.01
- G'sell2024Regulating under Uncertainty: Governance Options for Generative AI47.01.01 47.02.08 47.02.09
- Giarmoleo2024What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review37.01.01
- Gipiškis2024Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems62.04.01 62.10.01 62.16.04 62.18.04 62.31.06
- GOS2023Future Risks of Frontier AI56.01.00 56.02.00 56.10.00
- Habbal2024Artificial Intelligence Trust, Risk and Security Management (AI TRiSM): Frameworks, Applications, Challenges and Future Research Directions29.01.01
- Hammond2025Multi-Agent Risks from Advanced AI63.06.02
- Hogenhout2021A framework for ethical Ai at the United Nations06.01.00 06.03.00 06.04.00
- IBM2025IBM202565.19.02
- Kumar2023Ethical Issues in the Development of Artificial Intelligence: Recognizing the Risks38.02.00
- Li2025A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents66.08.04 66.10.01 66.10.02
- Liu2024Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment30.03.01 30.03.03 30.07.03
- Meek2016Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review09.02.01
- Paes2023Social Impacts of Artificial Intelligence and Mitigation Recommendations: An Exploratory Study10.01.00 10.07.00
- Perlo2025Embodied AI: Emerging Risks and Opportunities for Policy Action70.04.01
- Saghiri2022A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions39.03.00 39.08.00
- Schnitzer2024AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks59.09.00 59.26.02
- Shelby2023Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction11.02.00 11.02.01 11.02.02
- Sherman2023AI Risk Profiles: A Standards Proposal for Pre-Deployment AI Risk Disclosures12.05.00
- Stanley2024Emerging Risks and Mitigations for Public Chatbots: LILAC v169.06.02 69.07.00
- Steimers2022Sources of Risk of AI Systems14.01.00
- Sun2023Safety Assessment of Chinese Large Language Models27.01.02 27.01.04
- TC2602024AI Safety Governance Framework45.01.02 45.01.09 45.02.11
- Teixeira2022An Exploratory Diagnosis of Artificial Intelligence Risks for a Responsible Governance42.05.00 42.14.00
- Uuk2025A Taxonomy of Systemic Risks from General-Purpose AI61.01.03 61.02.29
- Weidinger2021Ethical and social risks of harm from language models17.01.00 17.01.02
- Weidinger2022Taxonomy of Risks posed by Language Models16.01.02 16.01.03
- Wirtz2020The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration20.02.04 20.03.02
- Wirtz2022Governance of artificial intelligence: A risk and guideline-based integrative framework19.01.03 19.05.00 19.05.02
- Zeng2024AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies50.01.04 50.04.02 50.04.03
- Zhang2023SafetyBench: Evaluating the Safety of Large Language Models with Multiple Choice Questions28.02.00
Ev IDs of the entries consolidated into this risk in the MIT AI Risk Repository (V4); the source sheet row appears on hover.
Framework crosswalk
Every framework item mapped to this risk. Items marked partial overlap only in part; definitions appear on hover where the source licence permits.
1- A.6 ISO/IEC 23894 Annex A A.6
3- A.5.4 ISO/IEC 42001 Annex A A.5.4
- A.6.2.4 ISO/IEC 42001 Annex A A.6.2.4
- A.7.4 ISO/IEC 42001 Annex A A.7.4
2- Art. 10
- Art. 5(c)
3- ibm-data-bias Data bias
- ibm-decision-bias Decision bias
- ibm-discriminatory-actions Discriminatory actions
1- GENAI.6 Harmful Bias or Homogenization
More in Model & system behaviour
Part of the Deployer AI Risk Register, an open-source resource powered by MindXO. Version 1.0, 3 July 2026. Derived from the MIT AI Risk Repository (V4, December 2025) under CC BY 4.0; an independent derivative work, not endorsed by or affiliated with MIT. Sub-risk decomposition references MITRE ATLAS™ v5.6.0 (© 2021-2026 The MITRE Corporation, reproduced and distributed with permission). ISO/IEC and EU AI Act references are by number only. License: CC BY 4.0. Full attribution and licensing.