MR-034 Human & usage Both scope

Overreliance and automation bias

Users place uncritical trust in system outputs (automation bias), accepting incorrect results without verification.

Risk family: Human & usage
MIT domain: 5. Human-Computer Interaction
MIT subdomain: 5.1 > Overreliance and unsafe use
AI type: GPAI, Agentic, Classical_ML
Scope: Both
Source standard: MIT AI Risk Repository v4

Provenance

Source standard

MIT AI Risk Repository v4

Source frameworks

17 source framework citation keys

Abercrombie2024, G'sell2024, GOS2023, Gabriel2024, Giarmoleo2024, Gipiškis2024, IBM2025, Kumar2023, NIST2024, Paes2023, Stanley2024, Tse2025, Uuk2025, Weidinger2022, Weidinger2023, Wirtz2020, Wirtz2022

ISO/IEC references

23894 obj A.3, A.12; src 4; mech B.4 | 42001 ctrl A.8.2

Framework crosswalk

Every framework item mapped to this risk. Items marked partial overlap only in part; definitions appear on hover where the source licence permits.

Sourcesframeworks that contributed to the register

ISO 238942

A.12 ISO/IEC 23894 Annex A A.12
A.3 ISO/IEC 23894 Annex A A.3

ISO 420011

A.8.2 ISO/IEC 42001 Annex A A.8.2

Cross-checksframeworks mapped in to test coverage

IBM2

ibm-over-or-under-reliance Over- or under-reliance
ibm-over-or-under-reliance-on-ai-agents Over- or under-reliance on AI agents

NIST GenAI1

GENAI.7 Human-AI Configuration

OWASP LLM1

LLM09:2025 Misinformation

OWASP Agentic1

ASI09 Human-Agent Trust Exploitation

More in Human & usage

MR-030 MR-032 MR-033 MR-035 MR-036 MR-038 MR-041 MR-048 MR-060

Part of the Deployer AI Risk Register, an open-source resource developed by MindXO. Version 1.0, 3 July 2026. Derived from the MIT AI Risk Repository (V4, December 2025) under CC BY 4.0; an independent derivative work, not endorsed by or affiliated with MIT. Sub-risk decomposition references MITRE ATLAS™ v5.6.0 (© 2021-2026 The MITRE Corporation, reproduced and distributed with permission). ISO/IEC and EU AI Act references are by number only. License: CC BY 4.0. Full attribution and licensing.