DARR
Home / Navigator / MR-046
MR-046 Governance & process Organization scope

Inadequate evaluation, testing and benchmarking

Evaluation/testing is incomplete or unrepresentative (e.g. benchmark contamination, missing safety evals), giving false assurance.

Risk family
Governance & process
MIT domain
6. Socioeconomic and Environmental
MIT subdomain
6.5 > Governance failure
AI type
GPAI, Classical_ML, Agentic
Scope
Organization
Source standard
MIT AI Risk Repository v4

Provenance

Source standard
MIT AI Risk Repository v4
MIT source entries
19 entries across 3 papers
  • Gabriel2024The Ethics of Advanced AI Assistants24.01.02
  • Gipiškis2024Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems62.16.00 62.16.02 62.16.09 62.16.10 62.16.11 62.16.12 62.16.13 62.16.14 62.16.15 62.16.16 62.16.17 62.17.00 62.17.02 62.17.03 62.29.03
  • IBM2025AI Risk Atlas65.22.02 65.22.05 65.22.07

Ev IDs of the entries consolidated into this risk in the MIT AI Risk Repository (V4); the source sheet row appears on hover.

ISO/IEC references
23894 obj A.9; src 2; mech B.8 | 42001 ctrl A.6.2.4
EU AI Act articles
Art. 9 | Art. 15
GPAI Code of Practice
S&S Ch. Commitments 2-5

Framework crosswalk

Every framework item mapped to this risk. Items marked partial overlap only in part; definitions appear on hover where the source licence permits.

Sourcesframeworks that contributed to the register
1
  • A.9 ISO/IEC 23894 Annex A A.9
1
  • A.6.2.4 ISO/IEC 42001 Annex A A.6.2.4
3
  • Art. 15
  • Art. 9
  • CoP S&S Ch. Commitments 2-5
Cross-checksframeworks mapped in to test coverage
5
  • ibm-incomplete-ai-agent-evaluation Incomplete AI agent evaluation
  • ibm-incorrect-risk-testing Incorrect risk testing
  • ibm-lack-of-testing-diversity Lack of testing diversity
  • ibm-reproducibility Reproducibility partial
  • ibm-unrepresentative-risk-testing Unrepresentative risk testing

More in Governance & process

MR-037MR-042MR-043MR-045MR-054MR-062MR-063MR-066MR-067MR-068MR-069MR-070
See all Governance & process risks →

Part of the Deployer AI Risk Register, an open-source resource powered by MindXO. Version 1.0, 3 July 2026. Derived from the MIT AI Risk Repository (V4, December 2025) under CC BY 4.0; an independent derivative work, not endorsed by or affiliated with MIT. Sub-risk decomposition references MITRE ATLAS™ v5.6.0 (© 2021-2026 The MITRE Corporation, reproduced and distributed with permission). ISO/IEC and EU AI Act references are by number only. License: CC BY 4.0. Full attribution and licensing.