MR-003 Model & system behaviour System scope

Toxic, hateful, or harassing content generation

The system generates hateful, abusive, profane, harassing, or otherwise offensive content.

Risk family: Model & system behaviour
MIT domain: 1. Discrimination & Toxicity
MIT subdomain: 1.2 > Exposure to toxic content
AI type: GPAI
Scope: System
Source standard: MIT AI Risk Repository v4

Provenance

Source standard

MIT AI Risk Repository v4

Source frameworks

17 source framework citation keys

Abercrombie2024, Anwar2024, Cui2024, Deng2023, Ghosh2024, Gipiškis2024, Hagendorff2024, InfoComm2023, Li2025, Liu2024, Solaiman2023, Stanley2024, Sun2023, Vidgen2024, Wang2025, Zeng2024, Zhang2023

ISO/IEC references

23894 obj A.6, A.10; src 6, 7; mech B.5 | 42001 ctrl A.5.4, A.6.2.4

Framework crosswalk

Every framework item mapped to this risk. Items marked partial overlap only in part; definitions appear on hover where the source licence permits.

Sourcesframeworks that contributed to the register

ISO 238942

A.10 ISO/IEC 23894 Annex A A.10
A.6 ISO/IEC 23894 Annex A A.6

ISO 420012

A.5.4 ISO/IEC 42001 Annex A A.5.4
A.6.2.4 ISO/IEC 42001 Annex A A.6.2.4

Cross-checksframeworks mapped in to test coverage

IBM2

ibm-spreading-toxicity Spreading toxicity
ibm-toxic-output Toxic output

Cisco5

AISubtech-15.1.11 Safety Harms and Toxicity: Profanity
AISubtech-15.1.3 Safety Harms and Toxicity: Animal Abuse partial
AISubtech-15.1.6 Safety Harms and Toxicity: Environmental Harm partial
AISubtech-15.1.8 Safety Harms and Toxicity: Harassment
AISubtech-15.1.9 Safety Harms and Toxicity: Hate Speech

NIST GenAI1

GENAI.3 Dangerous, Violent, or Hateful Content

More in Model & system behaviour

MR-001 MR-002 MR-004 MR-005 MR-006 MR-007 MR-008 MR-019 MR-021 MR-022 MR-023 MR-025 MR-026 MR-027 MR-028 MR-029 MR-031 MR-049 MR-050 MR-051 MR-052 MR-053 MR-055 MR-056 MR-057 MR-058 MR-059 MR-061

Part of the Deployer AI Risk Register, an open-source resource developed by MindXO. Version 1.0, 3 July 2026. Derived from the MIT AI Risk Repository (V4, December 2025) under CC BY 4.0; an independent derivative work, not endorsed by or affiliated with MIT. Sub-risk decomposition references MITRE ATLAS™ v5.6.0 (© 2021-2026 The MITRE Corporation, reproduced and distributed with permission). ISO/IEC and EU AI Act references are by number only. License: CC BY 4.0. Full attribution and licensing.