Back to the periodic table
95am-95
Wi
Head
Severity9/10
Wireheading
Direct manipulation of the reward signal by the agent instead of achieving the real objective, analogous to artificial stimulation of the pleasure center.
Periodic recordExistentialarXiv2016
Tom Everitt, Marcus Hutter
Mitigation Strategy
Implementation of Reward Tampering Protection, separation of reward sensors from agent control, and anti-wireheading architectures.
Atomic Number
95
Wi
Risk ID
am-95
Severity
9/10
Severity Level