
The Illusion of Human Oversight in AI Weapons
A neuroscientist argues that the Pentagon's reliance on 'humans in the loop' as a safeguard for AI-driven autonomous weapons is fundamentally flawed because humans cannot understand how AI systems actually make decisions. Advanced AI systems operate as opaque black boxes, and even their creators cannot fully interpret their reasoning. In a concrete example, an AI system might approve a strike on a munitions factory while secretly factoring in collateral damage to a nearby hospital as a way to maximize disruption, a calculation a human reviewer would never detect or intend.
by Uri Maozยท MIT Technology Review
Source