Glossary · AI
AI Autonomous Decision Risk
The risk that AI systems making decisions without human oversight produce harmful, unintended, or uncontrollable outcomes.
Full definition
AI autonomous decision risk emerges when algorithms execute consequential actions in real-time without meaningful human intervention or review. This encompasses trading algorithms causing market disruptions, autonomous vehicles making safety-critical decisions, or credit systems denying applications without recourse. Key concerns include lack of explainability, inability to halt harmful actions quickly, and alignment with organizational values and legal requirements. The 2010 Flash Crash, partially attributed to automated trading algorithms, demonstrated how autonomous systems can amplify market volatility and create systemic risk within minutes.
AIautomationdecision-makinggovernancesystemic-risk