On May 7, 2016, a Tesla Model S using Autopilot crashed near Williston, Florida, after the system failed to distinguish the sky from the white side of a truck, with the NTSB citing driver overreliance on automation as a key cause.
Notes on verification
Confirmed by NTSB official accident report and probable-cause determination, corroborated by multiple independent news outlets detailing the sensor/visual failure and overreliance finding. [tier=silver indep_score=0.867 clusters=3 claim_tier=exceptional]
Sources
- Concrete Problems in AI Safety, Revisited (seed:technology_and_ai)
- https://www.ntsb.gov/investigations/Pages/HWY16FH018.aspx (corroboration)
- https://www.ntsb.gov/Investigations/Accidentreports/Reports/Har1702.pdf (corroboration)
- https://www.truckinginfo.com/news/white-trailer-proved-invisible-to-teslas-autonomous-system (corroboration)
- https://www.ttnews.com/articles/tesla-automation-faulted-ntsb-2016-fatal-florida-crash (corroboration)