A professional fact-checker evaluated GPT-4's claims in the DebunkBot conversations and rated more than 99% of them as true and not politically biased.
Notes on verification
Confirmed by multiple independent sources (American University interview with study's lead author, Science News, Popular Science, The Business Standard) all citing the same peer-reviewed Science study by Costello, Pennycook, and Rand. Figures consistently reported as ~99.2% true, 0.8% misleading, 0% false, with explicit statement of no political bias. [tier=silver indep_score=0.812 clusters=4 claim_tier=notable]
Sources
- Chatbots are surprisingly effective at debunking conspiracy theories (seed:technology_and_ai)
- https://www.american.edu/cas/news/ai-debunkbot-conspiracy-theories-costello.cfm (corroboration)
- https://www.sciencenews.org/article/ai-chatbot-conspiracy-theories (corroboration)
- https://www.popsci.com/technology/conspiracy-debunk-ai-bot/ (corroboration)
- https://www.tbsnews.net/tech/ai-can-debunk-conspiracy-theories-can-it-help-your-uncle-940626 (corroboration)