AI Social Workers Gone Wrong: Why ChatGPT Should Never Decide a Child’s Future

This article warns against deploying generative AI like ChatGPT in child welfare, arguing that its probabilistic nature and tendency to hallucinate make it unsuitable for critical decisions. It emphasizes that 'good enough' automation is unacceptable when a child's future is at stake, risking the invention of false risk indicators.