My LLM Keeps Failing in Production. Here's What I Built to Fix It Automatically.

The author recounts their frustration with manually debugging a failing LLM-powered RAG pipeline in production, primarily due to JSON schema mismatches. Despite monitoring tools, the iterative manual process of fixing prompts for new edge cases proved unsustainable, leading them to build an automated solution.