Three limitations I keep hitting with retrieval-augmented generation in production and I'm running out of ideas [D]

A user details limitations of a production RAG system in the legal domain, specifically the "scatter problem" where answers are incomplete when requiring information from many distinct documents. They explore solutions like query decomposition to address this persistent issue.