Plan, divide, and conquer: How weak models excel at long context tasks

This content details a "Divide & Conquer" framework that enables smaller language models to outperform larger ones like GPT-4o on long context tasks. It addresses the performance degradation of LLMs with growing context windows by breaking documents into parallel chunks.