We Gave an AI Agent a Long Context Caching Idea. Here's what happened next!

The article describes an experiment where an LLM's (Qwen3.5-35B-A3B with 1M tokens) KV cache is used as a "document store" by prefilling and persisting it to answer queries, eliminating embeddings and vector databases. The AI engineering agent, NEO, autonomously implemented this Cache-Augmented Generation system in just 30 minutes.