Needle: Distilling Gemini Tool Calling into a 26M Model

Needle is a 26-million-parameter model that successfully distilled Gemini's tool-calling capabilities, achieving near-parity accuracy at a fraction of the compute cost. This breakthrough is crucial for developers building AI agents and edge deployments.