Knowledge Injection

2 items

RESEARCH↑ trendingReddit r/LocalLLaMA·4/18/2026

Accidentally discovered you can teach frozen MoE models new knowledge by just steering their expert routing — no training needed

A novel method allows teaching frozen MoE models new knowledge by steering their expert routing, bypassing traditional training. Dubbed Adaptive Cognitive Intelligence (ACI), this technique demonstrated correcting factual errors in Gemma 4 using only a small configuration file.

model steering LLMs Gemma 4 Knowledge Injection

RESEARCHarXiv CS.CL·4/7/2026

Knowledge Packs: Zero-Token Knowledge Delivery via KV Cache Injection

"Knowledge Packs" introduces a zero-token knowledge delivery method for large language models (LLMs) by directly injecting information into the KV cache. This technique aims to enhance LLM performance and reduce inference costs by efficiently integrating external knowledge without consuming context tokens.

Knowledge Injection machine learning AI large language models