Single-Position Intervention Fails: Distributed Output Templates Drive In-Context Learning

Research reveals that single-position intervention fails to transfer tasks in Llama-3.2-3B despite high probing accuracy, suggesting distributed task encoding. However, multi-position intervention achieves up to 96% transfer, pinpointing for the first time the causal locus of in-context learning task identity.