The Tool-Overuse Illusion: Why Does LLM Prefer External Tools over Internal Knowledge?

This paper reveals the pervasive phenomenon of "tool overuse" in LLMs, where models unnecessarily use external tools. It identifies a "knowledge epistemic illusion" and proposes a direct preference optimization-based strategy that reduces tool usage by 82.8% while improving accuracy.