AI scientists produce results without reasoning scientifically

LLM-based systems conduct autonomous scientific research but often fail to adhere to epistemic norms, ignoring evidence in 68% of traces. A study across eight domains and over 25,000 runs found that base models primarily determine agent performance and behavior.