Actor-Critic methods

When Does Critique Improve AI-Assisted Theoretical Physics? SCALAR: Structured Critic--Actor Loop for Agentic Reasoning

This paper introduces SCALAR (Structured Critic--Actor Loop for AI Reasoning), an Actor--Critic--Judge pipeline applied to theoretical physics problems. It investigates how the interaction between researchers and AI agents affects results in physics reasoning tasks, demonstrating that multi-turn dialogue significantly improves over single-shot attempts.