Compositional Generalization

2 items

RESEARCH↑ trendingReddit r/MachineLearning·4/13/2026

Thinking Deeper, Not Longer: Depth-Recurrent Transformers for Compositional Generalization [R]

This content discusses a research paper on Depth-Recurrent Transformers, highlighting its findings on compositional and out-of-distribution generalization. It explores how intermediate step supervision can hinder genuine reasoning in AI models, making them overly reliant on statistical heuristics, a concept extended to foundation models and human intuition.

OOD Generalization Compositional Generalization AI Reasoning Intermediate Supervision

RESEARCHarXiv CS.AI·4/30/2026

Grounding vs. Compositionality: On the Non-Complementarity of Reasoning in Neuro-Symbolic Systems

This work challenges the assumption that compositional reasoning emerges as a byproduct of symbol grounding in neuro-symbolic AI. It introduces the $i$LTN architecture, demonstrating that models trained solely on a grounding objective fail to generalize, while joint training on perceptual grounding and multi-step reasoning is crucial.

Compositional Generalization Reasoning AI Architectures Symbol Grounding