early-detection

ILDR: Geometric Early Detection of Grokking

This paper proposes the Inter/Intra-class Distance Ratio (ILDR) as a novel geometric signal for the early detection of 'grokking' in neural networks. ILDR, computed from second-to-last layer representations, indicates geometric reorganization in representation space before validation accuracy improves, outperforming existing detection methods.