Parcae: Doing more with fewer parameters using stable looped models

Parcae is a stable looped language model that matches the quality of a Transformer twice its size, using fewer parameters. It introduces the first scaling laws for looping, demonstrating that increasing recurrence is a compute-efficient path to better performance.