Brain Score Tracks Shared Properties of Languages: Evidence from Many Natural Languages and Structured Sequences

This research investigates the similarity between language models' processing and human language processing using the Brain Score framework. Findings suggest LMs trained on diverse natural languages and even structured data (human genome, Python) show similar Brain Score performance, indicating the metric captures the ability to extract common structure.