RESEARCH27
HEBATRON: A Hebrew-Specialized Open-Weight Mixture-of-Experts Language Model
arXiv CS.CLΒ·May 13, 2026
Hebatron is a Hebrew-specialized open-weight large language model built on NVIDIA's Nemotron-3 Mixture-of-Experts (MoE) architecture. It achieves a 73.8% Hebrew reasoning average, outperforming competitors and offering significantly higher inference throughput by activating fewer parameters per pass.
Read original β