open language models

Gemma 4: Byte for byte, the most capable open models

Gemma 4 is a highly capable and parameter-efficient open language model, achieving state-of-the-art performance. It leverages a transformer architecture with innovations like sparse attention and FFN optimizations to reduce computational costs and boost inference speeds.