RESEARCHβ trending42
110 tok/s with 12GB VRAM on Qwen3.6 35B A3B and ik_llama.cpp
Reddit r/LocalLLaMAΒ·May 21, 2026
The author achieved 110 tok/s with 12GB VRAM using ik_llama.cpp on the Qwen3.6 35B A3B model, noting a significant speed boost. This performance surpassed that of regular llama.cpp after its MTP PR merge.
Read original β