Parallel Prefix Verification for Speculative Generation

PARSE (PArallel pRefix Speculative Engine) is a new speculative generation framework that accelerates large language model (LLM) inference. It achieves this by parallelizing prefix verification on a semantic level, overcoming existing limitations by evaluating correctness across multiple prefixes in a single forward pass.