Vertex-Softmax: Tight Transformer Verification via Exact Softmax Optimization

The paper introduces Vertex-Softmax, a novel method for certified verification of transformer attention by exactly optimizing the softmax function. It proves that the exact optimum is attained at a vertex of the constraint box, yielding a tighter sound bound.