statistical inference

2 items

RESEARCHDEV.to AI·4d ago

Detection in the stochastic block model with multiple clusters: proof of theachievability conjectures, acyclic BP, and the infor

This paper explores detection within the stochastic block model with multiple clusters, providing proofs for achievability conjectures. It also discusses acyclic Belief Propagation and information-theoretic aspects of the model.

information theory stochastic block model machine learning graph theory

RESEARCHarXiv CS.LG·29d ago

Statistical Inference and Quality Measures of KV Cache Quantisations Inspired by TurboQuant

This research analyzes three KV cache quantization schemes (KV, KQV, QKQV) and their impact on inner product variance, especially how QJL on K inflates it, amplified by softmax. Empirical findings highlight KQV's superior performance at a budget of n=4, an unconditional K-V asymmetry where QKQV is consistently worse than KQV in KL divergence, and budget-dependent crossovers for geometric K reconstruction.

machine learning quantization AI statistical inference