statistical modeling

3 items

RESEARCHarXiv CS.LG·5/5/2026

Sparse Regression under Correlation and Weak Signals: A Reproducible Benchmark of Classical and Bayesian Methods

This research benchmarks classical (Lasso, Ridge) and Bayesian (Horseshoe, Spike-and-Slab) sparse regression methods under challenging conditions like correlated features and weak signals. Bayesian methods generally outperform classical ones in prediction error, with Horseshoe offering excellent coverage, though classical methods are faster.

sparse regression Bayesian statistics machine learning Benchmarking

ARTICLEDEV.to AI·4/15/2026

Notes on Kullback-Leibler Divergence and Likelihood

This content explores notes on Kullback-Leibler Divergence and its relationship with the concept of Likelihood. It covers fundamental principles of information theory and statistical inference relevant to AI.

information theory Likelihood Machine Learning Theory Kullback-Leibler Divergence

RESEARCHDEV.to AI·4/8/2026

Group Lasso with Overlaps: the Latent Group Lasso approach

Este conteúdo aborda o 'Latent Group Lasso', uma técnica avançada de regularização. A proposta visa otimizar o Group Lasso em cenários com grupos sobrepostos, sendo relevante para aprendizado de máquina e modelagem estatística.

Lasso machine learning Sparse Models regularization