BaLoRA: Bayesian Low-Rank Adaptation of Large Scale Models

BaLoRA is a Bayesian extension of LoRA that enhances the accuracy of large-scale model adaptation. This novel approach not only quantifies uncertainty but also significantly narrows the performance gap with full fine-tuning.