[New Optimizer] 🌹 Rose: low VRAM, easy to use, great results, Apache 2.0 [P]

A new PyTorch optimizer named 'Rose' has been released, promising low VRAM usage, fast convergence, and excellent generalization, licensed under Apache 2.0. Developed over several years, it aims to be easy to use and more memory-efficient than 8-bit AdamW.