DualOptim+: Bridging Shared and Decoupled Optimizer States for Better Machine Unlearning in Large Language Models

DualOptim+ is a novel optimization framework designed to improve machine unlearning in large language models by bridging shared and decoupled optimizer states. It uses base states for common representations and delta states for objective-specific residuals, also offering a quantized 8-bit variant to reduce memory overhead without compromising performance.