ARES: Adaptive Red-Teaming and End-to-End Repair of Policy-Reward System

ARES introduces a framework to address systemic weaknesses in RLHF-aligned LLMs, where imperfect Reward Models fail to penalize unsafe behaviors. It uses a "Safety Mentor" for adaptive red-teaming to discover and mitigate these dual vulnerabilities in both the LLM and its Reward Model.