Mixture-of-Agents

MMoA: An AI-Agent framework with recurrence for Memoried Mixure-of-Agent

MMoA is a recurrent Mixture-of-Agents (MoA) framework that integrates LSTM-based gating for adaptive agent selection. It enhances LLM performance by dynamically activating fewer agents while achieving comparable accuracy on benchmarks like AlpacaEval 2.0.