Toward a Modular Architecture for Embedded AI Agent Systems at the Edge

This paper proposes a modular reference architecture for Embedded Agent Systems, addressing the challenges of deploying agentic AI in pervasive computing environments with strict memory and energy constraints. It introduces a tiered design that decouples on-device agents (compressed neural networks) from cloud-augmented agents (SLMs) for different reasoning levels.