Cloud Is Closer Than It Appears: Revisiting the Tradeoffs of Distributed Real-Time Inference

This paper re-examines the viability of cloud-based inference for latency-sensitive cyber-physical systems, challenging the assumption that on-device processing is always superior. It demonstrates that high-throughput cloud platforms can match or surpass on-device performance for real-time control tasks by amortizing network and queueing delays.