LLM Gateway

I Built an LLM Gateway That Learns Which Model to Use — Here's How the Routing Works

Provara is an LLM gateway that intelligently routes requests to various AI models (OpenAI, Anthropic, Google, etc.) via an OpenAI-compatible endpoint. It uses an LLM-as-judge to score responses, enabling the router to learn and automatically select the best model for a given task over time, eliminating manual configuration.