LLM Gateway

An LLM gateway is a centralised proxy that sits between AI agents and foundation model APIs, providing a single point for authentication, rate limiting, cost tracking, content filtering, and audit logging across all model interactions.

It allows organisations to enforce consistent governance policies regardless of which model provider or API an agent uses, and to switch model providers without changing agent code.

Closely related concepts include Unit Economics (AI Agent), Agent Quota, Cost per Task (Agent), Inference Cost. Each is defined in the Prefactor glossary.