← Back to glossary
Glossary

Agent Load Balancing

Reviewed 20 March 2026 Canonical definition

Agent load balancing distributes incoming requests across multiple instances of an agent to optimise throughput and reliability. Load balancers may also route based on agent version, model, or compliance requirements.