← Back to glossaryGlossary

A/B Testing (Agent)

Reviewed 19 July 2026Canonical definitionPart of: Agent Evaluation Terms →

Agent A/B testing compares two versions of an agent, differing in model, prompt, tools, or configuration, by routing a portion of traffic to each and measuring performance, quality, and user satisfaction differences.

§01 / QUESTIONSterm: A/B Testing (Agent)
Questions

Common questions.

What is A/B Testing (Agent)?

Agent A/B testing compares two versions of an agent, differing in model, prompt, tools, or configuration, by routing a portion of traffic to each and measuring performance, quality, and user satisfaction differences.

Which terms are related to A/B Testing (Agent)?

Closely related concepts include Continuous Integration Agent, Prompt Regression Testing, Regression Detection (Agent), Regression Testing (Agent). Each is defined in the Prefactor glossary.

§02 / RELATEDnext: where this fits

See how every agent performs, and make it better

Prefactor helps teams observe, evaluate, and improve their AI agents in production, across every framework and provider.