← Back to glossaryGlossary

A/B Testing (Agent)

Reviewed 19 July 2026Canonical definitionPart of: Agent Evaluation Terms →

Agent A/B testing compares two versions of an agent, differing in model, prompt, tools, or configuration, by routing a portion of traffic to each and measuring performance, quality, and user satisfaction differences.

§01 / QUESTIONSterm: A/B Testing (Agent)
Questions

Common questions.

What is A/B Testing (Agent)?

Agent A/B testing compares two versions of an agent, differing in model, prompt, tools, or configuration, by routing a portion of traffic to each and measuring performance, quality, and user satisfaction differences.

Which terms are related to A/B Testing (Agent)?

Closely related concepts include Continuous Integration Agent, Prompt Regression Testing, Regression Detection (Agent), Regression Testing (Agent). Each is defined in the Prefactor glossary.

§02 / RELATEDnext: where this fits
Keep reading

Where this fits.

See how every agent performs, and make it better

Prefactor helps teams observe, evaluate, and improve their AI agents in production, across every framework and provider.