Questions
Common questions.
What is Canary Evaluation?
Canary evaluation routes a small fraction of production agent traffic to a new agent version and monitors quality, error rate, and policy compliance in real time before full rollout.
How does Canary Evaluation work?
It is a risk management technique that limits exposure to regressions while enabling empirical performance comparison on live data.
Which terms are related to Canary Evaluation?
Closely related concepts include Evaluation Harness (Agent), Ground Truth Evaluation, Quality Gate (AI), Evaluation Pipeline. Each is defined in the Prefactor glossary.
Keep reading