Common questions.
What is Answer Relevance?
Answer relevance is an evaluation metric that measures how directly an AI agent's response addresses the user's actual question or task.
How is Answer Relevance used in production?
A response that is factually accurate but off-topic scores low on relevance. It is typically assessed by comparing the response to the original query rather than to a source document.
Which terms are related to Answer Relevance?
Closely related concepts include Answer Faithfulness, Context Precision, Ground Truth Evaluation, Groundedness. Each is defined in the Prefactor glossary.