Questions
Common questions.
What is Model Distillation?
Model distillation is the process of training a smaller, faster model to replicate the behavior of a larger model.
How is Model Distillation used in production?
Distilled models can reduce cost and latency for agent deployments but may lose nuance, which requires re-evaluation for safety and accuracy.
Which terms are related to Model Distillation?
Closely related concepts include Continuous Integration Agent, Evaluation Harness (Agent), Ground Truth Evaluation, Model Card. Each is defined in the Prefactor glossary.
Keep reading