PrefactorvsArizevsFiddler

Arize vs Fiddler: how to choose

Both trace agents, run experiments and score production traffic with LLM judges and code. Arize gives you a free self-hosted starting point in Phoenix and prompt versioning in both of its products; Fiddler adds real-time guardrail scoring and monitors classic ML models in the same platform, but has no prompt tooling. Arize has been part of Dynatrace since 1 October 2026.[3][4]

support-agent v4 · one run, two layersexample
Illustrative run, showing what each layer tells you
Arize / Fiddlersee
fetch_customer212ms · 1.2k tok
apply_refund1.4s · 3.1k tok
send_reply340ms · 0.8k tok
trace recorded, no verdict
Prefactoradds
Did its job✓ yes
Quality84 / 100
Cost$0.42 · in budget
Drift vs baselinenone
✓ a run that breaches its schema is held for review
§01 / THE SHORT ANSWERtl;dr: which, and when
TL;DR

What is the difference between Arize and Fiddler?

Arize offers a free self-hosted tool, Phoenix, plus a paid platform, AX, with prompt versioning in both; Fiddler is a single commercial platform that adds real-time guardrails and covers classic ML models alongside LLMs and agents. Dynatrace completed its acquisition of Arize on 1 October 2026, and Phoenix and AX continue. Fiddler is independent and has no prompt versioning or playground.

The short answer

At a glance (checked 20 October 2026)

Decision factorArizeFiddler
OwnershipAcquired by Dynatrace, completed 1 October 2026; Phoenix and AX continueIndependent; $30M Series C in January 2026
ScopeLLM and agent tracing and evaluation across Phoenix and AXClassic ML models, LLM applications and agents in one platform
LicencePhoenix: Elastic License 2.0 (source-available); AX: commercialProprietary platform; Python client is Apache-2.0
Self-hostingPhoenix free; AX on Enterprise, including air-gappedEnterprise only: VPC, on-premises, or in your AWS account via SageMaker
Prompt toolingPrompt versioning and a playground in both productsNone
Run-time checksPartial: AX guards run in your code via Guardrails AIPartial: real-time guardrail scores; inline blocking through a third-party AI gateway
Free tierAX Free: 25k spans a month, 15-day retention; Phoenix free to self-hostGuardrails-only free plan, by demo request
First paid tierAX Pro: $50 a month, 50k spansDeveloper: $0.002 per trace, hosted only
§02 / CAPABILITY MATRIXside by side: what each covers
Side by side

Arize vs Fiddler: capabilities side by side

CapabilityArizeFiddlerPrefactor
Observe
LLM call tracing✓✓✓
Multi-step agent tracing (tool calls, nested spans)✓✓✓
Cost tracking✓Partial✓
OpenTelemetry support✓✓✓
Evaluate
Offline evals (datasets, experiments)✓✓✓
Online evals on production traffic✓✓✓
LLM-as-a-judge scoring✓✓✓
Code-based evaluators✓✓✓
Human review and annotation✓Partial✓
Prompt versioning and playground✓——
Act on findings
Runtime controls on live agent actionsPartialPartial✓
Gateway or proxy in the request pathPartial——
Licence and deployment
Open sourcePartialPartialPartial
Self-hosting✓✓Partial
§03 / IN DEPTHdetail: the reasoning
In depth

Arize changed owners; Fiddler did not

Dynatrace completed its acquisition of Arize on 1 October 2026. Its announcement says Arize will keep supporting both Phoenix and AX and that Arize capabilities will be integrated into Dynatrace over time. Teams already on Dynatrace may see that as a reason to choose Arize. Teams that are not should expect packaging and pricing to move over the next few quarters and plan a large rollout with that in mind.

Read more

Fiddler is a venture-backed independent company. It raised a $30M Series C in January 2026, bringing its total funding to $100M, and has positioned itself since then as a control plane for AI agents. Its changelog shows steady releases through October 2026, including a hosted judge model, span annotations and new gateway integrations.

What you can run yourself, and what it costs to start

This is the clearest practical difference. Phoenix is free to self-host with pip, Docker or Kubernetes, and it includes tracing, datasets, experiments, LLM and code evaluators and prompt versioning. It uses the Elastic License 2.0, so you can run and modify it internally but cannot offer it to others as a hosted service. Continuous evaluation of production traffic, monitors and alerting sit in Arize AX, and Phoenix's own documentation points users there.

Read more

Fiddler has no free self-hosted version. Its Developer plan is hosted only, and VPC, on-premises and SageMaker deployments come with the Enterprise plan through sales. Its free plan covers guardrails only and is reached through a demo request. For a team that wants to try agent tracing this week without a sales conversation, Arize is the easier start. For an enterprise that will buy a deployment inside its own network either way, both offer one: AX self-hosting, including air-gapped, is also Enterprise only.

Prompt iteration or real-time checks

Arize treats prompts as first-class objects. AX has a Prompt Hub with versioning, diffing, rollback and environment tags, and Phoenix has a playground with version control and tagging. Fiddler has none of this; its Prompt Specs are templates for judge evaluators, not application prompts. If your team changes prompts weekly and wants each version tied to traces and experiments, Arize covers that and Fiddler does not.

Read more

Fiddler's strength is on the other side. Fiddler Guardrails score requests and responses in real time for toxicity and other harmful content, faithfulness, personal data and secrets, and your application decides whether to block. When Fiddler is plugged into Kong AI Gateway, AgentGateway, LiteLLM or Portkey, blocking or redaction can happen inline. Arize AX documents guards built on the Guardrails AI framework that run in your own code around model calls. Neither vendor documents approval steps or policy checks on an agent's tool calls.

Fiddler also monitors classic ML models for drift, performance, explainability and fairness in the same platform. If you run fraud or ranking models alongside agents and want one vendor for both, that weighs in Fiddler's favour.

Instrumentation moves fairly easily between them, because both accept OpenTelemetry. Arize maintains OpenInference, a set of conventions for LLM and agent spans, and AX draws an agent trajectory graph automatically for frameworks such as LangGraph, CrewAI and AG2. Arize ships Python and TypeScript SDKs, plus a Go client for Phoenix. Fiddler maps the OpenTelemetry GenAI conventions and offers native agent SDKs for LangGraph, LangChain, Strands Agents and Google ADK, all in Python; other languages send raw OTLP or use its REST API.

Pricing shape

As of 20 October 2026, Arize AX Free costs nothing for 25k spans a month with 15-day retention and unlimited users, and AX Pro is $50 a month for 50k spans with 30-day retention. AX Enterprise is custom and is the only self-hosted AX option; Phoenix is free to run yourself. Fiddler's Developer plan charges $0.002 per trace, so 100,000 traces a month would cost $200 before any Enterprise terms. Note the units differ: Arize counts spans, of which one agent run can produce many, while Fiddler counts traces.

Read more

Check Arize's pricing and Fiddler's pricing against your own volumes; Arize's packaging may change as it moves into Dynatrace.

§04 / THE QUALITY GAPour take: where it stops
Our take

Where Prefactor fits

We sell the layer this section describes. Read it with that in mind.

Stated plainly, since Prefactor publishes this page: Prefactor is an agent evaluation platform that scores each step of a run and acts on what it finds through runtime policies on tool calls and data access, approval holds for risky actions, and a kill switch for a run, an agent or a team. Of these two, Fiddler's guardrails come closest, but they check content rather than tool actions; Arize's guards run in your own code around model calls. Prefactor has no prompt playground or prompt registry and its platform is hosted, so if prompt versioning or free self-hosting is the requirement, Arize is the better fit. See the full comparison of 15 platforms.

See it on your own agents

A working session on a fleet like yours: watch a run evaluated, catch a drift, walk the record.

§05 / WHICH TO PICKdecide: by your stack
Which to pick

Which one fits

Pick Arize if

  • You want a free self-hosted tool to start with, and can accept the Elastic License terms.
  • Prompt versioning and a playground are part of your daily workflow.
  • You run Dynatrace, or expect to, and want agent evaluation alongside it.
  • You will pay for AX once you need continuous production evals and alerting.

Pick Fiddler if

  • You monitor classic ML models as well as LLM applications and agents.
  • You want real-time content guardrails, ideally inline through an AI gateway you already run.
  • You need a VPC, on-premises or SageMaker deployment and will buy through sales.
  • Per-trace billing suits how you forecast usage.
§06 / HOW WE REVIEWEDsources: checked October 20, 2026
Methodology

How we reviewed this comparison

Reviewed against public product and documentation pages on October 20, 2026. If a vendor has changed a feature, product name, or positioning since then, send a correction and we will update it. Numbered source links in the page body point to the ordered sources below.

Sources reviewed

  1. Arize pricingChecked 2026-10-20.
  2. Arize documentation
  3. Arize ownership and status
  4. Fiddler pricingChecked 2026-10-20.
  5. Fiddler documentation
  6. Fiddler website
  7. Prefactor platform
Prefactor context

Methodology

  • Reviewed public product, documentation, and launch material visible at the time of writing.
  • Mapped each page to the primary buyer, control layer, and runtime capabilities each vendor describes publicly.
  • Prefer direct product and documentation pages over analyst summaries or reseller material.
§07 / QUESTIONSfaq: the common ones
Questions
What is the difference between Arize and Fiddler?
Both trace LLM and agent applications and run offline and online evaluations. Arize has a free self-hosted tool, Phoenix, and a paid platform, AX, with prompt versioning in both. Fiddler is one commercial platform that adds real-time guardrails and classic ML monitoring but has no prompt tooling.
How does Prefactor compare with Arize and Fiddler?
Prefactor is an agent evaluation platform for teams building AI agents: it observes every agent run from development to production, evaluates whether the agent did its job, and shows how to improve it. As of 20 October 2026, Prefactor can block or hold a live agent action; Arize and Fiddler do so in part. Prefactor supports human review and annotation; Arize does too and Fiddler does so in part. Arize includes prompt versioning and a playground. Prefactor evaluates how prompts perform in live runs rather than providing a prompt playground or registry.
Which suits a team that also runs classic ML models?
Fiddler documents drift, performance, explainability and fairness monitoring for classic ML models in the same platform as its LLM and agent tracing. This comparison covers Arize's LLM and agent products, Phoenix and AX.
Can I self-host Arize or Fiddler for free?
Only Arize. Phoenix is free to self-host under the Elastic License 2.0. Self-hosted Arize AX and every self-hosted Fiddler deployment, including VPC, on-premises and SageMaker, are Enterprise plans priced through sales.
Do Arize and Fiddler support OpenTelemetry?
Yes. Phoenix is built on OpenTelemetry and Arize maintains the OpenInference conventions. Fiddler accepts OTLP traces directly, maps the OpenTelemetry GenAI conventions and offers its own OTel SDK for custom Python agents.
What changed at Arize after the Dynatrace acquisition?
Dynatrace completed the acquisition on 1 October 2026. It says Phoenix and AX will continue and that Arize capabilities will be integrated into Dynatrace over time. Product packaging may change as that integration happens.
Who owns Arize?
As of 20 October 2026: Dynatrace, which completed its acquisition of Arize on 1 October 2026. Dynatrace says Phoenix and AX will continue and that Arize capabilities will be integrated into Dynatrace over time.
Is Arize open source?
Partly. Phoenix's code is public under the Elastic License 2.0, which is source-available rather than open source: you can self-host and modify it but not offer it to others as a hosted service. AX is commercial.
How much does Arize cost?
As of 20 October 2026: AX Free is $0 for 25k spans a month with 15-day retention. AX Pro is $50 a month for 50k spans with 30-day retention. AX Enterprise is custom and is the only self-hosted AX option. Phoenix is free to self-host.
Can Arize block or hold a live agent action?
Partly. Arize AX documents guards built on the Guardrails AI framework that run in your own code around model calls. There is no documented approval or policy layer for agent tool actions.
Who owns Fiddler?
As of 20 October 2026: Fiddler is an independent, venture-backed company. It raised a $30M Series C in January 2026, bringing total funding to $100M.
Is Fiddler open source?
Partly. The platform is proprietary; its Python client and Claude Code plugin are Apache-2.0.
How much does Fiddler cost?
As of 20 October 2026: A free plan covers guardrails only, through a demo request. The Developer plan is $0.002 per trace. Enterprise, which adds VPC and on-premises deployment, is quote-based.
Can Fiddler block or hold a live agent action?
Partly. Fiddler Guardrails score content in real time for your application to act on, and can block inline through a third-party AI gateway. There are no approvals or tool-call policies.
Is Prefactor open source?
Partly. Its deterministic evals package is Apache-2.0; the platform is hosted.
How much does Prefactor cost?
As of 20 October 2026: Dev is free with 5,000 spans a month. Startup is $49 a month and Scaleup $199 a month. Enterprise is custom above 4 million spans a month.
Can Prefactor block or hold a live agent action?
Yes. Runtime policies can block, throttle, sandbox or escalate an agent's tool calls and data access before they run, approval routing holds risky actions for a person, and a kill switch stops a run, an agent or a team.
Reviewed against public sources on October 20, 2026Suggest a correction

Score the run, then act on it

Prefactor scores each step of every agent run and can hold or stop an action when a score says it should not happen. Start on the free tier: 5,000 spans a month, no credit card required.

Agent Performance Platform
Unified performance platform for agents, authentication, and risk management
All Systems Operational
3Global Agents
7Instances
5Services
12%Human Intervene
4High Risk
$2,360Monthly Spend
Mission ControlLive agent health with 7-day activity heartbeat
Claims Proc...68
$330/moRed
Claims Proc...65
$160/moRed
Claims Proc...82
$170/moAmber
ChatGPT74
$150/moAmber

See how every agent performs, and make it better

Prefactor helps teams observe, evaluate, and improve their AI agents in production, across every framework and provider.