PrefactorvsGalileovsHelicone

Galileo vs Helicone: how to choose

These are different kinds of product at different stages. Galileo, now Splunk Agent Observability, is an active evaluation platform with guardrails that act during a run; Helicone is a request logger and gateway in maintenance mode, with new cloud sign-ups disabled since March 2026. For a new deployment the question is usually not which to pick but where Helicone users should go next.[3][6]

support-agent v4 · one run, two layersexample
Illustrative run, showing what each layer tells you
Galileo / Heliconesee
fetch_customer212ms · 1.2k tok
apply_refund1.4s · 3.1k tok
send_reply340ms · 0.8k tok
trace recorded, no verdict
Prefactoradds
Did its job✓ yes
Quality84 / 100
Cost$0.42 · in budget
Drift vs baselinenone
✓ a run that breaches its schema is held for review
§01 / THE SHORT ANSWERtl;dr: which, and when
TL;DR

What is the difference between Galileo and Helicone?

Galileo is an evaluation and guardrail platform for agents, now sold as Splunk Agent Observability, while Helicone is an open-source request logger and AI gateway that has been in maintenance mode since March 2026. Helicone's cloud has not accepted new sign-ups since then, and on 19 October 2026 it said it is no longer part of Mintlify, with no new owner named. For a new deployment Galileo, or another active platform, is usually the practical choice; existing Helicone users should plan a migration.

The short answer

At a glance (checked 20 October 2026)

Decision factorGalileoHelicone
StatusActive; Cisco completed its acquisition in May 2026, sold as Splunk Agent Observability since 7 August 2026Maintenance mode since March 2026; on 19 October 2026 said it is no longer part of Mintlify, no new owner named
New customersYes, through SplunkCloud sign-ups disabled since March 2026
What it isEvaluation, observability and run-time guardrails for agentsLLM request logging, cost tracking and an AI gateway; by its own docs, not an evaluation framework
Agent tracingSessions, traces and spans; agent framework integrations and A2A tracingHeader-based session grouping, not a span model for agent steps
Run-time checksAgent Control checks model and tool inputs and outputs during a runPrompt-injection and jailbreak blocking, OpenAI models only; rate limits
GatewayNoneYes: OpenAI-compatible endpoint for 100+ providers with failover and caching
LicenceProprietary platform; SDKs and Agent Control are Apache-2.0Apache-2.0; separate Rust gateway is GPL-3.0
Listed pricingFrom $100 a month per 1.2 million spans a year, billed annuallyHobby free, Pro $79 a month, Team $799 a month, though new accounts cannot be opened
§02 / CAPABILITY MATRIXside by side: what each covers
Side by side

Galileo vs Helicone: capabilities side by side

CapabilityGalileoHeliconePrefactor
Observe
LLM call tracing✓✓✓
Multi-step agent tracing (tool calls, nested spans)✓Partial✓
Cost tracking✓✓✓
OpenTelemetry support✓Partial✓
Evaluate
Offline evals (datasets, experiments)✓Partial✓
Online evals on production traffic✓Partial✓
LLM-as-a-judge scoring✓Partial✓
Code-based evaluators✓—✓
Human review and annotation✓Partial✓
Prompt versioning and playgroundPartial✓—
Act on findings
Runtime controls on live agent actions✓Partial✓
Gateway or proxy in the request path—✓—
Licence and deployment
Open sourcePartial✓Partial
Self-hosting✓✓Partial
§03 / IN DEPTHdetail: the reasoning
In depth

Start with product status

Mintlify announced its acquisition of Helicone on 3 March 2026 and moved the product to a maintenance-only phase covering patches, bug fixes and new model support, with help for customers to migrate to other platforms. Cloud sign-ups have shown 'Sign ups are disabled' since the same day, and the changelog has no feature entries after November 2025. On 19 October 2026 Helicone's site began saying it is no longer part of Mintlify, with details to follow and no new owner named.

Read more

Galileo also changed hands, but in the other direction. Cisco completed its acquisition in May 2026 and the product is sold as Splunk Agent Observability since 7 August 2026, with new features still shipping, such as annotation queues in August and metric access control in October.

So for a team choosing today, Helicone's cloud is not an option for a new account. Its Apache-2.0 code can still be self-hosted, but you would be running software whose own maintainers describe it as in maintenance.

They solve different problems

Helicone sits in the request path. Its proxy and AI Gateway log every model request, track cost per request and per session, and route traffic across more than 100 providers with failover, caching and rate limits. Its documentation says plainly that it does not run evaluations for you; scores from external tools can be posted to requests, and its Python evaluators were turned off in October 2026.

Read more

Galileo is an evaluation platform. It runs experiments on datasets, scores production traces with LLM judges, Luna-2 small models or code metrics, and supports human annotation. Agent Control checks model and tool inputs and outputs during a run and can block prompt injection, personal data leaks and harmful content. Helicone's prompt-injection blocking works with OpenAI models only. Galileo has no gateway, so it does not replace Helicone's routing or caching.

Instrumentation differs too. Helicone's async logging is built on OpenLLMetry through its own SDKs, and it documents no generic OTLP endpoint. Galileo accepts OTLP and lists native integrations for the OpenAI Agents SDK, LangGraph, CrewAI, Google ADK, Strands and Microsoft Agent Framework, plus A2A multi-agent tracing added in May 2026. Helicone's record this year also matters for planning: a May 2026 AWS account lock took its dashboard and log processing down for about four days, while its proxy stayed up.

Moving off Helicone

Existing Helicone users have two jobs, not one. The first is logging and evaluation: Galileo accepts OTLP traces and OpenInference instrumentors in Python, and has SDK integrations for the OpenAI Agents SDK, LangGraph, CrewAI and others, so instrumentation replaces Helicone's base URL or async logger. Helicone's sessions are grouped by headers, so expect to rebuild agent traces as proper spans rather than map them across.

Read more

The second is the gateway. If you rely on Helicone for provider routing, failover, caching or rate limits, Galileo does not offer those; plan for a separate gateway. Helicone's prompt versioning and stored prompts would also need a new home, since Galileo's prompts page does not document version control.

The ownership notice gives no timeline, and Mintlify's March announcement already offered help to migrate, so planning the move now costs little and avoids doing it under pressure later.

Pricing shape

As of 20 October 2026, Helicone still lists Hobby free with 10K requests, Pro at $79 a month and Team at $799 a month, but new cloud accounts cannot be created on any tier. Splunk lists Agent Observability from $100 a month per 1.2 million spans a year, billed annually, with no free tier listed. See Splunk's pricing and Helicone's pricing; for current Helicone customers the more useful number is the cost of the platform you move to.

§04 / THE QUALITY GAPour take: where it stops
Our take

Where Prefactor fits

We sell the layer this section describes. Read it with that in mind.

Stated plainly, since Prefactor publishes this page: Prefactor is an agent evaluation platform that scores each step of a run and acts on what it finds through runtime policies on tool calls and data access, approval holds for risky actions, and a kill switch for a run, an agent or a team. Galileo's Agent Control also blocks content during a run; Helicone's checks are limited to prompt-injection filtering on OpenAI models. Neither documents approval holds. Prefactor has no prompt playground or prompt registry, no gateway, and its platform is hosted, so Helicone users who need routing will still need a separate gateway. See the full comparison of 15 platforms.

See it on your own agents

A working session on a fleet like yours: watch a run evaluated, catch a drift, walk the record.

§05 / WHICH TO PICKdecide: by your stack
Which to pick

Which one fits

Pick Galileo if

  • You are choosing a platform for a new deployment and need an active vendor.
  • You need offline and online evaluation, not only request logs.
  • You want content checks on tool inputs and outputs during a run.
  • Splunk Observability Cloud is already part of your stack.

Stay on Helicone if

  • You already run it and need time to plan a migration.
  • You self-host the Apache-2.0 code and accept maintenance-only updates.
  • Your main use is request logging and cost tracking through its gateway.
  • You have a migration target in view for when the ownership picture is clearer.
§06 / HOW WE REVIEWEDsources: checked October 20, 2026
Methodology

How we reviewed this comparison

Reviewed against public product and documentation pages on October 20, 2026. If a vendor has changed a feature, product name, or positioning since then, send a correction and we will update it. Numbered source links in the page body point to the ordered sources below.

Sources reviewed

  1. Galileo pricingChecked 2026-10-20.
  2. Galileo documentation
  3. Galileo ownership and status
  4. Helicone pricingChecked 2026-10-20.
  5. Helicone documentation
  6. Helicone ownership and status
  7. Prefactor platform
Prefactor context

Methodology

  • Reviewed public product, documentation, and launch material visible at the time of writing.
  • Mapped each page to the primary buyer, control layer, and runtime capabilities each vendor describes publicly.
  • Prefer direct product and documentation pages over analyst summaries or reseller material.
§07 / QUESTIONSfaq: the common ones
Questions
What is the difference between Galileo and Helicone?
Galileo, now Splunk Agent Observability, is an evaluation platform that scores agent runs and can block harmful inputs and outputs during a run. Helicone is an open-source request logger and AI gateway that, by its own documentation, is not an evaluation framework, and it has been in maintenance mode since March 2026.
How does Prefactor compare with Galileo and Helicone?
Prefactor is an agent evaluation platform for teams building AI agents: it observes every agent run from development to production, evaluates whether the agent did its job, and shows how to improve it. As of 20 October 2026, Prefactor can block or hold a live agent action; Galileo does too and Helicone does so in part. Prefactor scores live production traffic automatically; Galileo does too and Helicone does so in part. Helicone includes prompt versioning and a playground. Prefactor evaluates how prompts perform in live runs rather than providing a prompt playground or registry.
Can I still sign up for Helicone?
Not for the cloud service. Helicone's sign-up page has shown 'Sign ups are disabled' since March 2026. The Apache-2.0 code can still be self-hosted with Docker or Kubernetes.
Is Galileo a replacement for Helicone's gateway?
No. Galileo has no gateway or proxy; it ingests traces through SDKs, integrations and OTLP. If you use Helicone for routing, failover, caching or rate limits, you will need a separate gateway alongside any evaluation platform.
How do I move traces from Helicone to Galileo?
Replace Helicone's proxy base URL or async logger with Galileo's Python or TypeScript SDK, an agent framework integration or OTLP export. Helicone groups sessions with headers rather than spans, so plan to instrument agent steps afresh rather than convert old sessions.
What changed at Helicone in October 2026?
On 19 October 2026 Helicone replaced its acquisition messaging with a notice that it is no longer part of Mintlify, with details to come and no new owner named. The same week, Python evaluators were turned off and LLM-as-a-judge calls were rate limited.
Who owns Galileo?
As of 20 October 2026: Cisco, which completed its acquisition of Galileo in May 2026. Since 7 August 2026 the product has been sold as Splunk Agent Observability inside Splunk Observability Cloud.
Is Galileo open source?
Partly. The platform is proprietary. Its Python and TypeScript SDKs and Agent Control, its run-time guardrail layer, are open source under Apache-2.0.
How much does Galileo cost?
As of 20 October 2026: Splunk lists Agent Observability from $100 a month per 1.2 million spans a year, billed annually, with a Luna model allowance. No free tier is listed. On-premises deployment is available.
Can Galileo block or hold a live agent action?
Yes. Agent Control checks model and tool inputs and outputs during a run and can block prompt injection, personal data leaks and harmful content using rules set in one place, without changes to agent code.
Who owns Helicone?
As of 20 October 2026: Unclear. Mintlify acquired Helicone in March 2026 and moved it to maintenance mode. On 19 October 2026 Helicone began saying it is no longer part of Mintlify, with no new owner named.
Is Helicone open source?
Yes. The main repository is Apache-2.0 and can be self-hosted. Its separate Rust AI gateway is GPL-3.0 and has not been updated since November 2025.
How much does Helicone cost?
As of 20 October 2026: Hobby is free with 10K requests, Pro is $79 a month and Team $799 a month, with Enterprise custom. New cloud sign-ups have been disabled since March 2026, so new customers cannot start on any plan.
Can Helicone block or hold a live agent action?
Partly. Its gateway can block prompt injection and jailbreak attempts, for OpenAI models only, and apply rate limits. There are no approvals or policies on agent tool actions.
Is Prefactor open source?
Partly. Its deterministic evals package is Apache-2.0; the platform is hosted.
How much does Prefactor cost?
As of 20 October 2026: Dev is free with 5,000 spans a month. Startup is $49 a month and Scaleup $199 a month. Enterprise is custom above 4 million spans a month.
Can Prefactor block or hold a live agent action?
Yes. Runtime policies can block, throttle, sandbox or escalate an agent's tool calls and data access before they run, approval routing holds risky actions for a person, and a kill switch stops a run, an agent or a team.
Reviewed against public sources on October 20, 2026Suggest a correction

Score the run, then act on it

Prefactor scores each step of every agent run and can hold or stop an action when a score says it should not happen. Start on the free tier: 5,000 spans a month, no credit card required.

Agent Performance Platform
Unified performance platform for agents, authentication, and risk management
All Systems Operational
3Global Agents
7Instances
5Services
12%Human Intervene
4High Risk
$2,360Monthly Spend
Mission ControlLive agent health with 7-day activity heartbeat
Claims Proc...68
$330/moRed
Claims Proc...65
$160/moRed
Claims Proc...82
$170/moAmber
ChatGPT74
$150/moAmber

See how every agent performs, and make it better

Prefactor helps teams observe, evaluate, and improve their AI agents in production, across every framework and provider.