Opik

What it is for

Opik is an agent trace + eval desk: you log spans, run test suites, and optionally open Optimization Studio to rewrite a prompt. Use it when the job is spans you can self-host at $0 or rent from $0 Cloud / $19 Pro, not when you need a $20 chat seat.

What makes it unique: the cover is the official comet-ml/opik docs Optimization Studio (trials, best prompt, evaluation bars) — not a pricing card. The Studio run button is ops, not a sixth product.

Key features

• Tracing — every step (retrieval, tool, model) as a span tree you can filter (pricing Observability). One graph. Sessions and token/cost columns are modes of this. The SDK is install.
• Test suites — pass/fail assertions on items and on the whole suite (pricing Test Suites). A gate, not a trace. Execution policies (N runs must pass) are SKU of this.
• Experiments + datasets — run a dataset through the agent with built-in or custom metrics (pricing Evaluation). A bench, not a live span. 30+ judges are metrics of this.
• Optimization Studio — algorithms (MIPRO, GEPA, …) that rewrite prompts/tools and plot the lift (pricing Agent Optimization; cover). A search, not a test. Prompt Library versioning is next to this.
• Annotation queues — a review UI so humans label traces or whole threads (pricing Expert Annotation). A desk, not a metric.

Agent Playground and Prompt Playground are ops. Ollie / Opik Connect (code edits) is a Cloud add-on (trial then tokens). Guardrails are self-host SKU. Spans are the meter.

Who it's for

Best fit: agent teams who will stay on OSS $0 or Free Cloud $0 (25k spans, 10 members), then buy Pro Cloud at $19/month when they need 100k spans and 50 seats.

Pricing

Verified 2026-10-22 (Asia/Shanghai) from comet.com/site/pricing (Opik cards). Cloud is spans. OSS is the same codebase.

• Open Source — $0. Self-host. Full observability + agent testing. Same codebase as hosted. Agent Playground included.
• Free Cloud — $0. Up to 10 members. 25k spans/month. 60-day retention. US region. Ollie coding-harness trial.
• Pro Cloud — $19/month. Up to 50 members. 100k spans/month. 60-day retention (customizable). Customizable span limits. Ollie Connect after trial is token purchase.
• Enterprise — custom. Unlimited members, flexible deploy, SSO, view-only users, SOC 2 / ISO / HIPAA / GDPR, dedicated support.

Academics can stay on Free. Confirm checkout; taxes follow your location.

Limitations / costs

• Free Cloud is 25k spans. OSS is unlimited on your metal.
• Ollie Connect is not inside $19. It is a trial, then tokens.
• A trace desk, not a gateway. For a proxy in front of many models see Helicone. For LangChain-native traces see LangSmith.

Alternatives

• Langfuse — OSS traces when you want a different UI and self-host path.
• LangSmith — LangChain-native eval when you already live in that stack.
• Braintrust — eval-first when you do not want Comet Cloud spans.

Official tutorial

A first-party Opik getting-started was not listed on a Comet-authored channel we could verify by oEmbed. Use the docs; do not embed a third-party walkthrough.

Written path: comet.com/site/pricing plus the Optimization Studio docs screenshot.

Website

https://www.comet.com/site/products/opik/

Repository

https://github.com/comet-ml/opik

Source

Catalog row curated for AI Tools Nav. Cover is the official comet-ml/opik Optimization Studio. Dollars checked on comet.com/site/pricing (OSS $0; Free Cloud $0 / 25k spans; Pro Cloud $19 / 100k spans).

Last verified

2026-10-22 (Asia/Shanghai) editorial check.