AgentOps

What it is for

AgentOps is an agent observability SDK + dashboard: two lines (pip install agentops + agentops.init) and every LLM call, tool, and multi-agent hop lands in a session you can replay. Use it when the job is watch the agent run, not when you need a model gateway.

The app is open source (AgentOps-AI/agentops). Hosted Basic is $0 (5,000 events / month). Pro starts at $40/month.

What makes it unique: the cover is AgentOps’ official drilldown chrome from the Quickstart — a clickable session URL printed to the console, then the same timeline you debug.

Key features

• Two-line SDK — agentops.init(API_KEY) before any OpenAI / CrewAI / AutoGen call (Quickstart).
• Session drilldown — LLM calls, tools, and multi-agent hops on one timeline (cover; agentops.ai).
• Time-travel replay — rewind a run to a point in the trace (agentops.ai).
• Cost tracking — spend across 400+ LLMs with current price rows (agentops.ai).
• Decorators — @session, @agent, @operation to wrap your own functions as spans (Quickstart).
• Fine-tune later — save completions and fine-tune cheaper on that log (homepage “25× cheaper” line).

Who it's for

Best fit: agent builders who will add two lines and then live in the session URL.

Poor fit: platform teams who need a multi-provider gateway with fallbacks (Portkey).

Pricing

Verified 2026-10-22 (Asia/Shanghai) from the live cards on agentops.ai. Re-check checkout.

• Basic — $0/month. Up to 5,000 events. Agent-agnostic SDK. Cost tracking (400+ LLMs). Replay analytics.
• Pro — starts at $40/month. Unlimited events. Unlimited log retention. Session / event export. RBAC. Dedicated Slack + email.
• Enterprise — custom. SLA, Slack Connect, custom SSO, on-prem / self-host (AWS, GCP, Azure), custom retention, SOC 2 / HIPAA / NIST AI RMF.

Limitations / costs

• Basic is 5,000 events. A verbose agent loop is not “free forever.”
• $40 is “starts at.” Confirm what the invoice meters beyond events.
• This is a tracer, not a gateway. You still pay OpenAI / Anthropic directly.
• No official getting-started video on the channels we checked; we link the docs instead of embedding a third-party tutorial.

Alternatives

• Langfuse — open-source traces if you want a fuller self-host stack.
• Helicone — gateway + request table if you will change baseURL.
• Braintrust — evals + traces if the next step is a score, not a replay.

Official tutorial

We searched YouTube for a current official AgentOps getting-started video. @AgentOpsAI exists; the walkthroughs we found (@agency_ai, @cmd_labs, @szymonmorawiec2641) are not first-party, so they are not embedded. Use the written Quickstart plus agentops.ai.

Website

https://www.agentops.ai

Repository

https://github.com/AgentOps-AI/agentops

Source

Catalog row curated for AI Tools Nav. Cover is AgentOps’ official session drilldown / Quickstart chrome. Basic $0 / 5k events; Pro from $40. No official YouTube embed found.

Last verified

2026-10-22 (Asia/Shanghai) editorial check.