aitoolsnav.com

Inspect AI vs Promptfoo

Our take

Pick Inspect AI if you're on a eval / safety team who will run Inspect locally at $0 (you bring model API keys) — not Promptfoo first unless they want a YAML CI red-team harness. Pick Promptfoo if you're on a app team who will run Community for $0 (MIT, self-host) and only buy Enterprise when they need SSO, a shared dashboard, and more than 10k probes.

Inspect AI

Inspect AI

local LLM eval log viewer

Promptfoo

Promptfoo

local LLM eval-and-attack harness

Best for

Inspect AI A research eval you can inspect at $0

Promptfoo Fail the build before a prompt ships

Free plan

Inspect AI $0 · local CLI + log viewer. You pay model inference and machines

Promptfoo No free plan

Lowest paid

Inspect AI Not published by the vendor

Promptfoo Not published by the vendor

Coding agent

Inspect AI

Promptfoo Eval matrix

Runs where

Inspect AI Hosted

Promptfoo Hosted

Watch out

Inspect AI $0 is the toolkit, not the model bill

Promptfoo Community red team is 10k probes/month

Last checked

Inspect AI 2026-10-27 · inspect.aisi.org.uk

Promptfoo 2026-10-27 · promptfoo.dev/pricing

Which one, then?

Pick Inspect AI if

eval / safety teams who will run Inspect locally at $0 (you bring model API keys) — not Promptfoo first unless they want a YAML CI red-team harness.

Read the Inspect AI page

Pick Promptfoo if

app teams who will run Community for $0 (MIT, self-host) and only buy Enterprise when they need SSO, a shared dashboard, and more than 10k probes.

Read the Promptfoo page

Other comparisons