aitoolsnav.com

Garak vs Inspect AI

Our take

Pick Garak if you're on a app / security team who will run Community-style scans at $0 and already have a model API key. Pick Inspect AI if you're on a eval / safety team who will run Inspect locally at $0 (you bring model API keys) — not Promptfoo first unless they want a YAML CI red-team harness. Skip Garak if you're on a team that want a YAML eval matrix + hosted dashboard (Promptfoo) or a research log viewer

Garak

Garak

local LLM vulnerability scanner

Inspect AI

Inspect AI

local LLM eval log viewer

Best for

Garak Fail a prompt before it ships

Inspect AI A research eval you can inspect at $0

Free plan

Garak $0 · apache-2.0. Local CLI. You pay model inference and machines

Inspect AI $0 · local CLI + log viewer. You pay model inference and machines

Lowest paid

Garak Not published by the vendor

Inspect AI Not published by the vendor

Runs where

Garak Hosted

Inspect AI Hosted

Watch out

Garak $0 is the toolkit, not the model bill

Inspect AI $0 is the toolkit, not the model bill

Last checked

Garak 2026-10-28 · github.com/NVIDIA/garak

Inspect AI 2026-10-27 · inspect.aisi.org.uk

Which one, then?

Pick Garak if

app / security teams who will run Community-style scans at $0 and already have a model API key.

Read the Garak page

Pick Inspect AI if

eval / safety teams who will run Inspect locally at $0 (you bring model API keys) — not Promptfoo first unless they want a YAML CI red-team harness.

Read the Inspect AI page

Other comparisons