Pick Promptfoo if
app teams who will run Community for $0 (MIT, self-host) and only buy Enterprise when they need SSO, a shared dashboard, and more than 10k probes.
Read the Promptfoo pagePromptfoo vs Roark
Our take
Pick Promptfoo if you're on a app team who will run Community for $0 (MIT, self-host) and only buy Enterprise when they need SSO, a shared dashboard, and more than 10k probes. Pick Roark if you're on a voice team who will spend the $50 credit, then $0.15 / min simulations. Skip Roark if you're people who need a $100 flat eval seat (Coval Starter) or a prompt YAML (Promptfoo).
Best for
Promptfoo Fail the build before a prompt ships
Roark Score the voice agent on audio-native metrics
Free plan
Promptfoo No free plan
Roark $0 · to start. $50 free credit. Simulation $0.15 / min + provider pass-through. Metric eval $0.04 / metric / min. Transcription $0.024 / min if you do not send a transcript. 1 project; 5 seats; 10 concurrent lines
Lowest paid
Promptfoo Not published by the vendor
Roark Enterprise $4
Coding agent
Promptfoo Eval matrix
Roark
Runs where
Promptfoo Hosted
Roark
Watch out
Promptfoo Community red team is 10k probes/month
Roark $0.15 / min is plus telephony/STT/TTS at cost
Last checked
Promptfoo 2026-10-27 · promptfoo.dev/pricing
Roark 2026-10-28 · roark.ai/pricing
Which one, then?
Pick Roark if
voice teams who will spend the $50 credit, then $0.15 / min simulations.
Read the Roark page