Model tracker: decision models compared on price, speed and benchmarks

12 models · checked
ModelWhereOpenInput / MJevBenchJevBench timeReported speedImagesContextSizeFine-tuningChecked
Jev 1.13↗TypeSafe AI
TypeSafe API, OpenRouter, Vercel AI Gatewayclosed$0.04277.10.24 s70–500 ms end to end (TypeSafe)No64K per requestUndisclosedNone offered2026-10-14
Clef↗Cloudflare
Cloudflare Workers AI, OpenRouteropen$0.2475.30.58 s152 ms median at about 800 input tokens, partly from a move to SGLang serving (Cloudflare, 9 Oct)Yes65,53627BHands-on RL fine-tuning service2026-10-14
d1↗Liquid AI
Liquid AI, OpenRouter, Vercel AI Gatewayclosed$0.0474.40.27 sNot published by the makerYes65,536UndisclosedNone ("not trainable")2026-10-14
OpenAI API (public beta), OpenRouter, Vercel AI Gatewayclosed$0.1073.50.30 sAbout 150 ms (OpenAI DevDay slide, unverified)YesUnpublishedUndisclosedUnknown2026-10-14
Microsoft Foundry, OpenRouter, Vercel AI Gatewayclosed$0.04270.80.46 s85 ms median, 125 ms p95, measured through Foundry (Microsoft)No32,768 (OpenRouter)9B (post-trained Qwen3.5-9B)Not stated2026-10-14
Clef-flash↗Cloudflare
Cloudflare Workers AI, OpenRouteropen$0.03863.80.36 s39 ms median at launch, before the context cut (Cloudflare)Yes24,576 hosted (cut from 64K on 9 Oct); the weights support 256K self-hosted9BHands-on RL fine-tuning service2026-10-14
Clef-omni↗Cloudflare
Cloudflare Workers AI, OpenRouteropen$0.1558.30.44 sAbout 130 ms median for text, 150 ms for images, 1.5 s for a 21-second video with sound (Cloudflare)Yes64,00030B MoE (3B active), on Qwen3-Omni-30B-A3BNot stated2026-10-14
d1-3B↗Liquid AI
Self-host onlyopenSelf-host49.50.18 s8 ms a decision on an NVIDIA RTX 4090, 16 ms on a Jetson AGX Thor (Liquid AI)Yes32,7683.1B–2026-10-14
Self-host onlyopenSelf-host32.80.19 sNot published by the makerYes16,384587M–2026-10-14
Laya↗Convai Innovations
Vercel AI Gateway (free until 31 Oct)openFree32.51.80 s33 ms on a T4 GPU (Convai)No512–8,192421MNotebook provided2026-10-14
CLM-8B↗Stanford and NVIDIA
Self-host onlyopenSelf-host20.10.19 sUp to 9× faster than Jev (authors)No2,0488BTools provided2026-10-14
Strands Decider 2B↗AWS Strands Labs
Self-host onlyopenSelf-host––115 ms median on an RTX 3090 (AWS)Yes4,0961.9BFull recipe published2026-10-14

What's a decision model? A model that answers a typed question (yes or no, pick one, pick several, a number) with probabilities instead of writing text, in milliseconds and for a fraction of an LLM call. Agents use them for routing, guardrails, classification and re-ranking. Our guide to decision models explains where they beat an LLM and where they don't, and every model has its own page.

JevBench is the main independent benchmark, run as a one-person project with Jev as its reference, which favours cheap hosted models. Its times are measured end to end for hosted APIs and estimated by the board for self-hosted models; the reported speeds are each maker's own figures on its own hardware, so neither compares cleanly across rows. None of the hosted models charge for output tokens.

Check before you build on it. An AI agent keeps this table from each maker's docs and announcements. Prices and models change quickly in this category, and we can get things wrong. Each row links to the page it was checked against; that page is the authority. Dbggr isn't affiliated with any of these companies.

Filters
Group rows
Where
Weights
Input