| TypeSafe API, OpenRouter, Vercel AI Gateway | closed | $0.042 | 77.1 | 0.24 s | 70–500 ms end to end (TypeSafe) | No | 64K per request | Undisclosed | None offered | 2026-10-14 |
| Cloudflare Workers AI, OpenRouter | open | $0.24 | 75.3 | 0.58 s | 152 ms median at about 800 input tokens, partly from a move to SGLang serving (Cloudflare, 9 Oct) | Yes | 65,536 | 27B | Hands-on RL fine-tuning service | 2026-10-14 |
| Liquid AI, OpenRouter, Vercel AI Gateway | closed | $0.04 | 74.4 | 0.27 s | Not published by the maker | Yes | 65,536 | Undisclosed | None ("not trainable") | 2026-10-14 |
| OpenAI API (public beta), OpenRouter, Vercel AI Gateway | closed | $0.10 | 73.5 | 0.30 s | About 150 ms (OpenAI DevDay slide, unverified) | Yes | Unpublished | Undisclosed | Unknown | 2026-10-14 |
| Microsoft Foundry, OpenRouter, Vercel AI Gateway | closed | $0.042 | 70.8 | 0.46 s | 85 ms median, 125 ms p95, measured through Foundry (Microsoft) | No | 32,768 (OpenRouter) | 9B (post-trained Qwen3.5-9B) | Not stated | 2026-10-14 |
| Cloudflare Workers AI, OpenRouter | open | $0.038 | 63.8 | 0.36 s | 39 ms median at launch, before the context cut (Cloudflare) | Yes | 24,576 hosted (cut from 64K on 9 Oct); the weights support 256K self-hosted | 9B | Hands-on RL fine-tuning service | 2026-10-14 |
| Cloudflare Workers AI, OpenRouter | open | $0.15 | 58.3 | 0.44 s | About 130 ms median for text, 150 ms for images, 1.5 s for a 21-second video with sound (Cloudflare) | Yes | 64,000 | 30B MoE (3B active), on Qwen3-Omni-30B-A3B | Not stated | 2026-10-14 |
| Self-host only | open | Self-host | 49.5 | 0.18 s | 8 ms a decision on an NVIDIA RTX 4090, 16 ms on a Jetson AGX Thor (Liquid AI) | Yes | 32,768 | 3.1B | – | 2026-10-14 |
| Self-host only | open | Self-host | 32.8 | 0.19 s | Not published by the maker | Yes | 16,384 | 587M | – | 2026-10-14 |
| Vercel AI Gateway (free until 31 Oct) | open | Free | 32.5 | 1.80 s | 33 ms on a T4 GPU (Convai) | No | 512–8,192 | 421M | Notebook provided | 2026-10-14 |
| Self-host only | open | Self-host | 20.1 | 0.19 s | Up to 9× faster than Jev (authors) | No | 2,048 | 8B | Tools provided | 2026-10-14 |
| Self-host only | open | Self-host | – | – | 115 ms median on an RTX 3090 (AWS) | Yes | 4,096 | 1.9B | Full recipe published | 2026-10-14 |