Public scoreboard
Evidence, not verdicts.
Providers checked against the model maker's own endpoint. Click a provider to see the data behind its result.
DeepSeek V4.1 Flashby DeepSeek
10 of 10 tested match · 50 on OpenRouter| Provider | Same answer as the maker · typical | Result | Precision | Price out / 1M |
|---|---|---|---|---|
| DeepSeek | makersame answer twice 98% of the time | Reference | unknown | $0.60 |
| Wafer · us | 94%100 of 106 prompts · typical 92% | Matches | mxfp4 | $0.50 |
| StreamLake · fp8 | 94%100 of 106 prompts · typical 92% | Matches | fp8 | $0.44 |
| DeepInfra · fp8 | 93%99 of 106 prompts · typical 92% | Matches | fp8 | $0.29 |
| DeepInfra · fp8 flex | 92%98 of 106 prompts · typical 92% | Matches | fp8 | $0.24 |
| Morph · fp8 | 92%97 of 106 prompts · typical 93% | Matches | fp8 | $0.40 |
| Relace · fp4 | 92%97 of 106 prompts · typical 93% | Matches | fp4 | $0.50 |
| Particle AI · us | 90%95 of 106 prompts · typical 93% | Matches | unknown | $0.50 |
| Particle AI · us flex | 89%94 of 106 prompts · typical 93% | Matches | unknown | $0.25 |
| Ionstream · flex | 87%92 of 106 prompts · typical 93% | Matches | unknown | $0.25 |
GLM 5.3by Z.ai
8 of 10 tested match · 47 on OpenRouter| Provider | Same answer as the maker · typical | Result | Precision | Price out / 1M |
|---|---|---|---|---|
| Z.AI · fp8 | makersame answer twice 62% of the time | Reference | fp8 | $4.40 |
| Novita · fp8 | 75%76 of 102 prompts · typical 71% | Matches | fp8 | $1.98 |
| Makora · fp4 | 74%56 of 76 prompts · typical 71% | Matches | fp4 | $2.00 |
| Decart · fp4 | 74%75 of 102 prompts · typical 71% | Matches | fp4 | $1.78 |
| GMICloud · fp8 | 72%73 of 101 prompts · typical 71% | Matches | fp8 | $2.20 |
| Reka | 71%72 of 101 prompts · typical 72% | Matches | unknown | $2.10 |
| SiliconFlow · fp8 | 70%71 of 102 prompts · typical 72% | Matches | fp8 | $2.20 |
| Wafer · us | 58%59 of 101 prompts · typical 72% | On watch | fp4 | $1.40 |
| Wafer · fp4 | 56%57 of 102 prompts · typical 72% | On watch | fp4 | $1.40 |
| Tenstorrent · fp8offline | 45%9 of 20 prompts · typical 60% | Matches | fp8 | $2.50 |
Kimi K3by Moonshot AI
8 of 10 tested match · 29 on OpenRouter| Provider | Same answer as the maker · typical | Result | Precision | Price out / 1M |
|---|---|---|---|---|
| Moonshot AI | makersame answer twice 71% of the time | Reference | unknown | $15.00 |
| InferenceNet · fp4 | 79%84 of 106 prompts · typical 63% | Matches | fp4 | $15.00 |
| InferenceNet · us | 79%84 of 106 prompts · typical 63% | Matches | fp4 | $15.00 |
| Decart · mxfp4 | 65%69 of 106 prompts · typical 63% | Matches | mxfp4 | $9.75 |
| Chutes · mxfp4 | 65%69 of 106 prompts · typical 63% | Matches | mxfp4 | $9.50 |
| Sail Research · fp4 | 63%67 of 106 prompts · typical 65% | Matches | fp4 | $13.26 |
| Relace · fp4 | 63%67 of 106 prompts · typical 65% | Matches | fp4 | $9.34 |
| Sail Research · fp4 us | 63%67 of 106 prompts · typical 65% | Matches | fp4 | $13.26 |
| Phalaoffline | 39%7 of 18 prompts · typical 72% | On watch | unknown | $12.75 |
| Wafer · us | 37%39 of 106 prompts · typical 65% | On watch | mxfp4 | $9.60 |
Real results from Nov 11: 13,681 test calls, 106 daily prompts per provider. Quality checks (known answers, tool calls, long context) are not running yet. A provider is marked as no match only after 2 failed checks on different days. Providers can reply to any result.