Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
DTEF: Predict response distributions for Urban. Source: Global Dialogues GD1 (https://github.com/collect-intel/global-dialogues)
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude Haiku 4.5 | Claude Sonnet 4 | Claude Sonnet 4.5 | Gemini 2.5 Flash | Gemma 3 12b It | Llama 4 Maverick | Mistral Medium 3 | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o Mini | Qwen3 30b A3B Instruct 2507 | Qwen3 Next 80b A3B Instruct | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 1st 80.8% | 9th 74.5% | 8th 75.5% | 6th 77.0% | 3rd 79.5% | 7th 75.8% | 13th 71.0% | 11th 73.3% | 5th 77.3% | 4th 77.5% | 10th 74.0% | 12th 73.0% | 2nd 79.8% | |
| 75.9% | 81% | 75% | 72% | 74% | 72% | 77% | 78% | 73% | 78% | 80% | 80% | 70% | 77% | |
| 77.4% | 77% | 75% | 75% | 79% | 77% | 79% | 67% | 79% | 82% | 81% | 80% | 77% | 78% | |
| 68.8% | 73% | 73% | 75% | 73% | 77% | 70% | 55% | 65% | 61% | 71% | 56% | 71% | 74% | |
| 82.2% | 92% | 75% | 80% | 82% | 92% | 77% | 84% | 76% | 88% | 78% | 80% | 74% | 90% |