Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
DTEF [synth]: Predict response distributions for 26-35. Source: Global Dialogues GD4 (https://github.com/collect-intel/global-dialogues)
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude Haiku 4.5 | Gemini 2.5 Flash | Gemma 3 12b It | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o Mini | |
|---|---|---|---|---|---|---|---|
| Score | 3rd 64.7% | 5th 54.8% | 2nd 74.2% | 4th 60.2% | 6th 44.5% | 1st 80.6% | |
| 70.3% | 67% | 75% | 81% | 77% | 41% | 81% | |
| 72.7% | 83% | 80% | 81% | 75% | 35% | 82% | |
| 60.7% | 62% | 41% | 81% | 48% | 41% | 91% | |
| 58.2% | 64% | 45% | 55% | 55% | 46% | 84% | |
| 67.2% | 62% | 62% | 77% | 64% | 51% | 87% | |
| 70.0% | 70% | 68% | 87% | 73% | 49% | 73% | |
| 26.2% | 18% | 19% | 29% | 19% | 29% | 43% | |
| 68.0% | 62% | 65% | 78% | 71% | 46% | 86% | |
| 71.5% | 93% | 37% | 93% | 59% | 53% | 94% | |
| 67.0% | 66% | 56% | 80% | 61% | 54% | 85% |