DTeval

A Collective Intelligence Project

Loading blueprint versions...

Please wait while we gather all the unique runs for this blueprint.

Analysis: Gd4 Dtef Global Dialogues Gd4 Environment%3Aurban - Run fa436b2...

Global Dialogues GD4 - Urban

DTEF: Predict response distributions for Urban. Source: Global Dialogues GD4 (https://github.com/collect-intel/global-dialogues)

TAGS:

Global Dialogues Gd4

Instruction Following & Prompt Adherence

Factual Accuracy & Hallucination

Social interaction

AI Safety & Robustness

General Knowledge

Economics & Finance

Best Models (Coverage)

1.Claude 3.7 Sonnet
85.5%
2.GPT 4o
83.2%
3.Claude Sonnet 4.5
83.2%
4.Claude Sonnet 4
83.1%
5.Claude Haiku 4.5
83.0%

Select Prompt:

Macro Coverage Overview

Average key point coverage extent for each model across all prompts.

Pro Tip

Click on any result cell to open a detailed view.

Advanced view

Highlight best performers

Sort prompts by

Sort models by

Color Scale - Simplified View (Avg. Coverage)

Perfect

Excellent

Good

Fair

Poor

Bad

Not Met

	Prompts vs. Models	Claude 3.7 Sonnet	Claude Haiku 4.5	Claude Sonnet 4	Claude Sonnet 4.5	Gemini 2.5 Flash	Gemma 3 12b It	Llama 4 Maverick	Mistral Large 2411	Mistral Medium 3	GPT 4.1	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o	GPT 4o Mini	GPT 5 Mini	GPT 5.1	GPT OSS 120b	GPT OSS 20b	Qwen3 30b A3B Instruct 2507	Qwen3 Next 80b A3B Instruct	Grok 4.1 Fast
Score		1st 85.5%	5th 83.0%	4th 83.1%	3rd 83.2%	10th 82.5%	17th 79.1%	7th 82.6%	12th 81.4%	13th 80.6%	6th 83.0%	8th 82.5%	20th 77.6%	2nd 83.2%	16th 79.7%	15th 80.2%	9th 82.5%	18th 78.4%	21st 76.6%	19th 78.4%	11th 81.4%	14th 80.3%
67.4%		75%	68%	69%	77%	63%	55%	64%	69%	63%	69%	71%	70%	69%	59%	74%	67%	65%	78%	59%	61%	70%
71.5%		78%	73%	70%	71%	91%	54%	60%	57%	62%	86%	79%	70%	78%	67%	76%	82%	69%	75%	62%	71%	71%
82.7%		90%	81%	84%	89%	80%	80%	84%	92%	81%	85%	90%	80%	83%	79%	85%	86%	80%	82%	78%	83%	65%
86.7%		93%	89%	90%	93%	92%	83%	85%	91%	91%	88%	84%	79%	85%	88%	81%	90%	88%	75%	85%	84%	87%
71.1%		85%	76%	79%	82%	74%	60%	76%	71%	74%	74%	68%	73%	70%	68%	52%	71%	67%	56%	63%	74%	80%
87.0%		92%	87%	88%	90%	92%	80%	86%	80%	91%	96%	86%	94%	96%	94%	92%	89%	74%	82%	78%	78%	81%
63.0%		67%	75%	66%	67%	62%	62%	68%	70%	52%	53%	69%	34%	65%	53%	78%	60%	57%	64%	67%	66%	67%
80.4%		80%	74%	82%	73%	72%	87%	86%	85%	76%	78%	80%	84%	74%	87%	64%	74%	86%	84%	81%	93%	88%
87.0%		91%	88%	84%	86%	85%	94%	95%	91%	80%	94%	93%	88%	88%	86%	71%	82%	84%	89%	76%	90%	92%
76.6%		72%	81%	58%	57%	62%	90%	69%	81%	63%	88%	87%	88%	94%	93%	55%	79%	80%	80%	83%	93%	56%
86.0%		90%	87%	90%	91%	75%	92%	87%	88%	85%	88%	89%	82%	89%	88%	85%	89%	83%	77%	80%	88%	84%
89.7%		97%	98%	94%	94%	96%	97%	95%	94%	92%	95%	92%	70%	92%	91%	78%	94%	87%	69%	84%	85%	89%
85.2%		82%	87%	84%	84%	79%	90%	85%	88%	89%	89%	88%	88%	89%	88%	90%	88%	86%	81%	79%	85%	71%
63.5%		68%	69%	70%	72%	66%	74%	67%	54%	61%	64%	57%	66%	54%	53%	57%	66%	57%	51%	68%	69%	71%
76.3%		76%	73%	79%	76%	67%	70%	83%	87%	73%	78%	85%	76%	76%	79%	77%	87%	81%	51%	72%	70%	87%
84.0%		86%	92%	77%	95%	96%	79%	86%	71%	88%	90%	83%	75%	84%	74%	91%	90%	80%	94%	71%	74%	87%
81.4%		78%	88%	80%	84%	81%	78%	85%	86%	87%	80%	76%	88%	86%	75%	75%	80%	81%	88%	74%	82%	78%
88.9%		96%	89%	95%	98%	92%	82%	94%	92%	88%	87%	89%	84%	90%	88%	87%	88%	87%	80%	86%	87%	88%
87.9%		96%	89%	97%	94%	87%	84%	95%	84%	83%	95%	87%	68%	88%	93%	87%	94%	90%	79%	87%	87%	81%
77.4%		76%	82%	76%	73%	75%	73%	78%	80%	79%	75%	79%	81%	85%	81%	78%	76%	79%	76%	77%	78%	69%
88.8%		94%	88%	96%	81%	94%	84%	89%	92%	87%	86%	92%	81%	94%	92%	81%	90%	86%	86%	87%	91%	93%
88.6%		88%	94%	90%	88%	84%	94%	98%	87%	95%	80%	93%	72%	80%	93%	92%	87%	83%	84%	92%	98%	89%
82.9%		89%	80%	78%	89%	89%	81%	83%	81%	93%	90%	77%	92%	90%	92%	69%	89%	75%	73%	78%	74%	79%
60.3%		71%	68%	68%	69%	57%	50%	65%	62%	62%	65%	62%	61%	60%	46%	58%	57%	64%	61%	49%	52%	59%
86.9%		94%	91%	88%	91%	91%	93%	85%	89%	82%	91%	85%	94%	88%	78%	90%	89%	64%	73%	89%	88%	91%
68.1%		69%	68%	59%	59%	76%	68%	68%	55%	73%	60%	68%	51%	69%	71%	75%	69%	73%	77%	84%	83%	56%
86.5%		91%	82%	86%	92%	91%	91%	87%	96%	87%	90%	90%	83%	89%	82%	73%	90%	92%	69%	82%	83%	90%
78.8%		82%	70%	79%	80%	82%	71%	78%	77%	87%	87%	81%	84%	84%	86%	75%	86%	81%	81%	66%	75%	63%
79.5%		91%	77%	84%	92%	82%	65%	85%	90%	83%	84%	76%	82%	85%	68%	82%	82%	77%	78%	69%	70%	68%
80.9%		83%	81%	84%	94%	76%	70%	83%	89%	77%	84%	79%	78%	83%	73%	91%	85%	79%	74%	69%	84%	83%
87.7%		95%	86%	93%	89%	89%	87%	89%	85%	85%	93%	86%	88%	94%	88%	90%	92%	79%	78%	85%	81%	89%
86.1%		90%	88%	87%	75%	86%	81%	86%	89%	84%	87%	91%	88%	90%	87%	86%	87%	79%	83%	88%	90%	86%
77.7%		77%	84%	72%	86%	87%	78%	72%	73%	93%	80%	74%	86%	79%	62%	95%	78%	79%	81%	58%	67%	70%
72.5%		76%	74%	69%	82%	88%	66%	74%	76%	79%	75%	68%	65%	71%	68%	78%	80%	69%	65%	60%	68%	71%
80.2%		76%	82%	85%	80%	85%	86%	87%	73%	63%	79%	74%	80%	86%	86%	78%	68%	75%	79%	90%	83%	90%
87.3%		92%	86%	87%	89%	86%	88%	86%	85%	85%	92%	86%	88%	92%	88%	91%	89%	83%	89%	83%	80%	88%
73.8%		73%	77%	85%	59%	72%	87%	75%	72%	67%	70%	72%	72%	73%	78%	51%	69%	72%	85%	93%	73%	75%
84.7%		90%	85%	82%	90%	87%	89%	82%	90%	71%	86%	89%	83%	78%	73%	90%	82%	83%	81%	88%	92%	87%
86.5%		93%	87%	90%	86%	88%	85%	84%	83%	91%	87%	88%	88%	91%	88%	76%	91%	84%	88%	83%	87%	79%
74.1%		73%	77%	69%	69%	66%	88%	79%	81%	71%	77%	81%	60%	79%	62%	82%	72%	81%	69%	78%	80%	63%
88.6%		98%	93%	96%	93%	89%	81%	94%	91%	91%	93%	94%	76%	91%	93%	86%	92%	89%	53%	73%	97%	97%
86.0%		95%	94%	96%	93%	74%	96%	93%	94%	89%	91%	94%	77%	92%	73%	76%	93%	69%	65%	95%	73%	83%
85.4%		90%	89%	91%	88%	92%	72%	91%	83%	86%	90%	92%	91%	89%	70%	81%	91%	76%	93%	65%	89%	85%
74.5%		78%	71%	75%	72%	75%	65%	89%	85%	86%	77%	75%	72%	81%	71%	65%	68%	83%	73%	72%	55%	76%
86.4%		96%	91%	94%	96%	76%	87%	90%	90%	79%	91%	89%	79%	87%	84%	88%	88%	83%	63%	83%	92%	89%
85.6%		89%	81%	85%	85%	87%	87%	92%	85%	89%	88%	84%	74%	90%	83%	94%	87%	74%	81%	88%	93%	82%
82.7%		85%	92%	83%	76%	82%	80%	83%	91%	84%	80%	85%	88%	82%	81%	80%	79%	78%	85%	82%	76%	84%
90.8%		90%	92%	96%	87%	82%	82%	85%	92%	86%	99%	82%	75%	95%	95%	95%	95%	95%	96%	96%	91%	100%
87.6%		85%	88%	88%	76%	91%	90%	99%	85%	90%	81%	94%	83%	85%	87%	86%	93%	94%	73%	85%	94%	92%
87.2%		97%	89%	96%	95%	83%	87%	88%	91%	85%	93%	84%	81%	92%	84%	86%	88%	84%	73%	84%	90%	82%
86.7%		91%	90%	94%	94%	83%	82%	90%	91%	89%	90%	86%	77%	88%	88%	87%	90%	85%	79%	80%	88%	79%
76.0%		92%	71%	76%	90%	77%	65%	78%	72%	84%	83%	74%	59%	79%	68%	83%	74%	74%	78%	67%	65%	86%
70.8%		63%	76%	69%	74%	85%	67%	59%	68%	68%	66%	79%	63%	67%	65%	77%	66%	78%	76%	70%	79%	71%
61.2%		67%	69%	61%	63%	63%	70%	63%	59%	68%	60%	66%	66%	68%	53%	56%	56%	51%	40%	70%	63%	54%
88.4%		93%	83%	93%	91%	76%	87%	93%	92%	89%	92%	91%	88%	91%	91%	85%	86%	85%	84%	87%	84%	95%
84.7%		92%	82%	85%	87%	84%	81%	79%	91%	94%	90%	84%	88%	88%	83%	82%	93%	89%	53%	75%	89%	89%
73.3%		83%	67%	84%	84%	64%	60%	88%	67%	74%	88%	67%	74%	81%	77%	68%	71%	69%	72%	48%	71%	82%
89.1%		90%	94%	87%	87%	88%	93%	87%	88%	85%	87%	93%	85%	92%	92%	91%	89%	88%	92%	89%	92%	83%
68.3%		78%	76%	64%	82%	83%	53%	70%	69%	71%	76%	74%	59%	68%	61%	80%	76%	50%	50%	58%	70%	66%
80.2%		85%	82%	85%	86%	84%	86%	78%	83%	72%	76%	81%	81%	82%	80%	68%	81%	79%	78%	86%	76%	75%
87.9%		91%	90%	90%	89%	85%	84%	92%	86%	89%	93%	94%	94%	90%	74%	93%	90%	83%	88%	69%	98%	84%
72.1%		83%	73%	82%	79%	73%	58%	72%	74%	73%	75%	66%	74%	72%	60%	62%	77%	72%	73%	65%	67%	84%
86.6%		93%	94%	94%	93%	92%	81%	93%	91%	94%	92%	81%	77%	94%	72%	91%	89%	74%	70%	77%	81%	96%
87.7%		93%	89%	90%	90%	90%	91%	90%	85%	82%	88%	90%	90%	92%	90%	78%	87%	80%	88%	83%	89%	87%
83.3%		90%	82%	80%	88%	82%	83%	84%	70%	85%	87%	83%	93%	88%	83%	73%	90%	76%	85%	80%	77%	90%
87.1%		91%	86%	92%	97%	89%	75%	92%	92%	85%	85%	84%	94%	86%	84%	94%	88%	72%	89%	77%	90%	87%
79.7%		80%	87%	79%	82%	81%	65%	80%	91%	87%	85%	76%	81%	77%	61%	87%	89%	79%	84%	63%	76%	84%
76.0%		88%	85%	80%	77%	76%	72%	71%	69%	70%	76%	82%	69%	73%	77%	76%	76%	78%	77%	67%	86%	71%
81.3%		80%	78%	82%	81%	76%	84%	78%	84%	80%	84%	84%	84%	82%	82%	85%	82%	80%	81%	78%	79%	83%
88.3%		84%	93%	89%	88%	85%	90%	85%	89%	85%	84%	95%	86%	86%	89%	93%	91%	90%	94%	85%	98%	75%
85.2%		91%	88%	91%	93%	89%	90%	87%	79%	84%	90%	78%	90%	86%	88%	75%	87%	78%	65%	90%	82%	89%
85.1%		90%	85%	88%	88%	67%	96%	88%	91%	72%	90%	92%	88%	89%	86%	68%	87%	86%	81%	82%	83%	90%
91.8%		97%	95%	95%	91%	92%	92%	95%	93%	89%	88%	94%	92%	94%	92%	92%	89%	91%	85%	89%	96%	86%
76.2%		84%	81%	85%	86%	81%	64%	82%	81%	90%	82%	68%	69%	86%	67%	83%	74%	69%	66%	61%	61%	80%
80.9%		84%	84%	79%	79%	84%	83%	79%	82%	80%	75%	84%	77%	86%	77%	83%	89%	78%	56%	86%	84%	89%
84.1%		91%	83%	88%	83%	87%	82%	88%	82%	81%	81%	86%	79%	78%	83%	91%	82%	87%	92%	83%	86%	74%
84.5%		90%	85%	96%	90%	86%	89%	87%	87%	83%	85%	84%	76%	88%	89%	66%	90%	74%	69%	87%	82%	92%
84.4%		89%	88%	81%	87%	82%	73%	86%	93%	79%	85%	85%	87%	86%	78%	92%	89%	85%	90%	75%	80%	82%
84.2%		90%	85%	85%	87%	80%	88%	86%	83%	88%	86%	85%	86%	85%	86%	76%	84%	83%	77%	76%	89%	83%
86.5%		96%	85%	91%	83%	79%	86%	91%	86%	82%	87%	88%	82%	85%	86%	90%	88%	80%	88%	87%	88%	88%
90.7%		96%	92%	92%	92%	90%	97%	94%	89%	95%	89%	94%	92%	91%	92%	92%	92%	86%	73%	89%	88%	90%
88.8%		90%	97%	95%	94%	91%	90%	90%	92%	87%	96%	92%	68%	92%	89%	86%	94%	86%	70%	84%	89%	93%
81.5%		83%	85%	89%	81%	78%	84%	86%	85%	82%	83%	80%	75%	79%	80%	78%	85%	80%	75%	81%	80%	82%
90.1%		95%	94%	97%	89%	89%	89%	95%	96%	98%	88%	89%	82%	81%	94%	89%	90%	93%	72%	90%	95%	87%
85.4%		87%	85%	94%	90%	90%	85%	93%	85%	90%	82%	85%	77%	89%	89%	83%	89%	88%	64%	87%	81%	80%
85.4%		89%	85%	89%	86%	79%	86%	86%	83%	88%	86%	86%	86%	87%	86%	83%	88%	79%	85%	85%	86%	85%
72.5%		77%	78%	75%	70%	78%	76%	70%	74%	69%	62%	74%	66%	70%	81%	63%	68%	64%	65%	86%	83%	74%
82.4%		89%	86%	78%	79%	84%	79%	78%	71%	80%	85%	85%	71%	82%	88%	92%	83%	88%	77%	83%	83%	90%
74.0%		88%	84%	86%	86%	91%	72%	69%	87%	70%	72%	65%	46%	81%	68%	57%	76%	56%	53%	85%	93%	68%
79.0%		80%	88%	79%	73%	72%	73%	76%	72%	72%	78%	92%	80%	82%	75%	87%	81%	76%	79%	92%	81%	71%
77.8%		78%	70%	71%	70%	72%	73%	80%	78%	79%	80%	84%	85%	77%	70%	85%	79%	87%	85%	75%	80%	75%
49.2%		47%	48%	56%	56%	70%	45%	47%	48%	46%	50%	51%	48%	48%	51%	42%	42%	47%	49%	67%	44%	32%
67.2%		70%	77%	62%	63%	69%	60%	54%	57%	57%	67%	69%	69%	82%	91%	70%	61%	61%	65%	86%	75%	47%
86.5%		95%	86%	86%	88%	89%	76%	85%	95%	91%	87%	87%	84%	92%	82%	87%	91%	90%	89%	79%	80%	77%
68.8%		67%	74%	75%	68%	73%	74%	74%	62%	73%	63%	63%	55%	71%	67%	58%	67%	66%	84%	70%	66%	74%
84.0%		78%	79%	88%	88%	87%	87%	86%	83%	75%	85%	81%	75%	87%	90%	80%	87%	85%	79%	90%	92%	83%
89.3%		91%	94%	93%	92%	91%	95%	96%	92%	85%	93%	86%	80%	93%	94%	81%	90%	82%	84%	90%	90%	84%
90.6%		96%	91%	92%	87%	91%	95%	89%	89%	89%	86%	93%	92%	92%	92%	92%	91%	95%	92%	90%	92%	77%
80.4%		91%	85%	85%	91%	93%	55%	81%	59%	84%	92%	85%	67%	80%	86%	93%	89%	68%	65%	68%	86%	86%
79.4%		88%	79%	87%	87%	92%	68%	69%	77%	76%	88%	85%	71%	84%	71%	80%	79%	70%	74%	73%	75%	94%
74.2%		90%	76%	79%	79%	78%	74%	62%	85%	73%	82%	82%	70%	80%	76%	79%	66%	59%	78%	59%	70%	62%
86.6%		87%	76%	82%	89%	91%	85%	83%	91%	90%	92%	89%	94%	89%	77%	91%	92%	92%	77%	80%	88%	83%
62.7%		68%	67%	51%	58%	74%	61%	65%	53%	47%	60%	62%	36%	65%	60%	76%	68%	65%	71%	82%	67%	61%
83.8%		86%	84%	78%	77%	85%	84%	77%	80%	84%	88%	85%	88%	84%	88%	83%	87%	90%	80%	84%	85%	83%
88.2%		90%	88%	92%	88%	92%	76%	96%	87%	92%	89%	94%	77%	92%	93%	88%	91%	87%	92%	80%	81%	87%
89.3%		96%	95%	88%	89%	92%	75%	94%	89%	89%	95%	94%	74%	92%	88%	91%	84%	82%	95%	83%	95%	95%
83.6%		93%	91%	96%	96%	89%	68%	81%	89%	95%	90%	87%	77%	85%	78%	96%	88%	70%	75%	52%	83%	76%
72.2%		78%	71%	69%	76%	91%	51%	72%	56%	75%	85%	79%	73%	76%	66%	84%	82%	63%	67%	57%	68%	77%
81.1%		86%	84%	84%	85%	81%	73%	84%	79%	81%	82%	83%	66%	79%	78%	78%	88%	81%	86%	83%	84%	78%
84.7%		84%	85%	83%	89%	92%	91%	87%	82%	82%	90%	95%	92%	89%	72%	77%	85%	88%	78%	67%	82%	89%
79.8%		74%	79%	82%	70%	75%	86%	78%	86%	68%	74%	78%	83%	77%	93%	73%	68%	77%	85%	97%	96%	77%
85.4%		84%	85%	81%	83%	94%	85%	96%	77%	76%	77%	91%	90%	87%	91%	86%	86%	93%	84%	76%	89%	82%
72.0%		77%	76%	67%	61%	83%	71%	77%	60%	66%	67%	74%	62%	77%	76%	78%	60%	70%	71%	84%	81%	75%
88.5%		94%	89%	90%	89%	91%	94%	90%	88%	83%	87%	93%	90%	93%	90%	75%	94%	82%	85%	88%	86%	88%
91.7%		96%	94%	96%	97%	94%	92%	98%	91%	94%	95%	91%	72%	85%	84%	97%	99%	83%	97%	91%	86%	94%
78.3%		89%	71%	78%	76%	78%	84%	83%	83%	79%	75%	81%	76%	81%	75%	75%	76%	80%	71%	82%	68%	84%