	Claude 3.7 Sonnet	Claude Haiku 4.5	Claude Sonnet 4	Claude Sonnet 4.5	Gemini 2.5 Flash	Gemma 3 12b It	Llama 4 Maverick	Mistral Large 2411	Mistral Medium 3	GPT 4.1	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o	GPT 4o Mini	GPT 5	GPT 5.1	GPT OSS 120b	GPT OSS 20b	Qwen3 30b A3B Instruct 2507	Qwen3 32b	Grok 4
Score	7th 67.6%	16th 64.9%	11th 67.0%	1st 68.9%	14th 65.6%	21st 58.1%	10th 67.1%	5th 67.8%	4th 67.8%	9th 67.1%	17th 62.9%	20th 60.7%	12th 66.6%	18th 62.8%	3rd 68.1%	2nd 68.4%	15th 65.3%	6th 67.7%	19th 61.8%	13th 66.3%	8th 67.2%
68.3%		65%	76%	76%	61%	69%	76%	65%	63%	69%	69%	63%	69%	66%	68%	70%	69%	67%	65%	72%	69%
64.0%		75%	52%	64%	42%	56%	68%	75%	75%	66%	58%	63%	52%	79%	65%	75%	58%	77%	58%	58%
60.4%		68%	50%	68%	40%	40%	68%	64%	59%	68%	59%	77%	59%	40%	68%	68%	68%	59%	59%	59%	68%
76.9%	88%	81%	70%	70%	70%	75%	70%	76%	81%	88%	75%	75%	75%	78%	88%	78%	86%	75%	70%	75%	70%
93.1%		89%	100%	100%	89%	89%	89%	99%	89%	100%	89%	89%	89%	89%	100%	100%	95%	89%	89%	89%	100%
84.7%		84%	87%	87%	64%	59%	87%	87%	87%	80%	87%	88%	80%	85%	100%	96%	81%	87%	100%	81%	87%
68.5%		71%	71%	71%	71%	58%	71%	69%	71%	62%	58%	71%	71%	58%	80%	71%	71%	75%	64%	68%
68.7%		70%	61%	63%	61%	70%	75%	87%	85%	61%	75%	61%	70%	74%	73%	63%	61%	61%	78%	61%	64%
75.5%		67%	64%	64%	77%	61%	77%	72%	70%	80%	77%	80%	80%	80%	78%	83%	78%	92%	77%	73%	81%
74.3%	75%	67%	84%	77%	77%	75%	77%	58%	75%	77%	77%	75%	75%	75%	77%	76%	70%	68%	75%	75%	76%
57.9%		71%	64%	64%	66%	61%	64%	71%	55%	55%	48%	65%	58%	43%	53%	54%	43%	46%	40%	73%	64%
62.3%		64%	68%	68%	67%	58%	54%	60%	66%	54%	66%	67%	61%	61%	61%	66%	57%	59%	61%	61%	67%
62.8%		65%	58%	58%	59%	58%	58%	68%	70%	58%	68%	68%	70%	68%	61%	67%	64%	60%	68%	70%	41%
70.3%		70%	71%	85%	54%	68%	70%	79%	85%	65%	54%	63%	85%	58%	83%	79%	60%	63%	85%	64%	65%
49.2%		51%	47%	47%	53%	64%	53%	56%	53%	53%	59%	59%	53%	59%	48%	50%	25%	39%	25%	25%	65%
76.7%		70%	83%	70%	100%	56%	64%	70%	74%	80%	70%	61%	86%	86%	76%	72%	100%	97%	70%	70%	79%
61.6%		55%	66%	66%	72%	61%	50%	55%	65%	61%	72%	55%	55%	64%	64%	62%	46%	51%	61%		89%
66.8%		55%	72%	72%	75%	72%	55%	55%	60%	75%	72%	45%	72%	72%	73%	72%	72%	68%	55%	72%	72%
57.6%	61%	52%	52%	63%	72%	62%	53%	56%	68%	61%	52%	38%	56%	63%	72%	60%	70%	42%	50%	63%	43%
59.1%	69%	60%	64%	64%	71%	60%	71%	64%	66%	66%	61%	46%	58%	86%	61%	49%	63%	57%	34%	37%	34%
59.1%		54%	66%	66%	59%	59%	54%	58%	51%	61%	44%	65%	61%	61%	62%	57%	61%	62%	59%	61%	61%
73.3%		66%	70%	69%	58%	69%	70%	87%	66%	70%	63%	70%	70%	66%	74%	76%	90%	84%	78%	85%	85%
62.1%	77%	66%	67%	77%	28%	33%	77%	59%	59%	56%	65%	72%	51%	59%	65%	70%	65%	70%	65%	65%	59%
62.9%		65%	58%	70%	68%	68%	58%	58%	58%	68%	58%	54%	68%	68%	63%	64%	68%	65%	58%	68%	53%
49.8%		48%	40%	56%	40%	32%	48%	54%	48%	54%	48%	51%	54%	50%	53%	50%	51%	51%	54%		65%
52.8%		70%	45%	51%	51%	43%	61%	61%	51%	45%	61%	51%	43%	43%	44%	59%	43%	48%	70%	50%	65%
64.9%		53%	70%	70%	83%	48%	61%	70%	70%	61%	39%	61%	70%	47%	70%	61%	82%	75%	64%		79%
61.8%		64%	67%	70%	70%	45%	65%	69%	63%	63%	65%	40%	65%	50%	72%	65%	46%	63%	55%	63%	75%
70.5%	67%	73%	68%	76%	67%	68%	67%	74%	67%	90%	72%	72%	67%	68%	68%	68%	67%	67%	67%	72%	76%
73.2%		75%	74%	74%	100%	49%	72%	77%	74%	72%	75%	74%	75%	74%	76%	69%	75%	82%	58%	75%	64%
43.8%		40%	40%	40%	55%	40%	51%	55%	63%	40%	40%	40%	51%	40%	34%	48%	44%	49%	32%	40%	34%
58.2%		51%	61%	61%	80%	24%	58%	74%	71%	51%	61%	40%	80%	40%	51%		51%	80%	40%	80%	51%
45.2%		45%	48%	48%	40%	40%	76%	46%	40%	40%	40%	56%	40%	40%	45%	45%	45%		40%	40%	45%
39.4%	49%	29%	41%	44%	56%	37%	29%	37%	37%	37%	37%	37%	37%	36%	45%	42%	49%	47%	27%	38%	37%
45.9%	46%	53%	53%	53%	22%	44%	31%	60%	57%	31%	38%	43%	47%	44%	46%	57%	36%	43%	53%	46%	61%
76.3%		75%	84%	83%	61%	59%	83%	71%	75%	87%	85%	59%	85%	70%	77%	82%	88%	80%	70%	78%	75%
65.7%		58%	69%	58%	74%	75%	71%	71%	69%	100%	40%	40%	67%	59%	66%	73%	56%	63%	58%	71%	76%
90.5%		87%	100%	100%	87%	89%	100%	79%	100%	87%	87%	89%	89%	89%	91%	92%	78%	97%	89%	89%
72.9%		72%	86%	92%	87%	61%	72%	75%	72%	70%	64%	58%	79%	58%	79%	74%	74%	80%	58%	72%	75%
76.5%		78%	90%	90%	59%	80%	90%	90%	90%	78%	59%	59%	59%	59%	78%	78%	78%	99%	59%	80%	78%
69.3%		71%	74%	69%	75%	46%	89%	71%	72%	87%	79%	37%	79%	47%	68%	79%	71%	66%	71%	66%	69%
75.9%	76%	76%	77%	77%	72%	57%	77%	77%	72%	84%	76%	75%	77%	74%	76%	79%	78%	77%	77%	77%	83%
72.7%		72%	72%	72%	89%	60%	76%	56%	75%	75%	61%	58%	75%	75%	76%	72%	75%	64%	72%	89%	89%

Model Similarity Dendrogram

Hierarchical clustering of models based on response similarity. Models grouped closer are more similar.