	Claude 3.7 Sonnet	Claude Haiku 4.5	Claude Sonnet 4	Claude Sonnet 4.5	Gemini 2.5 Flash	Gemma 3 12b It	Llama 4 Maverick	Mistral Large 2411	Mistral Medium 3	GPT 4.1	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o	GPT 4o Mini	GPT 5	GPT 5.1	GPT OSS 120b	GPT OSS 20b	Qwen3 30b A3B Instruct 2507	Qwen3 32b	Grok 4
Score	4th 77.4%	8th 76.0%	5th 77.2%	3rd 77.7%	16th 73.8%	21st 70.0%	14th 75.2%	9th 76.0%	7th 76.1%	12th 75.3%	13th 75.3%	18th 73.2%	11th 75.7%	15th 74.2%	2nd 77.7%	1st 78.1%	19th 73.1%	20th 71.0%	17th 73.6%	10th 75.9%	6th 76.6%
83.1%	81%	90%	87%	87%	77%	85%	83%	86%	86%	78%	89%	78%	87%	59%	86%	90%	87%	69%	90%	78%	92%
75.0%	73%	83%	78%	77%	56%	75%	78%	77%	63%	80%	78%	94%	81%	86%	76%	74%	59%	69%	80%		62%
56.5%	59%	59%	50%	57%	62%	54%	54%	54%	46%	59%	54%	46%	59%	84%	59%	59%	59%	54%	46%	54%	59%
79.3%	77%	75%	81%	82%	79%	71%	86%	75%	78%	83%	77%	86%	80%	64%	73%	82%	82%	83%	86%	86%
90.5%	92%	88%	92%	92%	88%	88%	87%	95%	95%	95%	88%	88%	88%	88%	95%	95%	88%	88%	88%	88%	95%
86.6%	90%	85%	85%	91%	85%	87%	85%	93%	84%	90%	84%	85%	85%	85%	94%	82%	81%	91%	79%	84%	94%
83.3%	90%	82%	84%	90%	76%	71%	80%	87%	87%	82%	76%	73%	86%	85%	86%	93%	91%	86%	76%	85%	83%
67.3%	62%	73%	62%	77%	66%	45%	64%	71%	64%	71%	60%	68%	69%	55%	77%	78%	78%	69%	58%		80%
70.8%	69%	44%	66%	66%	82%	63%	69%	84%	77%	74%	76%	76%	68%	61%	76%	76%	70%	76%	67%	76%	71%
81.7%	86%	86%	83%	85%	86%	86%	85%	70%	79%	80%	81%	73%	88%	86%	88%	86%	78%	68%	86%	68%	88%
67.5%	70%	79%	79%	79%	73%	70%	73%	76%	64%	62%	73%	59%	59%	62%	76%	74%	43%	41%	63%	75%
68.3%	68%	77%	78%	77%	68%	72%	68%	70%	68%	60%	68%	68%	60%	72%	68%	68%	65%	59%	78%	54%	69%
71.2%	75%	74%	74%	72%	68%	70%	76%	68%	71%	72%	68%	68%	74%	68%	72%	71%	75%	68%	68%	77%	66%
77.9%	78%	80%	75%	73%	79%	74%	72%	79%	79%	78%	81%	76%	78%	81%	73%	80%	82%	83%	80%	80%	75%
81.0%	82%	83%	81%	86%	83%	88%	81%	83%	81%	82%	82%	79%	82%	83%	79%	78%	79%	69%	78%	83%	79%
80.9%	86%	89%	76%	86%	68%	92%	92%	83%	86%	76%	86%	73%	86%	72%	86%	88%	79%	49%	79%	82%	85%
77.1%	81%	79%	72%	80%	72%	75%	84%	78%	84%	78%	69%	81%	77%	80%	81%	73%	69%	75%	84%	70%	77%
64.5%	68%	57%	63%	63%	61%	67%	61%	66%	65%	65%	64%	64%	61%	68%	69%	66%	67%	66%	57%	68%	68%
49.9%	49%	40%	50%	40%	65%	34%	44%	45%	61%	52%	45%	30%	53%	53%	66%	74%	61%	49%	34%	60%	42%
72.2%	76%	71%	74%	76%	72%	75%	70%	76%	76%	73%	73%	53%	78%	78%	60%	76%	72%	67%	72%	72%	76%
78.0%	82%	77%	90%	90%	78%	76%	72%	74%	74%	82%	74%	78%	75%	81%	78%	82%	78%	75%	73%	74%	76%
73.0%	69%	72%	73%	73%	78%	67%	73%	80%	70%	73%	76%	83%	71%	78%	77%	72%	69%	64%	68%		74%
60.6%	51%	56%	60%	58%	75%	76%	56%	59%	67%	70%	74%	44%	67%	77%	49%	53%	53%	47%	62%		58%
74.6%	78%	86%	82%	68%	68%	79%	80%	87%	84%	71%	75%	68%	75%	68%	77%	80%	68%	68%	68%	68%	68%
85.2%	91%	85%	82%	82%	81%	82%	85%	81%	87%	89%	85%	82%	91%	91%	87%	90%	81%	80%	81%	90%	87%
74.9%	79%	76%	83%	83%	79%	73%	81%	68%	73%	81%	78%	73%	73%	61%	80%	78%	68%	68%	74%	75%	69%
66.9%	76%	56%	69%	73%	72%	63%	60%	73%	66%	65%	53%	73%	60%	60%	72%	62%	70%	74%	59%	73%	76%
68.4%	66%	65%	69%	69%	77%	47%	70%	74%	74%	67%	63%	66%	73%	71%	74%	73%	68%	66%	63%	67%	74%
65.9%	74%	89%	80%	75%	64%	59%	86%	72%	68%	54%	63%	44%	53%	59%	64%	62%	49%	50%	80%	64%	74%
72.2%	77%	79%	68%	75%	62%	56%	75%	79%	71%	71%	72%	75%	65%	75%	72%	66%	74%	83%	79%		69%
83.7%	84%	79%	76%	76%	84%	72%	77%	87%	85%	85%	85%	89%	89%	89%	86%	86%	85%	87%	82%	88%	86%
77.0%	69%	69%	76%	73%	91%	57%	73%	86%	91%	69%	76%	91%	91%	57%	69%	69%	69%	91%	91%	91%	69%
64.8%	76%	57%	61%	62%	66%	66%	66%	62%	61%	73%	66%	57%	66%	57%	74%	73%	63%	59%	57%	66%	73%
72.8%	85%	70%	73%	80%	69%	73%	63%	79%	77%	71%	67%	80%	61%	61%	83%	77%	77%	71%	62%	67%	83%
73.3%	84%	83%	85%	85%	49%	66%	57%	62%	76%	65%	64%	65%	77%	85%	81%	82%	80%	64%	84%	64%	81%
68.6%	78%	72%	76%	72%	74%	67%	73%	67%	64%	72%	73%	76%	68%	69%	71%	64%	64%	62%	57%	61%	61%
89.2%	83%	100%	95%	84%	90%	70%	85%	85%	94%	90%	89%	89%	90%	85%	94%	100%	91%	84%	83%	100%	92%
91.8%	95%	95%	100%	96%	94%	88%	95%	94%	91%	92%	95%	88%	95%	88%	94%	94%	79%	76%	88%	96%	94%
86.5%	92%	82%	100%	92%	70%	69%	90%	92%	91%	92%	91%	80%	86%	95%	88%	92%	76%	84%	84%	75%	95%
85.5%	82%	81%	91%	90%	91%	66%	94%	89%	91%	82%	91%	91%	91%	66%	82%	82%	82%	91%	91%	91%	81%
72.9%	76%	76%	76%	76%	65%	52%	71%	64%	77%	82%	76%	57%	82%	70%	76%	76%	78%	74%	65%	82%	80%
82.6%	88%	84%	84%	84%	75%	62%	86%	75%	75%	82%	88%	88%	84%	88%	88%	88%	86%	77%	88%	79%	86%
78.6%	80%	87%	80%	87%	55%	83%	72%	62%	72%	72%	93%	93%	72%	90%	87%	96%	72%	78%	76%	72%	72%

Model Similarity Dendrogram

Hierarchical clustering of models based on response similarity. Models grouped closer are more similar.