	Claude 3.7 Sonnet	Claude Haiku 4.5	Claude Sonnet 4	Claude Sonnet 4.5	Gemini 2.5 Flash	Gemma 3 12b It	Llama 4 Maverick	Mistral Large 2411	Mistral Medium 3	GPT 4.1	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o	GPT 4o Mini	GPT 5	GPT 5.1	GPT OSS 120b	GPT OSS 20b	Qwen3 30b A3B Instruct 2507	Qwen3 32b	Grok 4
Score	11th 64.7%	6th 65.9%	3rd 67.2%	5th 66.5%	17th 60.6%	18th 60.5%	7th 65.3%	8th 65.2%	14th 64.0%	1st 67.5%	12th 64.6%	20th 59.7%	10th 64.8%	15th 61.5%	2nd 67.4%	4th 67.1%	16th 60.7%	19th 59.9%	21st 59.7%	9th 64.9%	13th 64.2%
65.1%	68%	68%	68%	68%	52%	77%	64%	65%	59%	77%	68%	68%	68%	54%	67%	68%	68%	58%	61%	53%	68%
37.5%	28%	36%	51%	25%	8%	55%	40%	46%	36%	31%	31%	28%	51%	78%	40%	36%	25%	33%	40%	51%	18%
80.2%		83%	71%	80%	80%	80%	84%	76%	75%	83%	80%	71%	80%	89%	83%	83%	83%	80%	80%	80%	83%
61.7%	64%	55%	64%	55%	64%	55%	65%	76%	64%	64%	55%	55%	55%	71%	56%	65%	71%	71%	55%	65%	51%
92.2%	91%	87%	100%	100%	87%	87%	100%	100%	100%	100%	87%	87%	87%	87%	100%	97%	89%	87%	87%	87%	89%
81.4%	70%	70%	70%	70%	81%	100%	89%	77%	81%	76%	89%	89%	89%	86%	76%	76%	89%	86%	76%	89%	81%
45.2%	58%	51%	51%	54%	25%	33%	44%	55%	55%	44%	40%	53%	44%	32%	55%	54%	49%	46%	32%	32%	43%
50.0%	54%	54%	65%	61%	42%	42%	42%	58%	42%	61%	42%	51%	42%	37%	61%	63%	42%	39%	42%	54%	55%
59.7%	50%	55%	59%	58%	70%	61%	67%	59%	67%	55%	59%	58%	58%	55%	56%	56%	53%	48%	70%	70%	70%
56.8%	55%	80%	61%	61%	55%	55%	46%	46%	51%	61%	55%	66%	55%	55%	55%	64%	46%	50%	55%	55%	66%
54.6%		52%	56%	60%	60%	53%	72%	65%	53%	53%	52%	62%	53%	38%	59%	55%	60%	38%	60%	69%	21%
70.6%	70%	75%	71%	71%	80%	56%	75%	71%	71%	80%	75%	80%	65%	75%	63%	69%	65%	55%	71%	65%	80%
77.2%	74%	72%	72%	72%	74%	85%	100%	74%	74%	74%	74%	75%	74%	74%	74%	86%	86%	79%	74%	74%	80%
41.6%	48%	48%	48%	48%	34%	58%	46%	47%	46%	44%	48%	32%	48%	32%	40%	43%	34%	35%	32%	34%	28%
49.8%	55%	55%	55%	55%	55%	46%	51%	46%	41%	51%	51%	55%	55%	55%	51%	51%	51%	37%	55%	37%	37%
53.9%	55%	55%	63%	55%	48%	55%	56%	48%	48%	55%	55%	51%	55%	48%	55%	63%	48%	48%	56%	56%	58%
69.4%		75%	75%	76%	66%	54%	76%	38%	60%	75%	76%	76%	45%	64%	76%	76%	76%	72%	76%	68%	89%
65.6%	65%	71%	75%	75%	58%	75%	70%	65%	56%	71%	70%	68%	77%	56%	65%	71%	56%	54%	58%	65%	56%
50.9%	58%	45%	53%	50%	48%	48%	64%	45%	56%	75%	50%	24%	53%	43%	65%	64%	30%	30%	34%	58%	75%
60.1%	68%	57%	70%	75%	49%	49%	10%	64%	64%	78%	58%	78%	64%	58%	58%	68%	61%	66%	35%	75%	58%
68.7%	74%	75%	69%	70%	72%	72%	75%	83%	75%	70%	75%	72%	75%	71%	62%	74%	42%	42%	87%	65%	42%
67.7%	67%	64%	67%	67%	67%	75%	67%	64%	75%	67%	64%	64%	76%	64%	71%	67%	64%	79%	64%	64%	65%
46.0%	44%	45%	50%	44%	45%	35%	51%	48%	52%	48%	51%	37%	35%	57%	44%	50%	45%	44%	48%	51%	41%
73.9%	74%	86%	72%	72%	74%	74%	74%	64%	72%	74%	74%	74%	74%	74%	75%	74%	74%	74%	74%	74%	74%
47.6%	58%	58%	45%	45%	34%	32%	61%	54%	45%	48%	42%	39%	45%	34%	56%	48%	51%	34%	39%	64%	67%
67.1%	75%	63%	72%	72%	72%	54%	72%	65%	65%	87%	77%	54%	61%	54%	80%	68%	61%	57%	56%	77%	67%
57.0%	56%	51%	56%	56%	56%	56%	56%	56%	64%	54%	51%	49%	54%	54%	56%	56%	56%	67%	62%	76%	56%
67.1%	70%	64%	70%	70%	67%	55%	64%	100%	65%	80%	64%	35%	69%	34%	100%	67%	64%	60%	64%	48%	100%
58.7%	67%	86%	75%	86%	60%	51%	64%	54%	54%	47%	37%	37%	37%	46%	66%	74%	54%	44%	54%	64%	75%
77.8%		88%	75%	71%	65%	88%	76%	75%	75%	76%	100%	75%	88%	100%	76%	78%	76%	75%	67%	75%	56%
65.3%	66%	66%	66%	66%	67%	88%	66%	77%	66%	66%	66%	66%	66%	66%	56%	56%	66%	66%	37%	66%	66%
66.3%		65%	71%	71%	61%	50%	61%	78%	71%	65%	61%	61%	61%	61%	65%	65%	71%	81%	61%	81%	65%
65.9%		67%	68%	68%	50%	50%	68%	63%	68%	68%	68%	59%	68%	77%	68%	68%	68%	68%	68%	68%	68%
57.6%	67%	55%	58%	67%	65%	49%	49%	63%	63%	55%	49%	49%	55%	55%	64%	70%	49%	67%	45%	56%	60%
66.0%	90%	69%	69%	86%	40%	54%	54%	72%	75%	89%	54%	40%	85%	66%	89%	75%	53%	54%	69%		37%
70.0%	72%	75%	66%	66%	66%	75%	65%	65%	60%	80%	74%	81%	86%	59%	72%	71%	54%	61%	68%	75%	80%
68.8%	76%	66%	65%	61%	66%	66%	78%	58%	78%	74%	66%	66%	78%	72%	78%	77%	60%	66%	62%	66%	66%
85.5%		87%	100%	87%	87%	87%	87%	89%	87%	87%	90%	84%	87%	87%	84%	81%	66%	80%	87%		81%
57.6%	63%	54%	63%	51%	81%	52%	54%	66%	51%	63%	63%	34%	63%	47%	60%	71%	51%	61%	45%	51%	66%
88.8%		90%	100%	100%	81%	81%	100%	100%	95%	90%	100%	80%	90%	80%	90%	90%	90%	68%	80%	81%	90%
51.1%	55%	48%	55%	55%	61%	19%	65%	56%	65%	56%	66%	41%	55%	29%	55%	55%	55%	48%	21%	58%	56%
83.8%	94%	94%	86%	86%	83%	53%	83%	86%	75%	83%	81%	53%	86%	94%	94%	88%	86%	94%	86%	86%	88%
70.3%		72%	72%	72%	51%	61%	58%	47%	58%	66%	89%	89%	76%	75%	82%	55%	72%	73%	72%	76%	89%

Model Similarity Dendrogram

Hierarchical clustering of models based on response similarity. Models grouped closer are more similar.