	Claude Haiku 4.5	Claude Sonnet 4	Claude Sonnet 4.5	Gemini 2.5 Flash	Gemma 3 12b It	Llama 4 Maverick	Mistral Medium 3	GPT 4.1	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o Mini	Qwen3 30b A3B Instruct 2507	Qwen3 Next 80b A3B Instruct
Score	3rd 57.3%	1st 58.3%	2nd 58.2%	4th 56.3%	8th 54.2%	6th 55.0%	11th 53.8%	7th 54.8%	9th 54.1%	5th 55.0%	12th 53.6%	13th 53.4%	10th 54.1%
45.8%	68%	55%	55%	34%	50%	50%	43%	32%	50%	43%	43%	34%	39%
70.1%	62%	79%	71%	62%	64%	75%	63%	70%	64%	75%	75%	75%	76%
76.7%	80%	83%	77%	83%	84%	79%	87%	85%	69%	69%	71%	61%	69%
51.7%	48%	57%	51%	48%	53%	47%	47%	47%	50%	53%	58%	54%	59%
38.5%	42%	46%	35%	28%	43%	27%	31%	32%	38%	43%	54%	45%	37%
33.4%	30%	29%	31%	32%	34%	36%	32%	34%	37%	46%	34%	34%	25%
74.2%	76%	82%	70%	77%	71%	72%	77%	79%	77%	71%	77%	70%	66%
68.0%	65%	100%	67%	100%	48%	51%	59%	77%	37%	59%	44%	100%	77%
73.5%	77%	82%	81%	55%	70%	69%	80%	74%	76%	73%	73%	71%	74%
52.8%	54%	60%	68%	56%	54%	49%	58%	57%	49%	55%	46%	41%	40%
41.4%	45%	34%	44%	53%	36%	39%	42%	45%	44%	46%	34%	38%	38%
67.5%	63%	68%	68%	68%	59%	58%	52%	64%	79%	79%	79%	80%	60%
50.8%	61%	63%	66%	72%	10%	51%	41%	53%	59%	51%	37%	37%	59%
53.4%	51%	56%	51%	50%	56%	56%	58%	55%	49%	56%	56%	51%	49%
52.2%	55%	56%	62%	44%	57%	55%	54%	51%	48%	56%	50%	45%	45%
65.3%	64%	73%	64%	70%	66%	63%	61%	66%	61%	64%	65%	71%	61%
52.2%	57%	52%	52%	54%	46%	56%	55%	55%	50%	55%	45%	53%	49%
62.3%	63%	61%	69%	67%	68%	64%	62%	69%	66%	51%	54%	47%	69%
32.2%	43%	20%	35%	38%	29%	30%	29%	28%	35%	28%	28%	28%	47%
66.1%	68%	66%	73%	66%	68%	74%	66%	69%	63%	69%	63%	57%	57%
60.4%	61%	60%	54%	60%	64%	57%	56%	63%	58%	60%	58%	66%	68%
52.8%	59%	59%	60%	52%	50%	58%	57%	55%	50%	52%	47%	45%	42%
70.2%	71%	68%	77%	77%	77%	77%	81%	68%	58%	68%	59%	64%	68%
50.0%	46%	50%	39%	52%	56%	52%	43%	50%	48%	52%	56%	52%	54%
51.2%	54%	56%	56%	53%	58%	51%	48%	50%	44%	53%	51%	46%	45%
83.1%	90%	88%	87%	82%	90%	78%	76%	80%	83%	74%	83%	83%	86%
57.6%	59%	67%	62%	60%	50%	64%	62%	52%	55%	57%	50%	55%	56%
49.8%	52%	53%	61%	56%	50%	48%	51%	53%	43%	50%	43%	42%	45%
57.6%	62%	62%	57%	59%	59%	62%	54%	58%	55%	56%	58%	53%	54%
44.5%	49%	34%	47%	47%	45%	45%	42%	42%	44%	39%	51%	38%	55%
61.6%	66%	60%	73%	51%	39%	78%	62%	67%	60%	62%	62%	56%	65%
29.0%	30%	35%	32%	22%	26%	21%	27%	28%	33%	32%	33%	28%	30%
52.5%	52%	58%	67%	55%	51%	50%	55%	61%	48%	55%	48%	44%	39%
58.4%	61%	62%	49%	57%	75%	57%	54%	57%	58%	50%	63%	58%	58%
32.3%	30%	30%	37%	37%	37%	30%	30%	30%	30%	33%	22%	30%	44%
56.2%	48%	62%	62%	60%	63%	54%	54%	56%	58%	59%	59%	50%	45%
70.9%	70%	69%	72%	69%	69%	66%	70%	75%	74%	69%	73%	71%	75%
28.4%	32%	20%	33%	23%	27%	18%	22%	20%	28%	37%	26%	45%	38%
44.5%	46%	43%	38%	49%	53%	44%	43%	39%	42%	46%	48%	46%	41%
59.4%	60%	66%	62%	65%	66%	62%	56%	58%	57%	57%	56%	56%	51%
49.5%	48%	51%	46%	49%	47%	52%	55%	49%	50%	50%	50%	50%	47%
55.2%	60%	59%	65%	63%	45%	55%	59%	57%	49%	58%	45%	50%	53%
35.1%	35%	38%	39%	46%	34%	23%	30%	32%	34%	31%	31%	44%	39%
39.8%	51%	51%	51%	28%	47%	47%	36%	34%	47%	34%	33%	33%	26%
64.7%	67%	66%	64%	73%	59%	71%	56%	60%	65%	70%	65%	59%	66%
60.4%	59%	51%	53%	68%	54%	58%	60%	51%	68%	69%	64%	68%	62%
37.6%	50%	36%	50%	28%	27%	35%	32%	25%	49%	32%	40%	32%	53%
62.4%	67%	63%	63%	64%	67%	75%	61%	65%	61%	64%	54%	59%	48%
57.2%	64%	60%	62%	60%	50%	57%	60%	58%	50%	62%	55%	50%	55%
65.7%	70%	70%	68%	74%	66%	61%	64%	67%	66%	51%	64%	66%	67%
64.6%	62%	74%	70%	67%	65%	67%	66%	63%	62%	55%	65%	62%	62%
61.3%	69%	61%	62%	58%	63%	61%	53%	58%	65%	64%	64%	53%	66%
82.7%	74%	90%	90%	77%	77%	87%	85%	94%	81%	77%	83%	87%	73%
48.9%	50%	54%	47%	43%	53%	47%	47%	44%	50%	50%	50%	50%	51%