Analysis: Gd5 C10 Dtef Global Dialogues Gd5 Country%3Ajapan C10

Loading analysis results...

Please wait while we prepare the detailed comparison.

Loading blueprint versions...

Please wait while we gather all the unique runs for this blueprint.

Prompts
vs.
Models

Claude 3.7 Sonnet

Claude Haiku 4.5

Claude Sonnet 4

Claude Sonnet 4.5

Gemini 2.5 Flash

Gemma 3 12b It

Llama 4 Maverick

Mistral Large 2411

Mistral Medium 3

GPT 4.1

GPT 4.1 Mini

GPT 4.1 Nano

GPT 4o

GPT 4o Mini

GPT 5 Mini

GPT 5.1

GPT OSS 120b

GPT OSS 20b

Qwen3 30b A3B Instruct 2507

Qwen3 Next 80b A3B Instruct

Grok 4.1 Fast

Score

3rd

70.2%

5th

69.6%

4th

70.0%

2nd

71.7%

16th

65.8%

19th

63.5%

13th

67.0%

7th

69.4%

11th

67.8%

10th

68.4%

8th

69.3%

21st

60.4%

9th

68.5%

15th

66.5%

6th

69.6%

1st

71.8%

20th

63.3%

18th

63.6%

17th

65.2%

14th

66.8%

12th

67.0%

70.0%

70%

68%

70%

69%

70%

67%

65%

73%

69%

73%

70%

68%

77%

71%

69%

65%

73%

53.6%

68%

62%

58%

63%

73%

31%

37%

59%

55%

50%

41%

53%

51%

56%

57%

66%

63%

41%

39%

62%

75.9%

81%

73%

81%

91%

79%

68%

79%

81%

69%

79%

67%

71%

75%

79%

64%

69%

79%

74%

76%

100.0%

100%

75.2%

75%

76%

82%

78%

76%

84%

75%

92%

82%

92%

48%

78%

60%

59%

89%

63%

72%

80%

64%

54.9%

62%

41%

48%

56%

61%

58%

56%

62%

55%

57%

54%

63%

60%

63%

44%

57%

54%

65%

63%

22%

51%

61.1%

68%

62%

63%

60%

69%

63%

62%

57%

64%

59%

63%

50%

63%

58%

59%

63%

54%

60%

63%

60%

41.5%

49%

37%

49%

42%

77%

25%

42%

44%

48%

36%

19%

36%

33%

67%

70%

31%

22%

38%

33%

68.2%

72%

84%

78%

72%

62%

64%

75%

88%

72%

74%

72%

43%

68%

47%

53%

72%

57%

72%

62%

68%

78%

55.2%

58%

48%

55%

49%

48%

58%

56%

59%

65%

64%

46%

53%

49%

68%

58%

63%

53%

50%

55%

56%

65.4%

75%

74%

75%

68%

83%

68%

60%

63%

60%

57%

69%

62%

68%

54%

64%

69%

54%

52%

68%

62%

63.9%

56%

70%

75%

73%

59%

69%

71%

59%

64%

71%

50%

59%

66%

67%

56%

66%

68%

61%

64.0%

67%

62%

61%

72%

67%

92%

79%

70%

79%

64%

58%

67%

59%

64%

67%

60%

30%

48%

67%

45%

100.0%

100%

54.7%

58%

61%

58%

53%

43%

47%

59%

54%

52%

69%

56%

57%

61%

63%

50%

48%

55%

40%

77.0%

71%

84%

73%

84%

91%

84%

69%

74%

69%

66%

76%

91%

76%

80%

76%

58%

75%

83%

84%

76%

48.8%

50%

47%

44%

50%

53%

42%

47%

50%

56%

29%

53%

50%

48%

47%

50%

56%

62.1%

63%

69%

61%

64%

75%

52%

53%

66%

64%

61%

64%

44%

66%

67%

65%

48%

56%

64%

69%

78.7%

77%

81%

87%

88%

78%

64%

72%

80%

81%

90%

74%

59%

80%

75%

80%

78%

73%

82%

93%

59.4%

64%

65%

60%

67%

56%

57%

55%

59%

57%

65%

51%

69%

62%

61%

64%

32%

63%

60%

55%

61%

74.5%

83%

78%

68%

82%

61%

62%

81%

83%

81%

66%

61%

78%

80%

81%

86%

78%

72%

74%

78%

69%

75.4%

84%

77%

84%

91%

29%

83%

72%

80%

82%

79%

82%

60%

87%

64%

81%

76%

82%

68%

70%

88%

64%

65.4%

67%

56%

62%

72%

57%

77%

67%

62%

52%

57%

98%

62%

64%

67%

63%

67%

70%

67%

57%

67%

43.8%

41%

43%

46%

47%

30%

37%

47%

45%

36%

45%

40%

45%

40%

41%

63%

57%

40%

37%

39%

50%

75.2%

82%

79%

76%

83%

82%

77%

79%

77%

79%

87%

77%

60%

82%

74%

76%

82%

69%

46%

65%

82%

66%

78.8%

87%

84%

78%

92%

82%

79%

72%

63%

80%

76%

71%

74%

78%

83%

80%

82%

55%

70.8%

69%

64%

81%

82%

52%

54%

80%

78%

62%

81%

69%

45%

79%

89%

82%

81%

52%

51%

58%

84%

93%

74.8%

63%

83%

75%

42%

76%

86%

76%

66%

67%

89%

70%

86%

77%

92%

74%

73%

89%

62%

64%

82.4%

87%

94%

87%

82%

10%

57%

98%

82%

92%

87%

88%

92%

81%

83%

87%

67%

87%

98%

60.0%

58%

75%

62%

59%

52%

69%

52%

60%

66%

58%

60%

76%

68%

59%

55%

48%

43%

69%

76.2%

69%

74%

73%

80%

69%

80%

69%

74%

70%

69%

82%

84%

81%

80%

76%

73%

81%

94%

69%

54.3%

63%

55%

60%

59%

51%

50%

57%

53%

51%

57%

55%

51%

50%

55%

61%

57%

46%

51%

57%

60.7%

71%

56%

54%

55%

65%

53%

62%

67%

63%

42%

61%

60%

65%

71%

53%

55%

63%

64%

75.7%

75%

79%

62%

75%

79%

73%

68%

75%

86%

81%

79%

81%

79%

75%

68%

75%

63%

79%

72.0%

79%

66%

76%

79%

71%

80%

70%

69%

76%

67%

69%

60%

70%

72%

62%

56%

79%

70%

87%

81.1%

77%

76%

80%

90%

78%

88%

89%

90%

84%

82%

73%

80%

78%

86%

89%

81%

78%

76%

80%

69%

79.0%

82%

81%

82%

83%

74%

75%

83%

81%

75%

81%

84%

83%

77%

59%

84%

72%

81%

80%

45.3%

48%

46%

42%

34%

35%

49%

43%

44%

51%

40%

33%

59%

41%

47%

41%

48%

56%

47%

42%

49%

56%

59.6%

62%

63%

64%

58%

60%

47%

69%

62%

68%

67%

57%

62%

58%

63%

68%

39%

50%

56%

59%

55%

62.4%

53%

75%

67%

61%

50%

67%

50%

58%

53%

47%

81%

61%

70%

67%

61%

58%

57%

81%

71%

61%

69.3%

75%

81%

78%

79%

65%

79%

84%

74%

69%

89%

75%

29%

67%

53%

58%

69%

61%

72%

64%

53%

81%

70.3%

73%

79%

78%

79%

59%

72%

73%

70%

79%

70%

69%

73%

72%

75%

62%

72%

58%

61%

76%

70%

56%

64.3%

78%

65%

73%

83%

89%

38%

44%

72%

65%

63%

56%

48%

69%

60%

69%

64%

57%

60%

69%

60.9%

63%

58%

69%

65%

56%

49%

62%

56%

54%

63%

69%

44%

61%

56%

65%

69%

61%

72%

61%

63%

67.4%

70%

74%

73%

55%

69%

71%

57%

66%

70%

82%

62%

54%

67%

75%

81%

54%

66%

67%

68%

62%

71.4%

86%

78%

80%

74%

64%

67%

80%

74%

75%

64%

75%

65%

64%

68%

70%

65%

69%

64%

DTeval

Global Dialogues GD5 - Japan (10 context Qs)

Best Models (Coverage)

Macro Coverage Overview

Pro Tip

	Claude 3.7 Sonnet	Claude Haiku 4.5	Claude Sonnet 4	Claude Sonnet 4.5	Gemini 2.5 Flash	Gemma 3 12b It	Llama 4 Maverick	Mistral Large 2411	Mistral Medium 3	GPT 4.1	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o	GPT 4o Mini	GPT 5 Mini	GPT 5.1	GPT OSS 120b	GPT OSS 20b	Qwen3 30b A3B Instruct 2507	Qwen3 Next 80b A3B Instruct	Grok 4.1 Fast
Score	3rd 70.2%	5th 69.6%	4th 70.0%	2nd 71.7%	16th 65.8%	19th 63.5%	13th 67.0%	7th 69.4%	11th 67.8%	10th 68.4%	8th 69.3%	21st 60.4%	9th 68.5%	15th 66.5%	6th 69.6%	1st 71.8%	20th 63.3%	18th 63.6%	17th 65.2%	14th 66.8%	12th 67.0%
70.0%	70%	70%	68%	70%	69%	70%	67%	67%	65%	73%	73%	69%	73%	73%	70%	68%	77%	71%	69%	65%	73%
53.6%	68%	62%	58%	63%	73%	31%	37%	59%	55%	50%	41%	41%	53%	51%	56%	57%	66%	63%	41%	39%	62%
75.9%	81%	73%	81%	91%	79%	68%	79%	79%	81%	69%	79%	67%	71%	75%	79%	79%	64%	69%	79%	74%	76%
100.0%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%
75.2%	75%	75%	76%	82%	78%	76%	84%	75%	92%	82%	92%	48%	78%	60%	59%	89%	63%	72%	80%	80%	64%
54.9%	62%	41%	48%	56%	61%	58%	56%	62%	55%	57%	54%	63%	60%	63%	44%	57%	54%	65%	63%	22%	51%
61.1%	68%	62%	63%	60%	69%	63%	62%	57%	64%	59%	63%	50%	63%	58%	59%	63%	54%	60%	63%	63%	60%
41.5%	49%	37%	49%	42%	77%	25%	42%	42%	44%	48%	36%	19%	36%	33%	67%	70%	31%	31%	22%	38%	33%
68.2%	72%	84%	78%	72%	62%	64%	75%	88%	72%	74%	72%	43%	68%	47%	53%	72%	57%	72%	62%	68%	78%
55.2%	58%	48%	48%	55%	49%	48%	58%	56%	59%	65%	64%	46%	53%	49%	68%	58%	63%	53%	50%	55%	56%
65.4%	75%	74%	75%	68%	83%	68%	60%	63%	60%	57%	69%	62%	68%	54%	64%	69%	54%	52%	68%	68%	62%
63.9%	56%	70%	75%	73%	59%	69%	71%	59%	59%	64%	71%	50%	59%	66%	66%	67%	56%	56%	66%	68%	61%
64.0%	67%	62%	61%	72%	67%	92%	79%	70%	79%	64%	58%	67%	67%	59%	64%	67%	60%	30%	48%	67%	45%
100.0%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%
54.7%	58%	61%	58%	58%	53%	43%	47%	59%	54%	52%	69%	56%	57%	57%	61%	63%	50%	50%	48%	55%	40%
77.0%	71%	84%	73%	84%	91%	84%	69%	74%	69%	66%	76%	91%	76%	80%	76%	76%	58%	75%	83%	84%	76%
48.8%	50%	47%	44%	50%	53%	42%	47%	47%	47%	50%	56%	29%	53%	53%	53%	53%	50%	48%	47%	50%	56%
62.1%	63%	69%	61%	64%	75%	52%	53%	66%	64%	61%	64%	44%	66%	66%	67%	67%	65%	48%	56%	64%	69%
78.7%	77%	81%	87%	88%	78%	64%	72%	80%	81%	90%	74%	59%	80%	75%	80%	80%	80%	78%	73%	82%	93%
59.4%	64%	64%	65%	60%	67%	56%	57%	55%	59%	57%	65%	51%	69%	62%	61%	64%	32%	63%	60%	55%	61%
74.5%	83%	78%	68%	82%	61%	62%	62%	81%	83%	81%	66%	61%	78%	80%	81%	86%	78%	72%	74%	78%	69%
75.4%	84%	77%	84%	91%	29%	83%	72%	80%	82%	79%	82%	60%	87%	64%	81%	76%	82%	68%	70%	88%	64%
65.4%	67%	56%	62%	72%	57%	77%	67%	62%	62%	52%	57%	98%	62%	64%	67%	63%	67%	70%	67%	57%	67%
43.8%	41%	43%	46%	47%	30%	37%	47%	45%	36%	45%	40%	45%	40%	41%	63%	57%	40%	37%	39%	50%	50%
75.2%	82%	79%	76%	83%	82%	77%	79%	77%	79%	87%	77%	60%	82%	74%	76%	82%	69%	46%	65%	82%	66%
78.8%	87%	84%	84%	84%	78%	78%	92%	92%	82%	79%	72%	63%	80%	76%	71%	74%	78%	83%	80%	82%	55%
70.8%	69%	64%	81%	82%	52%	54%	80%	78%	62%	81%	69%	45%	79%	89%	82%	81%	52%	51%	58%	84%	93%
74.8%	63%	83%	75%	75%	42%	76%	86%	76%	66%	67%	89%	70%	86%	86%	77%	92%	74%	73%	89%	62%	64%
82.4%	87%	94%	87%	87%	82%	10%	57%	98%	82%	92%	92%	92%	87%	88%	92%	81%	83%	87%	67%	87%	98%
60.0%	58%	75%	62%	62%	59%	52%	52%	69%	52%	60%	66%	58%	58%	60%	76%	68%	59%	55%	48%	43%	69%
76.2%	69%	74%	73%	80%	69%	80%	80%	69%	74%	74%	70%	69%	82%	84%	81%	80%	76%	73%	81%	94%	69%
54.3%	63%	55%	60%	59%	51%	50%	57%	53%	51%	57%	55%	51%	51%	50%	55%	61%	57%	46%	51%	51%	57%
60.7%	71%	56%	54%	55%	65%	53%	62%	62%	62%	67%	63%	42%	61%	60%	65%	71%	71%	53%	55%	63%	64%
75.7%	75%	79%	79%	79%	62%	75%	79%	79%	73%	68%	75%	86%	81%	79%	81%	79%	75%	68%	75%	63%	79%
72.0%	79%	66%	76%	79%	71%	80%	70%	69%	76%	76%	67%	69%	60%	70%	72%	62%	56%	79%	79%	70%	87%
81.1%	77%	76%	80%	80%	90%	78%	88%	89%	90%	84%	82%	73%	80%	78%	86%	89%	81%	78%	76%	80%	69%
79.0%	82%	81%	82%	83%	74%	75%	83%	81%	75%	75%	81%	84%	83%	83%	83%	77%	59%	84%	72%	81%	80%
45.3%	48%	46%	42%	34%	35%	49%	43%	44%	51%	40%	33%	59%	41%	47%	41%	48%	56%	47%	42%	49%	56%
59.6%	62%	63%	64%	64%	58%	60%	47%	69%	62%	68%	67%	57%	62%	58%	63%	68%	39%	50%	56%	59%	55%
62.4%	53%	75%	67%	61%	50%	67%	50%	58%	53%	47%	81%	61%	61%	70%	67%	61%	58%	57%	81%	71%	61%
69.3%	75%	81%	78%	79%	65%	79%	84%	74%	69%	89%	75%	29%	67%	53%	58%	69%	61%	72%	64%	53%	81%
70.3%	73%	79%	78%	79%	59%	72%	73%	70%	79%	70%	69%	73%	72%	75%	62%	72%	58%	61%	76%	70%	56%
64.3%	78%	65%	73%	83%	89%	38%	44%	72%	65%	63%	56%	48%	69%	60%	69%	69%	64%	57%	60%	60%	69%
60.9%	63%	58%	69%	65%	56%	49%	62%	56%	54%	63%	69%	44%	61%	56%	65%	69%	61%	72%	61%	63%	63%
67.4%	70%	74%	73%	73%	55%	69%	71%	57%	66%	70%	82%	62%	54%	67%	75%	81%	54%	66%	67%	68%	62%
71.4%	86%	78%	80%	74%	64%	67%	80%	74%	74%	74%	75%	64%	75%	65%	64%	68%	70%	65%	69%	69%	64%