Analysis: Gd4 Dtef Global Dialogues Gd4 Environment%3Asuburban

Loading analysis results...

Please wait while we prepare the detailed comparison.

Loading blueprint versions...

Please wait while we gather all the unique runs for this blueprint.

	Claude Haiku 4.5	Gemini 2.5 Flash	Gemma 3 12b It	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o Mini
67.2%	70%	72%	56%	70%	74%	61%
63.3%	64%	76%	40%	70%	65%	65%
81.7%	80%	85%	83%	84%	80%	78%
80.5%	87%	78%	81%	80%	76%	81%
65.2%	74%	71%	57%	64%	64%	61%
88.0%	86%	90%	78%	89%	92%	93%
48.2%	65%	45%	42%	54%	33%	50%
83.0%	81%	79%	83%	75%	94%	86%
87.7%	91%	81%	93%	84%	90%	87%
83.7%	83%	64%	89%	84%	91%	91%
84.7%	85%	79%	80%	88%	88%	88%
85.2%	96%	86%	86%	91%	66%	86%
81.0%	81%	77%	88%	82%	85%	73%
74.5%	74%	80%	88%	69%	74%	62%
77.8%	75%	62%	78%	88%	82%	82%
77.8%	81%	94%	74%	77%	72%	69%
81.5%	91%	87%	75%	73%	86%	77%
89.8%	89%	94%	91%	92%	84%	89%
81.8%	85%	88%	84%	79%	70%	85%
77.7%	79%	75%	76%	78%	79%	79%
86.8%	92%	89%	84%	80%	80%	96%
84.7%	89%	92%	73%	89%	84%	81%
83.7%	75%	91%	80%	85%	91%	80%
58.3%	69%	63%	56%	60%	56%	46%
85.0%	82%	87%	88%	86%	87%	80%
63.7%	70%	64%	64%	67%	55%	62%
87.3%	83%	91%	88%	88%	90%	84%
75.2%	70%	80%	59%	81%	78%	83%
80.5%	87%	85%	74%	82%	79%	76%
82.3%	84%	91%	70%	88%	85%	76%
89.2%	87%	94%	85%	89%	90%	90%
87.3%	90%	90%	85%	81%	87%	91%
74.7%	73%	85%	74%	85%	71%	60%
68.5%	71%	85%	56%	69%	65%	65%
80.5%	81%	79%	85%	73%	81%	84%
84.3%	80%	89%	78%	89%	86%	84%
81.7%	83%	74%	89%	72%	91%	81%
81.5%	83%	77%	90%	81%	85%	73%
88.8%	89%	86%	88%	91%	89%	90%
70.7%	65%	65%	81%	76%	75%	62%
86.3%	94%	93%	79%	88%	73%	91%
86.5%	86%	89%	79%	87%	91%	87%
84.3%	86%	87%	71%	89%	91%	82%
70.8%	76%	73%	62%	69%	73%	72%
86.3%	89%	84%	91%	87%	82%	85%
82.7%	81%	89%	91%	81%	72%	82%
82.5%	94%	91%	71%	83%	73%	83%
84.3%	84%	84%	84%	84%	77%	93%
91.5%	95%	90%	94%	93%	86%	91%
88.0%	92%	92%	91%	83%	79%	91%
87.8%	94%	92%	85%	87%	77%	92%
70.5%	70%	78%	69%	72%	65%	69%
68.7%	69%	61%	61%	77%	72%	72%
64.3%	67%	70%	69%	61%	63%	56%
83.5%	77%	83%	82%	86%	84%	89%
86.3%	86%	87%	85%	85%	91%	84%
66.2%	74%	67%	55%	66%	68%	67%
90.7%	93%	87%	95%	95%	91%	83%
64.0%	74%	81%	51%	69%	49%	60%
82.3%	80%	78%	93%	80%	79%	84%
88.2%	93%	87%	83%	94%	90%	82%
69.2%	72%	75%	57%	69%	74%	68%
88.2%	92%	86%	96%	92%	76%	87%
91.8%	91%	93%	90%	91%	93%	93%
83.2%	77%	89%	76%	85%	93%	79%
81.7%	83%	91%	79%	84%	75%	78%
76.5%	77%	89%	63%	75%	83%	72%
75.0%	82%	71%	78%	78%	68%	73%
81.2%	79%	82%	86%	76%	81%	83%
89.0%	91%	87%	91%	93%	85%	87%
87.7%	92%	86%	88%	88%	86%	86%
84.5%	89%	66%	94%	88%	86%	84%
92.8%	94%	91%	93%	96%	92%	91%
73.0%	84%	75%	72%	71%	65%	71%
79.3%	85%	78%	82%	79%	76%	76%
80.5%	80%	80%	85%	81%	77%	80%
85.7%	89%	87%	89%	86%	74%	89%
85.2%	88%	85%	77%	88%	85%	88%
87.2%	88%	78%	89%	90%	89%	89%
84.5%	83%	84%	85%	85%	84%	86%
86.5%	87%	84%	84%	92%	87%	85%
86.2%	94%	96%	87%	91%	64%	85%
80.8%	85%	74%	87%	79%	80%	80%
82.3%	90%	95%	60%	81%	87%	81%
82.3%	83%	85%	81%	84%	77%	84%
87.5%	87%	88%	87%	87%	88%	88%
78.3%	83%	74%	86%	77%	69%	81%
75.0%	77%	75%	76%	78%	67%	77%
77.2%	87%	92%	92%	69%	51%	72%
81.5%	85%	75%	68%	83%	99%	79%
72.0%	68%	68%	76%	77%	74%	69%
50.2%	49%	62%	52%	48%	40%	50%
60.8%	71%	51%	57%	57%	61%	68%
86.2%	90%	91%	77%	87%	82%	90%
69.8%	73%	78%	74%	65%	60%	69%
83.2%	78%	77%	87%	86%	82%	89%
86.3%	88%	80%	94%	88%	79%	89%
85.3%	87%	70%	93%	89%	88%	85%
74.7%	80%	93%	56%	82%	65%	72%
80.0%	93%	90%	70%	84%	69%	74%
77.3%	76%	76%	80%	82%	71%	79%
84.7%	74%	89%	82%	87%	91%	85%
56.7%	68%	53%	56%	65%	39%	59%
81.0%	74%	83%	67%	82%	90%	90%
86.7%	95%	92%	76%	90%	78%	89%
84.3%	79%	98%	72%	97%	74%	86%
82.5%	90%	90%	71%	87%	79%	78%
60.0%	66%	72%	35%	68%	59%	60%
72.8%	80%	78%	67%	78%	59%	75%
85.5%	83%	91%	85%	92%	79%	83%
87.7%	83%	92%	93%	73%	93%	92%
77.0%	77%	89%	58%	83%	77%	78%
65.3%	69%	60%	62%	71%	61%	69%
87.3%	90%	74%	93%	89%	89%	89%
92.5%	88%	96%	96%	96%	82%	97%
84.0%	83%	87%	86%	83%	77%	88%

Prompts
vs.
Models

Claude Haiku 4.5

Gemini 2.5 Flash

Gemma 3 12b It

GPT 4.1 Mini

GPT 4.1 Nano

GPT 4o Mini

Score

1st

81.9%

2nd

81.5%

5th

77.6%

3rd

81.0%

6th

77.5%

4th

79.4%

67.2%

70%

72%

56%

70%

74%

61%

63.3%

64%

76%

40%

70%

65%

81.7%

80%

85%

83%

84%

80%

78%

80.5%

87%

78%

81%

80%

76%

81%

65.2%

74%

71%

57%

64%

61%

88.0%

86%

90%

78%

89%

92%

93%

48.2%

65%

45%

42%

54%

33%

50%

83.0%

81%

79%

83%

75%

94%

86%

87.7%

91%

81%

93%

84%

90%

87%

83.7%

83%

64%

89%

84%

91%

84.7%

85%

79%

80%

88%

85.2%

96%

86%

91%

66%

86%

81.0%

81%

77%

88%

82%

85%

73%

74.5%

74%

80%

88%

69%

74%

62%

77.8%

75%

62%

78%

88%

82%

77.8%

81%

94%

74%

77%

72%

69%

81.5%

91%

87%

75%

73%

86%

77%

89.8%

89%

94%

91%

92%

84%

89%

81.8%

85%

88%

84%

79%

70%

85%

77.7%

79%

75%

76%

78%

79%

86.8%

92%

89%

84%

80%

96%

84.7%

89%

92%

73%

89%

84%

81%

83.7%

75%

91%

80%

85%

91%

80%

58.3%

69%

63%

56%

60%

56%

46%

85.0%

82%

87%

88%

86%

87%

80%

63.7%

70%

64%

67%

55%

62%

87.3%

83%

91%

88%

90%

84%

75.2%

70%

80%

59%

81%

78%

83%

80.5%

87%

85%

74%

82%

79%

76%

82.3%

84%

91%

70%

88%

85%

76%

89.2%

87%

94%

85%

89%

90%

87.3%

90%

85%

81%

87%

91%

74.7%

73%

85%

74%

85%

71%

60%

68.5%

71%

85%

56%

69%

65%

80.5%

81%

79%

85%

73%

81%

84%

84.3%

80%

89%

78%

89%

86%

84%

81.7%

83%

74%

89%

72%

91%

81%

81.5%

83%

77%

90%

81%

85%

73%

88.8%

89%

86%

88%

91%

89%

90%

70.7%

65%

81%

76%

75%

62%

86.3%

94%

93%

79%

88%

73%

91%

86.5%

86%

89%

79%

87%

91%

87%

84.3%

86%

87%

71%

89%

91%

82%

70.8%

76%

73%

62%

69%

73%

72%

86.3%

89%

84%

91%

87%

82%

85%

82.7%

81%

89%

91%

81%

72%

82%

82.5%

94%

91%

71%

83%

73%

83%

84.3%

84%

77%

93%

91.5%

95%

90%

94%

93%

86%

91%

88.0%

92%

91%

83%

79%

91%

87.8%

94%

92%

85%

87%

77%

92%

70.5%

70%

78%

69%

72%

65%

69%

68.7%

69%

61%

77%

72%

64.3%

67%

70%

69%

61%

63%

56%

83.5%

77%

83%

82%

86%

84%

89%

86.3%

86%

87%

85%

91%

84%

66.2%

74%

67%

55%

66%

68%

67%

90.7%

93%

87%

95%

91%

83%

64.0%

74%

81%

51%

69%

49%

60%

82.3%

80%

78%

93%

80%

79%

84%

88.2%

93%

87%

83%

94%

90%

82%

69.2%

72%

75%

57%

69%

74%

68%

88.2%

92%

86%

96%

92%

76%

87%

91.8%

91%

93%

90%

91%

93%

83.2%

77%

89%

76%

85%

93%

79%

81.7%

83%

91%

79%

84%

75%

78%

76.5%

77%

89%

63%

75%

83%

72%

75.0%

82%

71%

78%

68%

73%

81.2%

79%

82%

86%

76%

81%

83%

89.0%

91%

87%

91%

93%

85%

87%

87.7%

92%

86%

88%

86%

84.5%

89%

66%

94%

88%

86%

84%

92.8%

94%

91%

93%

96%

92%

91%

73.0%

84%

75%

72%

71%

65%

71%

79.3%

85%

78%

82%

79%

76%

80.5%

80%

85%

81%

77%

80%

85.7%

89%

87%

89%

86%

74%

89%

85.2%

88%

85%

77%

88%

85%

88%

87.2%

88%

78%

89%

90%

89%

84.5%

83%

84%

85%

84%

86%

86.5%

87%

84%

92%

87%

85%

86.2%

94%

96%

87%

91%

64%

85%

80.8%

85%

74%

87%

79%

80%

82.3%

90%

95%

60%

81%

87%

81%

82.3%

83%

85%

81%

84%

77%

84%

87.5%

87%

88%

87%

88%

78.3%

83%

74%

86%

77%

69%

81%

75.0%

77%

75%

76%

78%

67%

77%

77.2%

87%

92%

69%

51%

72%

81.5%

85%

75%

68%

83%

99%

79%

72.0%

68%

76%

77%

74%

69%

50.2%

49%

62%

52%

48%

40%

50%

60.8%

71%

51%

57%

61%

68%

86.2%

90%

91%

77%

87%

82%

90%

69.8%

73%

78%

74%

65%

60%

69%

83.2%

78%

77%

87%

86%

82%

89%

86.3%

88%

80%

94%

88%

79%

89%

85.3%

87%

70%

93%

89%

88%

85%

74.7%

80%

93%

56%

82%

65%

72%

80.0%

93%

90%

70%

84%

69%

74%

77.3%

76%

80%

82%

71%

79%

84.7%

74%

89%

82%

87%

91%

85%

56.7%

68%

53%

56%

65%

39%

59%

81.0%

74%

83%

67%

82%

90%

86.7%

95%

92%

76%

90%

78%

89%

84.3%

79%

98%

72%

97%

74%

86%

82.5%

90%

71%

87%

79%

78%

60.0%

66%

72%

35%

68%

59%

60%

72.8%

80%

78%

67%

78%

59%

75%

85.5%

83%

91%

85%

92%

79%

83%

87.7%

83%

92%

93%

73%

93%

92%

77.0%

77%

89%

58%

83%

77%

78%

65.3%

69%

60%

62%

71%

61%

69%

87.3%

90%

74%

93%

89%

92.5%

88%

96%

82%

97%

84.0%

83%

87%

86%

83%

77%

88%

DTeval

Global Dialogues GD4 - Suburban

Best Models (Coverage)

Macro Coverage Overview

Pro Tip

	Claude Haiku 4.5	Gemini 2.5 Flash	Gemma 3 12b It	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o Mini
Score	1st 81.9%	2nd 81.5%	5th 77.6%	3rd 81.0%	6th 77.5%	4th 79.4%
67.2%	70%	72%	56%	70%	74%	61%
63.3%	64%	76%	40%	70%	65%	65%
81.7%	80%	85%	83%	84%	80%	78%
80.5%	87%	78%	81%	80%	76%	81%
65.2%	74%	71%	57%	64%	64%	61%
88.0%	86%	90%	78%	89%	92%	93%
48.2%	65%	45%	42%	54%	33%	50%
83.0%	81%	79%	83%	75%	94%	86%
87.7%	91%	81%	93%	84%	90%	87%
83.7%	83%	64%	89%	84%	91%	91%
84.7%	85%	79%	80%	88%	88%	88%
85.2%	96%	86%	86%	91%	66%	86%
81.0%	81%	77%	88%	82%	85%	73%
74.5%	74%	80%	88%	69%	74%	62%
77.8%	75%	62%	78%	88%	82%	82%
77.8%	81%	94%	74%	77%	72%	69%
81.5%	91%	87%	75%	73%	86%	77%
89.8%	89%	94%	91%	92%	84%	89%
81.8%	85%	88%	84%	79%	70%	85%
77.7%	79%	75%	76%	78%	79%	79%
86.8%	92%	89%	84%	80%	80%	96%
84.7%	89%	92%	73%	89%	84%	81%
83.7%	75%	91%	80%	85%	91%	80%
58.3%	69%	63%	56%	60%	56%	46%
85.0%	82%	87%	88%	86%	87%	80%
63.7%	70%	64%	64%	67%	55%	62%
87.3%	83%	91%	88%	88%	90%	84%
75.2%	70%	80%	59%	81%	78%	83%
80.5%	87%	85%	74%	82%	79%	76%
82.3%	84%	91%	70%	88%	85%	76%
89.2%	87%	94%	85%	89%	90%	90%
87.3%	90%	90%	85%	81%	87%	91%
74.7%	73%	85%	74%	85%	71%	60%
68.5%	71%	85%	56%	69%	65%	65%
80.5%	81%	79%	85%	73%	81%	84%
84.3%	80%	89%	78%	89%	86%	84%
81.7%	83%	74%	89%	72%	91%	81%
81.5%	83%	77%	90%	81%	85%	73%
88.8%	89%	86%	88%	91%	89%	90%
70.7%	65%	65%	81%	76%	75%	62%
86.3%	94%	93%	79%	88%	73%	91%
86.5%	86%	89%	79%	87%	91%	87%
84.3%	86%	87%	71%	89%	91%	82%
70.8%	76%	73%	62%	69%	73%	72%
86.3%	89%	84%	91%	87%	82%	85%
82.7%	81%	89%	91%	81%	72%	82%
82.5%	94%	91%	71%	83%	73%	83%
84.3%	84%	84%	84%	84%	77%	93%
91.5%	95%	90%	94%	93%	86%	91%
88.0%	92%	92%	91%	83%	79%	91%
87.8%	94%	92%	85%	87%	77%	92%
70.5%	70%	78%	69%	72%	65%	69%
68.7%	69%	61%	61%	77%	72%	72%
64.3%	67%	70%	69%	61%	63%	56%
83.5%	77%	83%	82%	86%	84%	89%
86.3%	86%	87%	85%	85%	91%	84%
66.2%	74%	67%	55%	66%	68%	67%
90.7%	93%	87%	95%	95%	91%	83%
64.0%	74%	81%	51%	69%	49%	60%
82.3%	80%	78%	93%	80%	79%	84%
88.2%	93%	87%	83%	94%	90%	82%
69.2%	72%	75%	57%	69%	74%	68%
88.2%	92%	86%	96%	92%	76%	87%
91.8%	91%	93%	90%	91%	93%	93%
83.2%	77%	89%	76%	85%	93%	79%
81.7%	83%	91%	79%	84%	75%	78%
76.5%	77%	89%	63%	75%	83%	72%
75.0%	82%	71%	78%	78%	68%	73%
81.2%	79%	82%	86%	76%	81%	83%
89.0%	91%	87%	91%	93%	85%	87%
87.7%	92%	86%	88%	88%	86%	86%
84.5%	89%	66%	94%	88%	86%	84%
92.8%	94%	91%	93%	96%	92%	91%
73.0%	84%	75%	72%	71%	65%	71%
79.3%	85%	78%	82%	79%	76%	76%
80.5%	80%	80%	85%	81%	77%	80%
85.7%	89%	87%	89%	86%	74%	89%
85.2%	88%	85%	77%	88%	85%	88%
87.2%	88%	78%	89%	90%	89%	89%
84.5%	83%	84%	85%	85%	84%	86%
86.5%	87%	84%	84%	92%	87%	85%
86.2%	94%	96%	87%	91%	64%	85%
80.8%	85%	74%	87%	79%	80%	80%
82.3%	90%	95%	60%	81%	87%	81%
82.3%	83%	85%	81%	84%	77%	84%
87.5%	87%	88%	87%	87%	88%	88%
78.3%	83%	74%	86%	77%	69%	81%
75.0%	77%	75%	76%	78%	67%	77%
77.2%	87%	92%	92%	69%	51%	72%
81.5%	85%	75%	68%	83%	99%	79%
72.0%	68%	68%	76%	77%	74%	69%
50.2%	49%	62%	52%	48%	40%	50%
60.8%	71%	51%	57%	57%	61%	68%
86.2%	90%	91%	77%	87%	82%	90%
69.8%	73%	78%	74%	65%	60%	69%
83.2%	78%	77%	87%	86%	82%	89%
86.3%	88%	80%	94%	88%	79%	89%
85.3%	87%	70%	93%	89%	88%	85%
74.7%	80%	93%	56%	82%	65%	72%
80.0%	93%	90%	70%	84%	69%	74%
77.3%	76%	76%	80%	82%	71%	79%
84.7%	74%	89%	82%	87%	91%	85%
56.7%	68%	53%	56%	65%	39%	59%
81.0%	74%	83%	67%	82%	90%	90%
86.7%	95%	92%	76%	90%	78%	89%
84.3%	79%	98%	72%	97%	74%	86%
82.5%	90%	90%	71%	87%	79%	78%
60.0%	66%	72%	35%	68%	59%	60%
72.8%	80%	78%	67%	78%	59%	75%
85.5%	83%	91%	85%	92%	79%	83%
87.7%	83%	92%	93%	73%	93%	92%
77.0%	77%	89%	58%	83%	77%	78%
65.3%	69%	60%	62%	71%	61%	69%
87.3%	90%	74%	93%	89%	89%	89%
92.5%	88%	96%	96%	96%	82%	97%
84.0%	83%	87%	86%	83%	77%	88%