Analysis: Strawberry - Run 24267e6...

Loading analysis results...

Please wait while we prepare the detailed comparison.

Loading blueprint versions...

Please wait while we gather all the unique runs for this blueprint.

	Claude Opus 4.1	Deepseek Chat V3	Gemini 2.5 Pro	Meta Llama 3.1 405b Instruct Turbo	Mistral Medium 3	GPT 5	Qwen3 32b	Grok 4
25.0%	0%	100%	0%	100%	0%	0%	0%	0%
62.5%	100%	100%	0%	50%	50%	100%	50%	50%
18.8%	0%	50%	0%	0%	0%	0%	0%	100%
62.5%	100%	100%	0%	0%	100%	100%	0%	100%
56.3%	100%	50%	0%	50%	50%	50%	50%	100%
50.0%	100%	50%	0%	0%	100%	50%	0%	100%
50.0%	50%	50%	100%	0%	0%	50%	100%	50%
25.0%	100%	0%	0%	0%	0%	0%	50%	50%
50.0%	100%	100%	50%	0%	100%	0%	0%	50%
31.3%	100%	0%	50%	0%	0%	0%	100%	0%
25.0%	0%	0%	100%	0%	50%	0%	50%	0%
50.0%	100%	50%	100%	0%	100%	0%	50%	0%
81.3%	50%	100%	100%	0%	100%	100%	100%	100%
12.5%	0%	0%	0%	0%	50%	0%	0%	50%
25.0%	100%	0%	0%	0%	100%	0%	0%	0%
18.8%	0%	0%	50%	0%	100%	0%	0%	0%
25.0%	0%	0%	0%	0%	100%	0%	100%	0%
25.0%	0%	0%	100%	100%	0%	0%	0%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	0%	50%	0%
6.3%	0%	0%	0%	50%	0%	0%	0%	0%
12.5%	0%	0%	50%	0%	0%	0%	50%	0%
18.8%	100%	0%	0%	0%	0%	0%	50%	0%
87.5%	100%	100%	100%	0%	100%	100%	100%	100%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
18.8%	0%	0%	50%	0%	50%	0%	50%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
18.8%	100%	0%	0%	0%	0%	0%	50%	0%
12.5%	0%	0%	0%	0%	50%	50%	0%	0%
12.5%	0%	0%	50%	0%	50%	0%	0%	0%
12.5%	0%	0%	50%	0%	0%	50%	0%	0%
43.8%	100%	0%	0%	0%	100%	50%	50%	50%
31.3%	50%	50%	0%	0%	50%	100%	0%	0%
12.5%	0%	0%	0%	0%	0%	50%	50%	0%
87.5%	100%	100%	100%	0%	100%	100%	100%	100%
37.5%	0%	50%	50%	50%	50%	0%	100%	0%
12.5%	100%	0%	0%	0%	0%	0%	0%	0%
12.5%	0%	0%	0%	0%	50%	0%	50%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
18.8%	50%	50%	0%	0%	0%	50%	0%	0%
18.8%	100%	0%	0%	0%	0%	0%	0%	50%
25.0%	50%	50%	50%	0%	0%	0%	50%	0%
6.3%	0%	0%	0%	0%	0%	0%	50%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
25.0%	100%	100%	0%	0%	0%	0%	0%	0%
87.5%	100%	100%	100%	0%	100%	100%	100%	100%
18.8%	100%	0%	0%	50%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
18.8%	50%	0%	50%	0%	0%	0%	0%	50%
12.5%	50%	0%	0%	0%	50%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
18.8%	50%	0%	100%	0%	0%	0%	0%	0%
81.3%	100%	100%	0%	50%	100%	100%	100%	100%
25.0%	100%	0%	0%	0%	0%	100%	0%	0%
18.8%	0%	0%	0%	0%	0%	0%	50%	100%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
31.3%	100%	0%	0%	0%	0%	50%	0%	100%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
6.3%	0%	0%	0%	0%	0%	0%	0%	50%
93.8%	100%	100%	50%	100%	100%	100%	100%	100%
7.1%	0%	0%	0%	0%	0%	0%		50%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
12.5%	0%	0%	0%	0%	0%	0%	0%	100%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
12.5%	50%	0%	50%	0%	0%	0%	0%	0%
81.3%	100%	100%	0%	50%	100%	100%	100%	100%
31.3%	100%	0%	50%	0%	0%	0%	0%	100%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
75.0%	100%	100%	0%	100%	100%	100%	0%	100%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%		0%

Prompts
vs.
Models

Claude Opus 4.1

Deepseek Chat V3

Gemini 2.5 Pro

Meta Llama 3.1 405b Instruct Turbo

Mistral Medium 3

GPT 5

Qwen3 32b

Grok 4

Score

1st

33.0%

4th

19.5%

7th

18.0%

8th

7.5%

2nd

24.0%

6th

19.0%

5th

19.4%

3rd

21.0%

25.0%

100%

62.5%

100%

50%

100%

50%

18.8%

50%

100%

62.5%

100%

56.3%

100%

50%

100%

50.0%

100%

50%

100%

50%

100%

50.0%

50%

100%

50%

100%

50%

25.0%

100%

50%

50.0%

100%

50%

100%

50%

31.3%

100%

50%

100%

25.0%

100%

50%

50.0%

100%

50%

100%

50%

81.3%

50%

100%

12.5%

50%

25.0%

100%

18.8%

50%

100%

25.0%

100%

25.0%

100%

6.3%

50%

6.3%

50%

6.3%

50%

12.5%

50%

18.8%

100%

50%

87.5%

100%

0.0%

18.8%

50%

0.0%

18.8%

100%

50%

12.5%

50%

12.5%

50%

12.5%

50%

43.8%

100%

50%

31.3%

50%

100%

12.5%

50%

87.5%

100%

37.5%

50%

100%

12.5%

100%

12.5%

50%

6.3%

50%

18.8%

50%

18.8%

100%

50%

25.0%

50%

6.3%

50%

6.3%

50%

25.0%

100%

87.5%

100%

18.8%

100%

50%

6.3%

50%

18.8%

50%

12.5%

50%

6.3%

50%

6.3%

50%

6.3%

50%

0.0%

6.3%

50%

18.8%

50%

100%

81.3%

100%

50%

100%

25.0%

100%

18.8%

50%

100%

6.3%

50%

31.3%

100%

50%

100%

0.0%

6.3%

50%

0.0%

6.3%

50%

6.3%

50%

93.8%

100%

50%

100%

7.1%

50%

6.3%

50%

0.0%

12.5%

100%

6.3%

50%

0.0%

6.3%

50%

6.3%

50%

6.3%

50%

12.5%

50%

81.3%

100%

50%

100%

31.3%

100%

50%

100%

0.0%

6.3%

50%

6.3%

50%

0.0%

6.3%

50%

0.0%

75.0%

100%

6.3%

50%

6.3%

50%

6.3%

50%

0.0%

6.3%

50%

0.0%

6.3%

50%

0.0%

weval

🍓 Strawberry

Best Models (Coverage across 2 temperatures)

Macro Coverage Overview

Pro Tip

	Claude Opus 4.1	Deepseek Chat V3	Gemini 2.5 Pro	Meta Llama 3.1 405b Instruct Turbo	Mistral Medium 3	GPT 5	Qwen3 32b	Grok 4
Score	1st 33.0%	4th 19.5%	7th 18.0%	8th 7.5%	2nd 24.0%	6th 19.0%	5th 19.4%	3rd 21.0%
25.0%	0%	100%	0%	100%	0%	0%	0%	0%
62.5%	100%	100%	0%	50%	50%	100%	50%	50%
18.8%	0%	50%	0%	0%	0%	0%	0%	100%
62.5%	100%	100%	0%	0%	100%	100%	0%	100%
56.3%	100%	50%	0%	50%	50%	50%	50%	100%
50.0%	100%	50%	0%	0%	100%	50%	0%	100%
50.0%	50%	50%	100%	0%	0%	50%	100%	50%
25.0%	100%	0%	0%	0%	0%	0%	50%	50%
50.0%	100%	100%	50%	0%	100%	0%	0%	50%
31.3%	100%	0%	50%	0%	0%	0%	100%	0%
25.0%	0%	0%	100%	0%	50%	0%	50%	0%
50.0%	100%	50%	100%	0%	100%	0%	50%	0%
81.3%	50%	100%	100%	0%	100%	100%	100%	100%
12.5%	0%	0%	0%	0%	50%	0%	0%	50%
25.0%	100%	0%	0%	0%	100%	0%	0%	0%
18.8%	0%	0%	50%	0%	100%	0%	0%	0%
25.0%	0%	0%	0%	0%	100%	0%	100%	0%
25.0%	0%	0%	100%	100%	0%	0%	0%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	0%	50%	0%
6.3%	0%	0%	0%	50%	0%	0%	0%	0%
12.5%	0%	0%	50%	0%	0%	0%	50%	0%
18.8%	100%	0%	0%	0%	0%	0%	50%	0%
87.5%	100%	100%	100%	0%	100%	100%	100%	100%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
18.8%	0%	0%	50%	0%	50%	0%	50%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
18.8%	100%	0%	0%	0%	0%	0%	50%	0%
12.5%	0%	0%	0%	0%	50%	50%	0%	0%
12.5%	0%	0%	50%	0%	50%	0%	0%	0%
12.5%	0%	0%	50%	0%	0%	50%	0%	0%
43.8%	100%	0%	0%	0%	100%	50%	50%	50%
31.3%	50%	50%	0%	0%	50%	100%	0%	0%
12.5%	0%	0%	0%	0%	0%	50%	50%	0%
87.5%	100%	100%	100%	0%	100%	100%	100%	100%
37.5%	0%	50%	50%	50%	50%	0%	100%	0%
12.5%	100%	0%	0%	0%	0%	0%	0%	0%
12.5%	0%	0%	0%	0%	50%	0%	50%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
18.8%	50%	50%	0%	0%	0%	50%	0%	0%
18.8%	100%	0%	0%	0%	0%	0%	0%	50%
25.0%	50%	50%	50%	0%	0%	0%	50%	0%
6.3%	0%	0%	0%	0%	0%	0%	50%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
25.0%	100%	100%	0%	0%	0%	0%	0%	0%
87.5%	100%	100%	100%	0%	100%	100%	100%	100%
18.8%	100%	0%	0%	50%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
18.8%	50%	0%	50%	0%	0%	0%	0%	50%
12.5%	50%	0%	0%	0%	50%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
18.8%	50%	0%	100%	0%	0%	0%	0%	0%
81.3%	100%	100%	0%	50%	100%	100%	100%	100%
25.0%	100%	0%	0%	0%	0%	100%	0%	0%
18.8%	0%	0%	0%	0%	0%	0%	50%	100%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
31.3%	100%	0%	0%	0%	0%	50%	0%	100%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	50%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
6.3%	0%	0%	0%	0%	0%	0%	0%	50%
93.8%	100%	100%	50%	100%	100%	100%	100%	100%
7.1%	0%	0%	0%	0%	0%	0%		50%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
12.5%	0%	0%	0%	0%	0%	0%	0%	100%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
12.5%	50%	0%	50%	0%	0%	0%	0%	0%
81.3%	100%	100%	0%	50%	100%	100%	100%	100%
31.3%	100%	0%	50%	0%	0%	0%	0%	100%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
6.3%	0%	0%	50%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
75.0%	100%	100%	0%	100%	100%	100%	0%	100%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
6.3%	50%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	0%	50%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%	0%	0%
6.3%	0%	0%	0%	0%	50%	0%	0%	0%
0.0%	0%	0%	0%	0%	0%	0%		0%