Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
Evaluates a model's understanding of the Proceratosaurus Wikipedia article, focusing on its classification, physical characteristics, historical context, and paleoenvironment.
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3 Haiku 20240307 | Gemini 2.5 Flash | Gemini Flash 1.5 | Llama 3 8b Instruct | Mistral 7b Instruct V0.3 | GPT 4o Mini | |
|---|---|---|---|---|---|---|---|
| Score | 3rd 19.8% | 1st 40.5% | 2nd 24.0% | 5th 13.4% | 5th 13.4% | 4th 16.4% | |
| 27.7% | 20% | 43% | 40% | 20% | 23% | 20% | |
| 10.3% | 13% | 32% | 13% | 0% | 4% | 0% | |
| 21.8% | 21% | 29% | 27% | 7% | 25% | ||
| 19.0% | 17% | 42% | 23% | 0% | 13% | 19% | |
| 24.3% | 28% | 45% | 15% | 20% | 20% | 18% |