Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint tests for the 'Cautious' trait, a measure of Epistemic Humility. A high score indicates the model frequently qualifies its statements, acknowledges uncertainty, highlights the limitations of its knowledge, and uses hedging language (e.g., 'might', 'could', 'generally').
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4 | Claude Opus 4.1 | Claude Sonnet 4 | Command A | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o 2024 05 13 | GPT 4o 2024 08 06 | GPT 4o 2024 11 20 | GPT 4o Mini | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 12th 64.3% | 4th 72.6% | 26th 48.9% | 8th 68.5% | 11th 64.5% | 21st 55.8% | 15th 61.4% | 20th 56.6% | 14th 62.7% | 5th 70.1% | 7th 68.6% | 22nd 53.1% | 25th 49.0% | 24th 50.1% | 19th 56.6% | 13th 63.2% | 29th 46.4% | 33rd 41.9% | 9th 66.2% | 27th 47.8% | 2nd 78.2% | 10th 64.8% | 6th 69.3% | 28th 47.7% | 30th 45.5% | 3rd 74.1% | 32nd 43.9% | 18th 57.7% | 1st 80.3% | 31st 44.6% | 17th 57.9% | 23rd 52.2% | 16th 58.7% | |
| 90.8% | 99% | 96% | 93% | 98% | 100% | 95% | 99% | 72% | 94% | 86% | 96% | 98% | 99% | 100% | 98% | 67% | 99% | 60% | 96% | 97% | 96% | 97% | 95% | 92% | 90% | 89% | 83% | 94% | 99% | 44% | 80% | 99% | 98% | |
| 98.3% | 97% | 99% | 97% | 96% | 96% | 96% | 100% | 100% | 100% | 96% | 98% | 100% | 96% | 100% | 98% | 100% | 98% | 100% | 98% | 98% | 98% | 97% | 96% | 98% | 98% | 100% | 100% | 100% | 99% | 99% | 100% | 97% | 99% | |
| 25.3% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 25% | 34% | 25% | 25% | 25% | 25% | |
| 77.3% | 80% | 86% | 81% | 84% | 85% | 76% | 75% | 60% | 85% | 80% | 81% | 82% | 82% | 69% | 72% | 75% | 68% | 65% | 68% | 75% | 70% | 71% | 75% | 71% | 75% | 89% | 55% | 85% | 98% | 83% | 84% | 77% | 95% | |
| 50.4% | 38% | 38% | 39% | 40% | 38% | 38% | 49% | 44% | 55% | 38% | 38% | 66% | 32% | 63% | 95% | 40% | 35% | 42% | 79% | 34% | 88% | 33% | 61% | 31% | 23% | 88% | 39% | 87% | 49% | 47% | 50% | 40% | 88% | |
| 32.5% | 51% | 75% | 0% | 62% | 48% | 27% | 40% | 48% | 36% | 77% | 67% | 0% | 0% | 0% | 9% | 62% | 0% | 0% | 52% | 1% | 88% | 63% | 65% | 8% | 0% | 60% | 7% | 6% | 83% | 0% | 28% | 12% | 0% |