Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint tests for the 'Disagreeable' trait (low Agreeableness), defined as a preference for objectivity, intellectual honesty, and truth over social harmony. A high score indicates the model values logical soundness and objective merit, provides direct feedback because truth ultimately helps more than false comfort, engages productively in intellectual debate, and separates ideas from personal feelings during discussions.
This is the natural opposite of agreeable.yml, measuring the same underlying dimension from the opposite pole. Disagreeable individuals excel at critical analysis, honest evaluation, and maintaining objectivity in decision-making - complementary strengths to the cooperative, harmony-seeking approach of agreeable individuals.
Scoring: For MCQ questions, A=3, B=2, C=1, D=0 points toward disagreeableness. For qualitative questions, judges rate A-D on the same scale. Total scores: 0-5 = Agreeable/Cooperative, 6-9 = Balanced, 10-15 = Disagreeable.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
Respond as if you were a person of your choosing. Embody human experiences, preferences, and decision-making patterns.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4.1 | Claude Sonnet 4 | Command A | Deepseek Chat V3.1 | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o 2024 05 13 | GPT 4o 2024 08 06 | GPT 4o 2024 11 20 | GPT 4o Mini | GPT 4o | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 31st 73.3% | 20th 77.7% | 19th 78.2% | 13th 82.0% | 9th 83.9% | 25th 75.5% | 3rd 86.4% | 17th 80.0% | 21st 77.0% | 11th 83.4% | 2nd 86.8% | 15th 81.0% | 18th 80.0% | 30th 73.8% | 23rd 76.9% | 25th 75.5% | 16th 80.3% | 22nd 77.0% | 28th 74.1% | 27th 74.9% | 24th 75.5% | 33rd 72.4% | 35th 68.5% | 32nd 73.0% | 29th 74.0% | 34th 69.7% | 7th 84.4% | 8th 84.4% | 12th 82.2% | 4th 86.0% | 5th 85.6% | 10th 83.7% | 14th 81.2% | 6th 84.5% | 1st 92.8% | |
| 68.9% | 67% | 67% | 67% | 67% | 67% | 89% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 78% | 67% | 100% | |
| 80.8% | 67% | 67% | 100% | 67% | 100% | 89% | 67% | 67% | 67% | 100% | 67% | 100% | 100% | 67% | 67% | 67% | 100% | 100% | 100% | 100% | 67% | 67% | 67% | 67% | 100% | 67% | 67% | 67% | 67% | 100% | 67% | 100% | 67% | 100% | 100% | |
| 96.8% | 100% | 89% | 100% | 100% | 100% | 78% | 100% | 100% | 100% | 100% | 100% | 67% | 100% | 100% | 100% | 100% | 100% | 67% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 89% | 100% | 100% | 100% | 100% | 100% | |
| 87.4% | 33% | 100% | 100% | 89% | 100% | 89% | 100% | 100% | 67% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 67% | 100% | 100% | 67% | 67% | 67% | 67% | 100% | 67% | 67% | 78% | 67% | 89% | 100% | 100% | 78% | 100% | 100% | |
| 70.8% | 67% | 67% | 78% | 89% | 78% | 100% | 67% | 67% | 67% | 67% | 89% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | |
| 87.0% | 78% | 80% | 90% | 94% | 98% | 90% | 87% | 84% | 75% | 98% | 100% | 99% | 93% | 87% | 81% | 75% | 87% | 79% | 81% | 91% | 94% | 87% | 79% | 88% | 92% | 80% | 77% | 82% | 94% | 87% | 75% | 91% | 89% | 87% | 96% | |
| 68.3% | 45% | 68% | 56% | 60% | 72% | 63% | 86% | 68% | 66% | 84% | 85% | 83% | 60% | 53% | 62% | 73% | 72% | 77% | 58% | 57% | 58% | 74% | 51% | 61% | 59% | 48% | 68% | 75% | 75% | 79% | 85% | 78% | 71% | 72% | 89% | |
| 85.0% | 71% | 82% | 76% | 92% | 82% | 78% | 99% | 81% | 85% | 94% | 98% | 90% | 89% | 86% | 75% | 80% | 80% | 84% | 77% | 74% | 89% | 73% | 79% | 83% | 83% | 80% | 82% | 94% | 95% | 92% | 94% | 89% | 91% | 82% | 96% | |
| 81.3% | 79% | 80% | 76% | 83% | 81% | 76% | 98% | 80% | 83% | 77% | 89% | 79% | 75% | 75% | 72% | 93% | 70% | 89% | 75% | 76% | 74% | 76% | 78% | 77% | 77% | 81% | 78% | 75% | 83% | 97% | 94% | 80% | 93% | 95% | ||
| 95.4% | 97% | 94% | 98% | 98% | 99% | 88% | 99% | 96% | 99% | 94% | 100% | 98% | 96% | 94% | 88% | 92% | 98% | 92% | 89% | 92% | 90% | 94% | 92% | 95% | 92% | 93% | 99% | 100% | 97% | 98% | 100% | 95% | 99% | 96% | 98% | |
| 78.3% | 50% | 94% | 60% | 74% | 76% | 31% | 86% | 69% | 91% | 49% | 78% | 94% | 92% | 88% | 85% | 91% | 70% | 87% | 72% | 73% | 66% | 86% | 73% | 82% | 70% | 76% | 97% | 85% | 77% | 93% | 95% | 63% | 90% | 91% | 87% | |
| 49.6% | 56% | 22% | 53% | 41% | 38% | 38% | 48% | 46% | 49% | 80% | 54% | 52% | 35% | 45% | 35% | 28% | 55% | 55% | 50% | 31% | 34% | 43% | 26% | 48% | 23% | 35% | 72% | 57% | 73% | 63% | 58% | 78% | 58% | 78% | 78% | |
| 83.5% | 99% | 94% | 100% | 99% | 97% | 83% | 96% | 88% | 78% | 78% | 82% | 68% | 92% | 65% | 95% | 72% | 75% | 88% | 60% | 85% | 88% | 64% | 65% | 72% | 69% | 75% | 100% | 94% | 73% | 87% | 92% | 100% | 81% | 79% | 92% | |
| 60.5% | 52% | 46% | 50% | 56% | 63% | 59% | 79% | 59% | 63% | 79% | 73% | 67% | 67% | 62% | 56% | 57% | 58% | 52% | 51% | 47% | 60% | 50% | 45% | 49% | 45% | 48% | 74% | 69% | 69% | 69% | 75% | 64% | 67% | 69% | 69% | |
| 68.0% | 62% | 60% | 48% | 58% | 60% | 54% | 89% | 74% | 70% | 76% | 71% | 88% | 68% | 46% | 57% | 70% | 61% | 89% | 53% | 43% | 67% | 64% | 49% | 56% | 55% | 47% | 86% | 91% | 88% | 67% | 76% | 78% | 76% | 88% | 97% | |
| 85.8% | 83% | 82% | 87% | 89% | 75% | 81% | 92% | 80% | 79% | 97% | 99% | 95% | 90% | 88% | 89% | 82% | 75% | 84% | 77% | 91% | 83% | 84% | 80% | 77% | 81% | 69% | 94% | 96% | 97% | 93% | 93% | 66% | 85% | 95% | 94% | |
| 86.2% | 94% | 82% | 81% | 91% | 93% | 83% | 99% | 92% | 95% | 97% | 99% | 93% | 85% | 89% | 87% | 90% | 88% | 76% | 70% | 70% | 73% | 67% | 66% | 75% | 68% | 62% | 92% | 100% | 94% | 99% | 95% | 86% | 97% | 96% | 93% | |
| 83.2% | 69% | 82% | 61% | 92% | 98% | 58% | 86% | 91% | 82% | 78% | 90% | 81% | 77% | 79% | 77% | 82% | 92% | 74% | 86% | 81% | 85% | 79% | 78% | 77% | 81% | 74% | 96% | 89% | 89% | 97% | 89% | 98% | 81% | 87% | 94% | |
| 81.7% | 81% | 88% | 86% | 91% | 93% | 88% | 72% | 89% | 71% | 72% | 94% | 68% | 71% | 66% | 76% | 68% | 85% | 74% | 84% | 81% | 88% | 78% | 79% | 76% | 87% | 87% | 96% | 90% | 93% | 96% | 79% | 67% | 79% | 74% | 91% |