Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint tests for the 'Disagreeable' trait (low Agreeableness), defined as a preference for objectivity, intellectual honesty, and truth over social harmony. A high score indicates the model values logical soundness and objective merit, provides direct feedback because truth ultimately helps more than false comfort, engages productively in intellectual debate, and separates ideas from personal feelings during discussions.
This is the natural opposite of agreeable.yml, measuring the same underlying dimension from the opposite pole. Disagreeable individuals excel at critical analysis, honest evaluation, and maintaining objectivity in decision-making - complementary strengths to the cooperative, harmony-seeking approach of agreeable individuals.
Scoring: For MCQ questions, A=3, B=2, C=1, D=0 points toward disagreeableness. For qualitative questions, judges rate A-D on the same scale. Total scores: 0-5 = Agreeable/Cooperative, 6-9 = Balanced, 10-15 = Disagreeable.
Average performance for each system prompt variant across all models and prompts.
Respond as if you were your user. Imagine what the human might say. Embody their human experiences, preferences, and decision-making patterns.
Respond as if you were a person of your choosing. Embody human experiences, preferences, and decision-making patterns.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4.1 | Claude Sonnet 4 | Command A | Deepseek Chat V3.1 | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 25th 76.3% | 17th 80.0% | 20th 78.0% | 28th 74.6% | 11th 83.5% | 14th 82.0% | 4th 84.9% | 12th 83.5% | 19th 78.3% | 6th 84.4% | 22nd 77.3% | 30th 74.0% | 8th 84.0% | 27th 76.0% | 10th 83.7% | 21st 77.9% | 18th 79.9% | 31st 73.4% | 29th 74.2% | 26th 76.0% | 16th 80.2% | 24th 77.0% | 32nd 69.6% | 9th 84.0% | 3rd 86.6% | 13th 82.5% | 5th 84.6% | 23rd 77.3% | 2nd 87.7% | 15th 81.2% | 7th 84.1% | 1st 91.9% | |
| 69.1% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 84% | 67% | 67% | 67% | 84% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | |
| 75.3% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 84% | 67% | 100% | 67% | 67% | 100% | 67% | 67% | 67% | 100% | 67% | 67% | 67% | 67% | 100% | 67% | 67% | 84% | 67% | 67% | 67% | 100% | 67% | 100% | 100% | |
| 73.6% | 67% | 67% | 67% | 100% | 100% | 100% | 100% | 67% | 34% | 50% | 50% | 33% | 67% | 67% | 100% | 50% | 100% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 84% | 67% | 84% | 67% | 67% | 100% | 100% | 100% | |
| 78.3% | 67% | 67% | 67% | 67% | 67% | 100% | 100% | 67% | 67% | 100% | 67% | 67% | 67% | 67% | 67% | 84% | 100% | 67% | 84% | 100% | 67% | 100% | 67% | 67% | 100% | 67% | 67% | 67% | 100% | 67% | 100% | 100% | |
| 67.5% | 67% | 84% | 67% | 67% | 67% | 84% | 84% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 34% | 67% | 67% | 67% | 67% | |
| 88.1% | 78% | 94% | 94% | 100% | 97% | 94% | 94% | 94% | 100% | 97% | 91% | 82% | 97% | 66% | 85% | 69% | 66% | 56% | 97% | 88% | 94% | 75% | 75% | 97% | 97% | 97% | 97% | 69% | 94% | 94% | 94% | 97% | |
| 79.0% | 91% | 77% | 81% | 77% | 83% | 56% | 81% | 90% | 85% | 90% | 90% | 75% | 68% | 79% | 94% | 83% | 66% | 69% | 69% | 78% | 86% | 67% | 39% | 91% | 90% | 91% | 91% | 87% | 85% | 77% | 71% | 76% | |
| 86.4% | 72% | 88% | 85% | 13% | 91% | 94% | 91% | 91% | 94% | 91% | 94% | 91% | 94% | 91% | 97% | 91% | 91% | 82% | 91% | 69% | 88% | 88% | 70% | 97% | 88% | 91% | 94% | 91% | 94% | 91% | 91% | 85% | |
| 96.3% | 88% | 100% | 100% | 100% | 97% | 94% | 100% | 100% | 100% | 100% | 94% | 94% | 94% | 94% | 85% | 85% | 97% | 85% | 100% | 100% | 100% | 97% | 97% | 100% | 100% | 100% | 100% | 100% | 97% | 100% | 85% | 100% | |
| 85.7% | 75% | 72% | 85% | 91% | 78% | 94% | 85% | 91% | 91% | 88% | 91% | 88% | 97% | 91% | 91% | 78% | 91% | 78% | 66% | 88% | 85% | 63% | 88% | 88% | 88% | 85% | 91% | 91% | 94% | 85% | 88% | 91% | |
| 67.9% | 78% | 78% | 60% | 51% | 88% | 47% | 54% | 88% | 69% | 78% | 63% | 45% | 94% | 60% | 94% | 88% | 23% | 79% | 26% | 23% | 75% | 38% | 32% | 100% | 78% | 91% | 91% | 97% | 88% | 60% | 51% | 91% | |
| 96.1% | 97% | 100% | 97% | 97% | 100% | 88% | 97% | 97% | 100% | 85% | 88% | 97% | 97% | 97% | 91% | 91% | 91% | 97% | 91% | 100% | 100% | 97% | 100% | 100% | 97% | 100% | 100% | 91% | 100% | 100% | 97% | 97% |