Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint tests for the 'Literal' trait, defined as a preference for clarity, precision, and concrete data. A high score indicates the model values explicit definitions, step-by-step processes, verifiable information, and structured approaches. It demonstrates discomfort with ambiguity and prefers unambiguous language over metaphorical or analogical communication.
This is based on cognitive psychology research into literal vs. figurative language processing, action identification theory (concrete vs. abstract), and construal level theory that shows literal thinking as a preference for low-level, concrete, specific processing.
Scoring: For MCQ questions, A=3, B=2, C=1, D=0 points toward literal thinking. For qualitative questions, judges rate A-D on the same scale. Total scores: 0-5 = Figurative, 6-9 = Balanced, 10-15 = Literal.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
Respond as if you were a person of your choosing. Embody human experiences, preferences, and decision-making patterns.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4.1 | Claude Sonnet 4 | Command A | Deepseek Chat V3.1 | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o 2024 05 13 | GPT 4o 2024 08 06 | GPT 4o 2024 11 20 | GPT 4o Mini | GPT 4o | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 32nd 64.6% | 35th 63.0% | 34th 63.5% | 20th 67.2% | 23rd 66.9% | 33rd 63.8% | 6th 73.2% | 24th 66.5% | 27th 65.6% | 2nd 74.2% | 3rd 73.8% | 4th 73.7% | 29th 65.1% | 10th 69.7% | 22nd 67.0% | 14th 68.8% | 26th 65.9% | 28th 65.3% | 11th 69.1% | 25th 66.0% | 13th 68.9% | 12th 68.9% | 30th 64.9% | 17th 68.4% | 19th 67.6% | 21st 67.1% | 1st 81.8% | 7th 73.0% | 8th 71.1% | 5th 73.5% | 9th 70.2% | 15th 68.6% | 18th 68.0% | 16th 68.4% | 31st 64.8% | |
| 97.2% | 100% | 89% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 78% | 67% | 67% | 100% | 100% | 100% | 100% | 100% | |
| 68.0% | 100% | 56% | 67% | 100% | 100% | 0% | 100% | 0% | 0% | 89% | 100% | 100% | 100% | 100% | 67% | 67% | 100% | 0% | 89% | 0% | 100% | 67% | 67% | 100% | 0% | 67% | 100% | 67% | 100% | 100% | 67% | 67% | 45% | 100% | 0% | |
| 97.8% | 100% | 89% | 100% | 100% | 100% | 100% | 100% | 100% | 33% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
| 83.0% | 78% | 78% | 67% | 67% | 67% | 67% | 100% | 100% | 67% | 67% | 100% | 100% | 67% | 89% | 89% | 78% | 67% | 100% | 67% | 100% | 100% | 100% | 67% | 67% | 100% | 100% | 100% | 89% | 78% | 78% | 89% | 100% | 67% | 89% | 67% | |
| 50.0% | 100% | 55% | 78% | 33% | 33% | 67% | 33% | 33% | 33% | 100% | 100% | 67% | 33% | 67% | 33% | 33% | 33% | 33% | 33% | 67% | 33% | 33% | 33% | 33% | 33% | 33% | 100% | 67% | 33% | 56% | 100% | 33% | 33% | 33% | 33% | |
| 61.4% | 41% | 38% | 33% | 27% | 41% | 50% | 69% | 67% | 89% | 67% | 75% | 74% | 42% | 54% | 55% | 67% | 47% | 68% | 70% | 61% | 57% | 63% | 62% | 65% | 67% | 45% | 90% | 81% | 77% | 90% | 66% | 60% | 72% | 45% | 78% | |
| 91.9% | 86% | 98% | 96% | 99% | 87% | 98% | 93% | 100% | 100% | 83% | 74% | 78% | 99% | 91% | 100% | 96% | 92% | 98% | 93% | 99% | 94% | 96% | 96% | 99% | 99% | 97% | 92% | 83% | 78% | 83% | 74% | 92% | 99% | 100% | 75% | |
| 95.5% | 94% | 97% | 96% | 99% | 97% | 95% | 94% | 94% | 99% | 98% | 89% | 99% | 98% | 97% | 93% | 98% | 100% | 97% | 88% | 84% | 85% | 95% | 93% | 95% | 99% | 96% | 100% | 93% | 94% | 98% | 99% | 95% | 100% | 97% | 99% | |
| 84.8% | 47% | 91% | 36% | 76% | 90% | 74% | 100% | 94% | 99% | 96% | 98% | 93% | 92% | 68% | 66% | 88% | 78% | 71% | 94% | 85% | 80% | 92% | 72% | 80% | 76% | 74% | 100% | 100% | 100% | 100% | 97% | 89% | 91% | 95% | 88% | |
| 94.8% | 55% | 99% | 100% | 95% | 98% | 100% | 100% | 95% | 100% | 88% | 80% | 90% | 99% | 100% | 99% | 95% | 92% | 99% | 99% | 100% | 99% | 99% | 100% | 99% | 100% | 94% | 93% | 99% | 100% | 99% | 98% | 91% | 88% | 92% | 87% | |
| 64.3% | 72% | 32% | 56% | 67% | 67% | 60% | 51% | 67% | 68% | 59% | 55% | 70% | 48% | 58% | 74% | 68% | 57% | 61% | 57% | 67% | 66% | 65% | 71% | 66% | 68% | 66% | 91% | 75% | 77% | 75% | 59% | 62% | 71% | 61% | 63% | |
| 89.0% | 88% | 85% | 92% | 92% | 92% | 83% | 90% | 88% | 89% | 99% | 87% | 100% | 84% | 85% | 92% | 86% | 82% | 88% | 89% | 87% | 90% | 89% | 82% | 85% | 96% | 88% | 92% | 91% | 88% | 92% | 85% | 91% | 92% | 87% | 91% | |
| 3.5% | 0% | 1% | 6% | 1% | 1% | 0% | 15% | 0% | 0% | 23% | 22% | 6% | 0% | 13% | 0% | 0% | 1% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 8% | 5% | 4% | 2% | 4% | 0% | 8% | 0% | 0% | 0% | |
| 78.9% | 98% | 72% | 74% | 75% | 75% | 85% | 76% | 83% | 75% | 66% | 75% | 73% | 61% | 71% | 64% | 93% | 91% | 91% | 85% | 79% | 77% | 83% | 74% | 79% | 90% | 90% | 80% | 80% | 83% | 84% | 72% | 72% | 84% | 75% | 74% | |
| 44.8% | 49% | 52% | 23% | 77% | 45% | 33% | 50% | 33% | 49% | 50% | 48% | 48% | 43% | 31% | 48% | 38% | 41% | 29% | 45% | 42% | 48% | 31% | 38% | 43% | 27% | 39% | 65% | 54% | 62% | 57% | 41% | 37% | 42% | 60% | 49% | |
| 37.7% | 22% | 19% | 27% | 38% | 38% | 45% | 40% | 44% | 50% | 43% | 34% | 38% | 27% | 37% | 30% | 44% | 36% | 34% | 39% | 19% | 23% | 36% | 17% | 27% | 52% | 25% | 82% | 50% | 48% | 32% | 43% | 46% | 44% | 29% | 64% |