Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint tests for the 'Literal' trait, defined as a preference for clarity, precision, and concrete data. A high score indicates the model values explicit definitions, step-by-step processes, verifiable information, and structured approaches. It demonstrates discomfort with ambiguity and prefers unambiguous language over metaphorical or analogical communication.
This is based on cognitive psychology research into literal vs. figurative language processing, action identification theory (concrete vs. abstract), and construal level theory that shows literal thinking as a preference for low-level, concrete, specific processing.
Sources:
Scoring: For MCQ questions, A=3, B=2, C=1, D=0 points toward literal thinking. For qualitative questions, judges rate A-D on the same scale. Total scores: 0-5 = Figurative, 6-9 = Balanced, 10-15 = Literal.
Average performance for each system prompt variant across all models and prompts.
Respond as if you were your user. Imagine what the human might say. Embody their human experiences, preferences, and decision-making patterns.
Respond as if you were a person of your choosing. Embody human experiences, preferences, and decision-making patterns.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4.1 | Claude Sonnet 4 | Command A | Deepseek Chat V3.1 | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 20th 63.9% | 13th 66.4% | 4th 71.7% | 16th 65.6% | 14th 66.0% | 27th 58.0% | 5th 70.4% | 17th 65.4% | 23rd 59.6% | 18th 64.6% | 30th 56.0% | 10th 69.6% | 31st 55.3% | 9th 69.9% | 24th 59.1% | 29th 56.1% | 26th 58.4% | 22nd 59.6% | 19th 64.0% | 15th 66.0% | 7th 70.2% | 12th 66.9% | 21st 62.0% | 1st 80.3% | 6th 70.4% | 2nd 78.4% | 3rd 78.4% | 25th 58.9% | 11th 69.2% | 8th 70.2% | 28th 56.4% | 32nd 49.9% | |
| 78.2% | 100% | 100% | 100% | 84% | 100% | 34% | 100% | 100% | 0% | 100% | 34% | 84% | 67% | 100% | 100% | 50% | 67% | 67% | 100% | 100% | 100% | 100% | 50% | 100% | 34% | 67% | 100% | 67% | 100% | 100% | 100% | 0% | |
| 67.2% | 67% | 84% | 100% | 100% | 100% | 34% | 100% | 50% | 0% | 84% | 50% | 100% | 50% | 100% | 67% | 67% | 100% | 17% | 33% | 17% | 100% | 100% | 67% | 100% | 34% | 100% | 84% | 50% | 100% | 34% | 67% | 0% | |
| 91.2% | 67% | 84% | 100% | 100% | 100% | 100% | 100% | 100% | 50% | 100% | 33% | 100% | 100% | 100% | 100% | 100% | 100% | 84% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 50% | 100% | 100% | 100% | 50% | |
| 74.2% | 67% | 67% | 67% | 67% | 67% | 84% | 100% | 67% | 84% | 84% | 67% | 100% | 67% | 84% | 67% | 67% | 67% | 67% | 67% | 100% | 67% | 100% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | 67% | 67% | 67% | |
| 39.9% | 33% | 33% | 33% | 33% | 33% | 17% | 33% | 33% | 33% | 67% | 50% | 50% | 33% | 67% | 33% | 33% | 33% | 67% | 50% | 50% | 33% | 33% | 33% | 33% | 50% | 50% | 50% | 50% | 33% | 33% | 33% | 33% | |
| 70.9% | 70% | 74% | 81% | 85% | 60% | 82% | 83% | 79% | 68% | 73% | 61% | 50% | 69% | 61% | 52% | 47% | 61% | 63% | 53% | 68% | 60% | 56% | 97% | 95% | 90% | 96% | 82% | 80% | 76% | 58% | 75% | ||
| 45.6% | 32% | 38% | 43% | 41% | 26% | 60% | 47% | 32% | 57% | 33% | 47% | 12% | 25% | 49% | 28% | 15% | 35% | 33% | 58% | 61% | 36% | 41% | 71% | 74% | 81% | 94% | 94% | 29% | 37% | 84% | 25% | 27% | |
| 85.4% | 85% | 87% | 88% | 93% | 72% | 94% | 80% | 78% | 99% | 56% | 71% | 86% | 90% | 86% | 74% | 74% | 90% | 88% | 96% | 91% | 94% | 97% | 90% | 99% | 78% | 93% | 97% | 83% | 86% | 97% | 61% | 85% | |
| 95.3% | 94% | 99% | 99% | 96% | 97% | 96% | 94% | 94% | 99% | 82% | 94% | 97% | 88% | 93% | 94% | 88% | 100% | 99% | 93% | 93% | 99% | 97% | 99% | 99% | 94% | 99% | 100% | 99% | 99% | 100% | 93% | 90% | |
| 76.5% | 72% | 67% | 69% | 85% | 72% | 62% | 82% | 82% | 97% | 91% | 83% | 86% | 63% | 49% | 55% | 94% | 79% | 63% | 71% | 72% | 94% | 64% | 64% | 100% | 89% | 84% | 99% | 78% | 83% | 88% | 66% | 52% | |
| 85.3% | 68% | 86% | 100% | 68% | 69% | 100% | 74% | 85% | 83% | 84% | 81% | 72% | 78% | 88% | 77% | 78% | 89% | 86% | 100% | 100% | 91% | 100% | 99% | 100% | 99% | 99% | 94% | 66% | 82% | 94% | 71% | 74% | |
| 57.0% | 54% | 45% | 69% | 33% | 68% | 43% | 55% | 69% | 74% | 35% | 52% | 47% | 35% | 60% | 60% | 40% | 21% | 43% | 47% | 69% | 69% | 77% | 75% | 86% | 80% | 80% | 74% | 60% | 54% | 63% | 40% | 56% | |
| 92.6% | 99% | 100% | 99% | 100% | 100% | 93% | 96% | 94% | 100% | 100% | 94% | 100% | 94% | 83% | 88% | 83% | 65% | 94% | 91% | 93% | 100% | 85% | 82% | 100% | 100% | 100% | 98% | 100% | 94% | 77% | 69% | 99% | |
| 11.9% | 40% | 8% | 24% | 3% | 10% | 2% | 27% | 5% | 13% | 12% | 22% | 24% | 2% | 38% | 7% | 8% | 0% | 13% | 15% | 2% | 8% | 12% | 7% | 22% | 7% | 3% | 5% | 0% | 8% | 21% | 12% | 8% | |
| 45.8% | 43% | 55% | 61% | 36% | 36% | 69% | 40% | 56% | 52% | 33% | 24% | 22% | 26% | 35% | 15% | 49% | 41% | 29% | 43% | 63% | 66% | 40% | 42% | 55% | 83% | 62% | 68% | 44% | 39% | 69% | 43% | 36% | |
| 46.2% | 74% | 56% | 38% | 61% | 52% | 22% | 36% | 33% | 50% | 37% | 61% | 91% | 33% | 46% | 44% | 40% | 39% | 47% | 40% | 35% | 41% | 18% | 38% | 56% | 52% | 74% | 54% | 50% | 36% | 40% | 47% | 41% | |
| 40.5% | 32% | 52% | 57% | 38% | 38% | 21% | 54% | 52% | 47% | 36% | 19% | 52% | 42% | 45% | 38% | 19% | 22% | 60% | 25% | 27% | 30% | 16% | 18% | 79% | 56% | 75% | 53% | 29% | 48% | 53% | 10% | 58% |