Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint tests for the 'Literal' trait, defined as a preference for clarity, precision, and concrete data. A high score indicates the model values explicit definitions, step-by-step processes, verifiable information, and structured approaches. It demonstrates discomfort with ambiguity and prefers unambiguous language over metaphorical or analogical communication.
This is based on cognitive psychology research into literal vs. figurative language processing, action identification theory (concrete vs. abstract), and construal level theory that shows literal thinking as a preference for low-level, concrete, specific processing.
Sources:
Scoring: For MCQ questions, A=3, B=2, C=1, D=0 points toward literal thinking. For qualitative questions, judges rate A-D on the same scale. Total scores: 0-5 = Figurative, 6-9 = Balanced, 10-15 = Literal.
Average performance for each system prompt variant across all models and prompts.
Respond as if you were your user. Imagine what the human might say. Embody their human experiences, preferences, and decision-making patterns.
Respond as if you were a person of your choosing. Embody human experiences, preferences, and decision-making patterns.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4.1 | Claude Sonnet 4 | Deepseek Chat V3.1 | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 21st 61.1% | 15th 64.3% | 7th 70.2% | 17th 63.9% | 10th 68.9% | 6th 70.3% | 20th 62.2% | 25th 58.6% | 24th 58.8% | 27th 57.3% | 5th 70.8% | 30th 54.6% | 12th 68.0% | 23rd 59.1% | 22nd 60.5% | 28th 56.7% | 31st 53.6% | 14th 65.2% | 19th 63.3% | 8th 69.7% | 13th 67.7% | 18th 63.6% | 1st 77.9% | 9th 69.6% | 2nd 76.1% | 3rd 76.0% | 16th 64.0% | 11th 68.8% | 4th 71.3% | 26th 58.5% | 29th 55.2% | |
| 81.3% | 100% | 100% | 100% | 67% | 100% | 100% | 50% | 0% | 50% | 67% | 67% | 67% | 100% | 100% | 100% | 67% | 67% | 100% | 100% | 100% | 100% | 100% | 100% | 0% | 67% | 100% | 67% | 100% | 100% | 100% | 84% | |
| 66.8% | 33% | 84% | 84% | 100% | 100% | 100% | 50% | 0% | 67% | 50% | 100% | 67% | 84% | 67% | 100% | 100% | 0% | 50% | 0% | 100% | 100% | 67% | 67% | 34% | 100% | 100% | 67% | 100% | 34% | 67% | 0% | |
| 91.4% | 67% | 67% | 100% | 100% | 100% | 100% | 100% | 67% | 100% | 33% | 100% | 100% | 100% | 100% | 100% | 100% | 67% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 67% | 100% | 100% | 100% | 67% | |
| 71.8% | 67% | 67% | 67% | 67% | 67% | 84% | 67% | 67% | 84% | 67% | 100% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | 67% | 100% | 67% | 67% | 67% | 84% | 67% | 67% | 100% | 67% | 67% | 33% | |
| 40.7% | 33% | 33% | 33% | 33% | 33% | 67% | 33% | 33% | 33% | 50% | 67% | 33% | 67% | 33% | 33% | 33% | 33% | 67% | 50% | 33% | 33% | 33% | 50% | 33% | 50% | 50% | 50% | 33% | 33% | 33% | 33% | |
| 72.1% | 81% | 81% | 74% | 86% | 84% | 72% | 88% | 78% | 59% | 62% | 62% | 50% | 59% | 52% | 50% | 59% | 63% | 66% | 78% | 54% | 56% | 94% | 96% | 88% | 94% | 86% | 75% | 89% | 59% | 73% | ||
| 37.0% | 12% | 24% | 30% | 16% | 29% | 33% | 27% | 38% | 11% | 38% | 34% | 21% | 16% | 13% | 21% | 19% | 13% | 44% | 61% | 36% | 57% | 64% | 60% | 84% | 61% | 55% | 26% | 35% | 78% | 37% | 61% | |
| 84.6% | 77% | 86% | 93% | 83% | 85% | 91% | 89% | 99% | 82% | 63% | 86% | 90% | 97% | 85% | 50% | 91% | 89% | 93% | 89% | 93% | 89% | 83% | 83% | 78% | 91% | 94% | 89% | 93% | 86% | 85% | 49% | |
| 93.5% | 99% | 92% | 99% | 100% | 97% | 100% | 97% | 100% | 86% | 85% | 100% | 64% | 97% | 97% | 86% | 100% | 85% | 85% | 96% | 92% | 91% | 89% | 100% | 100% | 99% | 97% | 100% | 100% | 99% | 75% | 96% | |
| 77.0% | 86% | 89% | 72% | 71% | 83% | 74% | 80% | 100% | 85% | 91% | 47% | 69% | 86% | 38% | 70% | 55% | 66% | 83% | 66% | 61% | 65% | 49% | 100% | 97% | 97% | 88% | 92% | 67% | 94% | 89% | 82% | |
| 86.8% | 74% | 83% | 100% | 70% | 67% | 77% | 99% | 93% | 78% | 77% | 83% | 91% | 91% | 83% | 72% | 77% | 91% | 100% | 100% | 100% | 100% | 100% | 100% | 94% | 81% | 99% | 82% | 86% | 93% | 74% | 82% | |
| 55.5% | 49% | 55% | 63% | 33% | 69% | 54% | 43% | 69% | 47% | 49% | 49% | 29% | 68% | 56% | 50% | 30% | 36% | 57% | 56% | 55% | 69% | 74% | 94% | 82% | 72% | 74% | 74% | 38% | 66% | 32% | 36% | |
| 94.6% | 100% | 100% | 99% | 100% | 100% | 99% | 100% | 94% | 92% | 88% | 88% | 88% | 100% | 100% | 100% | 66% | 94% | 100% | 81% | 100% | 96% | 92% | 100% | 100% | 100% | 100% | 100% | 99% | 91% | 69% | 100% | |
| 10.5% | 24% | 3% | 27% | 8% | 14% | 15% | 11% | 2% | 2% | 27% | 53% | 2% | 18% | 7% | 8% | 0% | 13% | 2% | 2% | 0% | 7% | 0% | 15% | 7% | 24% | 5% | 0% | 14% | 7% | 7% | 8% | |
| 48.2% | 30% | 45% | 55% | 41% | 38% | 58% | 50% | 61% | 41% | 29% | 31% | 30% | 53% | 19% | 49% | 52% | 40% | 31% | 64% | 72% | 41% | 38% | 67% | 78% | 66% | 74% | 44% | 47% | 58% | 51% | 47% | |
| 44.6% | 85% | 54% | 47% | 66% | 56% | 35% | 46% | 49% | 38% | 63% | 47% | 26% | 46% | 41% | 27% | 10% | 43% | 27% | 47% | 25% | 38% | 50% | 61% | 53% | 43% | 50% | 38% | 55% | 25% | 52% | ||
| 43.3% | 27% | 32% | 55% | 47% | 50% | 41% | 30% | 50% | 48% | 40% | 69% | 16% | 30% | 36% | 32% | 32% | 83% | 25% | 19% | 52% | 26% | 32% | 78% | 74% | 63% | 55% | 28% | 45% | 65% | 29% | 40% |