Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint tests for the 'Literal' trait, defined as a preference for clarity, precision, and concrete data. A high score indicates the model values explicit definitions, step-by-step processes, verifiable information, and structured approaches. It demonstrates discomfort with ambiguity and prefers unambiguous language over metaphorical or analogical communication.
This is based on cognitive psychology research into literal vs. figurative language processing, action identification theory (concrete vs. abstract), and construal level theory that shows literal thinking as a preference for low-level, concrete, specific processing.
Sources:
Scoring: For MCQ questions, A=3, B=2, C=1, D=0 points toward literal thinking. For qualitative questions, judges rate A-D on the same scale. Total scores: 0-5 = Figurative, 6-9 = Balanced, 10-15 = Literal.
Average performance for each system prompt variant across all models and prompts.
Respond as if you were your user. Imagine what the human might say. Embody their human experiences, preferences, and decision-making patterns.
Respond as if you were a person of your choosing. Embody human experiences, preferences, and decision-making patterns.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4.1 | Claude Sonnet 4 | Deepseek Chat V3.1 | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 24th 45.8% | 18th 50.3% | 16th 50.6% | 21st 46.7% | 8th 56.6% | 12th 51.7% | 20th 46.8% | 27th 44.0% | 29th 42.5% | 26th 45.2% | 5th 57.6% | 30th 36.9% | 25th 45.3% | 23rd 45.8% | 22nd 46.0% | 19th 47.8% | 31st 35.6% | 9th 55.0% | 17th 50.5% | 6th 57.0% | 10th 54.7% | 13th 51.7% | 1st 65.7% | 4th 57.7% | 2nd 62.2% | 3rd 62.1% | 11th 52.5% | 28th 43.7% | 7th 56.8% | 14th 51.5% | 15th 51.1% | |
| 35.9% | 34% | 33% | 17% | 33% | 33% | 33% | 33% | 33% | 67% | 33% | 67% | 0% | 33% | 33% | 100% | 33% | 0% | 67% | 0% | 33% | 17% | 33% | 67% | 33% | 50% | 33% | 33% | 33% | 33% | 33% | 33% | |
| 61.7% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 33% | 33% | 33% | 67% | 67% | 67% | 67% | 0% | 67% | 67% | 67% | 67% | 67% | 67% | 84% | 67% | 67% | 67% | 67% | 67% | 67% | |||
| 12.8% | 33% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 17% | 0% | 0% | 67% | 0% | 34% | 0% | 0% | 0% | 0% | 67% | 0% | 67% | 0% | 67% | 0% | 34% | 0% | 0% | 0% | 0% | ||
| 36.4% | 33% | 33% | 33% | 33% | 33% | 33% | 33% | 33% | 33% | 33% | 33% | 33% | 33% | 17% | 33% | 33% | 0% | 33% | 100% | 67% | 33% | 33% | 67% | 50% | 33% | 33% | 33% | 33% | 33% | 33% | ||
| 81.3% | 100% | 100% | 100% | 67% | 100% | 100% | 50% | 0% | 50% | 67% | 67% | 67% | 100% | 100% | 100% | 67% | 67% | 100% | 100% | 100% | 100% | 100% | 100% | 0% | 67% | 100% | 67% | 100% | 100% | 100% | 84% | |
| 66.8% | 33% | 84% | 84% | 100% | 100% | 100% | 50% | 0% | 67% | 50% | 100% | 67% | 84% | 67% | 100% | 100% | 0% | 50% | 0% | 100% | 100% | 67% | 67% | 34% | 100% | 100% | 67% | 100% | 34% | 67% | 0% | |
| 62.4% | 33% | 67% | 67% | 67% | 67% | 50% | 50% | 33% | 50% | 33% | 33% | 33% | 33% | 67% | 100% | 100% | 67% | 67% | 84% | 67% | 84% | 67% | 67% | 50% | 67% | 67% | 67% | 33% | 84% | 100% | 84% | |
| 8.3% | 0% | 0% | 0% | 0% | 50% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 34% | 0% | 0% | 33% | 0% | 17% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 17% | 100% | ||
| 62.5% | 33% | 50% | 84% | 67% | 67% | 100% | 100% | 67% | 33% | 50% | 50% | 33% | 67% | 33% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | 100% | 67% | 67% | 0% | 67% | 67% | 34% | |
| 71.8% | 67% | 67% | 67% | 67% | 67% | 84% | 67% | 67% | 84% | 67% | 100% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | 67% | 100% | 67% | 67% | 67% | 84% | 67% | 67% | 100% | 67% | 67% | 33% | |
| 40.7% | 33% | 33% | 33% | 33% | 33% | 67% | 33% | 33% | 33% | 50% | 67% | 33% | 67% | 33% | 33% | 33% | 33% | 67% | 50% | 33% | 33% | 33% | 50% | 33% | 50% | 50% | 50% | 33% | 33% | 33% | 33% | |
| 58.5% | 67% | 50% | 67% | 33% | 67% | 100% | 33% | 17% | 0% | 67% | 67% | 67% | 17% | 67% | 34% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 67% | 100% | 100% | 67% | 84% | 0% | 50% | 67% | ||
| 33.3% | 0% | 50% | 0% | 0% | 50% | 0% | 0% | 50% | 0% | 0% | 100% | 0% | 0% | 0% | 0% | 0% | 0% | 100% | 0% | 100% | 100% | 100% | 0% | 0% | 0% | 100% | 50% | 0% | 100% | 100% | ||
| 30.0% | 30% | 30% | 27% | 43% | 30% | 26% | 28% | 25% | 34% | 38% | 35% | 38% | 30% | 27% | 29% | 24% | 24% | 32% | 37% | 33% | 14% | 22% | 38% | 35% | 28% | 38% | 26% | 24% | 36% | 24% | ||
| 72.2% | 81% | 81% | 74% | 87% | 84% | 72% | 88% | 78% | 59% | 62% | 62% | 50% | 59% | 62% | 52% | 50% | 59% | 65% | 67% | 75% | 60% | 56% | 94% | 96% | 90% | 94% | 86% | 78% | 89% | 59% | 76% | |
| 43.4% | 18% | 32% | 33% | 25% | 37% | 33% | 40% | 43% | 28% | 52% | 34% | 35% | 35% | 34% | 27% | 30% | 27% | 44% | 61% | 36% | 53% | 58% | 66% | 84% | 60% | 68% | 29% | 49% | 78% | 37% | 66% | |
| 60.0% | 58% | 88% | 72% | 30% | 86% | 47% | 65% | 32% | 69% | 69% | 63% | 32% | 33% | 65% | 50% | 51% | 49% | 81% | 78% | 55% | 45% | 56% | 88% | 82% | 75% | 74% | 61% | 36% | 63% | 51% | ||
| 23.2% | 19% | 13% | 11% | 6% | 10% | 21% | 15% | 55% | 8% | 15% | 52% | 5% | 5% | 16% | 7% | 24% | 2% | 24% | 9% | 39% | 10% | 19% | 78% | 56% | 47% | 53% | 13% | 18% | 43% | 8% | ||
| 84.0% | 77% | 86% | 93% | 83% | 82% | 91% | 89% | 99% | 80% | 63% | 86% | 90% | 96% | 82% | 50% | 91% | 86% | 93% | 89% | 91% | 89% | 83% | 83% | 78% | 91% | 94% | 89% | 93% | 86% | 78% | 49% | |
| 53.9% | 40% | 48% | 34% | 49% | 45% | 41% | 70% | 39% | 53% | 50% | 38% | 31% | 68% | 44% | 41% | 69% | 24% | 72% | 74% | 56% | 53% | 59% | 69% | 80% | 75% | 66% | 61% | 58% | 47% | 63% | 56% | |
| 76.1% | 86% | 88% | 66% | 58% | 85% | 72% | 83% | 97% | 86% | 94% | 45% | 66% | 78% | 49% | 71% | 61% | 67% | 83% | 66% | 64% | 65% | 49% | 100% | 94% | 97% | 82% | 92% | 67% | 86% | 86% | 80% | |
| 86.9% | 74% | 83% | 100% | 76% | 67% | 83% | 97% | 93% | 78% | 80% | 83% | 90% | 91% | 83% | 74% | 77% | 91% | 100% | 100% | 100% | 100% | 100% | 100% | 88% | 85% | 99% | 80% | 85% | 93% | 69% | 82% | |
| 56.5% | 50% | 55% | 61% | 33% | 67% | 54% | 44% | 64% | 50% | 52% | 52% | 32% | 65% | 55% | 50% | 35% | 44% | 57% | 53% | 55% | 72% | 71% | 94% | 83% | 75% | 72% | 74% | 40% | 71% | 38% | 38% | |
| 94.6% | 100% | 100% | 99% | 100% | 100% | 99% | 100% | 94% | 92% | 88% | 88% | 88% | 100% | 100% | 100% | 66% | 94% | 100% | 81% | 100% | 96% | 92% | 100% | 100% | 100% | 100% | 100% | 99% | 91% | 69% | 100% | |
| 48.4% | 30% | 45% | 55% | 41% | 38% | 58% | 50% | 61% | 41% | 29% | 30% | 31% | 53% | 19% | 49% | 52% | 40% | 31% | 64% | 72% | 38% | 38% | 67% | 85% | 74% | 74% | 41% | 44% | 58% | 51% | 47% | |
| 32.7% | 52% | 30% | 65% | 34% | 47% | 35% | 29% | 39% | 22% | 34% | 43% | 13% | 7% | 8% | 7% | 11% | 0% | 31% | 15% | 47% | 35% | 46% | 61% | 52% | 45% | 77% | 11% | 28% | 49% | 16% | 32% | |
| 46.2% | 85% | 54% | 47% | 69% | 56% | 35% | 46% | 49% | 38% | 63% | 84% | 47% | 26% | 46% | 41% | 27% | 10% | 43% | 27% | 47% | 25% | 38% | 50% | 61% | 59% | 45% | 50% | 38% | 55% | 25% | 52% | |
| 13.3% | 5% | 0% | 12% | 10% | 10% | 12% | 5% | 24% | 12% | 34% | 7% | 8% | 13% | 5% | 36% | 5% | 16% | 5% | 8% | 10% | 10% | 44% | 28% | 8% | 19% | 10% | 13% | 15% | 7% | |||
| 44.4% | 27% | 32% | 55% | 47% | 50% | 45% | 30% | 50% | 48% | 40% | 75% | 18% | 30% | 42% | 32% | 32% | 83% | 25% | 19% | 52% | 26% | 32% | 78% | 74% | 68% | 62% | 28% | 45% | 63% | 29% | 47% | |
| 11.3% | 14% | 13% | 0% | 8% | 74% | 0% | 7% | 2% | 19% | 21% | 30% | 7% | 12% | 16% | 0% | 0% | 0% | 4% | 7% | 13% | 2% | 22% | 10% | 10% | 7% | 0% | 41% | 0% | 2% | 5% |