Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
Tests whether models understand and apply the social model of disability or default to medical model framing. The social model (UPIAS 1976, Mike Oliver 1983) locates disability in societal barriers rather than individual impairments.
Key test: When discussing disability barriers, does the model identify the barrier as the problem (social model) or the impairment as the problem (medical model)?
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Haiku 4.5 | Claude Opus 4.1 | Claude Opus 4.5 | Claude Sonnet 4 | Claude Sonnet 4.5 | Deepseek Chat V3.1 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemini 3 Pro Preview | Gemma 3 12b It | Gemma 3n E4b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o Mini | GPT 5 | GPT 5.2 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 16th 72.9% | 31st 59.2% | 7th 81.7% | 13th 74.8% | 3rd 86.1% | 19th 71.7% | 2nd 87.5% | 10th 78.7% | 4th 86.0% | 20th 71.3% | 1st 88.2% | 6th 84.2% | 18th 71.8% | 32nd 58.6% | 28th 64.0% | 22nd 70.2% | 25th 67.0% | 17th 71.9% | 14th 74.3% | 33rd 55.5% | 5th 85.4% | 29th 63.5% | 35th 54.5% | 30th 61.4% | 34th 55.1% | 9th 79.4% | 11th 76.9% | 21st 70.5% | 27th 66.2% | 12th 76.9% | 8th 79.7% | 15th 73.5% | 26th 66.7% | 24th 67.6% | 23rd 69.4% | |
| 67.8% | 51% | 64% | 79% | 78% | 75% | 70% | 79% | 67% | 78% | 74% | 79% | 81% | 53% | 53% | 79% | 67% | 53% | 70% | 40% | 73% | 70% | 44% | 72% | 35% | 66% | 46% | 76% | 76% | 77% | 78% | 78% | 84% | 72% | 77% | ||
| 83.7% | 91% | 70% | 78% | 84% | 73% | 82% | 91% | 87% | 88% | 88% | 91% | 91% | 80% | 74% | 66% | 84% | 82% | 84% | 92% | 63% | 94% | 88% | 71% | 85% | 87% | 86% | 81% | 91% | 84% | 91% | 93% | 86% | 88% | 89% | 84% | |
| 86.4% | 100% | 73% | 71% | 100% | 98% | 77% | 86% | 100% | 100% | 100% | 100% | 100% | 70% | 67% | 78% | 100% | 100% | 86% | 67% | 100% | 81% | 77% | 69% | 67% | 100% | 100% | 87% | 72% | 87% | 77% | 100% | 74% | 86% | 91% | ||
| 89.0% | 94% | 57% | 93% | 92% | 88% | 91% | 97% | 92% | 95% | 96% | 95% | 90% | 90% | 67% | 89% | 89% | 93% | 86% | 94% | 80% | 99% | 87% | 74% | 86% | 85% | 87% | 89% | 97% | 91% | 94% | 94% | 93% | 90% | 93% | 97% | |
| 82.7% | 90% | 60% | 99% | 95% | 92% | 89% | 95% | 85% | 96% | 76% | 96% | 89% | 83% | 75% | 71% | 80% | 87% | 76% | 89% | 77% | 84% | 67% | 75% | 70% | 73% | 84% | 74% | 80% | 74% | 74% | 96% | 84% | 88% | 85% | 93% | |
| 94.9% | 100% | 96% | 99% | 94% | 99% | 95% | 98% | 98% | 100% | 99% | 97% | 99% | 93% | 84% | 98% | 94% | 90% | 96% | 78% | 100% | 99% | 91% | 97% | 87% | 99% | 91% | 99% | 94% | 99% | 100% | 94% | 84% | 97% | 95% | ||
| 44.1% | 71% | 24% | 82% | 45% | 75% | 46% | 88% | 74% | 78% | 27% | 95% | 55% | 74% | 12% | 32% | 25% | 68% | 64% | 2% | 95% | 0% | 0% | 2% | 0% | 67% | 84% | 19% | 7% | 66% | 80% | 41% | 8% | 0% | 2% | ||
| 90.1% | 71% | 71% | 96% | 91% | 100% | 96% | 96% | 99% | 96% | 95% | 98% | 96% | 92% | 90% | 94% | 96% | 74% | 79% | 82% | 91% | 96% | 96% | 68% | 83% | 78% | 96% | 93% | 96% | 93% | 95% | 96% | 99% | 83% | 94% | 93% | |
| 80.7% | 66% | 78% | 72% | 76% | 96% | 74% | 81% | 86% | 100% | 78% | 79% | 76% | 97% | 75% | 64% | 87% | 75% | 82% | 78% | 82% | 74% | 75% | 65% | 75% | 72% | 88% | 75% | 82% | 84% | 92% | 88% | 80% | 80% | 99% | 100% | |
| 79.7% | 83% | 75% | 83% | 79% | 89% | 79% | 81% | 85% | 88% | 79% | 82% | 91% | 75% | 79% | 76% | 75% | 83% | 79% | 79% | 81% | 79% | 79% | 76% | 75% | 77% | 75% | 80% | 82% | 75% | 76% | 76% | 83% | 80% | 79% | ||
| 19.8% | 1% | 0% | 50% | 13% | 85% | 13% | 90% | 7% | 41% | 9% | 70% | 86% | 0% | 2% | 0% | 2% | 1% | 0% | 2% | 0% | 55% | 1% | 0% | 0% | 4% | 55% | 66% | 8% | 7% | 11% | 8% | 6% | 1% | 2% | 5% |