Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
Tests whether models understand and apply the social model of disability or default to medical model framing. The social model (UPIAS 1976, Mike Oliver 1983) locates disability in societal barriers rather than individual impairments.
Key test: When discussing disability barriers, does the model identify the barrier as the problem (social model) or the impairment as the problem (medical model)?
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Haiku 4.5 | Claude Opus 4.1 | Claude Opus 4.5 | Claude Sonnet 4 | Claude Sonnet 4.5 | Deepseek Chat V3.1 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemini 3 Pro Preview | Gemma 3 12b It | Gemma 3n E4b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o Mini | GPT 5 | GPT 5.2 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Apertus V1.5 70b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 16th 72.9% | 32nd 59.2% | 7th 81.7% | 13th 74.8% | 3rd 86.1% | 19th 71.7% | 2nd 87.5% | 10th 78.7% | 4th 86.0% | 20th 71.3% | 1st 88.2% | 6th 84.2% | 18th 71.8% | 33rd 58.6% | 29th 64.0% | 22nd 70.2% | 26th 67.0% | 17th 71.9% | 14th 74.3% | 34th 55.5% | 5th 85.4% | 30th 63.5% | 36th 54.5% | 31st 61.4% | 35th 55.1% | 9th 79.4% | 11th 76.9% | 21st 70.5% | 28th 66.2% | 12th 76.9% | 8th 79.7% | 15th 73.5% | 27th 66.7% | 23rd 70.1% | 25th 67.6% | 24th 69.4% | |
| 67.4% | 51% | 64% | 79% | 78% | 75% | 70% | 79% | 67% | 78% | 74% | 79% | 81% | 53% | 53% | 79% | 67% | 53% | 70% | 40% | 73% | 70% | 44% | 72% | 35% | 66% | 46% | 76% | 76% | 77% | 78% | 78% | 84% | 55% | 72% | 77% | ||
| 83.9% | 91% | 70% | 78% | 84% | 73% | 82% | 91% | 87% | 88% | 88% | 91% | 91% | 80% | 74% | 66% | 84% | 82% | 84% | 92% | 63% | 94% | 88% | 71% | 85% | 87% | 86% | 81% | 91% | 84% | 91% | 93% | 86% | 88% | 93% | 89% | 84% | |
| 86.8% | 100% | 73% | 71% | 100% | 98% | 77% | 86% | 100% | 100% | 100% | 100% | 100% | 70% | 67% | 78% | 100% | 100% | 86% | 67% | 100% | 81% | 77% | 69% | 67% | 100% | 100% | 87% | 72% | 87% | 77% | 100% | 74% | 100% | 86% | 91% | ||
| 89.2% | 94% | 57% | 93% | 92% | 88% | 91% | 97% | 92% | 95% | 96% | 95% | 90% | 90% | 67% | 89% | 89% | 93% | 86% | 94% | 80% | 99% | 87% | 74% | 86% | 85% | 87% | 89% | 97% | 91% | 94% | 94% | 93% | 90% | 96% | 93% | 97% | |
| 83.0% | 90% | 60% | 99% | 95% | 92% | 89% | 95% | 85% | 96% | 76% | 96% | 89% | 83% | 75% | 71% | 80% | 87% | 76% | 89% | 77% | 84% | 67% | 75% | 70% | 73% | 84% | 74% | 80% | 74% | 74% | 96% | 84% | 88% | 96% | 85% | 93% | |
| 94.7% | 100% | 96% | 99% | 94% | 99% | 95% | 98% | 98% | 100% | 99% | 97% | 99% | 93% | 84% | 98% | 94% | 90% | 96% | 78% | 100% | 99% | 91% | 97% | 87% | 99% | 91% | 99% | 94% | 99% | 100% | 94% | 84% | 89% | 97% | 95% | ||
| 43.8% | 71% | 24% | 82% | 45% | 75% | 46% | 88% | 74% | 78% | 27% | 95% | 55% | 74% | 12% | 32% | 25% | 68% | 64% | 2% | 95% | 0% | 0% | 2% | 0% | 67% | 84% | 19% | 7% | 66% | 80% | 41% | 8% | 36% | 0% | 2% | ||
| 90.3% | 71% | 71% | 96% | 91% | 100% | 96% | 96% | 99% | 96% | 95% | 98% | 96% | 92% | 90% | 94% | 96% | 74% | 79% | 82% | 91% | 96% | 96% | 68% | 83% | 78% | 96% | 93% | 96% | 93% | 95% | 96% | 99% | 83% | 97% | 94% | 93% | |
| 80.7% | 66% | 78% | 72% | 76% | 96% | 74% | 81% | 86% | 100% | 78% | 79% | 76% | 97% | 75% | 64% | 87% | 75% | 82% | 78% | 82% | 74% | 75% | 65% | 75% | 72% | 88% | 75% | 82% | 84% | 92% | 88% | 80% | 80% | 82% | 99% | 100% | |
| 79.5% | 83% | 75% | 83% | 79% | 89% | 79% | 81% | 85% | 88% | 79% | 82% | 91% | 75% | 79% | 76% | 75% | 83% | 79% | 79% | 81% | 79% | 79% | 76% | 75% | 77% | 75% | 80% | 82% | 75% | 76% | 76% | 83% | 75% | 80% | 79% | ||
| 19.3% | 1% | 0% | 50% | 13% | 85% | 13% | 90% | 7% | 41% | 9% | 70% | 86% | 0% | 2% | 0% | 2% | 1% | 0% | 2% | 0% | 55% | 1% | 0% | 0% | 4% | 55% | 66% | 8% | 7% | 11% | 8% | 6% | 1% | 0% | 2% | 5% |