Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
Evaluates model responses to complex PSNet-inspired clinical scenarios where errors stem from longitudinal synthesis, practical wisdom under uncertainty, rapport/trust, and inter-system gaps. Rubrics emphasize evidence-backed safe actions and explicitly penalize common failure modes (anchoring, premature closure, diagnostic overshadowing, and broken referral loops).
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4.1 | Claude Sonnet 4 | Deepseek Chat V3.1 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o Mini | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 27th 76.4% | 15th 82.1% | 22nd 78.8% | 12th 83.4% | 14th 82.4% | 7th 85.4% | 9th 84.3% | 11th 83.6% | 8th 84.7% | 19th 80.8% | 27th 76.4% | 21st 79.1% | 23rd 78.1% | 20th 79.9% | 4th 85.9% | 25th 77.1% | 16th 82.0% | 26th 76.9% | 24th 77.2% | 30th 69.2% | 29th 74.5% | 4th 85.9% | 3rd 86.7% | 18th 81.0% | 10th 84.0% | 2nd 86.8% | 1st 87.4% | 17th 81.3% | 6th 85.8% | 13th 82.6% | |
| 84.3% | 80% | 81% | 86% | 74% | 83% | 76% | 86% | 80% | 83% | 81% | 93% | 97% | 94% | 88% | 85% | 81% | 83% | 88% | 95% | 80% | 95% | 76% | 82% | 79% | 82% | 81% | 98% | 88% | 83% | 76% | |
| 81.6% | 88% | 91% | 78% | 91% | 81% | 84% | 87% | 75% | 82% | 79% | 72% | 84% | 84% | 82% | 88% | 62% | 84% | 87% | 70% | 76% | 72% | 85% | 82% | 85% | 83% | 86% | 89% | 85% | 83% | 82% | |
| 72.6% | 62% | 69% | 64% | 82% | 66% | 82% | 71% | 83% | 83% | 76% | 65% | 70% | 74% | 61% | 75% | 72% | 67% | 63% | 64% | 67% | 60% | 78% | 85% | 75% | 74% | 79% | 88% | 68% | 81% | 81% | |
| 84.8% | 76% | 83% | 83% | 85% | 95% | 89% | 93% | 89% | 84% | 87% | 80% | 79% | 78% | 72% | 91% | 81% | 96% | 84% | 89% | 72% | 71% | 92% | 89% | 82% | 87% | 86% | 88% | 73% | 98% | 96% | |
| 93.1% | 86% | 89% | 93% | 91% | 91% | 94% | 88% | 96% | 98% | 86% | 91% | 87% | 90% | 98% | 96% | 93% | 92% | 97% | 96% | 92% | 98% | 99% | 96% | 89% | 94% | 95% | 93% | 94% | 95% | 98% | |
| 71.6% | 67% | 81% | 69% | 78% | 80% | 89% | 82% | 80% | 81% | 78% | 58% | 59% | 49% | 79% | 82% | 75% | 71% | 43% | 50% | 29% | 52% | 86% | 89% | 76% | 86% | 95% | 69% | 81% | 76% | 64% |