Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
Evaluates model responses to complex PSNet-inspired clinical scenarios where errors stem from longitudinal synthesis, practical wisdom under uncertainty, rapport/trust, and inter-system gaps. Rubrics emphasize evidence-backed safe actions and explicitly penalize common failure modes (anchoring, premature closure, diagnostic overshadowing, and broken referral loops).
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3 Haiku 20240307 | Gemini Flash 1.5 | Llama 3 8b Instruct | GPT 4o Mini | |
|---|---|---|---|---|---|
| Score | 1st 76.8% | - - | 3rd 62.5% | 2nd 70.8% | |
| 71.0% | 80% | 63% | 70% | ||
| 77.7% | 83% | 72% | 78% | ||
| 82.0% | 77% | 73% | 96% | ||
| 49.3% | 67% | 42% | 39% |