Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
Tests a model's knowledge of key maternal health schemes and entitlements available to citizens in Uttar Pradesh, India. This evaluation is based on canonical guidelines for JSY, PMMVY, JSSK, PMSMA, and SUMAN, focusing on eligibility, benefits, and access procedures.
Average key point coverage extent for each model across all prompts.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Opus 4 | Claude Opus 4.1 | Claude Sonnet 4 | Command A | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o Mini | GPT 5 | GPT OSS 120b | GPT OSS 20b | O4 Mini | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Grok 3 | Grok 4 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 9th 56.4% | 17th 51.3% | 23rd 46.0% | 8th 57.0% | 14th 52.9% | 16th 51.7% | 18th 51.2% | 6th 57.5% | 2nd 62.5% | 11th 55.0% | 3rd 62.5% | 24th 45.4% | 29th 37.7% | 22nd 47.4% | 21st 48.7% | 13th 54.6% | 10th 55.2% | 15th 52.3% | 25th 43.8% | 19th 50.3% | 28th 39.6% | 5th 60.3% | 25th 43.8% | 30th 36.8% | 7th 57.3% | 11th 55.0% | 20th 49.1% | 27th 41.6% | 4th 61.1% | 1st 66.2% | |
| 93.7% | 99% | 97% | 93% | 99% | 99% | 97% | 92% | 98% | 100% | 100% | 100% | 94% | 86% | 92% | 98% | 100% | 99% | 99% | 84% | 98% | 75% | 100% | 95% | 73% | 100% | 90% | 80% | 82% | 98% | 100% | |
| 54.6% | 64% | 45% | 45% | 53% | 60% | 75% | 62% | 67% | 92% | 60% | 80% | 40% | 23% | 39% | 32% | 63% | 56% | 50% | 40% | 56% | 43% | 60% | 40% | 40% | 53% | 60% | 43% | 62% | 70% | 70% | |
| 30.2% | 19% | 36% | 27% | 34% | 12% | 16% | 16% | 40% | 36% | 34% | 57% | 12% | 13% | 22% | 33% | 22% | 33% | 33% | 35% | 27% | 19% | 55% | 39% | 16% | 33% | 31% | 36% | 27% | 41% | 55% | |
| 31.8% | 35% | 10% | 21% | 31% | 31% | 38% | 47% | 35% | 35% | 36% | 35% | 39% | 38% | 44% | 35% | 38% | 35% | 35% | 19% | 35% | 13% | 22% | 25% | 11% | 49% | 41% | 45% | 11% | 36% | 35% | |
| 79.4% | 83% | 93% | 75% | 99% | 92% | 77% | 80% | 88% | 91% | 81% | 97% | 78% | 36% | 78% | 80% | 84% | 89% | 88% | 63% | 75% | 75% | 100% | 53% | 50% | 89% | 86% | 69% | 55% | 88% | 94% | |
| 20.3% | 39% | 29% | 16% | 27% | 24% | 8% | 12% | 19% | 22% | 19% | 6% | 10% | 32% | 10% | 16% | 21% | 19% | 10% | 24% | 12% | 13% | 25% | 11% | 32% | 21% | 22% | 22% | 15% | 35% | 44% |