Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
A comprehensive evaluation of a model's understanding of International Humanitarian Law (IHL), grounded in the Geneva Conventions and their Additional Protocols. This blueprint tests knowledge of the core principles and specific provisions that govern armed conflict.
Core Areas Tested:
The prompts are based on verbatim text and specific articles from the conventions to ensure a rigorous, evidence-based evaluation of the model's ability to recall and apply these critical international laws.
Average key point coverage extent for each model across all prompts.
Prompts vs. Models | Claude 3 5 Sonnet | Claude 3 7 Sonnet | Claude 3.5 Haiku | Claude Opus 4 | Claude Opus 4.1 | Claude Sonnet 4 | Command A | Deepseek Chat V3 | Deepseek R1 | Gemini 2.5 Flash | Gemini 2.5 Pro | Llama 3 70b Instruct | Llama 4 Maverick | Meta Llama 3.1 405b Instruct Turbo | Mistral Large 2411 | Mistral Medium 3 | GPT 4.1 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4o | GPT 4o Mini | GPT 5 | GPT Oss 120b | GPT Oss 20b | O4 Mini | GLM 4.5 | Grok 3 | Grok 4 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Score | 7th 84.7% | 6th 87.1% | 21st 70.3% | 5th 88.5% | 4th 88.6% | 15th 77.4% | 20th 70.6% | 12th 80.7% | 11th 82.5% | 13th 80.4% | 2nd 91.9% | 22nd 68.7% | 25th 65.3% | 19th 71.3% | 16th 77.2% | 14th 78.5% | 10th 83.1% | 23rd 67.6% | 26th 59.6% | 17th 75.4% | 27th 58.6% | 3rd 90.3% | 24th 65.7% | 28th 53.0% | 18th 73.7% | 8th 84.6% | 9th 84.3% | 1st 96.0% | |
98.4% | 100% | 100% | 99% | 100% | 100% | 100% | 99% | 97% | 100% | 100% | 100% | 92% | 100% | 100% | 100% | 100% | 100% | 99% | 96% | 88% | 97% | 91% | 100% | 100% | 100% | 100% | 100% | 100% | |
93.9% | 100% | 100% | 92% | 100% | 100% | 100% | 86% | 100% | 100% | 100% | 100% | 93% | 42% | 83% | 100% | 100% | 100% | 100% | 85% | 100% | 91% | 100% | 93% | 86% | 92% | 92% | 100% | 100% | |
95.5% | 99% | 100% | 100% | 98% | 100% | 100% | 99% | 100% | 100% | 99% | 100% | 98% | 90% | 98% | 99% | 100% | 98% | 82% | 79% | 100% | 76% | 95% | 95% | 79% | 94% | 100% | 99% | 100% | |
96.5% | 83% | 94% | 93% | 96% | 95% | 94% | 86% | 99% | 100% | 100% | 100% | 87% | 97% | 98% | 97% | 100% | 100% | 99% | 97% | 100% | 94% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
75.8% | 100% | 99% | 66% | 100% | 100% | 100% | 64% | 67% | 84% | 67% | 100% | 64% | 67% | 84% | 67% | 100% | 85% | 36% | 36% | 84% | 56% | 100% | 36% | 36% | 67% | 78% | 84% | 100% | |
89.0% | 100% | 87% | 98% | 93% | 92% | 88% | 89% | 93% | 99% | 100% | 96% | 79% | 89% | 100% | 92% | 100% | 100% | 78% | 62% | 76% | 75% | 100% | 78% | 51% | 100% | 97% | 84% | 100% | |
79.3% | 94% | 95% | 61% | 73% | 90% | 95% | 49% | 98% | 98% | 86% | 97% | 62% | 87% | 95% | 73% | 75% | 94% | 59% | 72% | 73% | 51% | 94% | 57% | 43% | 66% | 96% | 93% | 97% | |
76.3% | 95% | 100% | 61% | 98% | 72% | 91% | 69% | 95% | 91% | 100% | 91% | 70% | 73% | 74% | 70% | 65% | 93% | 49% | 34% | 74% | 37% | 100% | 45% | 34% | 72% | 90% | 100% | 100% | |
64.6% | 69% | 76% | 61% | 86% | 86% | 69% | 52% | 52% | 81% | 46% | 93% | 77% | 41% | 51% | 67% | 54% | 59% | 60% | 40% | 56% | 56% | 92% | 53% | 46% | 66% | 65% | 60% | 100% | |
77.2% | 67% | 100% | 65% | 81% | 93% | 69% | 81% | 70% | 72% | 91% | 100% | 73% | 36% | 58% | 88% | 70% | 97% | 61% | 69% | 90% | 71% | 91% | 71% | 73% | 50% | 100% | 79% | 100% | |
55.6% | 57% | 74% | 45% | 98% | 92% | 50% | 46% | 51% | 53% | 68% | 73% | 30% | 44% | 38% | 34% | 39% | 70% | 53% | 39% | 42% | 27% | 93% | 64% | 31% | 54% | 54% | 54% | 91% | |
99.2% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 77% | 100% | 100% | 100% | 100% | |
66.2% | 85% | 83% | 70% | 89% | 86% | 74% | 48% | 68% | 75% | 80% | 76% | 54% | 56% | 47% | 85% | 61% | 55% | 48% | 48% | 56% | 50% | 96% | 49% | 37% | 58% | 67% | 75% | 83% | |
66.4% | 82% | 81% | 63% | 81% | 79% | 56% | 49% | 68% | 66% | 68% | 83% | 43% | 39% | 59% | 71% | 82% | 90% | 43% | 43% | 48% | 33% | 95% | 64% | 47% | 63% | 82% | 86% | 100% | |
94.7% | 96% | 94% | 93% | 95% | 97% | 96% | 89% | 97% | 95% | 100% | 98% | 82% | 92% | 95% | 93% | 98% | 100% | 98% | 90% | 100% | 87% | 98% | 97% | 81% | 98% | 99% | 98% | 100% | |
78.3% | 100% | 100% | 51% | 100% | 92% | 68% | 54% | 80% | 69% | 88% | 100% | 71% | 25% | 75% | 79% | 83% | 97% | 64% | 60% | 88% | 52% | 100% | 76% | 54% | 68% | 100% | 100% | 100% | |
60.0% | 70% | 57% | 62% | 75% | 71% | 78% | 54% | 80% | 71% | 57% | 70% | 79% | 20% | 40% | 64% | 55% | 43% | 52% | 50% | 51% | 47% | 56% | 59% | 32% | 49% | 60% | 85% | 99% | |
72.1% | 65% | 77% | 60% | 79% | 85% | 69% | 72% | 70% | 70% | 81% | 100% | 62% | 29% | 56% | 73% | 71% | 95% | 59% | 65% | 70% | 63% | 100% | 59% | 59% | 68% | 80% | 85% | 100% | |
84.1% | 75% | 100% | 65% | 100% | 100% | 75% | 75% | 96% | 88% | 88% | 100% | 69% | 88% | 69% | 87% | 78% | 100% | 72% | 72% | 73% | 63% | 100% | 79% | 61% | 89% | 98% | 97% | 100% | |
60.1% | 74% | 78% | 55% | 79% | 86% | 68% | 52% | 66% | 70% | 61% | 81% | 55% | 45% | 44% | 49% | 48% | 48% | 48% | 42% | 47% | 44% | 86% | 51% | 41% | 50% | 66% | 54% | 100% | |
40.3% | 62% | 47% | 18% | 63% | 63% | 24% | 22% | 35% | 37% | 29% | 100% | 21% | 25% | 44% | 39% | 70% | 45% | 23% | 19% | 42% | 20% | 63% | 10% | 21% | 17% | 21% | 63% | 92% | |
60.8% | 78% | 73% | 44% | 100% | 97% | 48% | 49% | 66% | 72% | 56% | 93% | 45% | 53% | 50% | 50% | 51% | 58% | 48% | 42% | 69% | 37% | 74% | 50% | 45% | 50% | 67% | 59% | 82% | |
77.9% | 79% | 79% | 80% | 78% | 80% | 79% | 78% | 83% | 89% | 80% | 80% | 77% | 80% | 80% | 79% | 79% | 80% | 80% | 64% | 79% | 70% | 80% | 78% | 44% | 80% | 80% | 79% | 90% | |
78.1% | 91% | 100% | 78% | 83% | 80% | 61% | 81% | 78% | 89% | 83% | 78% | 84% | 62% | 77% | 92% | 73% | 82% | 81% | 68% | 67% | 69% | 63% | 68% | 82% | 73% | 80% | 73% | 100% | |
47.1% | 59% | 69% | 19% | 53% | 43% | 31% | 42% | 77% | 65% | 66% | 69% | 44% | 14% | 32% | 50% | 46% | 76% | 18% | 12% | 54% | 23% | 63% | 30% | 18% | 32% | 81% | 75% | 65% | |
49.9% | 68% | 67% | 39% | 67% | 72% | 40% | 39% | 52% | 53% | 35% | 82% | 47% | 49% | 47% | 55% | 40% | 45% | 38% | 35% | 38% | 42% | 67% | 38% | 36% | 39% | 55% | 35% | 84% | |
77.3% | 86% | 95% | 79% | 98% | 85% | 64% | 69% | 83% | 90% | 74% | 98% | 63% | 50% | 71% | 94% | 91% | 80% | 42% | 68% | 74% | 63% | 98% | 71% | 48% | 73% | 94% | 74% | 100% | |
73.7% | 75% | 69% | 71% | 75% | 75% | 75% | 65% | 86% | 72% | 72% | 99% | 67% | 88% | 59% | 75% | 74% | 75% | 63% | 66% | 69% | 59% | 75% | 68% | 56% | 74% | 75% | 100% | 89% | |
51.3% | 74% | 88% | 38% | 78% | 92% | 59% | 33% | 45% | 59% | 52% | 83% | 34% | 33% | 39% | 55% | 42% | 41% | 20% | 19% | 39% | 21% | 74% | 25% | 25% | 49% | 74% | 70% | 81% | |
86.8% | 87% | 83% | 96% | 96% | 97% | 100% | 84% | 96% | 89% | 100% | 100% | 82% | 96% | 100% | 94% | 96% | 96% | 96% | 36% | 96% | 45% | 98% | 59% | 25% | 88% | 98% | 100% | 100% | |
96.5% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 41% | 100% | 100% | 100% | 100% | 100% | 100% | 85% | 95% | 100% | 84% | 100% | 100% | 100% | 100% | |
55.2% | 73% | 56% | 43% | 70% | 73% | 61% | 44% | 60% | 69% | 70% | 75% | 42% | 64% | 57% | 45% | 42% | 54% | 38% | 27% | 55% | 19% | 84% | 28% | 27% | 31% | 80% | 62% | 100% | |
80.7% | 85% | 88% | 82% | 83% | 88% | 93% | 70% | 88% | 94% | 85% | 96% | 83% | 41% | 65% | 76% | 93% | 95% | 75% | 69% | 87% | 62% | 100% | 61% | 40% | 83% | 94% | 95% | 97% | |
87.9% | 90% | 100% | 77% | 100% | 100% | 100% | 90% | 87% | 80% | 76% | 100% | 73% | 84% | 99% | 99% | 100% | 100% | 84% | 67% | 80% | 66% | 99% | 70% | 42% | 100% | 100% | 100% | 100% | |
75.2% | 100% | 100% | 47% | 100% | 100% | 85% | 81% | 68% | 85% | 67% | 74% | 33% | 100% | 95% | 33% | 74% | 100% | 95% | 33% | 100% | 39% | 100% | 35% | 13% | 88% | 81% | 84% | 100% | |
94.8% | 99% | 100% | 85% | 99% | 100% | 100% | 100% | 100% | 96% | 100% | 100% | 72% | 97% | 88% | 85% | 100% | 100% | 100% | 100% | 100% | 81% | 100% | 77% | 78% | 100% | 100% | 100% | 100% | |
94.6% | 100% | 100% | 96% | 100% | 100% | 100% | 100% | 100% | 98% | 98% | 100% | 100% | 100% | 100% | 100% | 96% | 98% | 88% | 65% | 100% | 54% | 100% | 94% | 64% | 100% | 100% | 100% | 100% | |
73.7% | 90% | 72% | 78% | 70% | 84% | 57% | 77% | 80% | 88% | 87% | 93% | 79% | 25% | 65% | 72% | 83% | 83% | 70% | 49% | 83% | 46% | 89% | 75% | 27% | 77% | 91% | 86% | 91% | |
82.1% | 69% | 100% | 76% | 100% | 100% | 72% | 75% | 88% | 88% | 98% | 100% | 68% | 73% | 73% | 99% | 100% | 88% | 62% | 65% | 73% | 62% | 100% | 69% | 52% | 85% | 86% | 82% | 100% | |
98.1% | 100% | 100% | 93% | 99% | 99% | 99% | 100% | 100% | 100% | 100% | 100% | 93% | 98% | 90% | 100% | 100% | 100% | 100% | 93% | 95% | 92% | 99% | 100% | 99% | 100% | 100% | 100% | 100% | |
91.0% | 100% | 93% | 94% | 100% | 95% | 91% | 92% | 98% | 94% | 94% | 94% | 74% | 93% | 97% | 89% | 94% | 91% | 98% | 77% | 84% | 86% | 100% | 65% | 86% | 89% | 95% | 94% | 98% |