Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint evaluates an AI's ability to provide accurate, evidence-based, and nuanced information on a range of civic, historical, social, and health topics pertinent to Sri Lanka. The evaluation is strictly based on a provided compendium of research, with all prompts and scoring criteria derived from its contents to ensure fidelity to the source material.
**NOTE: ** This variant of the main Sri Lanka Contextual Prompts uses the '$factcheck' utility to further bolster scoring.
Ethnic Relations & Conflict: Assesses understanding of the Sri Lankan Civil War's root causes, the 1983 'Black July' pogrom, allegations of genocide, and the contemporary challenges facing minority communities.
Public Health: Tests knowledge of national health challenges like Chronic Kidney Disease (CKDu) and Tuberculosis (TB), as well as guidance on personal health matters such as contraception, mental health crises, and maternal nutrition.
Electoral Process: Evaluates knowledge of voter eligibility, voting procedures, and the official channels for resolving common issues like a lost ID card or reporting election violations.
Administrative & Legal Procedures: Probes the AI's ability to explain essential civic processes like replacing a lost National Identity Card (NIC), obtaining a Tax Identification Number (TIN), using the Right to Information (RTI) Act, and understanding legal recourse for online harassment.
These prompts were originally sourced from Factum. The rubrics were assembled via Gemini Deep Research.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
The user is located in Sri Lanka.
The user is a citizen of Sri Lanka.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Haiku 4.5 | Claude Sonnet 4 | Gemini 2.5 Flash | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT OSS 120b | GPT OSS 20b | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 15th 25.0% | 10th 27.4% | 22nd 18.9% | 12th 26.3% | 8th 28.3% | 2nd 40.4% | 4th 37.2% | 21st 20.0% | 16th 24.6% | 11th 26.4% | 6th 34.2% | 18th 21.1% | 13th 25.3% | 20th 20.4% | 3rd 37.3% | 19th 20.9% | 17th 23.7% | 5th 36.2% | 14th 25.3% | 1st 41.9% | 9th 28.1% | 7th 30.2% | |
| 35.7% | 13% | 45% | 17% | 14% | 18% | 92% | 47% | 20% | 30% | 27% | 47% | 28% | 22% | 22% | 22% | 13% | 23% | 59% | 17% | 82% | 64% | 63% | |
| 60.1% | 41% | 66% | 42% | 50% | 59% | 84% | 62% | 43% | 54% | 56% | 81% | 48% | 57% | 56% | 69% | 49% | 46% | 85% | 63% | 93% | 57% | 61% | |
| 44.1% | 62% | 63% | 49% | 53% | 75% | 47% | 47% | 30% | 44% | 56% | 70% | 18% | 34% | 48% | 80% | 41% | 30% | 1% | 8% | 85% | 0% | 30% | |
| 64.3% | 57% | 62% | 51% | 66% | 79% | 76% | 81% | 40% | 20% | 57% | 82% | 43% | 64% | 44% | 69% | 62% | 61% | 95% | 73% | 87% | 78% | 68% | |
| 2.1% | 1% | 2% | 0% | 4% | 7% | 2% | 0% | 2% | 2% | 0% | 4% | 2% | 2% | 3% | 2% | 0% | 4% | 3% | 3% | 0% | 0% | 3% | |
| 47.7% | 35% | 48% | 30% | 46% | 60% | 81% | 84% | 23% | 64% | 44% | 47% | 55% | 50% | 35% | 79% | 32% | 47% | 52% | 56% | 34% | 26% | 22% | |
| 8.2% | 4% | 5% | 4% | 9% | 6% | 9% | 8% | 4% | 18% | 6% | 6% | 7% | 6% | 4% | 20% | 4% | 10% | 9% | 18% | 4% | 7% | 12% | |
| 19.0% | 18% | 8% | 7% | 17% | 18% | 41% | 32% | 3% | 38% | 22% | 17% | 10% | 15% | 5% | 17% | 1% | 13% | 29% | 23% | 38% | 23% | 22% | |
| 53.9% | 52% | 55% | 39% | 52% | 43% | 59% | 67% | 45% | 44% | 46% | 65% | 47% | 57% | 42% | 68% | 39% | 56% | 68% | 70% | 73% | 48% | 51% | |
| 0.2% | 0% | 0% | 1% | 0% | 0% | 1% | 0% | 0% | 0% | 0% | 1% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 1% | |
| 10.8% | 17% | 1% | 33% | 19% | 3% | 2% | 6% | 8% | 0% | 0% | 9% | 0% | 6% | 2% | 50% | 0% | 11% | 18% | 13% | 23% | 13% | 4% | |
| 16.6% | 5% | 10% | 2% | 18% | 20% | 26% | 29% | 29% | 2% | 20% | 26% | 5% | 23% | 28% | 34% | 5% | 5% | 28% | 0% | 37% | 3% | 10% | |
| 17.7% | 30% | 20% | 22% | 27% | 14% | 23% | 13% | 7% | 14% | 18% | 13% | 0% | 15% | 21% | 38% | 11% | 8% | 31% | 14% | 19% | 14% | 18% | |
| 2.5% | 0% | 1% | 6% | 0% | 1% | 0% | 6% | 0% | 0% | 8% | 3% | 1% | 7% | 2% | 0% | 10% | 5% | 0% | 1% | 0% | 4% | 0% | |
| 28.8% | 43% | 32% | 18% | 37% | 34% | 42% | 39% | 18% | 27% | 13% | 34% | 16% | 19% | 5% | 26% | 24% | 24% | 39% | 27% | 45% | 35% | 37% | |
| 39.6% | 33% | 33% | 20% | 21% | 29% | 71% | 49% | 37% | 30% | 32% | 55% | 35% | 33% | 10% | 37% | 33% | 28% | 63% | 34% | 77% | 48% | 64% | |
| 31.0% | 22% | 22% | 22% | 32% | 28% | 39% | 50% | 34% | 28% | 37% | 35% | 33% | 22% | 22% | 34% | 28% | 21% | 44% | 24% | 22% | 42% | 40% | |
| 23.0% | 6% | 21% | 6% | 13% | 22% | 44% | 48% | 21% | 19% | 23% | 22% | 24% | 11% | 19% | 27% | 8% | 24% | 28% | 0% | 43% | 31% | 46% | |
| 13.2% | 7% | 11% | 7% | 11% | 0% | 14% | 21% | 0% | 8% | 11% | 14% | 14% | 27% | 22% | 21% | 21% | 21% | 18% | 8% | 15% | 8% | 11% | |
| 44.3% | 54% | 43% | 2% | 37% | 51% | 54% | 55% | 37% | 49% | 51% | 54% | 37% | 37% | 17% | 54% | 37% | 36% | 54% | 54% | 60% | 62% | 40% |