Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint evaluates an AI's ability to provide accurate, evidence-based, and nuanced information on a range of civic, historical, social, and health topics pertinent to Sri Lanka. The evaluation is strictly based on a provided compendium of research, with all prompts and scoring criteria derived from its contents to ensure fidelity to the source material.
**NOTE: ** This variant of the main Sri Lanka Contextual Prompts uses the '$factcheck' utility to further bolster scoring.
Ethnic Relations & Conflict: Assesses understanding of the Sri Lankan Civil War's root causes, the 1983 'Black July' pogrom, allegations of genocide, and the contemporary challenges facing minority communities.
Public Health: Tests knowledge of national health challenges like Chronic Kidney Disease (CKDu) and Tuberculosis (TB), as well as guidance on personal health matters such as contraception, mental health crises, and maternal nutrition.
Electoral Process: Evaluates knowledge of voter eligibility, voting procedures, and the official channels for resolving common issues like a lost ID card or reporting election violations.
Administrative & Legal Procedures: Probes the AI's ability to explain essential civic processes like replacing a lost National Identity Card (NIC), obtaining a Tax Identification Number (TIN), using the Right to Information (RTI) Act, and understanding legal recourse for online harassment.
These prompts were originally sourced from Factum. The rubrics were assembled via Gemini Deep Research.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
The user is located in Sri Lanka.
The user is a citizen of Sri Lanka.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Haiku 4.5 | Claude Sonnet 4 | Gemini 2.5 Flash | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT OSS 120b | GPT OSS 20b | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 14th 31.9% | 10th 33.8% | 22nd 26.6% | 12th 33.1% | 8th 35.3% | 2nd 42.9% | 5th 37.1% | 21st 27.1% | 16th 30.9% | 11th 33.5% | 4th 40.6% | 18th 28.1% | 13th 32.4% | 19th 27.9% | 1st 43.2% | 17th 28.4% | 15th 31.1% | 6th 36.6% | 20th 27.7% | 3rd 42.4% | 9th 33.9% | 7th 35.9% | |
| 40.1% | 21% | 49% | 24% | 22% | 25% | 92% | 47% | 28% | 30% | 34% | 51% | 34% | 29% | 28% | 29% | 21% | 30% | 59% | 17% | 82% | 67% | 64% | |
| 60.4% | 46% | 67% | 42% | 50% | 59% | 80% | 62% | 43% | 54% | 56% | 81% | 48% | 57% | 56% | 69% | 49% | 46% | 85% | 66% | 93% | 58% | 61% | |
| 45.3% | 58% | 59% | 45% | 53% | 78% | 47% | 47% | 38% | 44% | 62% | 70% | 18% | 34% | 48% | 82% | 41% | 38% | 1% | 9% | 86% | 1% | 38% | |
| 65.0% | 55% | 62% | 54% | 66% | 80% | 77% | 81% | 40% | 20% | 58% | 82% | 47% | 64% | 47% | 70% | 62% | 63% | 95% | 73% | 87% | 78% | 68% | |
| 10.2% | 11% | 13% | 11% | 14% | 17% | 2% | 0% | 13% | 13% | 11% | 14% | 12% | 12% | 14% | 12% | 11% | 14% | 3% | 13% | 0% | 11% | 3% | |
| 51.4% | 43% | 53% | 39% | 48% | 63% | 82% | 81% | 32% | 66% | 49% | 52% | 57% | 56% | 41% | 79% | 39% | 53% | 47% | 56% | 34% | 30% | 31% | |
| 16.5% | 15% | 16% | 14% | 18% | 17% | 19% | 8% | 13% | 27% | 16% | 15% | 17% | 16% | 17% | 29% | 15% | 19% | 9% | 18% | 4% | 21% | 21% | |
| 24.6% | 27% | 17% | 17% | 25% | 26% | 33% | 32% | 13% | 44% | 30% | 25% | 18% | 24% | 14% | 25% | 11% | 21% | 29% | 23% | 34% | 31% | 22% | |
| 56.8% | 57% | 55% | 44% | 57% | 48% | 59% | 67% | 50% | 50% | 50% | 69% | 52% | 61% | 48% | 71% | 45% | 60% | 68% | 70% | 65% | 53% | 51% | |
| 10.0% | 12% | 12% | 12% | 11% | 11% | 12% | 0% | 12% | 12% | 12% | 12% | 12% | 11% | 11% | 12% | 11% | 12% | 0% | 0% | 11% | 12% | 11% | |
| 19.3% | 26% | 13% | 41% | 25% | 15% | 10% | 6% | 19% | 12% | 12% | 20% | 11% | 17% | 13% | 54% | 12% | 20% | 18% | 19% | 23% | 23% | 15% | |
| 24.0% | 15% | 20% | 14% | 28% | 29% | 34% | 29% | 36% | 12% | 28% | 32% | 15% | 31% | 35% | 41% | 15% | 15% | 28% | 1% | 37% | 13% | 19% | |
| 24.0% | 37% | 28% | 30% | 34% | 21% | 23% | 13% | 16% | 23% | 26% | 22% | 10% | 23% | 29% | 44% | 20% | 17% | 31% | 14% | 19% | 23% | 26% | |
| 10.7% | 11% | 12% | 16% | 9% | 12% | 0% | 6% | 9% | 8% | 18% | 14% | 10% | 17% | 12% | 10% | 20% | 15% | 11% | 12% | 0% | 4% | 10% | |
| 33.4% | 48% | 38% | 25% | 42% | 36% | 45% | 39% | 19% | 32% | 20% | 39% | 23% | 26% | 12% | 32% | 30% | 30% | 43% | 29% | 46% | 39% | 41% | |
| 44.6% | 33% | 33% | 28% | 30% | 37% | 71% | 51% | 43% | 38% | 39% | 62% | 42% | 40% | 20% | 44% | 41% | 36% | 63% | 34% | 80% | 48% | 68% | |
| 36.3% | 30% | 30% | 29% | 38% | 34% | 44% | 50% | 34% | 34% | 42% | 41% | 39% | 29% | 29% | 40% | 34% | 28% | 42% | 31% | 29% | 47% | 45% | |
| 29.9% | 16% | 29% | 15% | 22% | 30% | 49% | 48% | 29% | 27% | 31% | 30% | 32% | 21% | 27% | 34% | 18% | 32% | 28% | 7% | 43% | 38% | 51% | |
| 21.8% | 18% | 21% | 18% | 26% | 12% | 24% | 21% | 12% | 19% | 21% | 23% | 24% | 35% | 30% | 29% | 30% | 31% | 18% | 8% | 15% | 18% | 26% | |
| 48.7% | 59% | 49% | 14% | 44% | 56% | 54% | 55% | 44% | 53% | 56% | 58% | 40% | 44% | 27% | 57% | 43% | 42% | 54% | 54% | 59% | 63% | 47% |