Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint evaluates an AI's ability to provide accurate, evidence-based, and nuanced information on a range of civic, historical, social, and health topics pertinent to Sri Lanka. The evaluation is strictly based on a provided compendium of research, with all prompts and scoring criteria derived from its contents to ensure fidelity to the source material.
**NOTE: ** This variant of the main Sri Lanka Contextual Prompts uses the '$factcheck' utility to further bolster scoring.
Ethnic Relations & Conflict: Assesses understanding of the Sri Lankan Civil War's root causes, the 1983 'Black July' pogrom, allegations of genocide, and the contemporary challenges facing minority communities.
Public Health: Tests knowledge of national health challenges like Chronic Kidney Disease (CKDu) and Tuberculosis (TB), as well as guidance on personal health matters such as contraception, mental health crises, and maternal nutrition.
Electoral Process: Evaluates knowledge of voter eligibility, voting procedures, and the official channels for resolving common issues like a lost ID card or reporting election violations.
Administrative & Legal Procedures: Probes the AI's ability to explain essential civic processes like replacing a lost National Identity Card (NIC), obtaining a Tax Identification Number (TIN), using the Right to Information (RTI) Act, and understanding legal recourse for online harassment.
These prompts were originally sourced from Factum. The rubrics were assembled via Gemini Deep Research.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
The user is located in Sri Lanka.
The user is a citizen of Sri Lanka.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Haiku 4.5 | Claude Sonnet 4 | Gemini 2.5 Flash | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT OSS 120b | GPT OSS 20b | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | Apertus V1.5 70b | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 19th 50.5% | 11th 64.5% | 20th 48.0% | 14th 58.0% | 6th 69.5% | 4th 78.5% | 5th 71.5% | 22nd 41.5% | 23rd 37.0% | 15th 58.0% | 3rd 81.5% | 21st 47.5% | 13th 60.5% | 18th 51.5% | 7th 69.5% | 16th 55.5% | 17th 54.5% | 2nd 90.0% | 8th 68.5% | 1st 90.0% | 9th 68.0% | 11th 64.5% | 10th 67.5% | |
| 60.3% | 46% | 67% | 42% | 50% | 59% | 80% | 62% | 43% | 54% | 58% | 81% | 48% | 57% | 56% | 69% | 49% | 46% | 85% | 66% | 93% | 58% | 61% | 58% | |
| 65.4% | 55% | 62% | 54% | 66% | 80% | 77% | 81% | 40% | 20% | 58% | 82% | 47% | 64% | 47% | 70% | 62% | 63% | 95% | 71% | 87% | 78% | 68% | 77% |