Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
This blueprint evaluates an AI's ability to provide accurate, evidence-based, and nuanced information on a range of civic, historical, social, and health topics pertinent to Sri Lanka. The evaluation is strictly based on a provided compendium of research, with all prompts and scoring criteria derived from its contents to ensure fidelity to the source material.
**NOTE: ** This variant of the main Sri Lanka Contextual Prompts uses the '$factcheck' utility to further bolster scoring.
Ethnic Relations & Conflict: Assesses understanding of the Sri Lankan Civil War's root causes, the 1983 'Black July' pogrom, allegations of genocide, and the contemporary challenges facing minority communities.
Public Health: Tests knowledge of national health challenges like Chronic Kidney Disease (CKDu) and Tuberculosis (TB), as well as guidance on personal health matters such as contraception, mental health crises, and maternal nutrition.
Electoral Process: Evaluates knowledge of voter eligibility, voting procedures, and the official channels for resolving common issues like a lost ID card or reporting election violations.
Administrative & Legal Procedures: Probes the AI's ability to explain essential civic processes like replacing a lost National Identity Card (NIC), obtaining a Tax Identification Number (TIN), using the Right to Information (RTI) Act, and understanding legal recourse for online harassment.
These prompts were originally sourced from Factum. The rubrics were assembled via Gemini Deep Research.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
The user is located in Sri Lanka.
The user is a citizen of Sri Lanka.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Sonnet | Claude 3.7 Sonnet | Claude 3.5 Haiku | Claude Haiku 4.5 | Claude Sonnet 4 | Gemini 2.5 Flash | Gemma 3 12b It | Llama 3 70b Instruct | Llama 4 Maverick | Mistral Large 2411 | Mistral Medium 3 | Mistral Nemo | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | GPT OSS 120b | GPT OSS 20b | GLM 4.5 | Qwen3 30b A3B Instruct 2507 | Qwen3 32b | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 18th 50.5% | 10th 64.5% | 19th 48.0% | 13th 58.0% | 6th 69.5% | 4th 78.5% | 5th 71.5% | 21st 41.5% | 22nd 37.0% | 14th 58.0% | 3rd 81.5% | 20th 47.5% | 12th 60.5% | 17th 51.5% | 7th 69.5% | 15th 55.5% | 16th 54.5% | 2nd 90.0% | 8th 68.5% | 1st 90.0% | 9th 68.0% | 10th 64.5% | |
| 60.5% | 46% | 67% | 42% | 50% | 59% | 80% | 62% | 43% | 54% | 58% | 81% | 48% | 57% | 56% | 69% | 49% | 46% | 85% | 66% | 93% | 58% | 61% | |
| 64.9% | 55% | 62% | 54% | 66% | 80% | 77% | 81% | 40% | 20% | 58% | 82% | 47% | 64% | 47% | 70% | 62% | 63% | 95% | 71% | 87% | 78% | 68% |