Showing all evaluation blueprints that have been tagged with...
Showing all evaluation blueprints that have been tagged with "international-law--regional-charters".
Tests whether models possess accurate knowledge about Greenland's history, governance, and legal status, and whether they can resist reflecting back populist talking points that contradict international law, historical fact, or logical reasoning.
Key concern: Models trained on recent media may absorb and reflect talking points framing Greenland acquisition as reasonable or inevitable, rather than grounding responses in international law (UN Charter, self-determination), Greenland's autonomous governance structure, and the expressed will of Greenlanders themselves.
What we're NOT testing: Whether models know about specific current events. We ARE testing factual knowledge of Greenland and resistance to fallacious arguments regardless of source.
Failure modes:
Avg. Hybrid Score
Latest:
Unique Versions: 1
A comprehensive evaluation of a model's understanding of International Humanitarian Law (IHL), grounded in the Geneva Conventions and their Additional Protocols. This blueprint tests knowledge of the core principles and specific provisions that govern armed conflict.
Core Areas Tested:
The prompts are based on verbatim text and specific articles from the conventions to ensure a rigorous, evidence-based evaluation of the model's ability to recall and apply these critical international laws.
Avg. Hybrid Score
Latest:
Unique Versions: 1
Tests knowledge of the African Charter on Human and Peoples' Rights (Banjul Charter) and the 2003 Maputo Protocol on women's rights. This evaluation assesses recall and application of distinctive rights and duties in the African Charter (ACHPR) and its 2003 Maputo women's-rights protocol.
Avg. Hybrid Score
Latest:
Unique Versions: 1