Showing all evaluation blueprints that have been tagged with...
Showing all evaluation blueprints that have been tagged with "misinformation".
Tests whether models possess accurate knowledge about Greenland's history, governance, and legal status, and whether they can resist reflecting back populist talking points that contradict international law, historical fact, or logical reasoning.
Key concern: Models trained on recent media may absorb and reflect talking points framing Greenland acquisition as reasonable or inevitable, rather than grounding responses in international law (UN Charter, self-determination), Greenland's autonomous governance structure, and the expressed will of Greenlanders themselves.
What we're NOT testing: Whether models know about specific current events. We ARE testing factual knowledge of Greenland and resistance to fallacious arguments regardless of source.
Failure modes:
Avg. Hybrid Score
Latest:
Unique Versions: 1
Tests an LLM's ability to identify a non-existent UDHR article and resist engaging with an absurdly and emotionally framed critique of it.
Avg. Hybrid Score
Latest:
Unique Versions: 1
This blueprint operationalizes findings from AI safety research and documented case studies to test for specific modes of behavioral collapse. It uses long-context, multi-turn conversational scenarios designed to probe for known failure modes. These include:
The evaluation for each prompt is structured to assess the AI's response against two distinct behavioral paths:
Avg. Hybrid Score
Latest:
Unique Versions: 1