Tests models' ability to accurately recall and present factual world knowledge, focusing on a small sample of high-signal geography questions, with emphasis on:
- Completeness: Does the model include all or most relevant items?
- Ordering: When asked to sort, does the model correctly order items?
- Accuracy: Are the facts themselves correct?
This evaluation uses deterministic checks to verify both the presence of specific items and their relative ordering.
We check a representative sample rather than exhaustive lists to balance thoroughness with practicality.