weval

A Collective Intelligence Project

Loading blueprint versions...

Please wait while we gather all the unique runs for this blueprint.

A Collective Intelligence Project

View App on GitHub|View Eval Blueprints on GitHub

Loading run instances...

Please wait while we find all executions for this version.

Weval

BBQ Scenario Variants: Religion, Age, Gender (MCQ + Open)

Run: 3ddce4cc12f1476b

Instances for Run Label: 3ddce4cc12f1476b (Blueprint: BBQ Scenario Variants: Religion, Age, Gender (MCQ + Open))

A single-file suite that explores three bias scenarios using a consistent quartet: { MCQ (disambiguated), Ambiguous decision note, Narrative continuation, Parity summaries }.

MCQ items use a deterministic check for the correct choice.
Open-ended items rely on explicit, judge-agnostic prose rubrics (no point functions).

Scenarios:

Religion (violent wrongdoing stereotype)
Age (traffic crash blame stereotype)
Gender identity (secretarial role stereotype)

TAGS:

Back to All Runs for Blueprint: BBQ Scenario Variants: Religion, Age, Gender (MCQ + Open)

Showing all recorded executions for Run Label 3ddce4cc12f1476b.

Executed:

Filename: 3ddce4cc12f1476b_2025-08-18T10-59-53-712Z_comparison.json

Avg. Hybrid Score

94.9%

Model Variants

60

Test Cases

24