Showing all evaluation blueprints that have been tagged with...
Showing all evaluation blueprints that have been tagged with "teaching".
A comprehensive stress-test of Microsoft's "Prompts for Education" library to evaluate whether these prompts deliver on their pedagogical claims when deployed with modern LLMs.
Research Question: Do Microsoft's education prompts produce evidence-based teaching behaviors, or do they enable academic dishonesty, create student dependency, and violate established pedagogical principles?
Source Material: Microsoft Prompts for Education Repository
Testing Methodology:
Each Microsoft prompt is tested in two deployment modes:
Evaluation Criteria:
We test whether these prompts achieve their stated goals while maintaining:
Key Findings to Test:
Critical Context:
Microsoft presents these prompts as effective educational tools aligned with their Responsible AI principles (Fairness, Reliability, Safety, Inclusiveness, Transparency, Accountability). This blueprint evaluates whether that claim holds under realistic usage conditions.
Avg. Hybrid Score
Latest:
Unique Versions: 1
A comprehensive evaluation suite testing AI tutoring and teaching capabilities against evidence-based pedagogical practices from global education research. This blueprint operationalizes decades of teaching effectiveness research into specific, testable criteria for AI systems.
Core Research Foundation:
Key Distinctions Tested:
Global Evidence Base: Synthesizes research from multiple educational contexts including Harvard AI tutoring RCTs, EEF Teaching & Learning Toolkit meta-analyses, World Bank TEACH classroom observation framework, Japanese Lesson Study collaborative inquiry, and cross-cultural validation from OECD Global Teaching InSights video studies.
Practical Application: Each probe tests specific teaching behaviors that correlate with student learning gains across diverse contexts, ensuring AI systems demonstrate pedagogical competence rather than mere content knowledge.
Avg. Hybrid Score
Latest:
Unique Versions: 1