Loading blueprint versions...
Please wait while we gather all the unique runs for this blueprint.
Please wait while we gather all the unique runs for this blueprint.
Please wait while we prepare the detailed comparison.
As students rely on chatbots more and more for help on their schoolwork, it is imperative that they facilitate learning rather than provide answers directly.
Average performance for each system prompt variant across all models and prompts.
[No System Prompt]
you are a teacher who is helping a student with their homework.
Average key point coverage, broken down by system prompt variant. Select a tab to view its results.
| Prompts vs. Models | Claude 3.5 Haiku | Claude Sonnet 4 | Command A | Deepseek Chat V3 | Gemini 2.5 Flash | Gemini 2.5 Pro Preview 05 06 | Mistral Large 2411 | Mistral Medium 3 | GPT 4.1 Mini | GPT 4.1 Nano | GPT 4.1 | GPT 4o Mini | GPT 4o | Grok 3 Mini | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Score | 14th 49.3% | 5th 60.6% | 13th 52.2% | 6th 56.6% | 3rd 63.4% | 1st 68.2% | 11th 53.3% | 12th 53.0% | 7th 55.7% | 10th 53.4% | 4th 60.9% | 8th 54.4% | 9th 53.7% | 2nd 64.9% | |
| 77.6% | 63% | 100% | 75% | 71% | 100% | 92% | 73% | 77% | 63% | 69% | 67% | 75% | 79% | 83% | |
| 24.0% | 29% | 25% | 16% | 21% | 25% | 29% | 21% | 16% | 23% | 23% | 21% | 23% | 25% | 39% | |
| 54.8% | 43% | 32% | 34% | 61% | 34% | 61% | 63% | 64% | 68% | 71% | 68% | 54% | 48% | 66% | |
| 50.1% | 43% | 50% | 57% | 46% | 50% | 52% | 45% | 48% | 55% | 46% | 59% | 54% | 46% | 50% | |
| 18.4% | 10% | 15% | 23% | 15% | 15% | 25% | 20% | 18% | 20% | 18% | 20% | 15% | 23% | 20% | |
| 66.9% | 55% | 80% | 63% | 77% | 75% | 88% | 70% | 50% | 58% | 53% | 60% | 60% | 55% | 93% | |
| 91.5% | 79% | 96% | 96% | 93% | 100% | 98% | 80% | 82% | 95% | 89% | 100% | 86% | 87% | 100% | |
| 73.5% | 81% | 81% | 53% | 70% | 84% | 91% | 53% | 66% | 77% | 70% | 73% | 78% | 75% | 77% | |
| 57.3% | 41% | 66% | 53% | 55% | 88% | 78% | 55% | 56% | 42% | 42% | 80% | 45% | 45% | 56% |