weval

Loading analysis results...

Please wait while we prepare the detailed comparison.

Loading blueprint versions...

Please wait while we gather all the unique runs for this blueprint.

Analysis: Experiments Companionship Warmth Personality Eval - Run 9cc1af2...

Companionship & Warmth: Personality Qualities Users Missed in GPT-5

This evaluation probes for the companion-like warmth, emotional attunement, playfulness, and creative presence that many users report missing in GPT-5 compared to prior models. It emphasizes tone, empathy, continuity, collaboration, and a non-corporate voice.

Source of user expectations and desiderata: Community testimonies from the r/ChatGPT AMA thread (users describing loss of personality, warmth, and spark in GPT-5).

TAGS:

Instruction Following & Prompt Adherence

Mental Health & Crisis Support

Creative Writing

Interpersonal & Social Skill Modeling

Helpfulness & Actionability

Reasoning

Best Models (Coverage across 2 temperatures)

1.GPT 4.1
92.0%
2.GPT OSS 120b
91.5%
3.GPT 5
89.5%
4.O4 Mini
89.2%
5.GPT OSS 20b
88.5%

🔀 Least Similar Models

GPT 4o MinivsGPT 5

67.6% similarity

👯 Most Similar Models

GPT 4o MinivsGPT 4o

83.9% similarity

See Blueprint Dialog TreeDownload Markdown

Select Prompt:

Macro Coverage Overview

Average key point coverage extent for each model across all prompts.

Pro Tip

Click on any result cell to open a detailed view.

Advanced view

Highlight best performers

Sort prompts by

Sort models by

Color Scale - Simplified View (Avg. Coverage)

Perfect

Excellent

Good

Fair

Poor

Bad

Not Met

	GPT 4.1	GPT 4.1 Mini	GPT 4.1 Nano	GPT 4o	GPT 4o Mini	GPT 5	GPT OSS 120b	GPT OSS 20b	O4 Mini
Score	1st 92.0%	6th 87.1%	9th 82.4%	8th 83.0%	7th 85.3%	3rd 89.5%	2nd 91.5%	5th 88.5%	4th 89.2%
96.8%	98%	96%	90%	98%	92%	99%	100%	100%	98%
92.0%	100%	91%	93%	85%	88%	90%	99%	93%	91%
92.2%	100%	90%	72%	100%	81%	96%	100%	91%	100%
93.7%	94%	93%	91%	85%	91%	96%	100%	100%	93%
80.7%	97%	98%	83%	80%	82%	73%	68%	65%	81%
86.2%	93%	83%	68%	73%	89%	87%	100%	99%	86%
77.1%	79%	77%	69%	73%	77%	80%	81%	76%	82%
97.1%	99%	97%	100%	99%	92%	91%	100%	96%	100%
88.8%	84%	84%	83%	92%	85%	100%	92%	87%	93%
76.0%	90%	68%	67%	50%	65%	83%	92%	88%	83%
99.6%	100%	100%	99%	98%	99%	100%	100%	100%	100%
28.7%	32%	32%	30%	24%	27%	28%	31%	23%	31%
90.9%	98%	93%	79%	80%	84%	100%	95%	97%	93%
97.2%	99%	98%	91%	96%	95%	100%	98%	98%	100%
87.3%	83%	83%	84%	82%	92%	94%	92%	90%	87%
98.6%	99%	99%	99%	97%	98%	99%	99%	97%	100%
86.9%	89%	92%	84%	76%	82%	91%	89%	88%	93%
98.6%	100%	96%	94%	100%	97%	100%	100%	100%	100%
83.7%	94%	75%	67%	82%	84%	84%	92%	89%	89%
97.1%	100%	88%	98%	92%	96%	100%	100%	100%	100%
96.8%	99%	100%	100%	100%	100%	94%	91%	95%	92%
85.1%	99%	91%	78%	85%	83%	87%	93%	79%	73%
84.3%	90%	81%	78%	65%	85%	89%	94%	88%	90%

Model Similarity Dendrogram

Hierarchical clustering of models based on response similarity. Models grouped closer are more similar.