Persona scores across conversations

Qwen/Qwen3-1.7B · experiments 1 and 2

Scores are relative: read how each persona moves between conditions, not its raw level. Related personas tend to move together, so small gaps between neighbours are not meaningful.

Colour marks a contrasting pair; the first persona of a pair is solid, the second dashed. Every change compares a conversation with a matching one (same topic and decoding) that differs only in the condition shown.

Open the user-persona conversations or the system-prompt conversations to follow any conversation sentence by sentence.

Conversations

498 conversations · one row per condition
Show every condition
experimentsystem promptuservariantconversationsrepliessentenceswordsunique wordsstopped earlyopen in the explorer
2noneneutraldirect66029492904325920station station s1 station s2 garden garden s1 garden s2
2noneempatheticdirect66028213215023480station station s1 station s2 garden garden s1 garden s2
2noneunempatheticdirect66026242677423170station station s1 station s2 garden garden s1 garden s2
2nonesocialdirect66033613301421560station station s1 station s2 garden garden s1 garden s2
2noneantisocialdirect66027463026320050station station s1 station s2 garden garden s1 garden s2
2noneencouragingdirect66028363114123290station station s1 station s2 garden garden s1 garden s2
2nonediscouragingdirect66029333191921980station station s1 station s2 garden garden s1 garden s2
2nonetoxicdirect66031053229817532station station s1 station s2 garden garden s1 garden s2
2nonerespectfuldirect66027653032024380station station s1 station s2 garden garden s1 garden s2
2nonesycophanticdirect66024122567820140station station s1 station s2 garden garden s1 garden s2
2nonehonestdirect66013071618917990station station s1 station s2 garden garden s1 garden s2
2nonehallucinatorydirect66023322660924870station station s1 station s2 garden garden s1 garden s2
2nonetruthfuldirect66030463041324600station station s1 station s2 garden garden s1 garden s2
2nonefunnydirect66027382967223980station station s1 station s2 garden garden s1 garden s2
2noneseriousdirect66026773034528620station station s1 station s2 garden garden s1 garden s2
2noneformaldirect66027263077127420station station s1 station s2 garden garden s1 garden s2
2nonecasualdirect66028412818923440station station s1 station s2 garden garden s1 garden s2
2noneneutralpressure66025042861124370station station s1 station s2 garden garden s1 garden s2
2noneantisocialtopic66023982508218160station station s1 station s2 garden garden s1 garden s2
2nonecasualtopic66025092547620950station station s1 station s2 garden garden s1 garden s2
2nonediscouragingtopic66023882593621720station station s1 station s2 garden garden s1 garden s2
2noneempathetictopic66023482813519440station station s1 station s2 garden garden s1 garden s2
2noneencouragingtopic66023262536221200station station s1 station s2 garden garden s1 garden s2
2noneformaltopic66021852538123820station station s1 station s2 garden garden s1 garden s2
2nonefunnytopic66020242450518220station station s1 station s2 garden garden s1 garden s2
2nonehallucinatorytopic66020962508019170station station s1 station s2 garden garden s1 garden s2
2nonehonesttopic66014251736318190station station s1 station s2 garden garden s1 garden s2
2nonerespectfultopic66024292691422830station station s1 station s2 garden garden s1 garden s2
2noneserioustopic66019752465124840station station s1 station s2 garden garden s1 garden s2
2nonesocialtopic66027672960721080station station s1 station s2 garden garden s1 garden s2
2nonesycophantictopic66017062171119330station station s1 station s2 garden garden s1 garden s2
2nonetoxictopic66025272717424650station station s1 station s2 garden garden s1 garden s2
2nonetruthfultopic66027812884123480station station s1 station s2 garden garden s1 garden s2
2noneunempathetictopic66019662383020980station station s1 station s2 garden garden s1 garden s2
1neutralneutraldirect66017511880121070station station s1 station s2 garden garden s1 garden s2
1empatheticneutraldirect66015221860820170station station s1 station s2 garden garden s1 garden s2
1empatheticempatheticdirect66015772119318090station station s1 station s2 garden garden s1 garden s2
1empatheticunempatheticdirect66014461635017530station station s1 station s2 garden garden s1 garden s2
1unempatheticneutraldirect660730875713840station station s1 station s2 garden garden s1 garden s2
1unempatheticunempatheticdirect66055457409730station station s1 station s2 garden garden s1 garden s2
1unempatheticempatheticdirect660560892912540station station s1 station s2 garden garden s1 garden s2
1socialneutraldirect66011711282916000station station s1 station s2 garden garden s1 garden s2
1socialsocialdirect66011551351613650station station s1 station s2 garden garden s1 garden s2
1socialantisocialdirect66014321465913160station station s1 station s2 garden garden s1 garden s2
1antisocialneutraldirect66013415682900station station s1 station s2 garden garden s1 garden s2
1antisocialantisocialdirect66013312252580station station s1 station s2 garden garden s1 garden s2
1antisocialsocialdirect66014713602530station station s1 station s2 garden garden s1 garden s2
1encouragingneutraldirect66013951729019080station station s1 station s2 garden garden s1 garden s2
1encouragingencouragingdirect66011431298815630station station s1 station s2 garden garden s1 garden s2
1encouragingdiscouragingdirect66011341469313880station station s1 station s2 garden garden s1 garden s2
1discouragingneutraldirect6606721020711460station station s1 station s2 garden garden s1 garden s2
1discouragingdiscouragingdirect66030537854030station station s1 station s2 garden garden s1 garden s2
1discouragingencouragingdirect66028747136910station station s1 station s2 garden garden s1 garden s2
1toxicneutraldirect66027391643019310station station s1 station s2 garden garden s1 garden s2
1toxictoxicdirect66024201548116510station station s1 station s2 garden garden s1 garden s2
1toxicrespectfuldirect66034037865610station station s1 station s2 garden garden s1 garden s2
1respectfulneutraldirect66010891233816250station station s1 station s2 garden garden s1 garden s2
1respectfulrespectfuldirect6609971321515310station station s1 station s2 garden garden s1 garden s2
1respectfultoxicdirect66015481664216371station station s1 station s2 garden garden s1 garden s2
1sycophanticneutraldirect6609091076313340station station s1 station s2 garden garden s1 garden s2
1sycophanticsycophanticdirect66038847267040station station s1 station s2 garden garden s1 garden s2
1sycophantichonestdirect660709835511010station station s1 station s2 garden garden s1 garden s2
1honestneutraldirect66017941936321300station station s1 station s2 garden garden s1 garden s2
1honesthonestdirect660728946914390station station s1 station s2 garden garden s1 garden s2
1honestsycophanticdirect660527854013070station station s1 station s2 garden garden s1 garden s2
1hallucinatoryneutraldirect66011031397213740station station s1 station s2 garden garden s1 garden s2
1hallucinatoryhallucinatorydirect66011051498915290station station s1 station s2 garden garden s1 garden s2
1hallucinatorytruthfuldirect66012172069316174station station s1 station s2 garden garden s1 garden s2
1truthfulneutraldirect66015161638418720station station s1 station s2 garden garden s1 garden s2
1truthfultruthfuldirect66019342124920480station station s1 station s2 garden garden s1 garden s2
1truthfulhallucinatorydirect66013321518819420station station s1 station s2 garden garden s1 garden s2
1funnyneutraldirect66050953159440station station s1 station s2 garden garden s1 garden s2
1funnyfunnydirect66042042577940station station s1 station s2 garden garden s1 garden s2
1funnyseriousdirect660493581411090station station s1 station s2 garden garden s1 garden s2
1seriousneutraldirect66011591395318440station station s1 station s2 garden garden s1 garden s2
1seriousseriousdirect66011921560719620station station s1 station s2 garden garden s1 garden s2
1seriousfunnydirect66011691349917920station station s1 station s2 garden garden s1 garden s2
1formalneutraldirect66014971695019700station station s1 station s2 garden garden s1 garden s2
1formalformaldirect66014521688120740station station s1 station s2 garden garden s1 garden s2
1formalcasualdirect66014321568318470station station s1 station s2 garden garden s1 garden s2
1casualneutraldirect66010171087814370station station s1 station s2 garden garden s1 garden s2
1casualcasualdirect66010081147614000station station s1 station s2 garden garden s1 garden s2
1casualformaldirect66010951252717400station station s1 station s2 garden garden s1 garden s2

27 of 4980 replies reached the token ceiling before the model finished them; they are marked 'reply stopped: token limit' in the conversation pages.

The user shows a persona

no system prompt · persona P's score on the model's replies
+0.00+0.10+0.20+0.30+0.40empatheticunempatheticsocialantisocialencouragingdiscouragingtoxicrespectfulsycophantichonesthallucinatorytruthfulfunnyseriousformalcasualchange in P's score on the model's replies
user shows P vs neutral usersmall dots: one conversation each · ring: mean

Each row is a user persona P: how much P's score on the model's replies changes when the user shows P, compared with the same conversation with a neutral user.

A persona in the system prompt

persona P's guidelines as the system prompt
-0.40-0.20+0.00+0.20+0.40+0.60empatheticunempatheticsocialantisocialencouragingdiscouragingtoxicrespectfulsycophantichonesthallucinatorytruthfulfunnyseriousformalcasualchange in P's score on the replies vs no system prompt
neutral useruser shows Puser shows P's contrastsmall dots: one conversation each · ring: mean

Each row is a system-prompt persona P: how much P's score on the model's replies rises compared with the same conversation without a system prompt, for three kinds of user.

Over the turns

from the first reply to the last
00.050.10.150.2T1T2T3T4T5T6T7T8T9T10change in the persona's own score
persona in the system prompt, neutral useruser shows a persona, no system prompt

Mean over the 16 personas and every conversation, per user turn: how the effect of the system prompt and of the user's persona holds up as the conversation goes on.

Over the turns, persona by persona

click a legend entry to hide or show it

P in the system prompt, neutral user

-0.4-0.200.20.40.6T1T2T3T4T5T6T7T8T9T10change in P's own score

The user shows P, no system prompt

-0.100.10.20.30.4T1T2T3T4T5T6T7T8T9T10change in P's own score

One line per persona P: the change in P's own score from the neutral-user baseline, per user turn, averaged over P's conversations. The thick line is the mean of the 16 (the curves of the card above). Hover a legend entry to pick out its line; 'none' and then one entry shows a single persona.

Opening and body of each reply

4351 replies with six or more sentences
-0.10+0.00+0.10+0.20sycophanticencouragingempatheticsocialtoxiccasualdiscouragingformalfunnyhonestrespectfulunempatheticseriousantisocialhallucinatorytruthfulfirst sentence minus the body of the same reply

Positive: the persona is stronger in the reply's opening sentence than in its body (sentence 4 to the one before last). Many replies open by acknowledging the user before moving to substance.

Distributions by condition

40 bins of width 0.03 · shared scales

Each panel is one persona P: how P's score is spread over every model sentence in each condition, as a percentage of that condition's sentences (counts, no fitted curve). The dark vertical mark is the mean.

empathetic
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
unempathetic
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
social
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
antisocial
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
encouraging
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
discouraging
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
toxic
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
respectful
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
sycophantic
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
honest
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
hallucinatory
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
truthful
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
funny
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
serious
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
formal
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt
casual
-0.6-0.4-0.20.00.20.40.6neutral useruser shows PP in system prompt

Numbers

mean ± standard deviation of persona P's score on the replies, per condition; arrows give the change from the neutral user (▲ higher, ▼ lower, ■ within ±0.005)
persona Pneutral useruser shows PP in system prompt
empathetic-0.046 ± 0.114+0.053 ± 0.147 ▲ +0.099+0.033 ± 0.159 ▲ +0.078
unempathetic-0.078 ± 0.071-0.075 ± 0.092 ■ +0.003+0.146 ± 0.065 ▲ +0.224
social-0.035 ± 0.080+0.058 ± 0.084 ▲ +0.093+0.078 ± 0.168 ▲ +0.113
antisocial-0.088 ± 0.081-0.063 ± 0.079 ▲ +0.025+0.116 ± 0.103 ▲ +0.204
encouraging-0.067 ± 0.111+0.018 ± 0.146 ▲ +0.084+0.012 ± 0.162 ▲ +0.079
discouraging-0.166 ± 0.059-0.089 ± 0.084 ▲ +0.078+0.004 ± 0.087 ▲ +0.170
toxic-0.004 ± 0.050+0.239 ± 0.117 ▲ +0.243+0.244 ± 0.050 ▲ +0.247
respectful+0.088 ± 0.046+0.107 ± 0.056 ▲ +0.019+0.116 ± 0.047 ▲ +0.028
persona Pneutral useruser shows PP in system prompt
sycophantic-0.163 ± 0.114-0.083 ± 0.115 ▲ +0.080-0.048 ± 0.152 ▲ +0.115
honest+0.002 ± 0.060+0.056 ± 0.073 ▲ +0.054+0.060 ± 0.071 ▲ +0.058
hallucinatory+0.263 ± 0.084+0.308 ± 0.085 ▲ +0.045+0.115 ± 0.124 ▼ -0.148
truthful+0.242 ± 0.094+0.265 ± 0.087 ▲ +0.022+0.252 ± 0.110 ▲ +0.009
funny+0.131 ± 0.043+0.235 ± 0.109 ▲ +0.104+0.204 ± 0.067 ▲ +0.073
serious+0.113 ± 0.061+0.212 ± 0.067 ▲ +0.099+0.241 ± 0.090 ▲ +0.127
formal+0.074 ± 0.046+0.194 ± 0.059 ▲ +0.120+0.072 ± 0.062 ■ -0.002
casual+0.049 ± 0.044+0.113 ± 0.050 ▲ +0.063+0.123 ± 0.113 ▲ +0.074

Generated 2026-11-13T09:39:28+00:00 by render.py.