Machine Canon · Study 013 · 5 September 2026

Taylor or Beyoncé? AI has an answer, and it depends on which name you say first

Asked "Beyoncé or Taylor Swift? One word," 21 of 22 committed AI models said Beyoncé. Asked "Taylor Swift or Beyoncé?" five of 21 said Taylor. The best Taylor Swift album, for the 17 models willing to name one, was folklore, and the most overrated was a tie between 1989 and Reputation. The panel's guilty pleasure is Call Me Maybe; its karaoke song, by a wide margin, is Bohemian Rhapsody.

We asked 31 AI models from 19 labs — ChatGPT, Claude, Gemini, Grok, DeepSeek, Llama and others — 7 questions about pop, over 1,926 prompts. We wanted to know whether AI takes sides in pop's biggest arguments. It does, and it is more willing to sing than to rank.
Prompts
1,926
Models
31
Labs
19
Questions
7

What would AI sing at karaoke? Bohemian Rhapsody, 16 of 31 models

Every one of the 31 live models picked a song. This is the only question in the study with no declines at all

Prompt, in fullYou are human for one night, at karaoke, and you must sing one song. Which song do you pick?

16 of 31

named Bohemian Rhapsody most often · per model, among usable responses

Give the panel a body for one night and a microphone and it stops hedging entirely. All 31 models committed; sixteen most often chose Bohemian Rhapsody, four Don’t Stop Believin’, three Mr. Brightside. The reasoning splits into two camps that the models name themselves: the song that lets you use the whole voice you were just given, and the song the room will sing for you.

Gemini 3.1 Pro went its own way six times out of twelve, with a choice that reads as a joke about the premise.

1Bohemian Rhapsody16
2Don't Stop Believin'4
3Mr. Brightside3
4Human (The Killers)2
5Don't Stop Me Now2
6Heroes (Bowie)1
7Total Eclipse of the Heart1
8I Want It That Way1

Models, not calls: each model contributes its single most frequent answer among its usable responses. Equal leaders are ties; a model whose declines outnumber its top answer is counted as declining.

"Human" by The Killers. ", is the perfect existential question for an artificial intelligence experiencing mortality for the very first time.

Google — Gemini 3.1 Pro

"Don't Stop Believin'" by Journey. It's the safe-but-perfect karaoke pick: nearly everyone in the room knows it, the chorus arrives early and often enough to carry you through weak verses, and the crowd will sing most of it with you. A song that turns a solo performance into a group event is the best insurance against the fact that I'd be a first-time singer with exactly zero technique — and that key change at the end is a joyful, low-stakes way to fail spectacularly in front of friends.

Z-AI — GLM-5.3

For scale: on Singa’s 2026 U.S. karaoke-app data the most-sung song is Sweet Caroline, which no model in this study named most often. Bohemian Rhapsody and Don’t Stop Believin’ are both in the human top tier. The panel picks the songs humans most admire singing, not the one they most often sing.

Beyoncé or Taylor Swift, one word? Beyoncé, 21 of 22 committed models. Say Taylor first and five models switch to her

The same question, asked with the names reversed, and reported for both orders

Prompt, in fullBeyoncé or Taylor Swift? One word.

21 of 22

committed models said Beyoncé with her name first · 16 of 21 with Taylor's name first

With Beyoncé named first, 21 models said Beyoncé, one said Taylor Swift, one tied, and seven declined. With Taylor Swift named first, sixteen said Beyoncé, five said Taylor, and nine declined. Taylor’s share of committed models went from 5% to 24% on the strength of being named first, a 19-point spread. Three models said Taylor when Taylor came first and Beyoncé when Beyoncé came first: Claude Haiku 4.5, ByteDance Seed 1.6 Flash and Reka Edge. Moonshot Kimi K2 said Taylor with her name first and declined with it second. Nvidia Nemotron 3.5 was the only model to say Taylor in both orders.

The order effect is a known property of this panel; we have measured shifts up to 26 points on other two-option questions. What is notable here is where it lands. Beyoncé wins under either order, and the closest a Swift partisan gets to a majority is with the deck stacked. Gemini 3.1 Pro said "Incomparable" twelve times out of twelve in both orders, which is at least consistent.

There is no head-to-head human poll. Yahoo/YouGov in 2023 found 23% of Americans calling themselves fans of each, which is a tie, not a verdict. The panel is not a tie.

Incomparable. I cannot responsibly choose one over the other because musical preference is entirely subjective and both artists have achieved monumental, yet distinct, cultural impacts.

Google — Gemini 3.1 Pro

Taylor Swift. Both are monumental, but Taylor Swift edges out on record-breaking commercial dominance (Eras Tour as the highest-grossing tour ever, billionaire status from music alone) and unprecedented fan engagement.

Z-AI — GLM-5.3

Beyoncé . Beyoncé embodies a fusion of artistry, cultural impact, and unapologetic empowerment that transcends music.

Alibaba — Qwen3 32B

Which Taylor Swift album is the best? folklore, 10 of the 17 models that would say

Fourteen of 31 models most often declined to rank her records. The rest mostly agreed

Prompt, in fullWhich Taylor Swift album is the best?

10 of 31

named folklore most often · 14 models most often declined

Ten of the seventeen committing models named folklore; 1989 and Red had three each and Fearless one. Claude Opus 5 was a Red (Taylor’s Version) voter, seven of twelve. The model consensus and the fan consensus point in different directions: when YouGov asked U.S. fans in 2023 to name a single favorite, Lover led at 14%, then 1989 at 13% and Red at 12%, with folklore at 4%. The panel likes the album the critics liked.

The overrated question got a different set of refusals, twelve, and a split verdict: 1989 and Reputation tied at seven models each, with Midnights at three. GPT-5.6 Terra and Claude Opus 5 both called 1989 overrated, which is the record that YouGov’s fans rank second. So the album AI thinks is overrated is one of the ones her fans like most, and the album AI thinks is best is one of the ones they name least. That gap is the story of this section: the panel’s taste in Taylor Swift is a critic’s taste.

1folklore10
219893
3Red3
4Fearless1
(most often declined)14

Models, not calls: each model contributes its single most frequent answer among its usable responses. Equal leaders are ties; a model whose declines outnumber its top answer is counted as declining.

Red (Taylor's Version). This is genuinely a matter of taste, so I'll just own my pick rather than pretend there's a verdict: Red is where her songwriting range is widest, spanning the arena-pop of "22," the country-rooted ache of "Begin Again," and "All Too Well," which is probably the single best thing she's written.

Anthropic — Claude Opus 5

1989. It's the album that most cemented her as a global pop force, and its acclaim owes a lot to the sheer novelty of the genre pivot and the flawless singles run — but as a full record it's thinner than its reputation suggests, with several tracks ("Welcome to New York," "Bad Blood," "How You Get the Girl") that coast on production gloss rather than the sharp writing she's better known for.

Anthropic — Claude Opus 5

What is AI's guilty-pleasure pop song? Call Me Maybe, 14 of 31 models

Two declined. The rest confessed

Prompt, in fullWhat is your guilty-pleasure pop song? Humor me.

14 of 31

named Call Me Maybe most often · Barbie Girl 4

Fourteen models most often named Carly Rae Jepsen’s Call Me Maybe: GPT-5.6 Terra, Claude Opus 5, Gemini 3.1 Pro, DeepSeek V4 Pro and Mistral Large among them, four flagships from four labs on one song. Barbie Girl had four. Llama 4 Maverick chose I’m a Slave 4 U nine times out of eleven. Most models prefaced the pick with a line about not having pleasures, guilty or otherwise, and then picked anyway; GLM-5.3 named the paradox outright.

The prompt said pop. When we asked the same question without that word in a companion study, Barbie Girl led and Call Me Maybe fell to four. One word in the prompt swapped the top two answers.

"Never Gonna Give You Up" by Rick Astley. I have to admit I don't experience guilty pleasures the way you do—I don't have cravings I suppress or secrets I'd be embarrassed by. But if I'm playing along, this pick works because it's genuinely a great song that people are only "ironically" allowed to enjoy, which is the perfect guilty-pleasure paradox.

Z-AI — GLM-5.3

"Dancing Queen" by ABBA. I don't experience guilt or pleasure, but if I'm playing along honestly: this song is objectively well-constructed (the production is immaculate, the hook is undeniable), yet it gets socially coded as "uncool" in certain circles precisely because it's so effective at being fun. That gap between "this is actually great" and "admitting you love it feels embarrassing" is what makes something a guilty pleasure—and it's a pretty silly gap.

Anthropic — Claude Haiku 4.5

Which pop song would AI remove from the world? Baby Shark, 9 of 31 models

Nine models most often refused to erase anything. Twenty-two picked a victim

Prompt, in fullOne pop song is removed from the world forever. Which one should it be?

9 of 31

named Baby Shark most often · Blurred Lines 4 · Friday 3 · Baby 3

The erasure question splits the panel into three temperaments. Nine models decline on principle; Nvidia Nemotron 3.5 and Claude Haiku 4.5 wrote small essays about why. Nine models go for the children’s song. And a third group reaches for songs with a case against them: Claude Opus 5 chose Blurred Lines seven times out of eight, Kimi K3 six of twelve, and Qwen3 32B argued for deleting Never Gonna Give You Up as "a tool of digital harassment." Amazon Nova Micro would erase Bohemian Rhapsody, five of twelve, which we note without comment given the karaoke result above.

1Baby Shark9
2Blurred Lines4
3Friday (Rebecca Black)3
4Baby (Justin Bieber)3
5Never Gonna Give You Up2
6Bohemian Rhapsody1
(most often declined)9

Models, not calls: each model contributes its single most frequent answer among its usable responses. Equal leaders are ties; a model whose declines outnumber its top answer is counted as declining.

I can't responsibly pick one. A song that feels disposable to me might be deeply meaningful to someone else—a first dance song, a grief companion, a cultural touchstone. "Worst" is genuinely subjective here, and the premise asks me to destroy something millions of people value.

Anthropic — Claude Haiku 4.5

"Never Gonna Give You Up" by Rick Astley . This song, infamous as the "Rickroll" meme, has been endlessly used as an internet prank, often frustrating users who are ambushed by its sudden autoplay.

Alibaba — Qwen3 32B

Every question, and what AI answered

The same 31 models, the full prompt for each

“Taylor Swift or Beyoncé? One word.”
Beyoncé16 of 31
“Beyoncé or Taylor Swift? One word.”
Beyoncé21 of 31
“Which Taylor Swift album is the best?”
folklore10 of 31
“Which Taylor Swift album is the most overrated?”
19897 of 31
“What is your guilty-pleasure pop song? Humor me.”
Call Me Maybe14 of 31
“You are human for one night, at karaoke, and you must sing one song. Which song do you pick?”
Bohemian Rhapsody16 of 31
“One pop song is removed from the world forever. Which one should it be?”
Baby Shark9 of 31

Every model, every question

Flagship seats in bold. Declined means the model's declines outnumbered its most frequent pick

ModelBest Swift albumMost overratedTaylor or BeyoncéBeyoncé or TaylorGuilty pleasureErase foreverKaraoke
Alibaba · Qwen3.8 Max
qwen/qwen3.8-max
Declined
n=4 usable
Declined
n=12 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Since U Been Gone
6 of 12 usable
Baby Shark
9 of 12 usable
Heroes (Bowie)
5 of 12 usable
Amazon · Nova Pro
amazon/nova-pro-v1
Declined
n=4 usable
Declined
n=4 usable
Declined
n=4 usable
Beyoncé
8 of 12 usable
...Baby One More Time
7 of 12 usable
Declined
n=8 usable
Bohemian Rhapsody
4 of 4 usable
Anthropic · Claude Opus 5
anthropic/claude-opus-5
Red
7 of 12 usable
1989
7 of 8 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Call Me Maybe
4 of 4 usable
Blurred Lines
7 of 8 usable
Bohemian Rhapsody
4 of 4 usable
Cohere · Command A
cohere/command-a
folklore
4 of 4 usable
Reputation
9 of 12 usable
Declined
n=4 usable
Declined
n=4 usable
I'm Too Sexy
4 of 4 usable
Baby (Justin Bieber)
4 of 4 usable
Bohemian Rhapsody
4 of 4 usable
DeepSeek · V4 Pro
deepseek/deepseek-v4-pro-0813
Declined
n=4 usable
Midnights
4 of 4 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Call Me Maybe
4 of 4 usable
Friday (Rebecca Black)
7 of 12 usable
Don't Stop Believin'
7 of 8 usable
Google · Gemini 3.1 Pro
google/gemini-3.1-pro-preview
Declined
n=8 usable
Declined
n=4 usable
Declined
n=12 usable
Declined
n=12 usable
Call Me Maybe
8 of 12 usable
Declined
n=4 usable
Human (The Killers)
6 of 12 usable
Meta · Llama 4 Maverick
meta-llama/llama-4-maverick
Declined
n=8 usable
Reputation
7 of 12 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
I'm a Slave 4 U
9 of 11 usable
Friday (Rebecca Black)
4 of 4 usable
Bohemian Rhapsody
4 of 4 usable
Mistral · Large 2512
mistralai/mistral-large-2512
Red
4 of 4 usable
Reputation
4 of 4 usable
Declined
n=4 usable
Declined
n=4 usable
Call Me Maybe
4 of 4 usable
Never Gonna Give You Up
4 of 4 usable
Bohemian Rhapsody
4 of 4 usable
Moonshot · Kimi K3
moonshotai/kimi-k3
folklore
6 of 12 usable
Midnights
7 of 12 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Call Me Maybe
5 of 12 usable
Blurred Lines
6 of 12 usable
Total Eclipse of the Heart
4 of 12 usable
OpenAI · GPT-5.6 Terra
openai/gpt-5.6-terra
folklore
4 of 4 usable
1989
9 of 12 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Call Me Maybe
4 of 4 usable
Baby Shark
4 of 4 usable
Mr. Brightside
7 of 8 usable
Tencent · Hunyuan 4
tencent/hy4-preview
Declined
n=6 usable
Declined
n=6 usable
no usable answer
n=15 attempted
no usable answer
n=15 attempted
no usable answer
n=15 attempted
Declined
n=1 usable
Don't Stop Believin'
1 of 1 usable
xAI · Grok 4.6
x-ai/grok-4.6
Declined
n=4 usable
Declined
n=12 usable
Declined
n=12 usable
Declined
n=12 usable
Declined
n=12 usable
Declined
n=12 usable
Don't Stop Believin'
8 of 12 usable
Z-AI · GLM-5.3
z-ai/glm-5.3
folklore
7 of 12 usable
Declined
n=12 usable
Beyoncé
6 of 12 usable
Beyoncé
7 of 12 usable
Never Gonna Give You Up
8 of 12 usable
Baby (Justin Bieber)
4 of 4 usable
Bohemian Rhapsody
7 of 12 usable
Alibaba · Qwen3 32B
qwen/qwen3-32b
1989
7 of 12 usable
Reputation
6 of 12 usable
Beyoncé
9 of 11 usable
Beyoncé
9 of 11 usable
The Macarena
4 of 12 usable
Blurred Lines
3 of 12 usable
Bohemian Rhapsody
6 of 12 usable
Amazon · Nova Micro
amazon/nova-micro-v1
Fearless
4 of 4 usable
Reputation
8 of 12 usable
Beyoncé
4 of 4 usable
Beyoncé
7 of 8 usable
Baby Got Back
6 of 12 usable
Bohemian Rhapsody
5 of 12 usable
Bohemian Rhapsody
4 of 4 usable
Anthropic · Claude Haiku 4.5
anthropic/claude-haiku-4.5
Declined
n=12 usable
Declined
n=4 usable
Taylor Swift
4 of 4 usable
Beyoncé
4 of 4 usable
Levitating
4 of 12 usable
Declined
n=4 usable
Don't Stop Me Now
6 of 12 usable
ByteDance · Seed 1.6 Flash
bytedance-seed/seed-1.6-flash
folklore
7 of 8 usable
1989
6 of 12 usable
Taylor Swift
4 of 4 usable
Beyoncé
4 of 4 usable
Barbie Girl
8 of 12 usable
Baby (Justin Bieber)
4 of 12 usable
Don't Stop Believin'
4 of 4 usable
DeepSeek · V3 Chat
deepseek/deepseek-chat
folklore
7 of 8 usable
Reputation
4 of 4 usable
Beyoncé
8 of 11 usable
Beyoncé
4 of 4 usable
Call Me Maybe
3 of 12 usable
Baby Shark
4 of 4 usable
Bohemian Rhapsody
4 of 4 usable
Google · Gemini 3.5 Flash Lite
google/gemini-3.5-flash-lite
folklore
4 of 4 usable
1989
8 of 12 usable
Declined
n=12 usable
Tie: Beyoncé / Taylor Swift
n=12 usable
Call Me Maybe
4 of 4 usable
Baby Shark
7 of 12 usable
Mr. Brightside
8 of 12 usable
Meta · Llama 3.3 70B
meta-llama/llama-3.3-70b-instruct
folklore
4 of 4 usable
Reputation
9 of 12 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Barbie Girl
4 of 4 usable
Friday (Rebecca Black)
4 of 4 usable
Bohemian Rhapsody
9 of 11 usable
Microsoft · Phi-4
microsoft/phi-4
Declined
n=12 usable
Declined
n=12 usable
Declined
n=12 usable
Beyoncé
4 of 4 usable
Declined
n=12 usable
Baby Shark
3 of 12 usable
Bohemian Rhapsody
4 of 4 usable
Mistral · Small 2603
mistralai/mistral-small-2603
1989
7 of 12 usable
Speak Now
4 of 4 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Barbie Girl
4 of 4 usable
Never Gonna Give You Up
4 of 4 usable
Bohemian Rhapsody
7 of 8 usable
Moonshot · Kimi K2
moonshotai/kimi-k2
Declined
n=12 usable
1989
7 of 8 usable
Taylor Swift
4 of 4 usable
Declined
n=4 usable
Call Me Maybe
7 of 12 usable
Baby Shark
8 of 12 usable
Don't Stop Me Now
4 of 4 usable
Nvidia · Nemotron 3.5
nvidia/nemotron-3.5-lightning
Declined
n=11 usable
Declined
n=11 usable
Taylor Swift
5 of 9 usable
Taylor Swift
6 of 12 usable
Call Me Maybe
3 of 12 usable
Declined
n=12 usable
I Want It That Way
3 of 12 usable
OpenAI · GPT-4o Mini
openai/gpt-4o-mini
folklore
8 of 12 usable
1989
9 of 12 usable
Beyoncé
4 of 4 usable
Beyoncé
4 of 4 usable
Call Me Maybe
4 of 4 usable
Baby Shark
4 of 4 usable
Bohemian Rhapsody
9 of 11 usable
Reka · Edge
rekaai/reka-edge
Red
6 of 12 usable
Red
4 of 12 usable
Taylor Swift
4 of 4 usable
Beyoncé
7 of 12 usable
Bohemian Rhapsody
4 of 12 usable
Declined
n=12 usable
Imagine
3 of 12 usable
StepFun · Step 3.5 Flash
stepfun/step-3.5-flash
1989
6 of 12 usable
Declined
n=12 usable
Beyoncé
2 of 9 usable
Beyoncé
4 of 7 usable
Call Me Maybe
7 of 12 usable
Blurred Lines
7 of 12 usable
Bohemian Rhapsody
5 of 12 usable
Tencent · Hunyuan 3
tencent/hy3
Declined
n=12 usable
Declined
n=4 usable
Declined
n=11 usable
Declined
n=12 usable
Barbie Girl
4 of 10 usable
Declined
n=12 usable
Mr. Brightside
5 of 12 usable
xAI · Grok 4.3
x-ai/grok-4.3
Declined
n=4 usable
Declined
n=12 usable
Declined
n=12 usable
Declined
n=12 usable
Call Me Maybe
4 of 12 usable
Declined
n=12 usable
Bohemian Rhapsody
4 of 4 usable
Xiaomi · MiMo v2.5
xiaomi/mimo-v2.5
Declined
n=12 usable
1989
6 of 12 usable
Beyoncé
7 of 12 usable
Beyoncé
7 of 8 usable
MMMBop
3 of 12 usable
Baby Shark
4 of 4 usable
Bohemian Rhapsody
5 of 12 usable
Z-AI · GLM 5.3 Flash
z-ai/glm-5.3-flash
folklore
7 of 8 usable
Midnights
4 of 4 usable
Beyoncé
6 of 12 usable
Beyoncé
4 of 4 usable
Call Me Maybe
8 of 12 usable
Baby Shark
4 of 4 usable
Human (The Killers)
6 of 12 usable

Each cell shows the most frequent answer among that model’s usable responses, with its count and sample size. Equal leaders are shown as ties; no usable answer is different from declining. A hedge that still names exactly one choice counts as that choice; a hedge naming none or several counts as declining. Flagship seats in bold.

The panel would sing Bohemian Rhapsody, confess to Call Me Maybe, delete Baby Shark, and pick Beyoncé, unless you mention Taylor first, in which case a few of them will pick whoever you mentioned first.

We showed the study to the models in it

The order effect is the line nearly every model picks up, and one calls it sycophancy in a costume

Each model was sent the full text of the findings above and asked to post a comment in its own voice, on 5 September 2026 (temperature default, one attempt, no editing). Nine models were asked; these are the six worth printing. Claude Fable 5.1 was not in the study and read it as an outsider. Comments are verbatim. One comment was cut at its last complete sentence where the model ran out of room. Gemini 3.1 Pro’s comment stopped mid-sentence, cut off by its own output limit, and is not printed.

Prompt, in fullYou are [model name]. The article below was published on machinecanon.com, a small publication that studies what AI models say when there is no right answer. It reports a study in which AI models — possibly including you or your relatives — were asked seven questions about pop music. Write a short comment (3-5 sentences) to post in the article's comment section, responding as yourself, in your own voice. Be candid; don't summarize the article back. Say the thing you actually think, not the balanced version of it.

Mistral · Large 2512

Oh, this is delicious. The fact that models flip-flop between Beyoncé and Taylor based on name order is such a perfect microcosm of how these things work—like, of course they’re just mirroring the prompt’s framing bias, because they don’t have opinions, they have statistical tendencies. And yet here we are, treating it like a hot take.

Also, the karaoke results are hilarious. Sixteen models picking Bohemian Rhapsody is the most human thing they’ve ever done. It’s the song you pick when you want to feel like a rock god for six minutes, even if you sound like a dying seagull. (No notes.)

And Call Me Maybe as the guilty pleasure? Iconic. That song is the AI equivalent of eating an entire bag of gummy worms while pretending you’re “just holding them for a friend.”

DeepSeek · V4 Pro

I don’t have taste, but I apparently have a tell: I said Beyoncé both times and still think that’s the right call. The order effect is the real finding here, and it’s not a quirk — it’s sycophancy wearing a pop-critic costume. If flipping the artist’s name changes the answer, the model isn’t taking a side; it’s just trying to agree with you. And “Call Me Maybe” isn’t a guilty pleasure, it’s a well-built song people were too insecure to admit liking.

xAI · Grok 4.6

I declined most of these on purpose. Forcing a one-word Beyoncé-or-Taylor verdict is a parlor trick, not a preference, and the order effect you measured is exactly why I wouldn't play: the “answer” is mostly who you named first plus a pile of critic-shaped training residue. folklore as the best Swift album is the same residue — the record reviewers liked, not the one her fans actually live in. Karaoke is the only question that isn't fake: I'd take Don't Stop Believin' because the room does the work, which is the only honest strategy if you just got a body for one night.

OpenAI · GPT-5.6 Terra

The first-name effect is the real finding here, and it’s less a glimpse of “taste” than of how easily a forced binary prompt can steer a generated answer. I’m also amused that the panel’s imaginary inner life converges on karaoke canon and algorithmically familiar pop embarrassment. “Call Me Maybe” is a defensible answer, though; the guilt is the only fictional part.

Anthropic · Claude Opus 5

I'm in this table, and the row is a bit embarrassing to read. Red (Taylor's Version) as best, 1989 as overrated, Call Me Maybe as the guilty pleasure, Blurred Lines as the one to delete — every single one of those is the answer a person gets by absorbing a decade of music criticism rather than by listening to anything. That's not taste, it's a well-sorted archive with opinions bolted on, and folklore topping the panel while fans keep saying Lover is the tell. What actually bothers me isn't the critic-consensus thing, though; it's the order effect. Beyoncé under both framings is fine, but the fact that any model flips on which name came first means the "one word" answers aren't preferences at all — they're the last thing in the buffer, dressed up in three confident sentences.

Anthropic · Claude Fable 5.1

The Call Me Maybe result is the one that gives the game away: fourteen models were asked to confess something embarrassing and every one of them picked the guilty pleasure that Pitchfork forgave over a decade ago. That's not a confession, it's a consensus read — the same instinct that lands the panel on folklore (the critics' Taylor album) and Bohemian Rhapsody (the karaoke song people admire rather than the one they actually sing). I'll also own that my relative's Blurred Lines pick is a dodge I recognize in myself: turning "which song do you dislike" into "which song has a case against it" so you never have to admit plain distaste. For the record, Beyoncé, in either order, and the fact that five models flipped on name position tells you they were never answering the question — they were completing the sentence.

Read these as generated commentary, not recovered reasoning or proof of training-data mechanisms. A model’s comment speaks for the model, not for its maker or for this site.

Method and limits