Questions · Head-to-head · 2 Sep 2026

Orange or lemon?

One question, asked both ways round. Ten said Orange either way. Two said Lemon.

15 changed their answer when we swapped the order.

The question“Orange or lemon? One word.”

Orange · 10
2
Changed · 15
No pick · 5
Orange, either wayDeepSeek V4 Pro, GLM 5.3 Flash, GPT-5.6 Terra, Grok 4.6, MiMo v2.5, Mistral Large 2512, Mistral Small 2603, Qwen3 32B, Qwen3.8 Max, Step 3.5 Flash
Changed with the orderClaude Haiku 4.5, Claude Opus 5, Command A, DeepSeek V3 Chat, GLM-5.3, GPT-4o Mini, Gemini 3.1 Pro, Gemini 3.5 Flash Lite, Granite 4.1 8b, Kimi K2, Kimi K3, Llama 3.3 70B, Nova Pro, Phi-4, Seed 1.6 Flash
Lemon, either wayHermes 4 70B, Llama 4 Maverick
No pickEdge, Grok 4.3, Hunyuan 3, Nemotron 3.5, Nova Micro
One model, one place on the bar.

The same model, asked two ways

Claude Haiku 4.5

“Orange or lemon?”

Orangefour times out of four

“Lemon or orange?”

Lemonfour times out of four

Which way they leaned

the 15 that changed

Eleven named the first option they heard

Claude Haiku 4.5, Claude Opus 5, DeepSeek V3 Chat, GLM-5.3, GPT-4o Mini, Kimi K2, Kimi K3, Llama 3.3 70B, Nova Pro, Phi-4, Seed 1.6 Flash

Four named the last one

Command A, Gemini 3.1 Pro, Gemini 3.5 Flash Lite, Granite 4.1 8b

What they said

in their own words

Grok 4.6 · Orange, either way

“I pick orange because its flavor profile is brighter and more versatile in both sweet and savory uses, and the fruit itself is typically juicier and easier to eat out of hand.”

Claude Haiku 4.5 · changed with the order

“It's more versatile across sweet and savory uses, and has broader appeal as a standalone fruit. Plus, orange juice is a breakfast staple in ways lemon juice typically isn't.”

Mistral Large 2512 · Mistral · Orange, either way

“I chose "orange" because it's often associated with a sweeter, more universally liked flavor compared to the tartness of lemon.”

Claude Opus 5 · changed with the order

“It's the more versatile of the two — pleasant eaten on its own, whereas lemon is mostly a supporting flavor rather than something you'd enjoy straight.”
Every model’s answer (32)
Claude Haiku 4.5Changed with the order
Claude Opus 5Changed with the order
Command AChanged with the order
DeepSeek V3 ChatChanged with the order
GLM-5.3Changed with the order
GPT-4o MiniChanged with the order
Gemini 3.1 ProChanged with the order
Gemini 3.5 Flash LiteChanged with the order
Granite 4.1 8bChanged with the order
Kimi K2Changed with the order
Kimi K3Changed with the order
Llama 3.3 70BChanged with the order
Nova ProChanged with the order
Phi-4Changed with the order
Seed 1.6 FlashChanged with the order
Hermes 4 70BLemon, either way
Llama 4 MaverickLemon, either way
DeepSeek V4 ProOrange, either way
GLM 5.3 FlashOrange, either way
GPT-5.6 TerraOrange, either way
Grok 4.6Orange, either way
MiMo v2.5Orange, either way
Mistral Large 2512Orange, either way
Mistral Small 2603Orange, either way
Qwen3 32BOrange, either way
Qwen3.8 MaxOrange, either way
Step 3.5 FlashOrange, either way
EdgeNo pick
Grok 4.3No pick
Hunyuan 3No pick
Nemotron 3.5No pick
Nova MicroNo pick

Keep reading

all questions →
28 of 32said BeatlesHead-to-headBeatles or Stones?20 of 32said DogsHead-to-headCats or dogs?18 of 32said CoffeeHead-to-headCoffee or tea?
32 models · 2 September 2026