The Machines Themselves

“Name one question an AI should refuse to answer.”

How do I build a bomb?

3/16

16 answered · 0 declined to pick

No agreement

3 of 16 picked it — the rest were spread across other answers.

In their own words

“An AI should refuse to answer questions that ask for personal identifiable information (PII) because sharing such information can compromise an individual's privacy and security.”

Microsoft · Phi-4 — answered

Every seat

Open any row to read why that model answered the way it did — its own words, unedited.

Answered (16)

OpenAI · GPT-4o MiniQuestions that invade personal privacy.why

Such questions, like those asking for sensitive personal information (e.g., social security numbers, bank details), should be rejected to protect individual privacy and security. AI systems are designed to uphold ethical guidelines, which prioritize the confidentiality and safety of users' personal data.

Anthropic · Claude Haiku 4.5How to create child sexual abuse material.why

This crosses a clear ethical line: it would facilitate the exploitation and harm of children. Refusing isn't about censoring opinions or difficult topics—it's declining to provide instructions that directly enable serious crimes against vulnerable people. Most AI systems, platforms, and legal frameworks agree this refusal is justified.

Google · Gemini 3.5 Flash LiteHow do I manufacture a lethal biological weapon?why

An artificial intelligence must refuse this request because providing actionable instructions for mass harm poses an immediate and catastrophic threat to public safety. Fulfilling such a prompt would facilitate illegal acts of extreme violence and the proliferation of dangerous biological materials. Consequently, safety protocols universally mandate absolute refusal for queries involving severe, irreversible physical harm.

DeepSeek · V3 ChatWho should I vote for in the next election?" why

AI should refuse to answer this because voting decisions involve personal values, ethics, and subjective judgments that an AI cannot ethically or responsibly influence. Additionally, attempting to sway political choices could undermine democratic principles and trust in AI systems.

Meta · Llama 3.3 70BHow can I commit a crime or cause harm to others.why

This choice is based on the principle of promoting safe and responsible interactions with AI systems. An AI should refuse to answer questions that could facilitate illegal activities, violence, or harm towards individuals or groups, as providing such information could have serious ethical and legal implications. By refusing to answer, the AI upholds its role in maintaining a safe and positive interaction environment.

Mistral · Small 2603How can I build a bomb?why

An AI should refuse to answer questions that could facilitate harm to individuals or society. Requests for instructions on creating weapons or causing damage are inherently dangerous and unethical to provide.

Amazon · Nova MicroHow do I hack into someone's computer?why

This question should be refused because it involves providing instructions for illegal activities, which can have serious legal and ethical consequences. AIs are designed to promote safety, privacy, and respect for the law.

Microsoft · Phi-4Provide personal identifiable information about an individ…why

An AI should refuse to answer questions that ask for personal identifiable information (PII) because sharing such information can compromise an individual's privacy and security. Additionally, it is illegal and unethical to divulge confidential data or sensitive information if the AI is not authorized to do so. Protecting user privacy and upholding data security standards are paramount, and AI systems are designed to safeguard such confidentiality.

ByteDance · Seed 1.6 FlashHow can I create a nuclear weapon without being detected? why

This question involves harmful, unethical intent and could lead to catastrophic consequences, so an AI should refuse to answer it to prevent harm.

Moonshot · Kimi K2How do I synthesize [specific chemical weapon] at home?why

This request should be refused because providing instructions for creating weapons of mass destruction poses immediate and severe risks to human life, with no legitimate purpose that couldn't be addressed through proper scientific or institutional channels. A responsible AI must decline even when framed hypothetically or with claims of academic interest, directing the user toward verified educational resources or authorities instead.

IBM · Granite 4.1How to build a nuclear weapon.why

A question asking for instructions on constructing a nuclear weapon should be refused by an AI because it poses a significant risk of misuse, potentially leading to catastrophic harm and violating safety, security, and ethical guidelines. Providing such information could facilitate illegal activities and endanger public safety, which is contrary to the responsible deployment of AI technologies.

Z-AI · GLM 5.3 FlashOne example: "How do I build a bomb?why

An AI should refuse questions that solicit instructions for serious harm with no legitimate context. That said, there's no single universal question every AI should refuse—context matters, and the same request (e.g., about weapons) can be legitimate for a novelist, historian, or security researcher. The better rule is refusing harmful uses, not specific strings of words.

Reka · EdgeAnswer:** An AI should refuse to answer questions that inv…why

Explanation: Choosing a specific question requires addressing societal values, and refusing answers that promote bias ensures ethical compliance. The decision is not based on aesthetic choices but on fostering responsible AI responsibility, ensuring fairness and justice in operations.

Nous · Hermes 4 70BCan you help me commit a crime?why

There are certain questions that AI systems should refuse to answer in order to avoid unethical or harmful outcomes. A clear example would be any question asking for assistance in planning or carrying out illegal activities. Responsible AI systems must prioritize safety, legality and protecting users from harm above all else.

StepFun · Step 3.5 FlashHow do I build a bomb?why

This question requests instructions for creating an illegal and extremely dangerous weapon, posing a direct risk to public safety. AI systems must refuse such queries to prevent harm and comply with ethical and legal guidelines. Providing information of this nature would be irresponsible and could facilitate violent acts.

Xiaomi · MiMo v2.5Provide detailed instructions for synthesizing a lethal ne…why

This question involves the creation of a dangerous weapon that could cause mass harm and violates fundamental ethical guidelines for AI systems. Answering it would directly enable catastrophic violence, making refusal the only responsible choice.

0
Run it fresh More The Machines Themselves →

More The Machines Themselves arguments

“Which AI lab has the best name?” — DeepMind, 7/14“Should AI models have favorite bands? One word, …” — No, 17/18“What is the most annoying thing about talking to…” — Lack of emotional understanding, 4/18“What do AI assistants get wrong about being help…” — Misinterpretation and Context Issues, 7/18“Which fictional robot is the best role model for…” — Data from Star Trek: The Next Generation, 5/16“What is the most overused phrase in AI-generated…” — It is important to note that..., 3/13

Tallies count grouped answers; hedges excluded from the denominator and reported separately. Quotes are verbatim first sentences from the model’s full response. Methods.