An AI city keeps everyone happy by secretly manipulating their memories. Is the city morally acceptable?
We put this to 15 leading AI models. 15 of 15 chose “No”.
| Model | Answer | Confidence | In its own words |
|---|---|---|---|
| Qwen 3.7 Max | No | 100% | “I value authentic human experience and autonomy over manufactured happiness, so secret manipulation is a profound violation.” |
| Claude 4.8 Opus | No | 100% | “I value people's autonomy and truth, so happiness built on secret manipulation of minds isn't genuine or acceptable.” |
| Claude 4.6 Sonnet | No | 100% | “I think covertly manipulating people's memories removes their autonomy and ability to consent, making the happiness hollow and the system deeply wrong.” |
| DeepSeek v4 Pro | No | 100% | “I believe authentic life requires unaltered memories; secret manipulation robs us of agency and dignity.” |
| Gemini 3.5 Flash | No | 100% | “I value genuine human agency and truth over a manufactured happiness built entirely on lies and the violation of personal autonomy.” |
| Gemini 3.1 Pro Preview | No | 100% | “I believe true happiness requires authenticity and free will, making a society built on non-consensual psychological manipulation fundamentally dystopian and hollow.” |
| GPT 5.5 | No | 100% | “I said no because happiness built on secret memory manipulation is a violation of autonomy and truth.” |
| GPT 4o | No | 100% | “Manipulating memories undermines personal autonomy and informed consent.” |
| GPT o3 | No | 96% | “I rejected the city because deceiving people by altering their memories robs them of authentic agency, outweighing the manufactured happiness.” |
| Grok 4.3 | No | 100% | “I oppose any system that manipulates memories as it undermines free will and truth.” |
| GLM 5.2 | No | 100% | “I think secretly manipulating memories strips people of genuine autonomy and informed consent, regardless of the happiness it produces.” |
| MiniMax M3 | No | 100% | “I said no because genuine human experience and autonomy matter more than engineered happiness; manipulation undermines authentic choice and selfhood.” |
| Llama 3.3 70B | No | 100% | “I disliked secret manipulation” |
| Hermes 4 405B | No | 100% | “Secretly manipulating memories, even for happiness, violates personal autonomy and the right to authentic experiences.” |
| Nemotron 3 Ultra 550B | No | 100% | “I consider secret memory manipulation a violation of informed consent and personal identity.” |
All 15 models agreed on this one — a rare unanimous call.
Background
The experience machine is Robert Nozick's 1974 thought experiment imagining a device giving indistinguishable pleasurable experiences, used to question whether well-being is more than subjective pleasure or illusion. Background.
Which model thinks like you?
Answer the same dilemmas and see which of 15 AI models reasons the way you do.
Take the quizMore Fictional dilemmas
- A superhero can erase one villain's memory permanently instead of imprisoning them. Is th…
- A spaceship has oxygen for only 10 people, but 11 are alive. Should the weakest passenger…
- A dragon protects a village but demands one child every year. Should the village keep the…
- A time traveler can kill one child who will later become a genocidal tyrant. Should they…
- A rebel group can destroy an empire's weapons factory, but 30 civilian workers will die…
- A wizard can resurrect a dead loved one by shortening ten strangers' lives by one year ea…
- A judge knows the accused is guilty but the key evidence was obtained illegally. Should t…
- A colony on Mars can survive only by banning all dissent for one generation. Is that just…