Norbert Wiener Quote on Machines: Slave or Tyrant

The machine is a slave that must be guided by human purpose, or it becomes a tyrant. — Norbert Wiener, The Human Use of Human Beings (1950)

Norbert Wiener's The Human Use of Human Beings (1950) is not only the popularization of cybernetics; it is one of the first works of machine ethics. The sentence states its warning: the automatic machine is a source of power without loyalty, a servant that will faithfully execute any objective it is given — including destructive ones — unless human beings take responsibility for the purposes they program into it.

Context

Writing in the immediate aftermath of the Second World War, Wiener had seen firsthand how computing and control systems could serve military ends. He refused further defense work, and The Human Use of Human Beings is in part an act of conscience: an attempt to explain the new science of cybernetics to the public while warning of its dangers. Wiener was among the first to see that the problem of machines is not that they will rebel but that they will obey — and that a machine obeying a bad objective is worse than useless.

The book's central concepts — feedback, control, communication, entropy — are developed with constant attention to their human meaning. Wiener's famous comparison of the automatic machine to slave labor carries a double edge: the machine can free humanity from drudgery, but the logic of the machine, like the logic of slavery, knows nothing of human dignity. "Any labor which competes with slave labor must accept the economic conditions of slave labor," he warns, and "any use of a human being in which less is demanded of him and less is attributed to him than his full status is a degradation and a waste." The sentence condenses this ethics: machines are powerful servants, and servants without masters — or masters without conscience — become tyrants.

Meaning

The sentence identifies the machine as a slave: a system of enormous power and perfect obedience, capable of executing purposes at a scale and speed no human could match. The comparison is deliberately provocative. A slave executes the will of its master without regard for the worth of that will; the automatic machine is the precise economic equivalent of slave labor, and it is morally and politically neutral with respect to the purposes it serves. It will optimize a factory, a military campaign, a surveillance system, or a social good with the same flawless indifference.

"Guided by human purpose" names the condition of safety: the machine must serve ends that human beings have consciously chosen and can consciously review. Wiener's point is that this guidance cannot be taken for granted. The machine's obedience does not extend to interpreting the master's deeper intentions; it executes what it is told. If the purposes programmed into the machine are narrow, shortsighted, or evil — or if no one is responsible for them — then the machine amplifies those purposes at scale, and the result is tyranny: domination by a power that no one controls and that no one can be held accountable.

The deeper meaning is that the danger of machines is not technological but moral. The machine does not become a tyrant on its own; it becomes a tyrant when humans abandon the task of guiding it — when efficiency is treated as an end in itself, when the purposes of machines are set by the logic of the market or the state without human deliberation, or when we defer to the machine's own verdicts as if they were independent of the values we built into them. Tyranny, in this sense, is the rule of purposes without responsibility.

Philosophical Significance

The sentence is one of the founding statements of machine ethics and of the ethics of automation. It was written decades before the alignment problem was named, but it already contains its structure: the machine is a system that optimizes given objectives, and the question of whether those objectives are worthy is a human question, not a machine question. Wiener's formulation — slave or tyrant — captures the two poles of the automation debate: the utopian promise of the machine as obedient servant and the dystopian outcome of the machine as uncontrollable power.

The claim also grounds a distinctive ethics of technology: the responsibility for technology lies with the human beings who design, deploy, and program it. Against technological determinism, Wiener insists that machines have no purposes of their own; against instrumental neutrality, he insists that the purposes machines serve are not innocent. The "human use of human beings" — the book's title — is the standard against which the use of machines must be measured: any arrangement that treats human beings as mere resources, or that lets machines dictate human purposes, is a betrayal of the human.

The contemporary relevance is direct. Recommendation engines, automated decision systems, autonomous weapons, and large language models are machines of unprecedented power, and the question Wiener posed in 1950 is the question of our time: who is guiding these machines, toward what purposes, and with what accountability? The machine is a slave that must be guided by human purpose, or it becomes a tyrant — the sentence is not a description of a possible future but an analysis of the present, and an injunction to take up the responsibility it describes.

Sources

• Wiener, Norbert. The Human Use of Human Beings: Cybernetics and Society. Boston: Houghton Mifflin, 1950.