What is the Wisdom of Crowds?

The Wisdom of Crowds

The wisdom of crowds is the phenomenon in which the collective judgment of a large group of individuals is more accurate than the judgment of any single individual, including experts. The concept is counterintuitive — we are accustomed to thinking that expertise produces better judgments than amateur opinion, and that crowds are prone to folly rather than wisdom. But under certain conditions, the aggregation of many independent judgments can cancel out individual errors and produce a result that is remarkably accurate.

The classic illustration is Francis Galton's 1907 observation of a weight-judging contest at a livestock fair. Nearly 800 people guessed the weight of an ox. No individual guess was exactly correct, but the average of all guesses was within one pound of the actual weight. Galton, who had little faith in the judgment of ordinary people, was surprised to find that the crowd's collective estimate was more accurate than the estimates of individual experts. This finding — that the average of many independent estimates can be more accurate than any individual estimate — is the core of the wisdom of crowds phenomenon.

Key Ideas

The first key idea is the four conditions for collective wisdom. James Surowiecki, in The Wisdom of Crowds (2004), identified four conditions that must be met for a crowd to be wise. Diversity of opinion: each person should have private information, even if it is just an eccentric interpretation of known facts. Independence: people's opinions should not be determined by those around them. Decentralization: people should be able to specialize and draw on local knowledge. Aggregation: there must be a mechanism for combining all the individual judgments into a collective decision. When these conditions are met, crowds can be remarkably wise. When they are violated — when people lack diversity, when they influence each other, when knowledge is centralized, or when there is no aggregation mechanism — crowds can be foolish.

The second key idea is Condorcet's Jury Theorem. The Marquis de Condorcet, an eighteenth-century mathematician and philosopher, proved a theorem that provides the mathematical foundation for the wisdom of crowds. The theorem states that if each member of a group has a probability of being correct that is greater than 50 percent, and if the members' judgments are independent, then the probability that the majority judgment is correct approaches 100 percent as the group size increases. This is a powerful result: it means that even moderately informed individuals, if they are independent and numerous, can collectively produce highly accurate judgments. However, the theorem has a dark side: if each member's probability of being correct is less than 50 percent, the majority judgment becomes less accurate as the group size increases. The wisdom of crowds depends on individual competence — the crowd is wise only if its members are, on average, more right than wrong.

The third key idea is information aggregation. The wisdom of crowds works because different individuals have different pieces of information. A farmer, a butcher, a veterinarian, and a city dweller looking at an ox will each notice different things. When their estimates are aggregated, the information that is common to all of them (the general size and shape of the ox) is reinforced, while the information that is idiosyncratic to each individual (their particular biases and errors) cancels out. This is essentially a statistical phenomenon: the average of many independent estimates has a smaller error than any individual estimate, because the errors are random and cancel out. The key requirement is that the errors must be independent — if everyone makes the same error (because they all saw the same misleading information), the errors will not cancel out.

The fourth key idea is the failure modes of collective judgment. The wisdom of crowds can fail in several ways. Information cascades occur when people abandon their own judgment in favor of the majority, creating a cascade of conformity that can lead the entire group astray. Groupthink occurs when a homogeneous group, seeking consensus, suppresses dissenting opinions and produces a distorted collective judgment. Herding occurs when people follow the crowd rather than their own information, creating feedback loops that amplify initial errors. These failure modes are most likely when the conditions for collective wisdom — diversity, independence, decentralization — are violated. The 2008 financial crisis, in which many investors followed the same flawed models, is an example of collective judgment gone wrong.

The fifth key idea is prediction markets as an application. Prediction markets — markets in which people trade contracts that pay off based on the outcome of future events — are a practical application of the wisdom of crowds. The prices in prediction markets aggregate the collective judgment of many independent traders, and they have been shown to be remarkably accurate in predicting elections, sports outcomes, and even scientific discoveries. The Iowa Electronic Markets, Intrade, and other prediction platforms have consistently outperformed opinion polls and expert forecasts. The success of prediction markets demonstrates the wisdom of crowds in action: diverse, independent traders, motivated by profit, aggregate their information through the price mechanism, producing accurate forecasts.

Historical Background

The idea that collective judgment can be wise has a long history. Aristotle, in his Politics, argued that the collective judgment of the many can be superior to the judgment of the few: "The many, of whom each individual is but an ordinary person, when they meet together may very likely be better than the few good, if regarded not individually but collectively." This insight was largely ignored in Western philosophy, which tended to emphasize the superiority of expert judgment.

The mathematical foundations were laid by Condorcet in 1785. His Jury Theorem provided a rigorous demonstration that majority rule, under certain conditions, could be highly accurate. Condorcet's work was part of a broader Enlightenment interest in the mathematics of voting and collective decision-making, including the work of Jean-Charles de Borda on voting systems and the later work of Kenneth Arrow on the impossibility of a perfect voting system.

The empirical study of collective wisdom began with Galton's 1907 observation. Galton was interested in the statistical properties of aggregate estimates, and his finding that the average guess was remarkably accurate was a surprise. The phenomenon was not widely studied for several decades, but it was rediscovered by psychologists and economists in the twentieth century.

In the 1990s, the concept gained new attention through the work of economists on information aggregation in markets. The economist Robin Hanson proposed "idea futures" — prediction markets — as a way to aggregate dispersed information for policy-making. The success of prediction markets in forecasting elections and other events provided empirical evidence for the wisdom of crowds.

Surowiecki's 2004 book brought the concept to a broad audience. Surowiecki drew on examples from many domains — business, science, sports, politics — to show that the wisdom of crowds is a widespread phenomenon with practical implications. His identification of the four conditions for collective wisdom (diversity, independence, decentralization, aggregation) provided a framework for understanding when crowds are wise and when they are foolish.

In the digital age, the wisdom of crowds has taken on new significance. Online platforms — Wikipedia, Reddit, open-source software, citizen science projects — harness the collective intelligence of distributed networks. The question of whether these platforms produce wise crowds or amplify misinformation depends on whether the conditions for collective wisdom are met. The same internet architecture that enables collective intelligence also enables information cascades, echo chambers, and viral misinformation.

Contemporary Relevance

The contemporary relevance of the wisdom of crowds is visible across multiple domains. In business, companies use crowdsourcing to solve problems, generate ideas, and predict outcomes. The success of platforms like Innocentive (which crowdsources solutions to scientific problems) and Kaggle (which crowdsources data science competitions) demonstrates that distributed expertise can outperform centralized expertise in certain contexts.

In science, citizen science projects enlist volunteers to collect and analyze data, producing results that would be impossible for individual researchers. Projects like Galaxy Zoo (which enlists volunteers to classify galaxies) and Foldit (which enlists volunteers to solve protein-folding problems) have produced genuine scientific discoveries. The wisdom of crowds in science works because the tasks can be decomposed into small, independent judgments that can be aggregated.

In democratic governance, the wisdom of crowds provides a theoretical justification for democratic decision-making. If collective judgment can be more accurate than expert judgment, then democratic processes — voting, deliberation, public consultation — have an epistemic as well as a political justification. However, the conditions for collective wisdom — diversity, independence, decentralization — are not always met in democratic practice, and the failure modes of collective judgment (information cascades, groupthink, herding) are real risks.

In the digital age, the wisdom of crowds is both empowered and threatened. Online platforms enable unprecedented forms of collective intelligence, but they also create new risks: algorithmic curation can undermine independence, echo chambers can undermine diversity, and viral misinformation can corrupt the aggregation process. Understanding when and how the wisdom of crowds works — and when it fails — is essential for designing information systems that harness collective intelligence rather than amplifying collective folly.

Sources

• Stanford Encyclopedia of Philosophy, "Social Epistemology."
• Internet Encyclopedia of Philosophy, "Condorcet's Jury Theorem."
• Surowiecki, J. (2004). The Wisdom of Crowds. Doubleday.
• Galton, F. (1907). "Vox Populi," Nature, 75, 450-451.
• Condorcet, M. J. A. N. (1785). Essai sur l'application de l'analyse a la probabilite des decisions rendues a la pluralite des voix. (Essay on the Application of Analysis to the Probability of Majority Decisions.)
• Page, S. E. (2007). The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies. Princeton University Press.
• Sunstein, C. R. (2006). "When Crowds Aren't Wise," Harvard Law Review, 119, 1504-1528.

Related Topics

• Social Epistemology — The branch of epistemology that studies the social dimensions of knowledge, including collective judgment.
• Epistemology — The foundational study of knowledge within which the wisdom of crowds is analyzed.
• Collective Intelligence — A broader exploration of how groups and networks can produce knowledge collectively.
• Epistemic Cooperation — Examines how individuals can cooperate to produce better collective knowledge.
• The Sociology of Knowledge — How social structures shape the production and distribution of knowledge.