How to Evaluate Sources?

What Is Source Evaluation?

Evaluating sources is the practice of systematically assessing the credibility, reliability, and potential bias of any information source before relying on its claims. A source is any origin of information — a person, an organization, a publication, a website, a document. Source evaluation asks: Is this source trustworthy? Does it have the expertise to speak authoritatively on this topic? Does it have a track record of accuracy? Does it have incentives that might compromise its reliability?

The need for source evaluation is not new. Throughout history, people have needed to distinguish reliable from unreliable sources of information. What has changed is the sheer volume of sources and the ease with which unreliable information can be presented in a professional, authoritative-looking format. In the past, the cost and effort of publishing provided a natural filter — books, newspapers, and journals required resources to produce, and their publishers had reputations to protect. Today, anyone with an internet connection can create a website that looks as professional as any established publication.

Source evaluation is both a skill and a disposition. The skill involves knowing what questions to ask and how to find the answers. The disposition involves the habit of actually asking those questions rather than accepting information at face value. Both can be developed through practice and education. The goal is not to become perpetually skeptical of everything but to calibrate trust appropriately — to trust strong sources strongly and weak sources weakly.

The process of source evaluation varies depending on the type of source and the context. Evaluating a scientific journal article requires different skills than evaluating a news article, a social media post, or a government report. However, certain core principles apply across contexts: check the author's expertise, assess the publisher's reputation, examine the evidence and reasoning, look for transparency about methods and funding, and seek corroboration from independent sources.

Historical Background

The systematic evaluation of sources has roots in several traditions. In historiography, the critical evaluation of sources has been central since the nineteenth century, when Leopold von Ranke and other historians established the discipline of source criticism. They developed methods for assessing the authenticity, provenance, and reliability of historical documents, distinguishing primary from secondary sources and evaluating the credibility of witnesses.

In journalism, the standards for source evaluation evolved through the twentieth century as the profession developed norms of verification, multiple sourcing, and fact-checking. The traditional journalistic standard of seeking at least two independent sources for any claim, and of attributing information to named sources whenever possible, reflects an understanding that single sources can be unreliable.

In academic research, peer review serves as a systematic source evaluation mechanism. Before a study is published in a reputable journal, it is reviewed by other experts in the field who assess its methodology, evidence, and reasoning. Peer review is not perfect — it can miss errors, perpetuate biases, and reject innovative ideas — but it provides a baseline level of quality control that non-peer-reviewed sources lack.

The internet disrupted traditional source evaluation by removing many of the gatekeepers. In the pre-internet era, the fact that something was published in a book or newspaper meant that it had passed through some level of editorial scrutiny. Online, the absence of gatekeepers means that the burden of source evaluation shifts entirely to the reader. This shift has been accompanied by new tools and techniques — search engines, fact-checking websites, reverse image search — but also by new challenges, including the sophisticated mimicry of legitimate sources by purveyors of misinformation.

The Stanford History Education Group's research on civic online reasoning, led by Sam Wineburg, has been influential in documenting the challenges of source evaluation in the digital age. Their studies found that even college students and professional fact-checkers often struggle to evaluate online sources effectively. Their research led to the development of new educational approaches, particularly the technique of "lateral reading," which involves leaving an unfamiliar website and checking what other sources say about it, rather than evaluating the site based solely on its own content.

Key Concepts

The CRAAP test. A widely taught framework for source evaluation, developed by the Meriam Library at California State University, Chico. CRAAP stands for Currency (is the information up to date?), Relevance (does it address your needs?), Authority (who wrote it and what are their credentials?), Accuracy (is the information supported by evidence?), and Purpose (why was it created — to inform, persuade, sell, or deceive?). The CRAAP test provides a practical checklist, though information literacy educators increasingly emphasize more nuanced, contextual approaches that go beyond simple checklists.

Lateral reading. A technique identified by the Stanford History Education Group as characteristic of professional fact-checkers. Rather than evaluating a source based on its own content (vertical reading), fact-checkers open new tabs and search for what other sources say about the source in question. This lateral approach is more effective because it leverages the collective judgment of the web rather than relying on the source's own self-presentation. Lateral reading is particularly important for evaluating unfamiliar websites, which may look professional but lack established reputations.

Authority and expertise. A key dimension of source evaluation is assessing the authority of the author or publisher. Authority comes from expertise — demonstrated knowledge and experience in a specific domain — and from track record — a history of reliable, accurate work. Expertise is domain-specific: a Nobel laureate in physics is an authority on quantum mechanics but not on epidemiology. When evaluating authority, look for relevant credentials, peer recognition, publications in reputable venues, and independence from conflicts of interest.

Bias and perspective. Every source has a perspective, and understanding that perspective is crucial for evaluation. Bias does not necessarily make a source unreliable — a source can be biased and still accurate. What matters is whether the source is transparent about its perspective, whether it presents evidence fairly, and whether it acknowledges and addresses counterarguments. Sources that conceal their perspective or present themselves as neutral while pushing a particular agenda are more concerning than sources that are openly partisan but rigorous in their evidence and reasoning.

Primary, secondary, and tertiary sources. The distinction between source types is important for evaluation. Primary sources are original materials — research studies, eyewitness accounts, original documents. Secondary sources interpret and analyze primary sources — review articles, textbooks, journalism. Tertiary sources compile and summarize secondary sources — encyclopedias, dictionaries. Primary sources are generally the most authoritative for specific claims but require expertise to interpret. Secondary sources provide context and synthesis. Tertiary sources provide overviews but are furthest from the original evidence.

Click restraint. A technique identified in the Stanford research, click restraint involves resisting the urge to click on the first search result and instead scanning multiple results to identify the most relevant and reliable sources. Search engines rank results by algorithms that consider relevance and popularity but not necessarily reliability. The first result may be the most popular but not the most accurate. Taking a moment to evaluate the list of results before clicking can lead to better sources.

Verification and triangulation. The most reliable way to evaluate a source's claims is to verify them against other sources. If multiple independent sources — sources that do not derive from the same original — report the same information, the information is more likely to be accurate. Triangulation is particularly important for claims from unfamiliar or potentially biased sources. Even authoritative sources can make mistakes, so independent verification remains the gold standard for important claims.

Contemporary Relevance

Source evaluation is a critical skill in the contemporary information environment. The proliferation of misinformation, disinformation, and low-quality content online means that the ability to distinguish reliable from unreliable sources is essential for informed decision-making. Whether you are researching a medical treatment, evaluating a political claim, or deciding which product to buy, the quality of your decisions depends on the quality of your sources.

The COVID-19 pandemic demonstrated the life-and-death stakes of source evaluation. People who could distinguish reliable health information from misinformation — who knew to trust the CDC and WHO over anonymous social media posts, who could evaluate the quality of preprint studies versus peer-reviewed research — were better equipped to protect themselves and their communities. Those who lacked these skills were more vulnerable to dangerous misinformation about treatments, vaccines, and prevention.

In politics, source evaluation is essential for democratic participation. Voters are bombarded with claims from campaigns, media outlets, social media, and interest groups, each with their own agendas. The ability to evaluate the credibility of these sources — to distinguish legitimate journalism from partisan propaganda, to recognize when a source is selectively presenting facts, to identify when a claim has been independently verified — is fundamental to informed voting.

The rise of artificial intelligence adds new dimensions to source evaluation. AI-generated content can mimic the style and format of legitimate sources, making it harder to distinguish genuine from synthetic information. Deepfakes can create convincing audio and video of people saying things they never said. Source evaluation in the age of AI requires new skills: recognizing the signs of AI-generated content, understanding the limitations of AI systems, and being especially vigilant about verifying claims from unknown or unverified sources.

For educators, teaching source evaluation is a priority that extends across disciplines. It is not just a skill for media literacy classes but a fundamental competency for academic work, professional life, and civic participation. Effective source evaluation education goes beyond checklists to develop the dispositions of skepticism, curiosity, and persistence that underlie good information practice. It also requires keeping up with the evolving information landscape, as new platforms, technologies, and manipulation tactics continually reshape the challenges of source evaluation.

Sources

• Wineburg, S., McGrew, S., Breakstone, J., & Ortega, T. (2016). "Evaluating Information: The Cornerstone of Civic Online Reasoning." Stanford History Education Group. https://purl.stanford.edu/fv751yt5934
• Stanford Encyclopedia of Philosophy. "Epistemology." https://plato.stanford.edu/entries/epistemology/
• Meola, M. (2004). "Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-Site Evaluation." Portal: Libraries and the Academy, 4(3), 331–344.
• Caulfield, M. (2017). Web Literacy for Student Fact-Checkers. Pressbooks. https://webliteracy.pressbooks.com/
• Head, A. J., Fister, B., & MacMillan, M. (2020). Information Literacy in the Workplace: A Study with Recent College Graduates. Project Information Literacy.

Related Topics

• How to evaluate evidence — Assessing the quality of evidence within sources
• What is information literacy? — The broader skill set
• What is media literacy? — Understanding media as a system
• What is misinformation? — The problem source evaluation helps solve
• What is epistemic authority? — Who we trust and why
• How to identify echo chambers — When sources are too homogeneous