Back to essays
Razors · Mental Models

The Sagan Standard

Extraordinary claims require extraordinary evidence. The skeptic's calibration tool: why some claims need more proof than others, and how to apply it without becoming the closed-minded person you're afraid of.

14min readTopicSkepticism & evidenceLevelIntroductory

In December 1980, the astronomer Carl Sagan stood on a beach in California, his collar turned up against the wind, and recorded the final episode of Cosmos, the public-television series that would, over its thirteen episodes, become one of the most-watched science programs in human history. Somewhere along the way, in his measured baritone and his characteristic turtleneck, he uttered a sentence that would outlive the show, the format, the photochemical film it was recorded on, and even Sagan himself. It went: "Extraordinary claims require extraordinary evidence."

The phrase wasn't entirely original. Versions of it had been kicking around in skeptical philosophy for at least two centuries. The 18th-century philosopher David Hume wrote something nearly identical in his essay on miracles in 1748: "A wise man proportions his belief to the evidence." Pierre-Simon Laplace, the French mathematician, wrote in the 1810s that "the weight of evidence for an extraordinary claim must be proportioned to its strangeness." But it was Sagan, with his television reach and his gift for distilling careful thought into memorable sentences, who turned the principle into something a popular audience could actually use. By the time he died in 1996, the phrase was already being called the Sagan Standard, and it had become one of the most-cited rules of skeptical thought.

The principle is, on its face, simple to the point of seeming obvious. Bigger claims need more proof. A casual statement deserves casual evidence; a startling, world-changing assertion deserves correspondingly strong, world-shaking evidence. But that surface simplicity hides something deep: a calibration mechanism that, applied consistently, prevents both gullibility and the closed-minded refusal to update beliefs that often gets confused with skepticism. The Sagan Standard is not a license to dismiss things you don't like. It's a way to make sure your belief in any given claim is proportional to the strength of the evidence behind it.

This essay is about how that calibration works, where it comes from, and where, like every razor, it can be misapplied.

What the standard actually says

The Sagan Standard makes one core claim: the strength of evidence required to accept a claim should be proportional to how unlikely the claim is given everything else you already know. A claim that fits comfortably with established knowledge needs ordinary evidence to be accepted. A claim that contradicts substantial bodies of established knowledge needs evidence proportionally stronger, strong enough to outweigh not just one's prior skepticism but the entire body of prior evidence the claim must overturn.

"Extraordinary claims require extraordinary evidence."

— Carl Sagan, Cosmos (1980)

Notice what the principle is not saying. It's not saying that extraordinary claims are false. It's not saying that they should be dismissed. It's not saying that establishment views can never be overturned. They have been, repeatedly, by people who produced extraordinary evidence. The standard is procedural, not substantive: it tells you how much evidence to require, not what conclusions to reach. Galileo overturned a millennium of cosmology because he produced extraordinary evidence in the form of telescope observations. Einstein overturned Newtonian mechanics because relativity made testable predictions that, when tested, turned out to be true. The Sagan Standard didn't stop these revolutions; it ensured that when they happened, they happened on solid ground.

The word "extraordinary" is doing all the work, and it's worth pinning down. In Sagan's framing, extraordinary doesn't mean "strange-sounding" or "exciting." It means improbable given everything else we currently know to be true. A claim is extraordinary in proportion to how much established understanding it would have to overturn or contradict if true. A claim that water boils at 99°C at sea level is mildly extraordinary. It contradicts a well-tested measurement, but only by a small margin. A claim that water boils at 30°C at sea level is highly extraordinary. It contradicts not just the measurement but the underlying chemistry. A claim that water spontaneously boils itself without heat is wildly extraordinary. It contradicts the entire framework of thermodynamics. Each step requires proportionally more evidence to take seriously.

Sagan, Hume, and the long history

Carl Sagan was a professor at Cornell, a NASA advisor, the host of Cosmos, and one of the most influential popular scientists of the twentieth century. His 1995 book The Demon-Haunted World: Science as a Candle in the Dark was, in many ways, a long elaboration on the Sagan Standard: an extended argument that society needed better tools for separating real claims from pseudoscience, and that the principle of proportionate evidence was at the heart of those tools. He wrote the book for general readers, not specialists, and it became a cornerstone of modern skeptical thinking.

But Sagan was the messenger, not the originator. The principle has a long pedigree. David Hume's 1748 essay "Of Miracles" laid out the logical structure clearly: a miracle, by definition, is a violation of the laws of nature, and the testimony for any specific miracle must be evaluated against the enormous prior evidence that nature's laws hold consistently. "No testimony is sufficient to establish a miracle, unless the testimony be of such a kind, that its falsehood would be more miraculous, than the fact, which it endeavours to establish." The phrasing is dense, but the idea is identical to Sagan's: balance the evidence for the claim against the evidence the claim would have to overturn. If the evidence for the claim is weaker, you should disbelieve it.

Pierre-Simon Laplace, working a few decades after Hume, formalized the idea in mathematical terms. His Théorie analytique des probabilités (1812) contains the line that "the weight of evidence for an extraordinary claim must be proportioned to its strangeness." Laplace was also the architect of much of what we now call Bayesian probability theory, and his version of the principle wasn't just an aphorism. It was a quantitative framework for updating beliefs in light of new evidence. We'll come back to that framework shortly, because it's the engine that makes the Sagan Standard work.

Sagan's contribution was bringing the principle out of the philosophy seminar and the mathematical journal and into the kitchen of public discourse. His sentence is shorter, sharper, and more memorable than Hume's or Laplace's. But the underlying logic is two and a half centuries old, and it has been refined continuously by every generation of philosophers and scientists since.

The Bayesian engine underneath

The Sagan Standard isn't just folk wisdom. It's a popularized version of a precise mathematical principle called Bayes's theorem, named for Thomas Bayes, an 18th-century English minister who worked out the math of updating beliefs in light of new evidence. The theorem looks intimidating in its formal notation, but the intuition behind it is remarkably simple: your confidence in a claim after seeing evidence depends on three things.

To make this concrete: imagine a friend tells you they ate eggs for breakfast. The prior probability is high (people often eat eggs), the evidence is reasonable (your friend told you, and they have no reason to lie), and there are no compelling alternative explanations. You believe them with very low evidentiary effort. Now imagine the same friend tells you they ate breakfast on Mars this morning. The prior probability is essentially zero (humans haven't been to Mars), so the evidence required to make this claim believable would have to be enormous: corroboration from NASA, photos, multiple witnesses, physical artifacts. Even very strong-looking evidence (say, a few apparent photos) would not be enough, because the prior is so low that more mundane explanations (the photos are fake, your friend is mistaken, this is a joke) remain more likely than the claim itself.

This is why "extraordinary evidence" doesn't just mean "more evidence." It means evidence that's unusually difficult to explain by anything other than the claim itself. The strength of evidence is not just about quantity but about how well it eliminates alternative explanations. A blurry photo is consistent with both "real Bigfoot" and "person in a costume" and "tree shadow," so it provides almost no Bayesian update toward Bigfoot. A clear, multi-angle, high-resolution video that ruled out costumes and pareidolia would update much more strongly. The standard is calibrated to the alternatives that need to be ruled out, not to the volume of confirmations alone.

Science: how the standard saves us from ourselves

Modern science is, in a real sense, the institutional implementation of the Sagan Standard. Peer review, replication, statistical rigor, methodological transparency: all of these mechanisms exist because the scientific community decided over the course of a few centuries that confident assertion is not the same as evidence, and that the evidence required to update accepted understanding must be proportional to how much that understanding would have to change.

The most dramatic recent illustration of the Standard at work was the September 2011 announcement by physicists at the OPERA experiment that they had measured neutrinos traveling faster than the speed of light, a result that, if true, would have overturned the foundations of special relativity. The claim was extraordinary. So the response was extraordinary skepticism. Other labs immediately attempted to replicate the result. Theorists examined the methodology in painstaking detail. Within a few months, two flaws had been found in the OPERA setup: a loose fiber-optic cable contributing about 73 nanoseconds of delay, and a clock-synchronization issue. The "discovery" disappeared, the team that announced it published a retraction, and physics carried on with relativity intact.

Notice how the Sagan Standard worked here. The OPERA team had not done anything wrong in announcing their result. They had observed something, they had reported it carefully, and they had explicitly invited independent verification. But the physics community didn't update its beliefs based on a single anomalous result, no matter how carefully measured. The prior probability that special relativity is wrong is extraordinarily low (it's been confirmed in thousands of experiments over a century), so the evidence required to overturn it would have had to be correspondingly strong: replication by independent teams, identification of the mechanism, ruling out of measurement error. None of those things happened, so the result didn't update the consensus. The Standard worked exactly as intended.

A useful frame

Science isn't slow to adopt new ideas because scientists are stubborn. It's slow because the principles that have already been accepted are accepted on the basis of enormous prior evidence, and overturning them requires evidence proportional to that accumulated weight. This isn't conservatism. It's calibration.

Medicine and miracle cures

The Sagan Standard does some of its most useful work in evaluating health claims, because medicine is one of the domains where extraordinary-sounding claims arrive most frequently, and where the cost of believing them prematurely is often paid in human lives.

The pattern is consistent. Someone produces a small, often poorly-controlled study showing that a particular substance (a vitamin, a herb, a supplement, an alternative therapy) produces a striking benefit. The benefit is announced widely. People begin using the substance. Then, years later, larger and better-controlled studies fail to replicate the original finding, and the substance turns out to do nothing or to be actively harmful. Examples are abundant: vitamin E supplementation was widely promoted for decades as cardioprotective before large trials showed it provided no benefit and increased mortality at high doses. Beta-carotene supplements were promoted to prevent cancer; large trials showed they actually increased lung cancer risk in smokers. Hormone replacement therapy was promoted to extend the healthy lives of post-menopausal women; the Women's Health Initiative trial in 2002 showed it increased the risk of stroke and breast cancer.

None of these original claims were obviously fraudulent. The researchers had observed something real, usually a correlation, often a small effect in a limited sample. What they didn't have was evidence proportional to the extraordinariness of the claim. "This common substance dramatically reduces a major disease" is an extraordinary claim because, given the enormous range of substances we've tested for medical effects, the prior probability of any given one having a large beneficial effect is low. To update belief in such a claim toward acceptance, you need evidence at the level of large randomized controlled trials with replication, not single observational studies, not animal models, not biochemical mechanisms that suggest a possible benefit. The Sagan Standard, applied to medicine, is essentially the framework of evidence-based medicine itself.

Common Pattern

The supplement headline

You see a headline: "New study finds that turmeric reduces heart disease by 40%." The mind's first move is to update toward "I should take turmeric." The Sagan Standard says: hold on. What's the prior probability that a single common spice has a 40% effect on a major disease? Low, because we've tested thousands of common foods for major health effects, and almost none have effects that large. So the evidence had better be very strong: a large randomized controlled trial, properly blinded, with hard endpoints (deaths or heart attacks, not just blood markers), replicated independently.

If the headline is based on a single 60-person observational study with surrogate endpoints, the Standard says: don't update much. The prior is too low for that kind of evidence to do meaningful work. Most "miracle" health findings don't survive this filter, and most that do survive turn out to make claims that aren't actually all that extraordinary in the first place.

Everyday claims and the news

The Sagan Standard is also a remarkably useful tool for navigating the daily flow of news, social media, and ordinary conversation. The volume of confident, striking claims arriving via these channels is enormous, and most people lack any systematic way of triaging them. The Standard provides one.

The trick is to ask, before reacting to any striking claim, two questions: How extraordinary is this if true? and How strong is the evidence presented? If those two are mismatched (extraordinary claim, weak evidence), the right response is suspended judgment, not credulous sharing or angry counter-argument. Most viral claims fail this test. A study reported in a single tabloid headline, citing a single researcher, with no peer review, claiming a dramatic and counterintuitive result, should not move your beliefs much. The headline writer wants you to update; the Sagan Standard tells you to wait.

Ordinary claim

"Local restaurant raises prices."

Fits with everything else we know. Restaurants raise prices regularly. A single news report or even a customer's word is sufficient to accept this. The prior is high; ordinary evidence does the job.

Extraordinary claim

"Local restaurant cures cancer."

Contradicts essentially everything we know about cancer biology and food chemistry. The prior is near-zero. Even very compelling-looking testimonials wouldn't be enough. You'd need clinical trials, replication, mechanism. The evidence required scales with the claim.

This filtering pays compound dividends. A person who applies the Standard consistently spends less time arguing with bad claims, less time being misled by viral but unsupported findings, less time updating their worldview based on noise, and more time engaging with claims that have actually done the work of being arguable. It's not that they become unmovable; it's that they move in proportion to the evidence, which is what calibrated belief looks like in practice.

UFOs, ghosts, and Bigfoot

The territory where the Sagan Standard has done the most public work is the realm of paranormal and pseudoscientific claims: UFOs, ghosts, telepathy, cryptids, alien abductions, faith healing, dowsing, astrology, perpetual motion machines. Each of these, if true, would represent an extraordinary claim, and each comes with enthusiastic proponents, vivid testimonials, and small bodies of suggestive evidence that never quite reach the threshold required.

The classic case is Bigfoot. There are thousands of reported sightings of a large hominid in the Pacific Northwest, dating back over a century. There are blurry photos. There are footprint casts. There are personal testimonies, sometimes from credible witnesses. By the standards of ordinary claims, this would be a substantial body of evidence. But for an extraordinary claim (a large undiscovered primate in a heavily populated region of North America) it falls dramatically short of what's required. The prior is very low (we've thoroughly catalogued the large mammals of the Pacific Northwest); the alternative explanations are abundant (bears at distance, hoaxes, misperception, suggestible memory); and the evidence is consistent with both the extraordinary explanation and many mundane ones.

What would meet the Sagan Standard for Bigfoot? Probably: a body, alive or dead. Or genetic samples consistent with an unknown primate, replicated by multiple independent labs. Or a population of well-documented, repeatedly-observed individuals over time. Such evidence would not be extraordinary in volume. It would be extraordinary in kind, in being the sort of thing that simply cannot be explained by hoaxes or misidentification. None of this evidence has appeared in the past century of intense interest, which is itself evidence: every year that passes without it lowers the posterior probability further.

Notice that the Sagan Standard doesn't say Bigfoot is impossible. It says: given the current evidence, the rational degree of belief is very low, and would only update upward in response to evidence proportionate to the claim. This is the right epistemic stance for nearly all paranormal claims. Not "false," but "not yet supported by evidence proportional to the extraordinariness." The two stances feel similar but are different. The first closes the door; the second leaves it open while declining to walk through without good reason.

Where the standard cuts the wrong way

The Sagan Standard is one of the most useful razors in popular thought, but like every razor it can be wielded badly. The most common misuses fall into a few clear patterns.

Calibration failures

The Standard depends entirely on accurately judging how extraordinary a claim is, and that judgment is itself fallible. People routinely classify claims as "extraordinary" because they conflict with their personal expectations rather than because they conflict with established evidence. Conversely, people accept claims as "ordinary" simply because they fit their existing beliefs, even when those beliefs are themselves poorly supported. The Standard works only as well as the priors used to assess extraordinariness, and those priors can be deeply miscalibrated, especially in fields where the user doesn't have actual expertise.

This is why the Standard works best when paired with humility about one's own priors. "This contradicts what I believe" is not the same as "this contradicts well-established evidence." Confusing the two (assuming your gut sense of plausibility is the same as the actual prior probability of the claim) leads to dismissing genuinely well-supported findings as "extraordinary" when they aren't, or accepting weakly-supported claims as "ordinary" when they should be doubted.

Status quo bias

A subtler failure is using the Standard to defend the existing consensus indefinitely, rather than as a calibration mechanism. If you set the bar of "extraordinary evidence" high enough, you can ensure that no new finding ever clears it, and the existing consensus remains immovable. This is closed-mindedness dressed up as skepticism. The proper application of the Standard requires that, when extraordinary evidence does arrive (when it has been replicated, scrutinized, and survived) the user actually updates their beliefs. Failure to update is a failure of the Standard, not its faithful application.

The history of science is full of cases where the establishment was slow to accept findings that did, in fact, meet the Standard: continental drift, the bacterial cause of ulcers, the role of inflammation in heart disease, the existence of meteorites. Each was initially treated as too extraordinary to accept. Each turned out to be correct. The Standard is a tool for calibration, not for permanent denial.

Asymmetric application

Like Hitchens's razor, the Sagan Standard fails when applied only to claims one already disagrees with. Skeptics frequently apply demanding evidentiary standards to claims they find objectionable while accepting much weaker evidence for claims that fit their priors. This is selection bias in epistemic clothing. The Standard works only if applied symmetrically: to your own beliefs as well as your opponents'. The honest test: are you applying the same demanding standards to claims your tribe makes that you'd apply to claims the other tribe makes? If not, you're not really using the Standard. You're using its appearance as a weapon.

The "what counts as extraordinary" trap

Finally, there's the more philosophically interesting problem of defining extraordinariness. Is the existence of consciousness extraordinary? It depends on your prior framework. Is the existence of free will extraordinary? Same problem. Is the existence of moral facts extraordinary? Some of the most contested questions in philosophy turn precisely on whether the claim being made is "extraordinary" or "ordinary," and the Sagan Standard, on its own, doesn't tell you. It assumes you've already classified the claim correctly. For everyday empirical questions, this classification is usually obvious. For deep philosophical or interpretive questions, it isn't, and the Standard becomes less useful, not because the principle is wrong but because the inputs to it become contested.

How to actually use it

The Sagan Standard becomes a habit with practice. The move is always the same: before believing or sharing any striking claim, calibrate the evidence to the claim's extraordinariness, and update only in proportion.

The Sagan discipline

1
Estimate the prior honestly

Before evaluating evidence, ask: how likely is this claim given everything else I know to be true? If the claim contradicts well-established findings, the prior is low. If it fits comfortably, the prior is higher. Be honest with yourself. Don't lower the prior for claims you dislike or raise it for claims you want to be true.

2
Assess the evidence's strength, not just its volume

Strong evidence isn't just abundant. It's the kind that rules out alternative explanations. A clear, replicable, mechanism-explained finding outweighs ten ambiguous testimonials. Ask: what other explanations are consistent with this evidence? If many, the evidence is weaker than it looks.

3
Match evidence to extraordinariness

The two should be calibrated. Ordinary claim, ordinary evidence: believe. Extraordinary claim, extraordinary evidence: also believe. Extraordinary claim, ordinary evidence: suspend judgment, don't update much. Ordinary claim, missing evidence: typically still fine to provisionally accept, since the prior carries it.

4
Beware your own priors

A claim that feels extraordinary because it contradicts your personal expectations may not actually be statistically extraordinary. A claim that feels ordinary because it fits your existing beliefs may not actually be well-supported. Periodically ask: am I judging this claim's extraordinariness based on real evidence, or on my own comfort?

5
Be willing to update

If extraordinary evidence does appear (replication, mechanism, independent confirmation) update accordingly. The Standard is not a license for permanent skepticism. Refusing to update in the face of evidence proportional to the claim is closed-mindedness, not calibration.

6
Apply it symmetrically

The standards you apply to claims from people you disagree with should be the same as the standards you apply to claims from people you agree with. If you find yourself demanding more evidence from one side than the other, the Standard isn't doing its work. Your tribal loyalty is.

The Sagan Standard isn't about disbelief. It's about calibrated belief: believing things in exact proportion to the evidence, neither more nor less, regardless of how exciting or comforting they happen to be.

The principle, restated

Belief should be proportional to evidence, and the strength of evidence required should scale with how much established understanding the claim would have to overturn if true. This is not closed-mindedness. It is the only consistent way to remain open to genuine discovery while declining to be moved by the everyday flow of confident-sounding noise. Used well, the standard is what intellectual honesty actually looks like in practice.

Carl Sagan died in December 1996, two decades before the world he helped shape encountered a flood of information greater than any previous generation had faced. He didn't live to see most of what his standard would be used for: the deepfakes, the viral misinformation, the supplement industry, the conspiracy ecosystems, the countless small daily situations in which a person scrolling a feed must decide what to believe and what to set aside. But his sentence was built for exactly this. It was always meant to be portable; it was always meant to scale.

The standard does not make you cynical. It does not make you closed to discovery. It does not make you refuse to be moved by anything. It makes you proportional, willing to be moved exactly as much as the evidence justifies, and no more. In a world that constantly tries to move you with insufficient evidence, that proportionality is one of the few intellectual habits that keeps your beliefs roughly in contact with reality. And reality, as Sagan reminded us all those years ago on that windy California beach, has the unusual property of remaining true whether or not we're paying attention. The Standard is just our part of the bargain: staying calibrated enough to notice when it speaks.