4

Are these two terms exact synonyms? Or is there some subtle difference between the two?


For example, David Deutsch (2011) writes:

Testability is now generally accepted as the defining characteristic of the scientific method. Popper called it the 'criterion of demarcation' between science and non-science.

Popper (1963) writes:

the criterion of the scientific status of a theory is its falsifiability, or refutability, or testability.

Testability is falsifiability.

pygosceles
  • 606
  • 3
  • 12
  • 5
    The difference isn't subtle. "Testable" is a vague catchall for unspecified exposure of a theory to some empirical/pragmatic checks that decide its adoption or rejection. More specific guidelines are spelled out in particular scientific disciplines, and vary widely. "Falsifiable" is a much more precise term coined by Popper that prescribes a specific testing approach more or less universally, which, however, turned out to be too restrictive to fit most of science. It still retains popular appeal as a kind of aspirational ideal. – Conifold Jun 06 '20 at 07:05
  • 1
    @Conifold: No. Neither that question nor its answers contain a single instance of the string "test", so I don't see how it could answer this question. –  Jun 06 '20 at 07:14
  • @Conifold, "It still retains popular appeal as a kind of aspirational ideal." - it retains popular appeal as something that allows scientists to claim one thing, whilst really doing another. The appeal to a "mainstream" (of what is already a very small and exclusive community) is another strategy whereby "scientists" dress up the ideological opinions of a minority as being somehow scientific in nature. They are basically all strategies for scientists to misrepresent the nature of the work they do, or the bases on which they adopt their own views which they then peddle as "science". – Steve Jun 06 '20 at 12:38
  • 1
    @Steve I doubt it. In the common talk about science even the difference between verifiability and falsifiability is largely ignored. It is more of an ideal for those who care about subtleties. While there is no such thing as "scientific in nature", historically, scientific procedures proved to be reliable and fruitful despite the fact that they were always developed and carried out by a small minority which is far from infallible and details of whose work are too technical for public discussions of them to be of much use. – Conifold Jun 07 '20 at 01:58
  • 1
    @Conifold, "historically, scientific procedures" - that begs the very question of what those procedures are, and whether today's self-proclaimed "scientists" have been following them! My argument is not against science - it is against the deadweight of absurd ideologies and, increasingly, the creeping intellectual corruption amongst academics and scientists. – Steve Jun 07 '20 at 02:55
  • @Steve It is not that procedures are scientific because they have to follow some pre-existing platonic criteria, but rather that sciences develop their procedures, and those are then philosophized about and called scientific. So "science" detached from scientists that practice it, with all their flaws, is an empty word. And historically, their practice was a success, despite the flaws. If societies are dissatisfied with their scientists they can defund them. But they will do well to remember that others might not, and history will be the judge of who comes out on top. – Conifold Jun 07 '20 at 07:15
  • 1
    @Conifold, the problem is that if you can't attribute anything in particular to science, then how is it distinguished from anti-science - that is, something which stifles or regresses scientific reproduction and progress? The alternative to dealing with anti-science is not merely to defund them, it is to reorganise the activity which purports to be science, for broader society to start imposing different terms on which they must work, and to sanction specific modes of thinking or operating which are thought to be contrary to science. – Steve Jun 07 '20 at 12:06
  • 1
    The starting point, of course, is to establish what science is and is not. There must be some criteria, for otherwise the profession would be completely disorganised, and we would not be able to tell the difference between funding science and putting money in the church collection box. – Steve Jun 07 '20 at 12:07
  • @Steve Let me make an analogy: history knows many attempts to prescribe "proper" grammar and vocabulary, and where are those prescriptions and their prescribers? And language arguably lends itself far more readily to the competencies of public at large and its civil servants than the finer points of scientific methodology. The typical level of deliberation in public forums does not instill confidence. Even assuming that one can identify guidelines cogent enough to impose on science, which so far has been unpromising, god help us when the masses and/or their bureaucracies get to the imposing. – Conifold Jun 07 '20 at 15:48
  • 1
    @Conifold, my point is not to argue for a fully prescriptive definition or method - one true way of doing science. Nor is it to argue for micromanagement by the uninformed masses, or the supposed efficiency savings of bureaucracies. My point is that there must be some characteristic criteria of science which distinguishes it from non-science or even anti-science. I also made the secondary point that the control we (broader society) have over science is not limited to just their degree of funding, but also how they are funded, who is funded, and on what terms. – Steve Jun 07 '20 at 16:14
  • @Steve My concern is who gets to decide what these criteria are and how to apply them. Philosophers did not have much success in any generality because there is no monolithic science and methodology is technical and discipline specific. A safer bet is to have people with specialized technical expertise adjust these criteria by trial and error than impose them from an armchair or public forums. There are competing research groups even within a single subdiscipline that serve as checks on each other, and the "invisible hand" of peer review, for all its flaws, is preferable to the alternatives. – Conifold Jun 08 '20 at 21:27
  • 1
    @Conifold, my concern is also who gets to decide, what the criteria are, and how to apply them. I disagree that those with "specialised technical expertise" are best to decide, for this typically just leads to highly ideological and self-serving minorities, particularly once there is perceived to be no accountability to the public at large (and the perception of being overseen may be more important than the actual oversight). (1/2) – Steve Jun 08 '20 at 22:25
  • I'm also not sure philosophers have entirely failed - the failure to reduce science to a single mechanical method, for example, is not a failure of philosophy, since making the methodlessness of science explicit is itself a worthwhile achievement. I think it's important that scientists are also explicit about their methods - resorting to "invisible hands" and other metaphors which suggest scientific methods are either not worth analysis or even beyond analysis should be seen as evidence of a suspect and unscientific approach. Any fool can resort to invisible hands to explain anything. (2/2) – Steve Jun 08 '20 at 22:33
  • 1
    I will add as well (3/2!), the inability to reduce science to a specific method doesn't mean science has become indefinable. What it does show is that it's not determined by its method (as we know the word). I would suggest it is at least in part defined by its axioms - of naturalism and determinism. It is perhaps also defined by other tenets which relate to how science is practiced - for example, if practitioners engage in wilful deceptions or misrepresentations, that may be regarded as unscientific. As I said before, there must be some criteria by which science is in fact distinguished. – Steve Jun 08 '20 at 22:41
  • Testability involves research and laboratory work. Falsifiability involves comparisons among concepts. Both may iinvolve scientific subject matter but they do not bear comparison. –  Oct 06 '20 at 03:40

6 Answers6

1

It is the difference between existential and universal statements in science. "All electrons in the universe are the same" is not testable but it is falsifiable - a single instance would disprove the assertion. It is important to note that the burden of proof is shifted(!). It is not the party who asserts universality that provides evidence. Popper's idea devloped from the observation that natural science had otherwise to adopt a rather vague conception of "testable in principle" (e.g. the electrons in the universe) which is not different from inductivism.

sand1
  • 3,704
  • 10
  • 20
  • So "Unicorns do not exist" is falsifiable, while "Unicorns do exist" is not? Is either or both testable? – Guy Inchbald Oct 04 '20 at 12:28
  • @Guy Inchbald Neither are testable or falsifiable. That's what excludes those statements from scientific investigation. A theory having "scientific status" doesn't mean the theory is endorsed by the majority of scientists; it just means the theory meets the criteria for scientific investigation (i.e. it doesn't mean it's true; it means we can use science to ask whether it's true). – Dayv87 Aug 23 '21 at 04:48
  • Perhaps we can say that while both statements are testable, only "Unicorns do exist" is provable (at least in theory)? – Yuri Zavorotny Jan 31 '24 at 23:45
  • If you find just one unicorn you proved that unicorns exist. You could prove that unicorns don’t exist on earth by checking every single place where one could be, making somehow sure that they are not moved while checking all places, and so on. – gnasher729 Feb 02 '24 at 22:46
1

Popper used testability, falsifiability and refutability interchangeably and presents it as a “criterion of demarcation”. (in “Conjectures and refutations” Page 53, lines 8-14)

He meant by that, a criterion for distinguishing scientific statements, from religious, metaphysical or pseudo-scientific statements.

Testability: The requirement that, any statement/ hypothesis/model/theory which claims to be scientific, should be testable, via empirical observations and if need be experiments.

Refutability and falsifiability: However, the purpose of the testing is not to verify or confirm the hypothesis but to refute it (refutability) or falsify it (falsifiability).
. Popper adds (in “Conjectures and refutations” Page 48, line 4):” A theory which is not refutable by any conceivable event is non-scientific. Irrefutability is not a virtue of a theory (as people often think) but a vice”

Note 1: The “confusion” arises from the fact that the term, ”testability” had been used before Popper in a broader sense, one that stops at “verifiability”. In restating the need for falsifiability, Popper insists that verifiability is not sufficient as criterion of demarcation between science and false science. He is redefining testability and giving it a narrower meaning.

Note2: Popper in my view rediscovered and restated in a clear manner what had been practiced by scientists since at least Newton, and had been proposed implicitly by early modern philosophers (see for example Francis Bacon, in Stanford Encyclopedia of Philosophy (on line), & 5). In a sense, he restored testability to its original meaning i.e. refutability or falsifiability.

Note3: Some scientific theories contain their refutability criterion implicit in their counterintuitive predictions such as the predictions of time dilation, distance contraction or the bending of light by gravity, in the theory of relativity. Any failed prediction refutes, falsifies the theory. In some cases, scientists themselves proposed a refutability criterion for their new hypothesis: I quote Darwin for example (in ‘The origin of Species’, p190) : “If it could be demonstrated, that any complex organ existed, which could not possibly have been formed by numerous, successive, slight modifications, my theory would absolutely break down” (end of quote).

Becharaj
  • 11
  • 1
0

A short digression first... Part of the problem we have with this question is that the Philosophy of Science has (historically speaking) over-focused on academic science. That makes a certain amount of sense; the core question of the field is the nature of science, and science as it's commonly understood occurs in academic settings, with academic scientists proposing and arguing over various theories. But in truth, much of 'science' isn't strictly academic. It isn't about people trying to suss out and model fundamental principles; it's more technological, with people trying to use and expand what we already know to produce things. For example, thousands of researchers around the world right now are trying to produce vaccines and treatments for Covid-19. That is not groundbreaking research, we likely won't learn much from the process, but still the struggle to produce these materials is thoroughly scientific.

The point of this digression is that when we restrict ourselves to academic science, 'testing' is at best a synonym for falsification and at worst a completely empty signifier. When an academic scientist tests something, she is not much interested in having the test succeed. a successful test is only useful as:

  1. Proof of concept, or...
  2. A teaching aid for students.

Tests that fail, on the other hand, are interesting and useful. Academics learn from tests that fail; they create new theories based on tests that fail. This is what led Popper to the 'falsification' model. He recognized that only the failure of a hypothesis had value to an academic scientist.

However, outside of academia, testing has an entirely different meaning; it's an essential part of production. We test plastic toys to make sure they don't poison children; we test materials to make sure they can withstand stresses. Every time we shoot a basketball at a hoop we are testing the theory of gravity (ToG), and every time we start a car we are testing the theory of oxygen combustion (ToOC). If we miss the hoop or if the car doesn't start, we don't automatically think that we've 'falsified' ToG or ToOC. We think we did something wrong, we try to fix the error, and we test it again until we get it right.

So in the broadest perspective testing is distinct from falsification: testing is a process that uses our knowledge to produce and improve outcomes we desire. But when we restrict our perspective to academic science testing collapses into falsification, because the academic world isn't trying to produce anything except valid theories and principles.

Ted Wrigley
  • 19,410
  • 2
  • 22
  • 55
  • I think falsifiability has origins in statistics as well: Since it is only possible to reject a hypothesis with statistical certainty, but never to confirm it - all we can deduce is that we cannot say that the hypothesis is not true with statistical certainty - it is natural to use only those hypotheses that can be rejected by tests, ie. falsifiable ones. – Philip Klöcking Nov 25 '20 at 20:18
0

Testability can just mean there are tests whose results would increase or decrease one's confidence in a theory, as in Bayesian hypothesis testing, without necessarily requiring that there be any test that would definitively rule a theory out. Whereas Popper grounded his idea of falsificationism in formal logic, namely the idea that any statement involving universal quantification (the ∀ symbol) is refuted by a single counter example. As the Stanford Encyclopedia of Philosophy article on Popper puts it:

In a critical sense, Popper’s theory of demarcation is based upon his perception of the logical asymmetry which holds between verification and falsification: it is logically impossible to conclusively verify a universal proposition by reference to experience (as Hume saw clearly), but a single counter-instance conclusively falsifies the corresponding universal law. In a word, an exception, far from ‘proving’ a rule, conclusively refutes it.

But as various critics have pointed out, in practice one can always come up with supplementary hypotheses as to why a seeming falsification does not actually definitively disprove some general law. For example, historically astronomers noticed irregularities in the motion of Uranus that didn't seem to match the predictions of Newton's theory of gravity, but they realized that the motions might be explainable in Newtonian gravity by positing that Uranus was experiencing the gravitational influence of a new unknown planet in a more distant orbit, and this led directly to the discovery of Neptune.

So, some argue that Popper's falsificationism doesn't really reflect the way science is done to require that there be a possible experimental result that would absolutely falsify a given theory, while agreeing that any scientific theory needs to be testable in the sense of there being tests whose results would strengthen or weaken the theory relative to others.

Hypnosifl
  • 2,857
  • 1
  • 17
  • 19
0

When Popper says that one is the other, he is overstating his case, exaggerating and being non literal. Confirmability is also testability.

-1

As you have noted, Karl Popper advanced an hypothesis that equated falsifiability with testability. However, an oft-overlooked facet of testability is the logical duality of propositions and proofs. Logical duality says that if there is falsifiability, there must also be a concept of verifiability. Almost no one talks about verifiability independent of falsifiability in philosophical problems, despite its crucial importance to the hard sciences and engineering.

We can prove the non-equivalence of falsifiability and testability with a simple truth table. The columns denote true and untrue claims, respectively, and the rows correspond to whether a claim is verifiable or falsifiable. This means there are four elemental types of claims, as follows:

There are only two types of grey area: Unverifiable truths, and unfalsifiable falsehoods. Importantly there are two quadrants of the chart that correspond to testable and provable claims--not only a one-dimensional category, the "falsifiable", as Popper's fallacy is commonly misrepresented to imply.

As a consequence, falsifiability only matters for claims that are false. If they are not false, there does not need to exist a mechanism for proving them false--that would be immaterial, just as there does not need to exist a mechanism for proving a false claim to be true.

An interesting historical question emerges. Prior to the publication of Popper's opinion, were testability and falsifiability viewed as one and the same? Or must we acknowledge that Popper invented or discovered the true nature of testability? The prior emergence of verification of unfalsifiable claims, including for example that humans can fly, is definitive proof of the recognition of the fact that a true claim needn't be falsifiable in order for it to be verifiable (and consequently, testable).

pygosceles
  • 606
  • 3
  • 12