Stories
Slash Boxes
Comments

SoylentNews is people

posted by martyb on Friday January 22 2016, @10:12PM   Printer-friendly
from the nothing-to-see-here dept.

Paul Meehl is responsible for what is probably the most apt explanation for why some areas of science have made more progress than others over the last 70 years or so. Amazingly, he pointed this out in 1967 and it had seemingly no effect on standard practices:

Because physical theories typically predict numerical values, an improvement in ex-perimental precision reduces the tolerance range and hence increases corroborability. In most psychological research, improved power of a statistical design leads to a prior probability approaching ½ of finding a significant difference in the theoretically predicted direction. Hence the corroboration yielded by "success" is very weak, and becomes weaker with increased precision. "Statistical significance" plays a logical role in psychology precisely the reverse of its role in physics. This problem is worsened by certain unhealthy tendencies prevalent among psychologists, such as a premium placed on experimental "cuteness" and a free reliance upon ad hoc explanations to avoid refuation.

Meehl, Paul E. (1967). "Theory-Testing in Psychology and Physics: A Methodological Paradox" (PDF). Philosophy of Science 34 (2): 103–115.
https://dx.doi.org/10.1086%2F288135 . Free here: http://cerco.ups-tlse.fr/pdf0609/Meehl_1967.pdf

There are many science articles posted to this site that fall foul of his critique probably because researchers are not aware of it. In short, this (putatively fatally flawed) research attempts to disprove a null hypothesis rather than a research hypothesis. Videos of some of his lectures are available online:
http://www.psych.umn.edu/meehlvideos.php

Session 7 starting at ~1hr is especially good.


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 3, Insightful) by wonkey_monkey on Friday January 22 2016, @11:56PM

    by wonkey_monkey (279) on Friday January 22 2016, @11:56PM (#293386) Homepage

    In short, this (putatively fatally flawed) research attempts to disprove a null hypothesis rather than a research hypothesis.

    To what does "this" refer? Is it referring to some hypothetical piece of research (such as those previously posted to Soylent which the previous paragraph refers to) which makes the mistakes this guy is pointing out?

    Without clarification, "this" could be confused to refer to the critiques the guy is making, implying that they are flawed. I'm not even sure this isn't the case.

    --
    systemd is Roko's Basilisk
    Starting Score:    1  point
    Moderation   +1  
       Insightful=1, Total=1
    Extra 'Insightful' Modifier   0  
    Karma-Bonus Modifier   +1  

    Total Score:   3  
  • (Score: 0) by Anonymous Coward on Saturday January 23 2016, @12:02AM

    by Anonymous Coward on Saturday January 23 2016, @12:02AM (#293391)

    To clarify: "this" refers to "many science articles posted to this site that fall foul of his critique". Not that that is any fault of the people submitting and approving the science articles. Researchers love their false null hypotheses these days, it becomes clear why if you think about it.

  • (Score: 0) by Anonymous Coward on Saturday January 23 2016, @12:33AM

    by Anonymous Coward on Saturday January 23 2016, @12:33AM (#293406)

    This submission sounds like one of those cases were the submitter is having an imaginary argument with someone and we are only able to hear the submitter's argument.

    • (Score: 0) by Anonymous Coward on Saturday January 23 2016, @01:22AM

      by Anonymous Coward on Saturday January 23 2016, @01:22AM (#293428)

      I presented Paul Meehl's argument for your consumption.