Stories
Slash Boxes
Comments

SoylentNews is people

SoylentNews is powered by your submissions, so send in your scoop. Only 16 submissions in the queue.
posted by martyb on Friday April 19 2019, @06:34PM   Printer-friendly
from the significant-change dept.

In science, the success of an experiment is often determined by a measure called "statistical significance." A result is considered to be "significant" if the difference observed in the experiment between groups (of people, plants, animals and so on) would be very unlikely if no difference actually exists. The common cutoff for "very unlikely" is that you'd see a difference as big or bigger only 5 percent of the time if it wasn't really there — a cutoff that might seem, at first blush, very strict.

It sounds esoteric, but statistical significance has been used to draw a bright line between experimental success and failure. Achieving an experimental result with statistical significance often determines if a scientist's paper gets published or if further research gets funded. That makes the measure far too important in deciding research priorities, statisticians say, and so it's time to throw it in the trash.

More than 800 statisticians and scientists are calling for an end to judging studies by statistical significance in a March 20 comment published in Nature. An accompanying March 20 special issue of the American Statistician makes the manifesto crystal clear in its introduction: "'statistically significant' — don't say it and don't use it."

There is good reason to want to scrap statistical significance. But with so much research now built around the concept, it's unclear how — or with what other measures — the scientific community could replace it. The American Statistician offers a full 43 articles exploring what scientific life might look like without this measure in the mix.

Statistical Significance

Is is time for "P is less than or equal to 0.05" to be abandoned or changed ??


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 2) by ikanreed on Friday April 19 2019, @07:11PM (6 children)

    by ikanreed (3164) Subscriber Badge on Friday April 19 2019, @07:11PM (#832251) Journal

    How do I make money off this?

    Be the publisher, mandate that dozens upon dozens of grad students have to review each article for their advisor who's "too busy" to do it, charge institutions like every byte of data costs you a brick of gold to serve them, and pretend you're a proud institution protecting science from the riff-raff.

    Starting Score:    1  point
    Karma-Bonus Modifier   +1  

    Total Score:   2  
  • (Score: 0) by Anonymous Coward on Friday April 19 2019, @07:25PM (2 children)

    by Anonymous Coward on Friday April 19 2019, @07:25PM (#832256)

    How do *I*, the common peasant, make money off this?

    • (Score: 1) by khallow on Friday April 19 2019, @10:39PM (1 child)

      by khallow (3766) Subscriber Badge on Friday April 19 2019, @10:39PM (#832341) Journal
      Research shows that bullshit in your diet reduces colon cancer. Buy my $19.95 book to learn how you can get more bullshit in your diet. But beware the unhealthy bullshit, which I'll describe in my sequel to my first book, $19.95, which will shorten your life instead. And of course, there's high protein bullshit diet I outline in my third book, again for $19.95, where I describe how you can add decades to your life, but only if you buy all three books and follow the nebulous instructions exactly.
      • (Score: 1, Touché) by Anonymous Coward on Friday April 19 2019, @11:45PM

        by Anonymous Coward on Friday April 19 2019, @11:45PM (#832373)

        That is making money off BS, albiet a different variant. I want to know how to make money off the eventual collapse of the cuurent "mainstream" BS.

  • (Score: 0) by Anonymous Coward on Friday April 19 2019, @07:38PM (2 children)

    by Anonymous Coward on Friday April 19 2019, @07:38PM (#832259)

    No, I want to make money off the eventual "crash" off this government propped up bubble in BS research.

    • (Score: 2) by ikanreed on Saturday April 20 2019, @01:58AM (1 child)

      by ikanreed (3164) Subscriber Badge on Saturday April 20 2019, @01:58AM (#832399) Journal

      Be really good at timing, and shortsell those same publishers?

      • (Score: 0) by Anonymous Coward on Saturday April 20 2019, @04:50AM

        by Anonymous Coward on Saturday April 20 2019, @04:50AM (#832449)

        The publishers are just a cynical parasite that accounts for ~1% the fake value.