SoylentNews

Five Major Cancer Studies Are Proving Difficult to Reproduce

posted by on Saturday February 04 2017, @09:51AM   
from the if-at-first-you-don't-succeed dept.

An Anonymous Coward writes:

Humanity would understand very little about cancer, and be hard-pressed to find cures, without scientific research. But what if, when teams recreated each other's research, they didn't arrive at the same result?

That's what the Reproducibility Project: Cancer Biology of the Center for Open Science is attempting to do—redo parts of 50 important cancer studies and compare their results. They released their first five replications today, and it turns out that not all of the data is matching up. At least once in every paper, a result reported as statistically significant (the way scientists calculate whether an effect is caused by more than chance alone) was not statistically significant in the replicated study. In two of the cases, the differences between the initial and replicated studies were even more striking, giving the Center for Open Science researchers cause for concern

"I was surprised by the results because of all that homework that we did" to make sure the studies were being reproduced accurately, Tim Errington, Project Manager at the Center for Open Science told Gizmodo. "We thought we were crossing every T and dotting every I... Seeing some of these experimental systems not behave the same was something I was not expecting to happen."

---

Original Submission

• Re:There's nothing wrong with p-values... Re:There's nothing wrong with p-values... (Score: 3, Insightful) by mhajicek on Saturday February 04 2017, @05:53PM

  by mhajicek (51) on Saturday February 04 2017, @05:53PM (#462878)

  Perhaps it should become standard to publish the full data set, so that anyone cam do their own statistical analysis.

  --
  The spacelike surfaces of time foliations can have a cusp at the surface of discontinuity. - P. Hajicek

  Parent

  Starting Score:	1		point
  Moderation		+1
  Insightful=1, Total=1
  Extra 'Insightful' Modifier		0
  Karma-Bonus Modifier		+1
  Total Score:		3

• Re:There's nothing wrong with p-values... (Score: 2) by deimtee on Saturday February 04 2017, @10:57PM

  by deimtee (3272) on Saturday February 04 2017, @10:57PM (#462960) Journal

  I agree that publishing all the data would be best, but in human studies it is possible you will run into patient confidentiality problems. At the very least there would be extra work involved in anonymizing patient data. (however, any animal based studies should be regarded as very suspect if they don't make the full dataset available. )

  --
  If you cough while drinking cheap red wine it really cleans out your sinuses.

  Parent