Stories
Slash Boxes
Comments

SoylentNews is people

posted by martyb on Wednesday May 23 2018, @08:20AM   Printer-friendly
from the peerless-recommendation dept.

The Scientist has an opinion piece that insufficient evidence of peer review is happening in scholarly publishing. In it, the author writes a call for publishing of anonymized peer reviews.

Scientific rigor demands that claims be substantiated by evidence. If I claim that gene A regulates gene B and provide no evidence, my claim will be dismissed. It must be dismissed. Yet, if a journal claims to conduct peer review and provides no evidence of it, the claim is rarely dismissed.

However, given the specialized nature of some disciplines and the small number of researchers, it is likely that the anonymity would not last for long. How do Soylentils weigh in on the opinion piece?

[Ed's Comment: The link is unreliable, but patience tends to get through eventually]


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 0) by Anonymous Coward on Thursday May 24 2018, @12:32AM (11 children)

    by Anonymous Coward on Thursday May 24 2018, @12:32AM (#683328)

    Not sure what you mean. Can you give an example where there is no correlation measured between any pair? It doesn't need to be real, made up data will do.

  • (Score: 2) by c0lo on Thursday May 24 2018, @12:47AM (9 children)

    by c0lo (156) Subscriber Badge on Thursday May 24 2018, @12:47AM (#683335) Journal

    I mean influencing interrelations between N-tuples of genes with N>2

    Can you give an example where there is no correlation measured between any pair?

    Note: your original statement is quite a hard one to disprove within the limits of the current knowledge/technology. But it's equally hard to prove.

    --
    https://www.youtube.com/watch?v=aoFiw2jMy-0 https://soylentnews.org/~MichaelDavidCrawford
    • (Score: 0) by Anonymous Coward on Thursday May 24 2018, @01:02AM (8 children)

      by Anonymous Coward on Thursday May 24 2018, @01:02AM (#683343)

      I never talked about "proving" anything, it is a matter of evidence not mathematics. There is no a priori reason the universe needs to be that way, but it is.

      However, can you give one example of what you are talking about with fake data and calculations?

      • (Score: 2) by c0lo on Thursday May 24 2018, @02:33AM (7 children)

        by c0lo (156) Subscriber Badge on Thursday May 24 2018, @02:33AM (#683374) Journal

        However, can you give one example of what you are talking about with fake data and calculations?

        Say the effect one gene has on another is described by a unitary/orthogonal matrix [wikipedia.org] with N>2.
        Then, depending where your start, if you iteratively apply the transform matrix over a "gene group's activation-level vector" you are going to fall into one or the other eigenvector of that matrix.

        Or any system in which you need to consider the influences of more than 2 parts to determine the evolution of a system.

        --
        https://www.youtube.com/watch?v=aoFiw2jMy-0 https://soylentnews.org/~MichaelDavidCrawford
        • (Score: 0) by Anonymous Coward on Thursday May 24 2018, @04:09AM (6 children)

          by Anonymous Coward on Thursday May 24 2018, @04:09AM (#683409)

          Please just give one actual example. Do the correlation calculations with large sample size to show what you are talking about does not lead to guaranteed pairwise correlations...

          • (Score: 2) by c0lo on Thursday May 24 2018, @04:43AM (5 children)

            by c0lo (156) Subscriber Badge on Thursday May 24 2018, @04:43AM (#683422) Journal

            Please just give one actual example. Do the correlation calculations with large sample size to show what you are talking about does not lead to guaranteed pairwise correlations...

            I'm talking about more than pairwise influence.
            Pure imagination, this may mean that, depending on the value of activation of a gene C, the influence of a gene A over a gene B may be show by a positive/negative or even no correlation at all.

            --
            https://www.youtube.com/watch?v=aoFiw2jMy-0 https://soylentnews.org/~MichaelDavidCrawford
            • (Score: 0) by Anonymous Coward on Thursday May 24 2018, @04:56AM (4 children)

              by Anonymous Coward on Thursday May 24 2018, @04:56AM (#683424)

              I really don't see what the problem is. Please go beyond using imagination and give a proof of concept dataset and calculation. You can make up the data any way you want.

              • (Score: 2) by c0lo on Thursday May 24 2018, @06:39AM (3 children)

                by c0lo (156) Subscriber Badge on Thursday May 24 2018, @06:39AM (#683447) Journal

                You can make up the data any way you want.

                Generate yourself a over 1000 points dataset picking at random levelA,B in [-1, 1] and take
                levelC = exp(-(levelA+levelB))^2) -0.5 + 0.01*unit_random_noise.
                Forget how the data was generated (you never knew anyway), then study on the data set what correlations you want using only pairs of dimensions, see where this gets you.

                --
                https://www.youtube.com/watch?v=aoFiw2jMy-0 https://soylentnews.org/~MichaelDavidCrawford
                • (Score: 0) by Anonymous Coward on Thursday May 24 2018, @01:24PM (2 children)

                  by Anonymous Coward on Thursday May 24 2018, @01:24PM (#683534)

                  Ok, here it is in R (There was an extra parentheses in your level_C, so I'm not sure if I did it right):

                  set.seed(8008135)
                  n   = 5
                  dat = data.frame(A = sample(c(-1, 1), n, replace = T),
                                   B = sample(c(-1, 1), n, replace = T))

                  dat$C = exp(-(dat$A + dat$B)^2) - 0.5 + 0.01*rnorm(n)

                  It looks like this:

                     A  B          C
                  1 -1 -1 -0.4850803
                  2  1  1 -0.4889374
                  3 -1  1  0.5022517
                  4 -1  1  0.5167859
                  5  1 -1  0.5177900

                  In this case you have defined A and B to be independent. I am saying this never happens in nature, the correlations may get negligibly small and difficult to detect but they are always there when enough effort is put forth.

                  This was already tested and well known by the 1960s:

                  These armchair considerations are borne out by the finding that in psychological and sociological investigations involving very large numbers of subjects, it is regu- larly found that almost all correlations or differences between means are statisti- cally significant. See, for example, the papers by Bakan [1] and Nunnally [8]. Data currently being analyzed by Dr. David Lykken and myself, derived from a huge sample of over 55,000 Minnesota high school seniors, reveal statistically signifi-cant relationships in 91% of pairwise associations among a congeries of 45 miscel-laneous variables such as sex, birth order, religious preference, number of siblings, vocational choice, club membership, college choice, mother’s education, dancing, interest in woodworking, liking for school, and the like. The 9% of non-significant associations are heavily concentrated among a small minority of variables having dubious reliability, or involving arbitrary groupings of non-homogeneous or non-monotonic sub-categories. The majority of variables exhibited significant relation- ships with all but three of the others, often at a very high confidence level (p < 10^–6).

                  https://meehl.dl.umn.edu/sites/g/files/pua1696/f/074theorytestingparadox.pdf [umn.edu]

                  • (Score: 2) by c0lo on Thursday May 24 2018, @01:52PM (1 child)

                    by c0lo (156) Subscriber Badge on Thursday May 24 2018, @01:52PM (#683539) Journal

                    When I wrote [-1, 1] I intended the continuous interval between -1 and 1 including the limits. Should I have used the [-1..1] notation?

                    In this case you have defined A and B to be independent.

                    Not quite true. Taking values for any two of them, the third is determined.
                    If you want, you can express it as an implicit function under the form f(A, B, c)=0 (something like "homoeostasis happens only when the level of activation of these 3 genes follows this relation..." - without knowing those 3 genes are dependent somehow, using simple linear correlations between will tell you nothing).

                    --
                    https://www.youtube.com/watch?v=aoFiw2jMy-0 https://soylentnews.org/~MichaelDavidCrawford
                    • (Score: 0) by Anonymous Coward on Thursday May 24 2018, @02:44PM

                      by Anonymous Coward on Thursday May 24 2018, @02:44PM (#683564)

                      Should I have used the [-1..1] notation?

                      Since you were referring to "levels", saying [-1,1] looks like "the set of -1 and 1" to me. I don't think it really mattesr, either way the situation is set up so there will be no correlation.

                      Not quite true. Taking values for any two of them, the third is determined.

                      That isn't what independent means. There is no feedback from C onto A or B in your model. I am saying that in any real situation there will be feedback. Then the values of A and B will be dependent upon C and each other. Then there will be a correlation.

                      without knowing those 3 genes are dependent somehow, using simple linear correlations between will tell you nothing

                      Sure it will, it will tell you that the expression of those genes are correlated with each other. I am saying this is worthless info since we already know it to be true.

                      "homoeostasis happens only when the level of activation of these 3 genes follows this relation..."

                      This is exactly what biologists like in TFA should be doing. That is not what they are doing. As I noted my the original comment, they are looking for the existence of simple correlations.

  • (Score: 1) by khallow on Saturday May 26 2018, @03:56AM

    by khallow (3766) Subscriber Badge on Saturday May 26 2018, @03:56AM (#684349) Journal

    Can you give an example where there is no correlation measured between any pair?

    Sure, when they aren't correlated. Let us remember that the space of vectors with almost no correlation would be much larger than the space of vectors which almost perfectly correlate or anti-correlate, because the former would be a locus of a (N-1)-sphere on a N-sphere while the latter would the locus of two points (the 0-sphere for your edification).