Stories
Slash Boxes
Comments

SoylentNews is people

posted by chromas on Monday January 14 2019, @02:22AM   Printer-friendly
from the Surely-you-jest,-Dr.-Feynman dept.

Probably not that good of an article, but it actually exists, only at Wired, so it is certain that it probably is worth reading. But only if you go in with no preconceptions.

Nobel laureate Richard Feynman once asked his Caltech students to calculate the probability that, if he walked outside the classroom, the first car in the parking lot would have a specific license plate, say 6ZNA74. Assuming every number and letter are equally likely and determined independently, the students estimated the probability to be less than 1 in 17 million. When the students finished their calculations, Feynman revealed that the correct probability was 1: He had seen this license plate on his way into class. Something extremely unlikely is not unlikely at all if it has already happened.

Bayesian probability is all well and good, until it runs up against actuality. But the point here is all about having a Beautiful Mind or π, and seeing patterns everywhere, and how if you see them in Big Data, the patterns are bigger. But no less crazy.

The Feynman trap—ransacking data for patterns without any preconceived idea of what one is looking for—is the Achilles heel of studies based on data mining. Finding something unusual or surprising after it has already occurred is neither unusual nor surprising. Patterns are sure to be found, and are likely to be misleading, absurd, or worse.

This approach to "science" can certainly lead to interesting results, as in this particular study:

A standard neuroscience experiment involves showing a volunteer in an MRI machine various images and asking questions about the images. The measurements are noisy, picking up magnetic signals from the environment and from variations in the density of fatty tissue in different parts of the brain. Sometimes they miss brain activity; sometimes they suggest activity where there is none.

A Dartmouth graduate student used an MRI machine to study the brain activity of a salmon as it was shown photographs and asked questions. The most interesting thing about the study was not that a salmon was studied, but that the salmon was dead. Yep, a dead salmon purchased at a local market was put into the MRI machine, and some patterns were discovered. There were inevitably patterns—and they were invariably meaningless.

Brings to mind (brains!) a certain Irish myth of the Salmon of Knowledge, and the parallel formation of the posthumous Salmon of Doubt by Douglas Adams.

The problem has become endemic nowadays because powerful computers are so good at plundering Big Data. Data miners have found correlations between Twitter words or Google search queries and criminal activity, heart attacks, stock prices, election outcomes, Bitcoin prices, and soccer matches. You might think I am making these examples up. I am not.

There are even stronger correlations with purely random numbers. It is Big Data Hubris to think that data-mined correlations must be meaningful. Finding an unusual pattern in Big Data is no more convincing (or useful) than finding an unusual license plate outside Feynman's classroom.

New Myth: Big Data and the MRIed Dead Salmon of Pattern Imagination.


Original Submission

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 1, Funny) by Anonymous Coward on Monday January 14 2019, @04:42PM

    by Anonymous Coward on Monday January 14 2019, @04:42PM (#786477)

    Schrodinger and Heisenberg were pulled over.

    Policeman asks if he knew how fast he was going.

    Heisenberg says no, but he was quite confident as to where he was.

    Policeman asks to look in the trunk, "Did you know you had a dead cat in here?"

    Schrodinger says, "well, I do NOW!"

    Starting Score:    0  points
    Moderation   +1  
       Funny=1, Total=1
    Extra 'Funny' Modifier   0  

    Total Score:   1