Information Intelligent Design News

When Big Data fails

Spread the love

… proving that information is not God either.

From Financial Times:

Five years ago, a team of researchers from Google announced a remarkable achievement in one of the world’s top scientific journals, Nature. Without needing the results of a single medical check-up, they were nevertheless able to track the spread of influenza across the US. What’s more, they could do it more quickly than the Centers for Disease Control and Prevention (CDC). Google’s tracking had only a day’s delay, compared with the week or more it took for the CDC to assemble a picture based on reports from doctors’ surgeries. Google was faster because it was tracking the outbreak by finding a correlation between what people searched for online and whether they had flu symptoms.

Not only was “Google Flu Trends” quick, accurate and cheap, it was theory-free. Google’s engineers didn’t bother to develop a hypothesis about what search terms – “flu symptoms” or “pharmacies near me” – might be correlated with the spread of the disease itself. The Google team just took their top 50 million search terms and let the algorithms do the work.

The rest was the stuff of millions of PowerPoints and thousands of stories. Then,

Four years after the original Nature paper was published, Nature News had sad tidings to convey: the latest flu outbreak had claimed an unexpected victim: Google Flu Trends. After reliably providing a swift and accurate account of flu outbreaks for several winters, the theory-free, data-rich model had lost its nose for where flu was going. Google’s model pointed to a severe outbreak but when the slow-and-steady data from the CDC arrived, they showed that Google’s estimates of the spread of flu-like illnesses were overstated by almost a factor of two.

The problem was that Google did not know – could not begin to know – what linked the search terms with the spread of flu. …

… One explanation of the Flu Trends failure is that the news was full of scary stories about flu in December 2012 and that these stories provoked internet searches by people who were healthy. Another possible explanation is that Google’s own search algorithm moved the goalposts when it began automatically suggesting diagnoses when people entered medical symptoms. More.

Yes, all of the above. For one thing, flu tends to fell people who are already older and less healthy—disproportionately less likely to proactively seek out information on the Internet. Young, active people with a lot to lose are more likely to seek information even though they are at less risk.

Somewhere out there, there must be a general law that governs the spread of information and its limits.

When Big Data fails, common sense comes into its own, and maybe a law of some kind even underlies that.

Follow UD News at Twitter!

One Reply to “When Big Data fails

  1. 1
    bornagain77 says:

    as to:

    “proving that information is not God either.”

    I hate to quibble about a off hand quip, but actually, this story does nothing to ‘prove’ that the universe is not ‘Information Theoretic’ at is foundational basis as is predicted in John 1:1-4

    A few notes to that effect:

    “It always bothers me that in spite of all this local business, what goes on in a tiny, no matter how tiny, region of space, and no matter how tiny a region of time, according to laws as we understand them today, it takes a computing machine an infinite number of logical operations to figure out. Now how can all that be going on in that tiny space? Why should it take an infinite amount of logic to figure out what one stinky tiny bit of space-time is going to do?”
    – Richard Feynman – one of the founding fathers of QED (Quantum Electrodynamics)
    Quote taken from the 6:45 minute mark of the following video:
    https://www.youtube.com/watch?v=obCjODeoLVw

    I don’t know about Feynman, but as for myself, being a Christian Theist, I find it rather comforting to know that it takes an ‘infinite amount of logic to figure out what one stinky tiny bit of space-time is going to do’:

    John1:1
    “In the beginning was the Word, and the Word was with God, and the Word was God.”

    of note: ‘the Word’ in John1:1 is translated from ‘Logos’ in Greek. Logos is the root word from which we derive our modern word logic
    http://etymonline.com/?term=logic

    Wheeler and Zeilinger both weigh in here:

    “it from bit” Every “it”— every particle, every field of force, even the space-time continuum itself derives its function, its meaning, its very existence entirely—even if in some contexts indirectly—from the apparatus-elicited answers to yes-or-no questions, binary choices, bits. “It from bit” symbolizes the idea that every item of the physical world has a bottom—a very deep bottom, in most instances, an immaterial source and explanation, that which we call reality arises in the last analysis from the posing of yes-no questions and the registering of equipment—evoked responses, in short all matter and all things physical are information-theoretic in origin and this is a participatory universe.”
    – Princeton University physicist John Wheeler (1911–2008) (Wheeler, John A. (1990), “Information, physics, quantum: The search for links”, in W. Zurek, Complexity, Entropy, and the Physics of Information (Redwood City, California: Addison-Wesley))

    Why the Quantum? It from Bit? A Participatory Universe?
    Excerpt: In conclusion, it may very well be said that information is the irreducible kernel from which everything else flows. Thence the question why nature appears quantized is simply a consequence of the fact that information itself is quantized by necessity. It might even be fair to observe that the concept that information is fundamental is very old knowledge of humanity, witness for example the beginning of gospel according to John: “In the beginning was the Word.”
    Anton Zeilinger – a leading expert in quantum mechanics:

    John Wheeler is more explicit here:

    John Wheeler (1911–2008) summarizes his life in physics – February 2014
    Excerpt: “I think of my lifetime in physics as divided into three periods. In the first period, extending from the beginning of my career until the early 1950?s, I was in the grip of the idea that Everything Is Particles. I was looking for ways to build all basic entities – neutrons, protons, mesons, and so on – out of the lightest, most fundamental particles, electrons, and photons.
    I call my second period Everything Is Fields. From the time I fell in love with general relativity and gravitation in 1952 until late in my career, I pursued the vision of a world made of fields, one in which the apparent particles are really manifestations of electric and magnetic fields, gravitational fields, and space-time itself.
    Now I am in the grip of a new vision, that Everything Is Information. The more I have pondered the mystery of the quantum and our strange ability to comprehend this world in which we live, the more I see possible fundamental roles for logic and information as the bedrock of physical theory.”
    – J. A. Wheeler, K. Ford, Geons, Black Hole, & Quantum Foam: A Life in Physics New York W.W. Norton & Co, 1998, pp 63-64.

    And Wheeler’s and Zeilinger’s contention, that reality at its foundation is ‘information theoretic’, is pretty convincing since it is now shown that ‘material’ atoms can be reduced to quantum information and teleported. In fact, all the ‘material’ atoms of an entire human body can, theoretically, be reduced to quantum information and teleported to another position in the universe:

    Quantum Teleportation of a Human? – video
    https://vimeo.com/75163272

    Of related note, Ms. O’Leary (UD News) has wisely noted previously:

    “But information is fundamentally relational”
    &
    “If information underlies the universe, then meaning underlies the universe. Pass it on.”

    In other words:

    John 1:1-4
    In the beginning was the Word, and the Word was with God, and the Word was God.
    The same was in the beginning with God.
    All things were made by Him, and without Him was not anything made that was made.
    In Him was life, and that life was the Light of men.

Leave a Reply