Slashdot Mirror


Asimov's Psychohistory Becoming a Reality?

northernboy writes "Today's LA Times has an article describing how a Wikileaks data dump from Afghanistan plus some advanced algorithms are allowing accurate predictions about the behavior of large groups of people. From the article: 'The programmers used simple code to extract dates and locations from about 77,000 incident reports that detailed everything from simple stop-and-search operations to full-fledged battles. The resulting map revealed the outlines of the country's ongoing violence: hot spots near the Pakistani border but not near the Iranian border, and extensive bloodshed along the country's main highway. They did it all in just one night. Now one member of that group has teamed up with mathematicians and computer scientists and taken the project one major step further: They have used the WikiLeaks data to predict the future.' Considering they did not discriminate between types of skirmish, but only when and where there was violence, this seems like an amazing result. It looks like our robotic overlords will have even less trouble controlling us than I previously thought."

27 of 291 comments (clear)

  1. Obligatory TED reference by Bananatree3 · · Score: 4, Informative
    1. Re:Obligatory TED reference by Taco+Cowboy · · Score: 5, Informative

      Quoting Asimov:

      "... and so I assumed that the time would come when there would be a science in which things could be predicted on a probabilistic or statistical basis"

      What Asimov talked about, had actually been researched by many - in a principle known as "group dynamics" http://en.wikipedia.org/wiki/Group_dynamics

      The LA Times TFA described is mere an extension - by tapping on the powerful computing ability that we have today, and by tapping on the enormous databases that are being gathered (and kept) by private/corporate/governmental agencies around the world, including Facebook, FBI, and so on
       

      --
      Muchas Gracias, Señor Edward Snowden !
  2. That is no prediction by siddesu · · Score: 5, Insightful

    In the absence of change in circumstances, it is quite obvious that areas of conflict will have more conflict. TFA doesn't say enough about the methodology for one to be able to estimate how valuable it is.

    On the other hand, yet another good thing about the Wikileak emerges. Were those data hidden by the secrecy wall, this research would not have been available to the NATO forces over there. Is secrecy really productive? Was the leak good or bad? Are the costly measures to make future leaks less likely a good investment?

    1. Re:That is no prediction by drinkypoo · · Score: 4, Insightful

      On one hand, I know a person (personally) who knows another person (personally) who was named in the leak who was currently deployed over there. On the other hand, who can say that their identity wasn't already known? On the gripping hand, what the fuck are we actually doing over there anyway?

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    2. Re:That is no prediction by slew · · Score: 5, Insightful

      [W]e weren't broke during WWII and the Civil War was not about slavery.

      Actually we were pretty broke during WWII. Remember WWII was right after the great depression and many think it was the event that allowed us to pull out of the depression. The US treasury debt was ~$40B in 1941, and $250B in 1946 when the war ended. The US financed WWII with lots of warbonds...

      FWIW, I don't think any historians would agree that we fought WWII to protect the rights of any people (other than US self interest). The US entered WWII to stop Japan from gaining too much influence in the Pacific (of course we were at the same time giving lots of money to England in their fight against Germany, but that wasn't really to protect their rights either). History records that it all came to head when Japan bombed Pearl Harbor. The fact that Germany wanted to pick a direct fight with the US pretty much gave us no choice but to go over to Europe for real too...

      And of course the Civil war wasn't about slavery, but states rights. Is it okay to secede from the union when you don't get your way? Apparently, no say the winners.

    3. Re:That is no prediction by Black+Parrot · · Score: 4, Insightful

      For those who say it isn't our business to protect the rights of others, that line of thinking was invalidated by WWII and previously in the Civil war.

      So what's our policy for deciding which people's rights get protected?

      Roll the dice, and if their country is important to our strategic economic interests we intervene, otherwise we don't?

      And whose right were we protecting on those occasions that we knocked off or destabilized democratically elected governments to put some thuggish warlord into power?

      --
      Sheesh, evil *and* a jerk. -- Jade
    4. Re:That is no prediction by cavreader · · Score: 4, Insightful

      Slavery was the most sensationalist and persuasive argument for the Civil War. It made good press coverage and personalized the argument on whether to engage in the war. Slaves did exist and slavery needed to be abolished but the Civil War was a fight against Balkanization. Instead of 50 states we could have ended up going down the path of creating 50 different countries and boy wouldn't that be fun.

    5. Re:That is no prediction by The+Snowman · · Score: 5, Informative

      The American Civil Was was about *more* than slavery, but it's ridiculous to say that it wasn't about slavery.

      My U.S. History professor, who wrote a dissertation about the civil war, agrees but in a slightly different way. He said it was an economic war. It just so happened that the economics of the South were based on slave labor. So while Congressmen in both chambers of Congress from both sides of the Mason-Dixon line were debating economic strife, the underlying issue was that the South made their money on the backs of slaves, while the North made their money on the backs of poor lower-class workers who were exploited just as bad but were free to walk away from their jobs.

      Nothing was good about either side in those times, but the North was slightly less bad.

      --
      24 beers in a case, 24 hours in a day. Coincidence? I think not!
    6. Re:That is no prediction by artor3 · · Score: 4, Insightful

      And whose right were we protecting on those occasions that we knocked off or destabilized democratically elected governments to put some thuggish warlord into power?

      The fact that people who happened to be born in the same 3.5 million square mile area as us did bad things decades ago does not mean that we should never do anything ever again.

      I'm against most wars for purely practical reasons: they're expensive, rarely work, and they kill lots of people. But intervening in other countries to stop atrocities can be a good thing, when done right. Suggesting we should never do so simply because we don't have a good way of deciding where to intervene is foolish. To use the requisite car analogy: I can't come up with a definitive method to make sure I always buy the right car, but that doesn't mean I should never buy a car, just that I should try my best to get it right.

    7. Re:That is no prediction by The+Snowman · · Score: 4, Interesting

      while the North made their money on the backs of poor lower-class workers who were exploited just as bad

      Yeah, all those whippin's and amputations and such that the poor lower-class workers got... er, wait.

      Working in crappy factories where injuries were common, to include losing digits, limbs, etc., yeah. Where if you quit, the only other jobs were just as bad. Sure, slaves had to deal with stuff like being whipped, raped, etc. but the living conditions of a slave were comparable to the Northern working class, and the hope of changing one's situation was equally as abysmal. Meanwhile, the crime and other crap the working class in the North dealt with (including beatings, rape, etc) were almost as bad.

      Slavery is evil and was never good. My point is the plight of a non-slave working class in that time was almost as bad. Look at the whole picture: not just the employer/slavedriver, but where did those people live? What did they deal with on a daily basis?

      Makes me grateful that the worst I deal with is my tendonitis and the risk of CTS.

      --
      24 beers in a case, 24 hours in a day. Coincidence? I think not!
    8. Re:That is no prediction by Black+Parrot · · Score: 4, Insightful

      The American Civil Was was about *more* than slavery, but it's ridiculous to say that it wasn't about slavery.

      My U.S. History professor, who wrote a dissertation about the civil war, agrees but in a slightly different way. He said it was an economic war.

      I think it was a broader cultural schism, basically the same thing the parent country worked out in their own civil war a couple of centuries earlier:

      north = roundheads (modernity)

      south = cavaliers (medievality)

      Of course, our esteemed Founding Fathers set us up the bomb with the 3/5 compromise. They wanted a union more than they wanted to deal with the issue of slavery, so they left it for their great-grandchildren to solve.

      --
      Sheesh, evil *and* a jerk. -- Jade
    9. Re:That is no prediction by Kjella · · Score: 4, Insightful

      History records that it all came to head when Japan bombed Pearl Harbor. The fact that Germany wanted to pick a direct fight with the US pretty much gave us no choice but to go over to Europe for real too...

      The attack on Pearl Harbor happened in December 1941, D-day was in June 1944. The turning point in the war was probably in late 1942 so by the time the US got seriously involved in ground combat it was pretty obvious Hitler was going to lose. The invasion was to stop the Soviet Union from taking all of Europe, it was to stop communism not fascism. Ironically that was one of the reasons Hitler got to do all he did, the other European leaders thought he'd stop the commies. You might say that backfired a little when he made a peace treaty with Stalin and invaded westwards instead, if you're going to let a rabid dog loose you'd better make sure he'll bite in the right direction.

      --
      Live today, because you never know what tomorrow brings
    10. Re:That is no prediction by slew · · Score: 4, Informative

      we were at the same time giving lots of money to England in their fight against Germany

      IIRC lending, not giving. They had to pay it back, and they eventually did.

      Better review your history on lend-lease. Basically the US (and Canada) gave stuff to England for token payments (e.g. giving England 50 destroyer in "exchange" for lease payments for new US base locations to be located in former British colonies). Then after the war was over, the US depreciated the value of the lend-lease items by 90% (because now they were "used") and allowed England to "buy" them at the depreciated value with a 2% loan stretched out over 50 years.

      Eventually, the residual of lend-lease was "paid" back on these terms on Dec 2006. Of course England could have paid it back earlier, but a 2% loan was a good deal and they of course paid it back in 50 year inflated money value...

      If that kind of loan would have been made to members of congress, I think many people would have called it a gift... (e.g., lend them a $1M house, depreciate it 90% in 4 years, give them the opportunity to buy it for $100K with a 2% 50 year loan) What would you call it?

      I'm not saying we shouldn't have done it, just calling a spade a spade. That whole lend-lease fiction was just to do an end-around the isolationist republican congress. It wasn't reality...

    11. Re:That is no prediction by kdemetter · · Score: 4, Insightful

      You are right, but you are forgetting the frame of mind of that time.
      I'm sure most lower class workers took it as part of the job, and were happy that they were at least free, and had a job.

      When looking back on history, it always seems cruel, because we are used to higher standards of living.

      For all we know, somewhere in the future, people will pitty us because our foods contained to much salt.

    12. Re:That is no prediction by n3r0.m4dski11z · · Score: 4, Informative

      Restrepo dude. Afghanistan has a culture of repelling invaders. As in, it is in their shared cultural heritage and defines them as a people. It should be one of the last reformed places on earth. They just want to be left alone.

      --
      -
    13. Re:That is no prediction by The+Master+Control+P · · Score: 4, Interesting

      At the start of WWII, the alliance system that caused The Great War and the monstrous and pointless slaughter that went on during it were still very much fresh on everyone's mind. That was why Neville Chamberlain let Hitler get away with as much as he did in the 1930s (That and that Britain couldn't afford another war either). That was why the US retreated into an isolationist/protectionist shell. America is an impregnable fortress - we have two entire oceans between us and any plausible invader - why should we send our boys to die in a European fight? Not sending them into fights that aren't ours is rather the popular meme these days as I understand it.

      I'm also curious how you conclude that the US only showed up after the Soviets had won the war. Seeing as the US declared war on all the Axis powers in early December of 1941, at which time Soviet forces were in full retreat, and the decisive turning point in the Eastern front - the Battle of Stalingrad - didn't even begin until late summer 1942.

      I also question how you conclude that Japan could barely challenge the US, when the Pacific Theater (which, if I might remind you, the US that contributed "very little to the defeat of the Axis" fought essentially its own while simultaneously fighting and/or arming two others in North Africa and Europe) began with the US Pacific Fleet getting sucker-punched and suffering defeat after defeat for over a year. Yes, for many reasons it's certainly true that for Imperial Japan to start a war with the US was a suicidal proposition in the long term, but you dishonor the memory of all the men who died fighting towards the home islands to say they were barely challenged.

      And the war was most certainly not practically won - The Imperial Japanese Army's own internal documents say they were ready to send every person in their entire nation to die fighting, and not until the US demonstrated unequivocally that we could now grant that suicidal wish and not lose a single man doing it did they surrender (unconditionally surrender - Japanese has about a dozen ways to yes and no without actually saying yes and no). Our own generals were forecasting literally millions of dead (to say nothing of casualties) if we finished the island hopping strategy and invaded the Home Islands conventionally.

      Was the Axis doomed much sooner by Hitler's strategic incompetence? I'll let Operation Barbarossa speak to that, along with several other potentially critical decision points that shouldn't have gone in Allied favor (like the decision not to release Panzers at Normandy because the Fuhrer was asleep and not to be disturbed). Was America's industrial and manpower committment to the war a footnote? Not on your life.

  3. It's only temporary by Narrowband · · Score: 5, Interesting

    Even in Asimov's world, psychohistory only works on groups that don't practice psychohistory themselves. Harry Seldon only kept things from going off the rails by making the science die out, and by starting a Second Foundation of telepaths.

    Once someone starts making predictions from data aggregation more effective, the race will be on to duplicate or improve on it, and then nobody's prediction algorithms will work.

    Almost sounds like someone should write a dystopian Foundation book, where the mathematicians race to predict each others' predictive abilities (and of course, stop them!)

    1. Re:It's only temporary by HornWumpus · · Score: 5, Insightful

      Sounds like algorithmic trading.

      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    2. Re:It's only temporary by Robotbeat · · Score: 5, Interesting

      Sounds like algorithmic trading.

      That's EXACTLY, EXACTLY what I was thinking. We've solved a lot of the secrets of the atom (and seemed to decide mostly as a society that we don't want to harness that power), the two great superpowers have essentially made peace (superpower defined as a great power that can project regional-great-power-level globally... something that China will not be capable of for decades, hemmed in as they are on all sides by powerful rivals), money for "big science" has started to dry up (partly because of "starve the beast" politics starving the US of greatness, partly by the fact the Cold War is over), and we've just found the Higgs, basically confirming the Standard Model. So, what do we do? Well, theoretical physicists turn out to be really good at modeling arcane, abstract things. They've been moving en masse (remember, they're still a tiny group compared to all the MBAs out there) into quantitative finance. A lot of technology that once went to building faster and faster supercomputers (such as interconnect technology similar to Infiniband) is now being used to reduce latencies for financial transactions, where nanoseconds matter.

      And while I've often felt pretty skeptical (as a graduate student physicist myself) about the purpose of string theory, a theoretical physicist-turned quant said, "It turns out that string theory is useful in valuing mortgage backed securities."

      Somewhat unlike physical laws, the nature of financial systems changes constantly, so you have to redo your models (not just the constants in your models, but the models themselves) quite often, meaning endless job security for these physicist quants. And we're talking about the world's economy, meaning the potential profits aren't marginal, like they might be for designing a slightly more efficient laser or semiconductor, but is literally all the liquid or semiliquid assets in the world. After the end of the Cold War, physicists have found a way to be indispensable again.

      It's an arms race of quantitative finance going on out there. Personally, I think it's unsustainable and will eventually result in an enormous clampdown as we have more flash-crashes or something unforeseen, but even then, there will still be a market for quantitive finance as long as there is money.

  4. Re:Macro versus Micro by Teresita · · Score: 4, Interesting

    The concept was fascinating and original, but flawed. Asimov based psychohistory on thermodynamics, not chaos theory. Greg Bear tossed around a lot of technobabble in "Foundation and Chaos" but his understanding of the underlying theory was as simplistic as George Lucas and his "good force/dark force" dualism. If Asimov hadn't have contracted HIV from that blood transfusion, he would have had Seldon (in yet another prequel) speak of the Second Empire as a strange attractor, without focusing on the details that led up to it.

  5. Not a prediction by Hentes · · Score: 5, Interesting

    This is model building, not prediction. They tried to find a model that can calculate the events of 2010 based on data from 2009. This may sound like prediction, but the important thing is that the researchers started this after the events the model "predicted" happened. Thus, they were able to tweak their models to fit reality. This is not a bad thing, that's how you create working models, but a prediction is a statement about things in the future. They only made predictions now that they have published their results, and whether they are right or not remains to be seen.

  6. The full paper ... by bwoneill · · Score: 5, Informative

    for those who are interested. I'm looking forward to reading it this weekend.

    http://www.pnas.org/content/early/2012/07/11/1203177109

  7. Psychohistory by br00tus · · Score: 5, Interesting

    Most modern Americans are unaware of the worldwide ideological debates of the early 20th century, and thus they miss the boat on what psychohistory obviously is. From a variety of things, including knowing Asimov's involvement with the Futurians in the 1930s, it's obvious that psychohistory is a parody of the Marxist conception of historical materialism. In fact, to anyone familiar with Marxian historical materialism, it is incredibly easy to see that this is what is made reference to by psychohistory in the book - although in the book the technique has been further developed. I've always felt the Mule was a reference to charismatic leaders like Hitler and Mussolini - ugly at close view, but with the ability to persuade large masses of people nonetheless, something which Marx did not foresee. That's just my interpretation though, it's not completely clear. I think that Hari Seldon is a Karl Marx figure is even more of a sure bet than the Mule possibility. To people who don't know the ideas of the Futurians, or the ideological ideas within the milieu of left-wing Jewish intellectual circles in New York City in the 1930s, I think it is easy to miss a lot of the references being made.

  8. Re:Macro versus Micro by HornWumpus · · Score: 4, Funny

    A permanent Franco-German political union called,,,wait for it,,,Germany.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  9. Re:Other uses? by methano · · Score: 5, Funny

    I read the Foundation Trilogy about 40 years ago and have been terrified ever since that this type of technology would be used in marketing. Thank goodness we're only using it in war.

  10. Re:Moslem beheading non-moslem by z0idberg · · Score: 5, Insightful

    And in the countries the US hasn't gotten to yet, they just stone women who've been raped for adultery, sell daughters into marriage and generally work against any sort of progress.

    From Wikipedia:
    Current dowry practices
    #India
    #Bangladesh
    #Pakistan
    #Nepal
    #Afghanistan
    #Vietnam


    Good luck with getting through that list. Are they starting their way from the bottom and working upwards? Perhaps should have ticked the bottom one off before moving to the next one.

  11. Re:Other uses? by kraut · · Score: 4, Interesting

    I never understood why people believe it's okay to kill people as long as you "respect" their dead bodies afterward.

    --
    no taxation without representation!