Slashdot Mirror


How Data Science Powered the Search for MH370 (hpe.com)

"In the absence of physical evidence, scientists are employing powerful computational tools to attempt to solve the greatest aviation mystery of our time: the disappearance of flight MH370." Slashdot reader Esther Schindler shared this article from HPE Insights: Satellite communications provider Inmarsat announced it had found recorded signals in its archives that MH370 had sent for another six hours after it disappeared. The plane had been aloft and flying for that whole time -- but where had it gone? As Inmarsat scientists examined the signals, they saw that what they had was not data such as text messages or location information. Rather, the signals contained metadata: information about the signal itself. This was recorded as the satellite automatically contacted the plane's communications system every hour to see if it was still logged on. Bafflingly, whoever had taken the plane hadn't used the satcom system to communicate with the outside world, but had switched it off and then on again, leaving it able to exchange hourly "pings" with the satellite. Some of the metadata related to extremely subtle variations in the frequency of the signal. "We're talking about changes as big as one part in a billion," says Inmarsat scientist Chris Ashton.

Nobody had tried to use this kind of data to try to locate an airplane before. At first, Ashton's team didn't know if the attempt would work. But painstakingly, over the course of weeks, the team figured out how the movement of the plane, the orbital wobble of the satellite, and the electronics within the satcom system all interacted to create the data values that had been received. "We had to create the model from scratch," Ashton says. Their work revealed that the plane had flown into the remote southern Indian Ocean. They didn't know where exactly. But since there are no islands in that part of the world, it was impossible that anyone could have survived. For the first time in history, hundreds of people were declared legally dead based on mathematics alone.

Then mathematician Dr. Neil Gordon led a team from the Defense Science and Technology Group "to extract a path from a subset of the Inmarsat data called the Burst Timing Offset. This measured how quickly the aircraft responded each time the satellite pinged it, and was used to determine the distance between the satellite and the plane." They ultimately generate "a probabilistic 'heat map' of the plane's most likely resting places using a technique called Bayesian analysis. These calculations allowed the DSTG team to draw a box 400 miles long and 70 miles across, which contained about 90 percent of the total probability distribution.

22 of 133 comments (clear)

  1. Very userful by 110010001000 · · Score: 5, Insightful

    "Their work revealed that the plane had flown into the remote southern Indian Ocean. They didn't know where exactly."

    Amazing stuff.

    1. Re:Very userful by fermion · · Score: 5, Interesting
      The problem with fake science is that reporters state supposition as fact even when the data suggests it is not, and scientists hang onto to their 90% confidence level even when data suggests there is no such thing.

      This is an old story, and I think the analysis has shown it to be more conjecture that a real model. There is simply too many assumptions that need to be made, the variables are too complex.

      The analysis was interesting, and if it had worked would have a great feat of data analysis. But over a year ago drift analysis of the wreckage indicated that any probably location was nowhere near the IMSAT estimated locations.

      --
      "She's a scientist and a lesbian. She's not going to let it slide." Orphan Black
    2. Re:Very userful by TemporalBeing · · Score: 2

      The funny thing is everyone knows that the plane went down in the ocean but don't know where exactly.

      Everyone except those that look at the alternate interpretations of the same data.

      Again, if the data analysis had actually led to something that would be one thing; but it hasn't. There's still only a high likelihood that MH370 ended in the Indian Ocean. And yes - I'm aware of the components found; consider that if if it went on the Northern Arc (again - a path predicted by the data) that it would have been in the interest of parties to make it look like it went on the Southern Arc by giving some evidence. Conspiratorial? Yes; but until the plane is actually found we have to consider all possibilities that fit the findings.

      --
      Truth is like the sun. You can shut it out for a time, but it ain't goin' away. - Elvis Presley (source: imdb.com)
    3. Re:Very userful by sycodon · · Score: 3, Funny

      CNN is still looking.

      --
      When Fascism comes to America, it will call itself Anti-Fascism, and tell you to give up your guns.
    4. Re:Very userful by Solandri · · Score: 5, Insightful

      Drift analysis relies on the average value of year's worth of estimated currents and winds. The satellite data analysis relied on precisely known satellite positions and the speed of light (which is also precisely known). My money is on the satellite analysis being more accurate.

      But until the plane is actually found, there's no point arguing which is correct. We can't draw any conclusions until the plane is found. And it probably will never be found. Even if the search area indicated by the satellite signals is accurate, finding it there was always going to be a long shot (after the pingers stopped after 30 days). Given the relative sizes of the plane and the search area, finding a needle in a haystack is child's play by comparison. This is like trying to find a needle in field of haystacks.

      If they wanted to test the accuracy of their satellite analysis, they should be running it on planes on regular flights. They can calculate a plane's position at certain times based on similar satellite ping times, then check it against the plane's actual flight path. Do it enough times and you can figure out just how accurate the methodology is.

    5. Re: Very userful by Jesus+H+Rolle · · Score: 5, Funny

      This is like trying to find a needle in field of haystacks.

      Use a really big magnet.

      Technology makes things easier.

    6. Re: Very userful by ls671 · · Score: 5, Insightful

      Last time I tried, I couldn't grab aluminum with a magnet.

      --
      Everything I write is lies, read between the lines.
    7. Re: Very userful by jabuzz · · Score: 5, Informative

      I can. Just need to induce an electric current in it, and bingo. They are known as Eddy Current Separators, and are used extensively to separate non ferrous metals from recycling waste, usually after removing the ferrous metals first using a magnet.

      Where I live we put all our metal and plastics in the same bin, because the metal can be separated from the plastic with ease automatically.

  2. Well... by hcs_$reboot · · Score: 5, Informative

    all that science worked well!

    --
    Slashdot, fix the reply notifications... You won't get away with it...
    1. Re:Well... by Mr+D+from+63 · · Score: 2

      all that science worked well!

      Back in the old days, we called it math and statistical analysis. "data science" sounds cooler I suppose.

  3. Shia Labeouf by QuadEddie · · Score: 5, Funny

    If Shia Labeouf were on the plane, 4chan could have found it in less than 24 hours.

    1. Re:Shia Labeouf by Anonymous Coward · · Score: 2, Interesting

      I think /pol/ is getting bored of ruining Shia's life. A week ago he put the flag on top of some music hall in France and all they've done so far is launch a flaming drone at it in a half-hearted attempt to set it on fire.

  4. Let's not forget what brought us here by eclectro · · Score: 5, Insightful

    Everybody would not be needing to comb over minute pieces of data and vast esoteric computations if service providers had behaved better.

    The satellite service was capable of gathering the gps data from the plane instantaneously and throughout its flight path. But the satellite company was charging for it, and Malaysian authorities did not want to pay for it presumably because it cost too much.

    If the gps location service had been available for this flight, one can't help but wonder if there was a possible intervention that could have been undertaken when the plane would have been discovered wildly off course, and even though it appears the crash was not survivable, the quick crash site discovery and possible apprehension of possible criminals involved (if there are any).

    As it is, everybody was chintzy all the way around at the expense of the safety of the flying public.

    --
    Take the cheese to sickbay, the doctor should see it as soon as possible - B'Elanna Torres, "Learning Curve"
  5. Re:MH370, aka the moment CNN stopped being real ne by Anonymous Coward · · Score: 2, Insightful

    CNN has been shit for a lot longer than that.

  6. Re:MH370, aka the moment CNN stopped being real ne by thegreatbob · · Score: 2

    That's the epoch you chose? I'll admit, they've been on the decline, but I hope you don't seriously believe it started there.

    --
    There is no XUL, only WebExtensions...
  7. MH370 is STILL missing.... by kenwd0elq · · Score: 5, Insightful

    I'd be a whole lot more impressed about the performance of "Big Data" if the submarine ROVs had found any trace of the aircraft. Right now, what they have is a big fat NOTHING. Some control surfaces washed up on islands a thousand miles away are not indicative of the performance of any sort of data analysis.

    1. Re:MH370 is STILL missing.... by Anonymous Coward · · Score: 3, Informative

      ... because nuclear submarines, which are expensive and built to 24/7 stand alert, are just willy nillly sent off looking for a missing civil airliner instead of hunting enemy submarines and putting nuclear missiles off the enemy's coast.

      Oh by the way, water affects sonar the same way for sonobouys, dippers, towed sonar arays and submarines. You still have to be relatively close.

      -Dan

  8. MH370 huh? by slashmydots · · Score: 2

    Anyone keep reading these headlines and thinking it's the new Intel chipset?

  9. Too early by mseeger · · Score: 5, Insightful

    This post comes too early. First find the damn thing, then boast about how this or that method helped finding it.

  10. Dead by mathematics? by thegarbz · · Score: 3, Interesting

    How about declared dead after they couldn't find the plane for over 9 months and no one had established contact?

    This article is a load of crap. It's an example of how these data models have failed to achieve anything useful. Firstly after almost 2 years they announced that they were looking in the wrong place: http://www.aljazeera.com/news/... and also that they were confident that after spending $200m the plane was not in the search area they established. https://www.theguardian.com/wo...

    Good work big data!

  11. That is not "Data Science" by gweihir · · Score: 5, Insightful

    That is merely a bit more special RF signal analysis engineering and not so much different from other radio-location tasks, although you usually have more data. Calling this "Data Science" is nonsense.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  12. Best Explanation I've heard... by Anonymous Coward · · Score: 2

    There was a similar aircraft where the oxygen bottle for the pilots broke its valve top and shot out the side of the aircraft like a rocket, putting a decent-sized hole in the fuselage (A foot or two in diameter). Turning off all the electronics breakers is consistent with fighting an electrical fire. So the theory would be - the pilots' oxygen bottle, in the radio bay below them, starts leaking, producing an oxygen-rich environment underneath them in the electrical hold - an electrical spark then results in a fire, so they immediately turn off the electrics. The oxygen bottle then fails and departs the aircraft putting a big hole in the fuselage; the pilots put on their masks and begin emergency procedures, turn the aircraft around about 180 and program the heading back to the nearest airport on the Malay peninsula. It would take a while for the pilots to realize they have no oxygen, by which point they are probably passing out, before they can program the autopilot for a lower flight level, a rather complex task for an oxygen-starved brain. I'm not sure I believe the Malaysians or Indonesians claiming on somewhat shakey grounds that they tracked the aircraft meandering - possibly that's an excuse for not having good radar data. Most likely, it follows the course set toward the nearest airport, keeps going over the Malay peninsula and Aceh, and out into the ocean. The passengers have 15 minutes or so of oxygen in those drop-down masks, so by the time they realize there's a problem in the cockpit they probably can't do anything about it, and also pass out. The aircraft flies on with it's programmed direction, everyone either passed out or dead or frozen, until it runs out of fuel. Does it stay level until it stalls, or gracefully glide down at greater than stall speed? Do some of the occupants wake up when the aircraft is low enough, only to watch it hit the water in the middle of nowhere?