Slashdot Mirror


How Flight Tracking Works: a Global Network of Volunteers

An anonymous reader writes If a website can show the flight path and all those little yellow planes in real time, how can they not know where Malaysia Airlines flight MH370 went down? Answering that involves understanding a little about how flight-tracking sites work, where they get their data, and the limitations of existing technologies. It also involves appreciating a relatively new approach that the two large flight-tracking companies, Texas-based FlightAware and Sweden-based Flightradar24 are rushing to expand, a global sensor system known as ADS-B, which broadcasts updates of aircraft GPS data in real time. ADS-B is slowly superseding the ground-based radar systems that have been used for decades, becoming central not only to flight tracking but also to the future of flight safety. And it's powered, in part, by thousands of dedicated aviation hobbyists around the globe.

52 comments

  1. I live in the middle of nowhere by Anonymous Coward · · Score: 2, Informative

    I live in the middle of nowhere in the USA, and provide ADS-B data. Its fun.

    If you lived in a populated area like California or New York, there are already hundreds of people in your area doing this, and so its probably not necessary.

    1. Re:I live in the middle of nowhere by JWSmythe · · Score: 1

      I didn't even know FlightAware had a program like their ADS-B FlightFeeders I checked their map, and I'm a bit farther North in my area than the nearest feed, and there's a large gap to the next.

      I have some questions for you. Hopefully you read this. What services accept hobbyist input, besides the ones in the article? Is there hardware you recommend for cheap and reliable?

      I only took a quick look through, so I have more reading to do. Is there a software that reports to multiple services? Like Cumulus for my PWS reports to 5 plus two of my own personal feeds.

      I've had a weather station up for a few years, and it's been feeding off to APRS/CWOP/FindU, MetOffice.gov.uk, PWS Weather, Weather Underground, Weather Underground, and my own twitter feed and web site. It's nice putting up a resource that can be useful to everyone. As I understand it, that data is in turn aggregated by major weather services to give better weather reporting and forecasting. It helps the weather stations report with resolution down to "It's raining on X street, but Y street is still dry."

      It's also useful so family and friends can check on the weather here. Not just "some reporting station within 50 miles, here", but "right at his damned house, here". When I'm away from home, I can check the weather there, so I know what I'm going home to.

      --
      Serious? Seriousness is well above my pay grade.
  2. Misleading summary by swaq · · Score: 5, Informative

    ADS-B is not powered (in whole or in part) by aviation hobbyists. They are just piggybacking with receivers for flight tracking.

    The ADS-B system itself was designed for plane-to-plane communications to improve situational awareness. Ground-based ATC or hobbyists are not required to make the system work.

    Source: I worked on an ADS-B product at Garmin.

    1. Re:Misleading summary by tshawkins · · Score: 2

      They are however required to keep the realtime databases that the websites mentioned in the article use. The reciever is basicaly a usb DVB-T terrestial digital tv receiver working as a software defined radio and a bunch of code to pickup the ADS transmissions. The results are streamed to the tracking sites databases.

       

    2. Re:Misleading summary by tshawkins · · Score: 3, Informative

      http://flightaware.com/adsb/pi...

      Build your own for under $100, raspberry pi, dtv reciever, internet connection.

    3. Re:Misleading summary by KGIII · · Score: 1

      Interesting. I have six Pi's that do exactly nothing. All of them have memory cards in place. My goal was to build a cluster for the enjoyment of it but it never got any further then that. Now I may have to take one, or go ahead with clustering first, and then give this a try. It is all automated, right? I won't have to run around with some exactly tuned directional antenna ever time I want to share? I am way too lazy to do that and would give that up in just a few days.

      --
      "So long and thanks for all the fish."
    4. Re:Misleading summary by 0123456 · · Score: 2

      I set one of these up a while ago with an old Atom server I had lying around. A couple of hours' work, about $15 for the USB receiver, and the antenna is just taped to my bedroom windowsill. Works OK out to around 100 miles, though reception gets patchy beyond 50.

      I'd often wondered where all the vapour trails over our heads were going, and now I know. Of course, I could have saved time and just looked it up on the Internet :).

    5. Re: Misleading summary by Anonymous Coward · · Score: 0

      So you want to build a cluster, huh?

      Seems like you lack a valid purpose to build a cluster... know the feeling. well, for a cluster to be of some use, you need some task that the cluster can solve better/faster than a single R.Pi. I doubt the receivers are a good example. Except maybe if you want to continously track analyse all flights your receiver has seen until each one has landed. Also track changes over tines, like delays, possibly predicting delays based on weatger conditions etc. Kind of "where did it go, when will it arrive?". Then you'd need one node getting the signal in and stream it to of the tracking sites. Also to an another if your R.Pi. that second R.Pi then gets continous updates from the tracking site, stores these etc. That should keep this busy. Next you could set up a little hadoop/spark cluster with the other four R.Pis. this would analyze the data, make predictions etc.

      Hope this helps...

    6. Re:Misleading summary by KGIII · · Score: 1

      Looking it up is the lazy way. Is it a specific meter length required antenna? Did you have to make it? Or is it just some stereo wire taped to a T and then strung up or similar? I do have the absolute perfect tree to tape a fishing sinker to and toss it over and I am on the side of a mountain so I may do well but there's not much traffic out this way. My hand-held scanner does airplane frequencies but I seldom hear (I had actually typed here, I'm glad I preview before the preview.) anything and that has an upgraded antenna. The big scanner does the same and that has a mounted outdoor antenna. The ham does a much better job and I have a buddy who has a tower for sale, cheap, and it's 100' which is legal here. My issue with the tower is aesthetics. I have a pine that it would fit behind, mostly, but that is about 50' from the corner of the house. Do-able but there is a lot of math needed. I might see if there is a "local" ham club that will lend a hand or simply call around and hire someone so that it is right the first time. I can mix the concrete myself and fill four sonotubes and get the bolts in the right spot on my own so I will at least get my hands dirty, :D

      --
      "So long and thanks for all the fish."
    7. Re: Misleading summary by KGIII · · Score: 2

      That does help. It gives me some ideas and some potential motivation. The only reason I bought them was to build a cluster and I have absolutely no need for a cluster so I figured I would make one and then make another basement NAS or a media server. I already have a couple of servers down there but no media server. I don't actually have any use for a media server - that is already covered but the goal was to build a cluster, I don't really have a need or a good reason to build one. I figured it would be amusing and that maybe I would get another line put in and maybe make a web facing server. I understand that creating a LAMP stack clustered is really easy but making a clustered LAMP stack RIGHT is actually difficult. I never, I have had them for almost a year and have not done anything with them so I am really liking this plane tracking idea. With all the idiots with small planes in the area, the ones that don't do a flyover before landing their little Cessna or Pipers on water, snow, or a fairly flat field it might get some interesting results. We have those sorts of people crashing all the time. They land parallel to the waves. The hit ridges or small spaces of open water on the ice. Or, often enough they are landing effectively on someone's lawn and they very much misjudge the distance, So it might be interesting.

      --
      "So long and thanks for all the fish."
    8. Re:Misleading summary by Anonymous Coward · · Score: 0

      Source: I worked on an ADS-B product at Garmin.

      If you don't mind me asking, which one or series?

    9. Re: Misleading summary by oobayly · · Score: 1

      To be fair I've always fancied building a cluster, but similarly have had no tasks to solve. However I wouldn't care if it took longer than my current machine because it would be learning about how to do cluster computing. I suppose I could open an old CFD textbook and cone up with a simulation and optimise it for clustered computing.

    10. Re:Misleading summary by 0123456 · · Score: 1

      It's just the free antenna that came with the USB receiver. A proper, tuned antenna should do much better, if you want to spend the time making one.

    11. Re:Misleading summary by KGIII · · Score: 1

      And it would make a good excuse to rescue the tower. He could make more selling it for scrap than he'd make selling it to me. I don't know where you live but it is just 100 USD.

      --
      "So long and thanks for all the fish."
  3. Too bad they're not more open... by Anonymous Coward · · Score: 1, Insightful

    It's a shame that services like FR24 are not more open. A lot of people are contributing to the service for free - though some may get a free subscription in exchange - but then what happens to that data?

    First, it gets massaged. Sensitive flights, flights operated by people who don't want to appear on FR24, etc.get removed. Alright, I can see how that makes sense - if for no other reason than that if they didn't, they'd probably be shut down pretty quickly.

    Second, you don't get access to the data. You only get access to exactly what they want to present - be that with ads around, under a subscription payment, or via apps, etc.

    As an example, another app that gave superior AR results (point smartphone at sky, identify what plane is leaving what control) was shut down because FR24 didn't much appreciate them using the data off of the site - leaving users instead with the inferior FR24 AR.

    However, the same applies to any other item. Would you like an alert whenever there's a rare plane passing over? Sorry - you can't do that. It would be easy to code, but you don't get access to the data.
    Do you want to accumulate flight paths for an image of how flights appear around an airport? Easy to code, but no access to data.
    See a flight that has no apparent destination, but you just know that if you look for similar flights along similar flight paths in the past, you could probably get a good idea of where it ought to be going - well unfortunately you can't do anything with that knowledge, because you get no access to data.

    In more recent times, FR24's website has become less and less usable as things get tabletized - which you could fix by building a new site, but, of course, no access to data.

    "Don't they have an API?"
    No, they don't. The only API on their site is the string "API" in certain plane registrations.

    Sure, you can access some of the data that's public by necessity of app limitations, but at the very top of the JSON output you'll find a message about how it's copyright and only for use by FR24 and if you use it for yourself they'll happily sue your ass, etc.

    Of course, you could set up a rival website, but then you still need people feeding you the data - and it seems most of them are more than content with only feeding to FR24.

    For something that is almost entirely dependent on semi-voluntarily provided information by the public, it's a shame that they cannot give back more to the public other than a premium subscription, and instead tries to monetize the data as much as they can; even their paid app ($3.50?) has in-app purchases for things like "Realistic aircraft symbols" - the same symbols that were available for free before... in the free app.

    tl;dr: While sites like FR24 have popularized crowdsourcing of flight data, they have simultaneously crippled the potential of that data.

    1. Re:Too bad they're not more open... by Anonymous Coward · · Score: 0

      You can use apps to look at your own data easily.
      VirtualRadarServer for instance, and that's just one light weight one.

    2. Re:Too bad they're not more open... by Shinobi · · Score: 1

      Let me guess, you're one of the cunts who made one of those advertising funded apps that only pulled data from FR24's servers, leaving them with the bill for all the server and bandwidth use, while you yourself earned a decent sum every month?

      That's a very real problem FR24 had with all these entitled freeloaders(as did MarineTraffic's AIS data site)

    3. Re: Too bad they're not more open... by Anonymous Coward · · Score: 1

      Well they seem to have chosen the worst of all options: close the service to the point of no use. That kind of makes them cunts of their own right. Instead they could monetize on the obvious demand for the data by selling API access, priced by bandwith etc. Hell, they might even make enough money to pay out to those volunteers who make their site work in the first place. Takes one lot of tight assed dumbf****s not to do this. Talking of freeloading cunts, gee.

    4. Re:Too bad they're not more open... by Anonymous Coward · · Score: 0

      Hi, Anon here, the answer is: no

      I was just an end-user. Who purchased the app. That for a while became incompatible with my device. Then became bloated because of HD graphics only actually available to people who paid an additional sum. Then got crippled.
      Did I use an alternative app that used FR24's data against the ToS? You bet I did - it was better.
      I don't complain that they eventually got blocked and were forced off of the Play (not even named Play back then) store, though.
      I fully understand that FR24 incurs costs that need to be covered somehow.

      My issue is truly that:
      1. They have crippled their product trying to milk money from it, and not offering anything to anybody to escape that crippling. No, that needn't be free - there's plenty of companies that would pay for that sort of data - and I would be happy to as well. I'd also happily accept if that access comes with limitations like no re-serving the data via websites or apps, allowing use only for massaged output. That would still be 1/0 times more useful than what there is now.

      2. This is being done by standing on the shoulders of the feeders who provide the information either freely, or in exchange of a subscription that is still very, very limited.

    5. Re:Too bad they're not more open... by dbaker · · Score: 1

      FlightAware's PiAware software and FlightAware's FlightFeeder hardware both allow access to unfiltered access over TCP ports 10001, 30002, and 30003 as well as a live web interface on port 8080.

      FlightAware, for years, has offered APIs and data feeds: https://flightaware.com/commer...

  4. Works great when you want to be seen by steve-san · · Score: 3, Insightful

    "ADS-B is slowly superseding the ground-based radar systems that have been used for decades"
    ... until the aircraft decides to become "uncooperative" and turns the darn thing off -- at which point, this (and any beacon/transponder-based system) becomes instantly useless.
    Which is why you'll see ADS-B augment, but never completely replace old fashioned search radar anytime soon.

    --
    What you want is irrelevant; what you've chosen is at hand! - Spock, ST VI
    1. Re:Works great when you want to be seen by raxx7 · · Score: 1

      Primary radar (what you call search radar) is not very used for air traffic control.
      Primary radar stations are very expensive to build and to operate; their range and accuracy is rather limited too. That is because primary radar stations need to transmit very powerful pulses and listen back for the very faint echoes generated by the aircraft, while discerning them from all the other sources of noise and clutter.
      In general, only the military operate primary radar stations and coverage is rather limited. Eg, a large country like the USA will not have much coverage of primary radar deep inside it's borders. For poorer countries, even at the borders you may have nothing.
      Some countries (eg, USA, Russia, Australia) have long wave radar stations which can detect the launch of a missile or a bomber squadron half world away, but those provide very very rough information.

      The current primary tool for air traffic control, being superseded by ADS-B, is secondary radar.
      In this type, the radar stations emit pulses which are detected by the transponders of (cooperative) aircraft. The transponders then transmit (sqwak) a reply to the radar pulse, which is detected by the radar station.
      This requires much less power to be transmitted by the radar station and the transponder reply is a much stronger signal than an echo. The transponder signal can also include information such as aircraft ID, altitude and etc.

    2. Re:Works great when you want to be seen by Anonymous Coward · · Score: 0

      You forgot to put why the transponder can reply with more information. Its because they use lisp and a recursive tail call to return the tail of the list. This can only be done in lisp not C or python mind you. ponk.

    3. Re:Works great when you want to be seen by steve-san · · Score: 1
      Thank you for reinforcing most of my comment, except for one little thing:

      Eg, a large country like the USA will not have much coverage of primary radar deep inside it's borders.

      Fortunately for the USA, you are wrong:
      http://en.wikipedia.org/wiki/J...
      Consider it a lesson learned from 9/11.

      --
      What you want is irrelevant; what you've chosen is at hand! - Spock, ST VI
    4. Re: Works great when you want to be seen by Anonymous Coward · · Score: 0

      Since you clearly don't know how air traffic control works here in the USA, I'll just point out that since almost none of our passenger aircraft has active radar, they rely on someone telling them where the traffic is so they can avoid it. When in the air, it is to your advantage to let EVERYONE know where you are so you don't have an accident. Kind of like driving on oublic roads, it's generally accepted that at night you'll have you lights on, for your own vision and so that others can see you.

  5. Re:Please repair your broken tail light by KGIII · · Score: 1

    You might be able to outrun the cop but you can not outrun his radio.

    --
    "So long and thanks for all the fish."
  6. Re:Global ADS-B and AIS spy networks by Anonymous Coward · · Score: 0

    You're a retard. Really. Besides this is already being done on our roadways, with license plate readers...

  7. Re:Global ADS-B and AIS spy networks by WaffleMonster · · Score: 0

    You're a retard. Really.

    Truly, certainly, actually indeed.

    Besides this is already being done on our roadways, with license plate readers...

    Using the fact that something has been done to justify doing it is genius.

  8. Malaysia airlines by Anonymous Coward · · Score: 0

    from what I understand about Malaysia Airlines flight 370 is that the transponder stopped transmitting its position and heading to air traffic control before the plane entered Vietnamese airspace.

  9. That's really great, but... by hcs_$reboot · · Score: 1

    But the problem is the user application, at least for flightradar24. Have the paid version on iOS and it shows sometimes inconsistent data, or clearly not updated areas (while WIFI is ON and fast). If there is one tangible argument to show that the app is not well written: when the app is updating the screen (takes about .5~1 second for a busy area) the user cannot move (drag) the map (user should have priority as (s)he doesn't care about the display since it's gonna change in 2 seconds after moving!).

    --
    Slashdot, fix the reply notifications... You won't get away with it...
  10. Re: This should be tightly regulated by Anonymous Coward · · Score: 0

    Absolutely. What are amateurs and meddlers doing with this information? Why they should have access to it? Is it even legal? Because it shouldn't be.

  11. Re:Global ADS-B and AIS spy networks by Anonymous Coward · · Score: 0

    Dude, what is wrong with you?

    No, seriously. There is really something very wrong with you. It sounds like a mental illness. You NEED to get it looked at by medical professionals.

  12. Radars remain essential in Europe by Frans+Faase · · Score: 1

    Here in Europe radars remain essential because of Russian planes (both fighters and nuclear bombers) are flying around with their ADS-B switched of, just to test how quick European forces respond to possible treats. These planes fly in international air space, but often at close range of commercial flights. European countries are quite angry about this behavior, but the Russians think that they do nothing wrong. Just waiting for the first mid-air collision to happen. About a decade ago, the Russians started with these flights again, which they did during the Cold War. Especially, the last year they are become bolder and bolder, trying to enter national air space over and over again, and flying at supersonic speeds.

    1. Re:Radars remain essential in Europe by tlhIngan · · Score: 1

      Here in Europe radars remain essential because of Russian planes (both fighters and nuclear bombers) are flying around with their ADS-B switched of, just to test how quick European forces respond to possible treats./blockquote.

      ADS-B isn't mandatory on planes yet. There are plenty of aircraft in North America that are NOT ADS-B equipped, notably General Aviation ones where ADS-B Out devices still remain in the $5000+ category of avionics cost. Even in Canada, when Transport Canada mandated use of 405 ELTs there was great pushback because the approved ELTs still costed $5000 at implementation. The price has dropped a little bit - you can get 'em for around $3000 or so. But it also requires about $2-4000 worth of work to hook it up (especially if it doesn't have a built-in GPS and has to be wired to the onboard GPS). It's hard enough that it the mandate was pushed back.

      To have ADS-B Out, you need either a Mode-S transponder with ES (Extended squitter), or a dedicated ADS-B Out transmitter. Mode S is common on commercial jetliners, so the ES part pretty much comes "for free". General Aviation aircraft typically have Mode C transponders and need to be fitted with the requisite gear.

      So no, primary and secondary radar aren't going away anytime soon. The FAA is encouraging ADS-B adoption by providing free weather and traffic information for those who provide ADS-B Out - the ground stations receive a plane's ADS-B information, then consult the databases and return it traffic and weather (centered around the plane). If you only have ADS-B In, you can sometimes piggy back on that data. (Inflight weather is generally a cost option - either through satellite networks, or through SiriusXM WX service, you're still looking at over $1000/year for the service).

  13. Re: This should be tightly regulated by Anonymous Coward · · Score: 0

    Classic Peg!

  14. Cruising Sailors by anorlunda · · Score: 4, Interesting

    I am a blue water sailor. I, and many others like me, would be happy to carry an ADS-B reciever onboard. That is, provided that it draws very little power, and that it gathers data unattended without my active intervention. Statistically, I think cruising sailors would cover a large fraction of the ocean areas of the globe. I believe the probability of a sailing vessel being within 200 miles of MH370s final flight path would be almost 100%.

    The caveat being that I can not transmit the data to the Internet until the next time I reach shore and I can find someone who will let me plug in a USB device. That could mean a delay of months up to a year.

    Would non-real time information be valuable? Thinking of the MH370 case, the answer must be yes. Not matter what the delay, the information is still valuable to someone. We could also record AIS signals that many vessels already transmit. I receive AIS from up to 40 miles away.

    The idea could be etended to (symbolic) notes-in-a-bottle. A million floating ADS-B recorders would eventually reach shore, and some of them may have their data extracted and transmitted, then thrown back into the sea. Would that be worthwhile? Hard to say.

    1. Re:Cruising Sailors by Anonymous Coward · · Score: 0

      Why invent a new more complex, clearly less reliable system than what already exists? Realtime data from aircraft via satellites is possible and has been possible for many years already. Some airlines...hrm Malaysia hrm, hrm... just don't want to pay for it. Why should other people volunteer their resources instead of mandating all airlines to do it? Economies of scale would probably bring the cost down and compared with your proposal, I'm sure satellite based tracking is cheaper. I mean, the cost of receivers which can withstand salt water, UV radiation, have long-lasting batteries etc. is high and the cost of the system becomes even higher when the intended recipient must pay a high reward for them in order not to have fishermen and others from poor countries collect them just for the batteries and electronics... And that in turn would make collecting them even more rewarding and increase the need to drop more of them in the ocean... I mean, in some countries theft of cables is still a real problem for phone companies. Seriously, the more I think about your idea the dumber it seems. Are you sure you're not an idiot and not a sailor?

    2. Re:Cruising Sailors by 0123456 · · Score: 1

      MH370 was perfectly capable of sending ADS messages by satellite... but didn't. That system was either disabled, or turned off.

    3. Re:Cruising Sailors by Anonymous Coward · · Score: 0

      I don't really see what the point is. The Whole ADS-B system will be abandoned when terrorists start using it for guidance data for their 3D printed missiles in the fall of 2018. Uhhh, I mean I am not a time traveler with specific knowledge of future events. Move along linears nothing to see here.

  15. The SKYWARN network is also largely volunteer driv by cleara · · Score: 1

    The SKYWARN network that is involved with tracking storms, I was told, is also largelyl volunteer driven. It uses a network of amateur radio operators as storm spotters.

    --
    Most Respectfully Yours Mrs. Cleara Plastique
  16. Misleading by Anonymous Coward · · Score: 0

    This seems a little misleading to me. ADS-B isn't required until 2020, and then only in those areas where radar transponders are required. You'd think this would allow flight without the radar treansponders, but alas, it seems they are still required.

    No one, including the FAA, seems to know what they are actually doing.

  17. How to get my hands on live ADS-B data? by jlar · · Score: 1

    I would really like to get my hands on a live ADS-B feed like FlightAware and FlightRadar24 apparently have. Does anyone know what I would need to do to do that? Global data would be ideal but European or Arctic coverage would also be very interesting. But others might be interested in other areas.

    1. Re:How to get my hands on live ADS-B data? by dbaker · · Score: 1

      FlightAware makes it available in data feeds and APIs: https://flightaware.com/commer...

  18. Ignore me... by Anonymous Coward · · Score: 0

    Posting to undo incorrect moderation (thank you, trigger-happy touchpad). Hopefully this still works as AC...

  19. Idiots by Anonymous Coward · · Score: 0

    how can they not know where Malaysia Airlines flight MH370 went down?

    Because fucking big empty ocean, that's why. Cretins.

  20. Re:Global ADS-B and AIS spy networks by WaffleMonster · · Score: 1

    Dude, what is wrong with you?

    No, seriously. There is really something very wrong with you. It sounds like a mental illness. You NEED to get it looked at by medical professionals.

    What is wrong with the people who take information for purposes other than original intent without asking and proceeding to leverage it for commercial gain?

    Did these companies ask the Pilots for permission first?