Slashdot Mirror
This Week 'IT Issues' Ground Delta Airlines' Flights (cnbc.com)
Delta Air Lines has been forced to cancel at least 150 flights, and expects to cancel even more. But "the IT department is working to rectify the situation as soon as possible," they tweeted Sunday -- more than four hours ago. Long-time Slashdot reader SonicSpike quotes CNBC:
Delta Air Lines U.S. domestic flights were grounded on Sunday evening due to automation issues, according to an advisory from the Federal Aviation Administration... "Delta teams are expeditiously working to fix a systems outage that has resulted in departure delays for flights on the ground," the airline said in the statement. "Flights in the air remain unaffected". [And their international flights were unaffected.]
Delta also grounded 2,000 flights last summer after a computer outage caused by a power outage in Atlanta. At the time Reuters reported that "Airlines will likely suffer more disruptions... because major carriers have not invested enough to overhaul reservations systems based on technology dating to the 1960s." And sure enough, just last week, another "IT issue" forced United Airlines to ground all their domestic flights.
Delta also grounded 2,000 flights last summer after a computer outage caused by a power outage in Atlanta. At the time Reuters reported that "Airlines will likely suffer more disruptions... because major carriers have not invested enough to overhaul reservations systems based on technology dating to the 1960s." And sure enough, just last week, another "IT issue" forced United Airlines to ground all their domestic flights.
How long can the airlines go on like this? Somewhere in office buildings around the country, there are MBAs and accountants working for various airlines who have compared the cost of in-house IT with the cost of outsourcing, and they all once decided that outsourcing was best. Somehow, I doubt they've included in their calculations the true frequency (and therefore cost) of IT failures that ground the entire airline for days. As these events stack up, these guys are going to have to re-evaluate their models for predicting the frequency and severity of failures, and at some point it's going to look like a good idea to have a real IT staff on-hand to keep systems working in the first place, and to deal with it when shit hits the fan.
I work for Delta, and this is weather related so no one should get vouchers.
This is simply a case of technical debt being piled on top technical debt. Don't blame anyone but management. Marketing screaming for more features and MBAs running a business that is a large technical enterprise. 50 years of added crap on top of crap and this is what you get, IT issues, outages, "power failures", automation issues. Each one causing tens of millions is losses. What the airline industry needs is a large IT colonic and then some good design to move forward.
You are not going to be able to fix this problem with the same thinking that got you into it.
Somewhere, there's a computer that's "Preparing to configure Windows" after it rebooted in the middle of a flight scheduling run.
Or stuck at a BIOS prompt saying "No keyboard found, press F1 to continue."
- The Sigless Wonder
Wow, if they are so economical (cheap) they use reservation tech from that era, maybe they'd consider hiring contractors from India to give the system an overhaul. Of course the contracting firm will probably just hand it over to a bunch of juniors who will then use techniques/tech/flaws from the 1990's, but that's still an improvement, right?
"Imagination is more important than knowledge" - Einstein
As a developer, I can't imagine even bothering to answer an offer of employment from an airline these days. I spent considerable time looking for better options last year before deciding to take an offer and leave my employer of 20 years (HPE), and there were several potential employers I did avoid; work for any airline would have been a huge red flag for me. The way they've cut corners over the last few decades would definitely not make it a good place for career advancement.
I suspect the quality of their hires in IT would be limited by their reputation as employers and probably tend toward the desperate only looking to fill immediate financial needs on a temporary basis. I can't say this would lead to the most inspired work effort.
Nah, not ransom ware. Delta recently outsourced it's infra to Microsoft and 3rd party contractors. We weren't even able to log into email on the intranet during all this. Security certs out of date, and everything is now on *ugh* SharePoint. Intranet used to be fast, albeit it was organized horribly. They they announced the "new" deltanet which was all SharePoint. Now it's 4 times slower, but hey, it'll look good on a tablet and has slick animations while you're dying of old age waiting for the pages to load.
I can tell you are an insider, and so am I. WHAT WERE THEY THINKING!!!! Now when I login to DLnet no matter the browser its a crap shoot whether or not I will login. I always get security issues left and right. The new website is pretty but what good is it if when I need to list for a flight I have to wait an unknown amount of time before I can actually get in. A horrible decision on their part and I hope they're moving away from microsoft garbage.
A large solar flare will take out all the transformers, so you probably won't be running much of anything, electronic or otherwise.
I do not want your cheap brainburning drugs. They are useless for work. And I am a working man today.
We may never know what happened - but airlines are coming off their holiday change freezes so I'll bet one of their releases went bad. I don't work for Delta, but I do work in the industry, including some stints at airlines. The central problem is that airlines are incredibly low-margin businesses. Yes, they charge for everything and flying is expensive, but for every last minute $1000 ticket are hundreds of people demanding the same flight for $129 and getting it, even though they barely break even on those customers. Airlines' biggest costs are fuel, labor and planes. When it comes to IT, it's just massive amounts of technical debt built on a very old core set of systems. All that customer facing tech is really driving some ancient stuff several layers deep, collecting the information and presenting it in a nice format like your phone screen. All of these abstractions, wrappers on wrappers and middleware have to work perfectly and it's a rickety tower sometimes. Also, airlines are run by MBAs who don't consider their IT a "core competency", so it either gets minimal funding or dumped off on a contractor. Often, the contractors develop stuff like the phone app or one of a billion middleware components and there are always integration issues...but the people in charge love the ability to pay someone $x to implement "that phone thing" or "the ability to do X without talking to an agent."
With all the negatives, it's a very challenging and fun environment to work in for the right kind of person. I've been doing it for 20+ years and on balance I really like it. Resourceful types do very well in airline IT, as do IT geeks who understand and care about the business they're supporting. It's extremely frustrating at times as well, and there's way more firefighting than there should be. Typical businesses will just throw money at a problem until it goes away or they run out, which is why there are so many software tool vendors and expensive hardware systems out there. Go to an airline and tell them to spend 5 million bucks, and you can forget it unless it's required for compliance, safety related or guaranteed to return an immediate increase in revenue. Unfortunately this is where the technical debt comes from because there's never enough people, and all those people are running around putting out fires all the time. If I were working for Delta right now, I guarantee I wouldn't have been sleeping for the last 24 hours as everyone tried to figure out what had gone wrong.