Slashdot Mirror


Outage Knocks Out All Major Phone Providers On the East Coast (dailydot.com)

Every major phone carrier experience outages on United States' east coast this morning at around 11am local time. The outage lasted for about 45 minutes. DownDetector, which monitors outages of services, confirmed AT&T, Verizon, Charter Spectrum, Comcast, Sprint, Time Warner Cable, US Cellular, and Vonage among others were affected. From a DailyDot report: T-Mobile CEO John Legere tweeted about the incident, pointing to issues with Level 3, a major internet backbone. Other tech firms quickly pointed to a Level 3 outage as well. No specific information has been released on potential causes of the outage or consequences that may result from it. Business VoIP providers (Resource: https://www.voip-info.org/wiki/view/VOIP+Service+Providers+Business) were unaffected as they run over internet connections.

64 of 121 comments (clear)

  1. they should really plan for this by Anonymous Coward · · Score: 3, Funny

    The really should think of some sort of system of interconnected networks that is so redundant and widespread that even a nuclear war couldn't take out!

    1. Re:they should really plan for this by xxxJonBoyxxx · · Score: 5, Funny

      >> think of some sort of system of interconnected networks

      Talk to Al Gore. I heard he has an idea.

    2. Re:they should really plan for this by Mostly+a+lurker · · Score: 1

      Quite so. I understand DARPA long ago funded an effort to design such a network. It is a pity that it was, apparently, never actually deployed.

    3. Re: they should really plan for this by seven+of+five · · Score: 1

      In this case, the Internet was the problem. Level 3.

    4. Re:they should really plan for this by Hylandr · · Score: 2

      You have been watching too much Mr. Robot.

      --
      ~ People that think they are better than anyone else for any reason are the cause of all the strife in the world.
  2. I didn't notice any outage. by Oswald+McWeany · · Score: 2

    I'm on the East Coast and didn't notice any outage. Are we sure it was the entire East coast?

    --
    "That's the way to do it" - Punch
    1. Re:I didn't notice any outage. by markana · · Score: 1

      Initial reports on the outage list calls from wired and wireless to local and toll-free numbers (and other carriers), while long-distance (is that a thing anymore??) was unaffected. Don't know if this impacted pure data connections yet - it seems not.

      Probably a rogue backhoe...

    2. Re:I didn't notice any outage. by Anonymous Coward · · Score: 1

      I had two people send me e-mails saying that they could not reach me because my cell phone was "out of service". I am in Daytona Beach, FL.

    3. Re:I didn't notice any outage. by NatasRevol · · Score: 1

      How often do you use your phone to actually call someone?

      --
      There are two types of people in the world: Those who crave closure
    4. Re:I didn't notice any outage. by Oswald+McWeany · · Score: 2

      People still do that?

      --
      "That's the way to do it" - Punch
    5. Re:I didn't notice any outage. by LynnwoodRooster · · Score: 4, Funny

      Sure! There's an app for that!

      --
      Browsing at +1 - no ACs, I ignore their posts. So refreshing!
    6. Re:I didn't notice any outage. by ehaggis · · Score: 1

      East coast of what? That may make a difference.

      --
      One ring to bind them - should probably have more fiber and less rings in their diet.
    7. Re:I didn't notice any outage. by unixisc · · Score: 2

      Same here. Didn't notice a thing

    8. Re:I didn't notice any outage. by dgatwood · · Score: 1

      I noticed. It explains why I didn't get my usual daily wakeup call from that a**hole scammer robocalling me and pretending to be the IRS....

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    9. Re: I didn't notice any outage. by jisom · · Score: 2

      One rogue backhoe shouldn't affect a coast.

      Just saying.

    10. Re:I didn't notice any outage. by fahrbot-bot · · Score: 1

      rogue backhoe

      The next Star Wars sequel.

      --
      It must have been something you assimilated. . . .
    11. Re:I didn't notice any outage. by apoc.famine · · Score: 1

      That amazes me. Why do you still suffer that? I haven't had a land-line in almost a decade, and I can't fathom ever having one again. Well, I guess I can fathom it if I was motivated to build a call-screening system with ring-only-on-whitelist, but since I can't fathom having that motivation.....

      --
      Velociraptor = Distiraptor / Timeraptor
    12. Re:I didn't notice any outage. by Grishnakh · · Score: 2

      I get those IRS scammer calls too. I only have a cellphone. Scammers don't care what kind of phone you have; it's not like they're worried about following the law when they're impersonating a Federal agency.

    13. Re:I didn't notice any outage. by Grishnakh · · Score: 1

      That's right! I use two different VoIP apps currently for calls.

    14. Re:I didn't notice any outage. by mrbester · · Score: 1

      A communications blackout can only mean one thing: invasion

      --
      "Wait. Something's happening. It's opening up! My God, it's full of apricots!"
    15. Re:I didn't notice any outage. by seabrook · · Score: 1

      Yes it was out for what seemed like an hour. My cell phone showed no bars for Verizon. Fortunately I still have a land line.

    16. Re:I didn't notice any outage. by gzuckier · · Score: 1

      That amazes me. Why do you still suffer that? I haven't had a land-line in almost a decade, and I can't fathom ever having one again. Well, I guess I can fathom it if I was motivated to build a call-screening system with ring-only-on-whitelist, but since I can't fathom having that motivation.....

      cause when hurricane matthew hits, i'll still be able to call my mom and tell her verizon and comcast are both dead, but i'm not.

      --
      Star Trek transporters are just 3d printers.
  3. Must be big by um...+Lucas · · Score: 1

    Looks like I'm getting 2nd post... Must have knocked a lot of slash dotters off line!

  4. Can you hear me now? by bobbied · · Score: 1

    No? Well carry on..

    This is when Ham Radio shines... 73's to my fellow 0.2%

    --
    "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    1. Re: Can you hear me now? by ThePhish · · Score: 1

      73!

    2. Re:Can you hear me now? by FrankHaynes · · Score: 1

      Yes, I can the see the lines queuing up to pass traffic via ham radio. Business calls, tech support requests, assignations with the mistress, etc.

      Oh, wait, it's just gas station lines. nvm.

      --
      slashdot: A failed experiment.
    3. Re:Can you hear me now? by bobbied · · Score: 1

      Getting emergency services when you cannot call 911?

      Yep, Ham Radio does that.... The rest of your list, is not going to be legal third party traffic, except for the messages of a personal nature. You want to meet her where exactly?

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    4. Re:Can you hear me now? by Guyle · · Score: 2

      This is why I maintain my license, mobile gear and some semblance of emergency power. I'm hardly ever on the air these days (was way more active when I had a long commute and used to travel a lot) but if the proverbial shit hits the fan I'll be able to do something.

    5. Re:Can you hear me now? by Jawnn · · Score: 2

      I just have to laugh some times when I see my fellow hamateurs spout off about how much ham radio helps. When your little Baofeng 1/2 Watt portable can't hit the repeater because it has no electrical power then there won't be much you can do.

      First of all, lots of repeaters are provisioned with backup power. Not all of them, but enough to serve in a pinch. Next, not all of us have only a 500 mw HT at our disposal. A 4-5 watt 2-meter transceiver, with the right antenna, can reach a very long way. We're making note of you and will make sure that you go to the back of the line when your iPhone has been off-line for 10 days or so.

    6. Re:Can you hear me now? by R4D4R · · Score: 1

      Don't forget that HF is also an option, not requiring repeaters at all for long distance communication.

    7. Re:Can you hear me now? by bobbied · · Score: 4, Informative

      I just have to laugh some times when I see my fellow hamateurs spout off about how much ham radio helps. When your little Baofeng 1/2 Watt portable can't hit the repeater because it has no electrical power then there won't be much you can do.

      I know of at least two repeaters which have battery backup (one which I help maintain) and I'm sure there are plenty more within the range of my Baofeng with spare batteries and the large mobile antenna I can hook up to. Then there is the mobile rig in the car, that's good for as long as I have gasoline to keep the battery charged. The repeater I help to maintain has an on site contingency plan to provide power from a portable generator should the need arise from an extended power outage so it could be on the air for days. SOME of us have plans for such things...

      Heck, some of us even practice these plans doing that yearly contest called "Field Day" perhaps you've heard of it?

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    8. Re:Can you hear me now? by bobbied · · Score: 1

      Burp...

      Water, Shelter, Food and protection come before communication... Got that message a LONG time ago... Yet I still have my ham ticket and radios so what do you suppose the status of the rest of that stuff is? That ain't camping gear in my garage, nor is that 12ga in the closet for hunting rabbits... I hate camping AND hunting actually...

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    9. Re:Can you hear me now? by bobbied · · Score: 1

      The FCC, should it take notice, will put a stop to an unlicensed operator. However, if you don't tick off the local hams, the chances of getting the notice of the FCC is slim.. Well, it was UNTIL you posted here. Radio pirates are generally not well received by the FCC.....

      Let me warn you, when the FCC comes calling, they can fine you upwards to $5,000 per instance per day of illegal operation. This can really add up. So if this little story is really true, don't mistake the lack of action thus far with the idea the FCC doesn't care. The enforcement branch is a bit undermanned these days, but they still exist and are active.

      --
      "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
    10. Re:Can you hear me now? by gzuckier · · Score: 1

      Yes, I can the see the lines queuing up to pass traffic via ham radio. Business calls, tech support requests, assignations with the mistress, etc.

      Oh, wait, it's just gas station lines. nvm.

      "I'm sorry young lady, but there's no way for me to broadcast a picture of what you're eating right now' "Can you broadcast a description, then?"

      --
      Star Trek transporters are just 3d printers.
    11. Re:Can you hear me now? by gzuckier · · Score: 1

      The FCC, should it take notice, will put a stop to an unlicensed operator. However, if you don't tick off the local hams, the chances of getting the notice of the FCC is slim.. Well, it was UNTIL you posted here. Radio pirates are generally not well received by the FCC.....

      Let me warn you, when the FCC comes calling, they can fine you upwards to $5,000 per instance per day of illegal operation. This can really add up. So if this little story is really true, don't mistake the lack of action thus far with the idea the FCC doesn't care. The enforcement branch is a bit undermanned these days, but they still exist and are active.

      i still have the license we were originally required to have, to operate a CB radio in a vehicle.....

      --
      Star Trek transporters are just 3d printers.
  5. It hit us, in MD by FirstNoel · · Score: 1

    any external calls weren't coming in. sound like they're starting to get it moving again.

    --
    "Hmm. I am to metaphor cheese as metaphor cheese is to transitive verb crackers!"
  6. Ham Radio by gnu-sucks · · Score: 1

    Meh, (analog) ham radio is still working fine...

  7. Just a test... by Anonymous Coward · · Score: 1

    brought to you by your favorite 3-letter govt agency.

  8. Bad SS7 code by FrankHaynes · · Score: 1

    At least it wasn't a missing semicolon at the end of a line of source code in the SS7 Signal Transfer Point. That was all it took about 25 years ago.

    --
    slashdot: A failed experiment.
  9. systemd by Anonymous Coward · · Score: 1

    testing systemd in the wild?

  10. W9ABC this is K6XYZ by argee · · Score: 5, Funny

    W9ABC this is K6XYZ, over ....
    (no answer)
    W9ABC this is K6XYZ, over
    no answer
    Dial up on cell.
    "Hey, Harry, turn on your damned radio!"
    "OK"
    W9ABC, this is K6XYZ, over
    K6XYZ this is W6ABC, I hear you 5 by 5 now!

    Lesson: This is a fine example of communications redundancy ... errrr ...

  11. Re:all major providers.. by bobbied · · Score: 2

    Once you get to an L3 switch, it doesn't matter if it's a POTS line or not, it's just a phone call.. Heck, when you hop off the MSC on a cell, it's just a phone call... The only possible advantage a POTS line might have in this situation is you don't have all the HLR/VLR signaling when you are roaming outside of your home MSC, so you might actually get a dial tone and be able to make local to the exchange calls...

    --
    "File to fit, pound to insert, paint to match" - Aircraft Maintenance 101
  12. Closer to true than you might think by dcooper_db9 · · Score: 4, Insightful

    What Al Gore actually said was "I took the initiative in creating the internet". In context his statement is true. No, he did not invent the internet. But he was the first politician to recognize that interconnecting computers could have benefits far beyond improvements in science. He realized that the network should opened up to everyone. As far back as the 1970's Gore was involved in legislation involving technology and he worked tirelessly to educate other politicians about technology. He wrote bills that funded research in robotics, magnetic leviation, biotech, image recognition, speech recognition just to name a few. He wrote the bill that funded Mosaic and also wrote the bill that essentially privatized the Internet.

    If you want to know more about how Gore "invented the internet" take the initiative and find a book. It's a fascinating story.

    --
    I do not block ads. I do block third party scripts.
    1. Re:Closer to true than you might think by Anonymous Coward · · Score: 1

      So in other words, Al Gore funded the internet.

      With other people's money.

    2. Re:Closer to true than you might think by Anonymous Coward · · Score: 2, Insightful

      So in other words, Al Gore funded the internet.

      That isn't in "other words", that is precisely what he claimed to have done.

      And it is still true. Before Gore passed legislation to allow private telecoms in the mix, the name Internet wasn't used until after his funding to publicize the Arpanet.

      On the Arpanet, an ISP wasn't something you could call up and get connected with as a normal pleb.
      You could only get access from a university and then only as a student there in some class that needed it, although access wasn't always revoked after said class, but generally was upon graduation depending on the university.

      Inventing the Internet doesn't mean he also invented each (or any) piece of underlying technology, no more than when Vint Cerf and Bob Kanh invented TCP doesn't mean they invented phone lines that TCP operated over.

    3. Re:Closer to true than you might think by Hylandr · · Score: 1

      You could only get access from a university and then only as a student there in some class that needed it,

      Or you knew someone with the right number to call. Some universities used department level login credentials that would get you all the Archie, Gopher, or WAIS you wanted.

      Finding things was a lot like exploring a new HDD you found in the closet with no *real* search functions. Finding neat and interesting stuff could be a real challenge sometimes.

      --
      ~ People that think they are better than anyone else for any reason are the cause of all the strife in the world.
    4. Re:Closer to true than you might think by FrankHaynes · · Score: 1

      I was on the Internet in 1986 and watched Al Gore invent it from within.

      --
      slashdot: A failed experiment.
    5. Re:Closer to true than you might think by stinerman · · Score: 1

      According to Futurama, he invented the environment.

    6. Re:Closer to true than you might think by Anonymous Coward · · Score: 1

      "...the name Internet wasn't used until after his funding to publicize the Arpanet."
      "On the Arpanet, an ISP wasn't something you could call up and get connected with as a normal pleb."
      Um, you won't win any bets with that... knowledge.

      "The Internet", capitalized, existed at least since the late seventies; the Arpanet was _one_ of the networks within it. CompuServe was another network that normal plebs could actually dial into, and connect up. (Just Email initially; then UUCP.) Those overseas had their own networks. It is a common Myth that the US "invented" the Internet, (Especially within the US...); yes, the US Government did fund and promote _parts_ of the Internet, but they weren't the only country to do so, (The Nordic NORSAR is significant here.) Certain private companies such as Apple, (apple.com, 1986), Xerox PARC, and AT&T, were also influential, as well as some privately funded Universities. And then there is the entirely separate MILNET...

      The Maps here are fascinating:
      http://www.computerhistory.org/internethistory/1970s/
      http://www.computerhistory.org/internethistory/1980s/

      The "Gore Bill" of _1991_ was a significant move forward in bringing US Public attention to the Internet, and I think that Gore is a pretty cool guy for pushing it.
      But neither Gore, nor the US Government, invented either the Internet, or the name.
      (In 1979, with money provided by BBN/Telenet, I was part of a group hooking up our CDCs, MODCOMPs, DECs, etc. all together over regular Telephone lines, then into a dedicated T1 line to Stanford, and then on to Internet. I had a Silent 700 at home... because it was Cool.)

    7. Re:Closer to true than you might think by gzuckier · · Score: 1

      So in other words, Al Gore funded the internet.

      With other people's money.

      beats the hell out of funding an invasion of iraq with other people's money.

      --
      Star Trek transporters are just 3d printers.
    8. Re: Closer to true than you might think by gzuckier · · Score: 1

      I don't think that finding projects to spend money on is the purpose of government.

      " promotion of the general welfare of the citizens " that ring a bell at all?

      --
      Star Trek transporters are just 3d printers.
    9. Re:Closer to true than you might think by gzuckier · · Score: 1

      Ha! your kidding right. Al Gore is a politician that jumped on a bandwagon like politicians do and tried to claim a role in something he had nothing to do with.

      What is far more fascinating about Al Gore is his father Al Gore Sr. who was a well known member of the KKK down here. His son was raised around some of the most violent racists this country has ever known.

      Its also just one example of the fake "southern strategy" the democrats concocted to make people think the KKK left the Democratic Party. They all remained Democrats and most of the KKK offspring still are today.

      sure, that's why david duke is such a trump supporter.

      --
      Star Trek transporters are just 3d printers.
    10. Re:Closer to true than you might think by RockDoctor · · Score: 1

      So in other words, $POLITICIAN$ funded $PROJECT$.
      With other people's money.

      Errr, isn't that precisely what politicians in a representative system are meant to do?

      You personally may not like it - in which case you're free to leave. If anywhere else would accept you and people like you (not very likely).

      --
      Birds are not dinosaur descendants;birds are dinosaurs, for all useful meanings of "birds", "are" and "dinosaurs"
  13. One day after DDoS source code release. by nuckfuts · · Score: 2

    Hmmm. Major Internet outage reported the day after source code for enormous DDoS attacks is released.

  14. Issues All the way in CO by pdfsmail · · Score: 1

    We were impacted by this at my Denver, CO office... a long way from the east coast.
    At least I had something to blame the outage on this time :)

  15. I hope you're not completely unaware of the irony by presidenteloco · · Score: 3, Interesting

    of receiving emails from people telling you that they can't communicate with you.

    --

    Where are we going and why are we in a handbasket?
  16. Can you hear me now? by niftymitch · · Score: 4, Insightful

    OK networking is designed to be routable and redundant.
    Now if all traffic must pass through a fort that used to have no signs
    or a bit of Utah so hot and far from anyplace that only Octopussy could
    think of ...

    In all fairness for phones to go down because an Internet backbone failed
    tells me that all our phone company laws need revision at all levels.
    At one time a POT had obligations of reliability and redundancy that
    seem to have flipped to a binary work or is broken.

    I recall mothers day calls where you got all signals busy because of
    the surge. At least the management was not Uber imposing hidden
    surge pricing.

    This is an opportunity for good questions at the VP thing tonight.

    --
    Truth is stranger than fiction, but it is because Fiction is obliged to stick to possibilities; Truth isn't. Mark Twain.
  17. What he did was legalize Spam. by Ungrounded+Lightning · · Score: 5, Interesting

    So in other words, Al Gore funded the internet.

    As I understand it, what he did was sponsor legislation to open the Internet / ARPANet, to general use, including commercial use, removing the limitations on who could connect and what they could say. Prior to that the connections and traffic had to have some connection to education, the military, or dealings with them.

    So on one hand he helped give the general Internet a great boost, enabling it to become the public utility we know, love, and use.

    But on the other hand he effectively legalized Spam, because going from very limited business uses to any business use is OK took away the main tool for suppressing unsolicited commercial email and network newsgroup postings.

    --
    Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
  18. Isn't it great how blame can be forwarded... by ffkom · · Score: 2

    ... these days to some company else? Gone are the days when any kind of service was provided by just one company, who was then undoubtly responsible for however good or bad a service was. Today, there is an endless chain of suppliers, sub-contractors, infrastructure providers, whom to assign blame to, so ultimately no one feels responsible, everybody has an excuse, and whatever SLA exists, it's not worth the paper it's written on.

  19. Re:all major providers.. by AHuxley · · Score: 2

    The US POTS network was also a robust way to contact a lot of vital and important people.
    If a second shift or experts where needed on site due to an event, often a second POTS service would be installed and kept in good working condition.
    No need to worry about a new phone been "on" or "off", local power. Unless the phone line did not work, that phone was expected to ring under most conditions.
    In theory the back end to such a POTS into the wider network would have been well looked after and robust in most states.
    The change to optical, cell towers with battery only power lasting hours, a lack of gas or other looked after on site power to take over.
    Crews finding they have to totally rebuild, repair or replace network power during a longer loss of power rather than just to ensure backup power keeps working.
    The other issues is the network design. Lots of long shared "pipe" as the network, with no other ready networks to change to. One always working pipe is the network from telco, network to telco to user. Redundancy is now reduced to a crew an hour or further away in the "state" on standby to fix the one and only big connection.

    --
    Domestic spying is now "Benign Information Gathering"
  20. Re:all major providers.. by TheRealHocusLocus · · Score: 1

    Absolutely THIS, plus layoffs. I started a discussion about the end of POTS in 2013, some interesting stuff about cell vulnerability in there.

    And missed opportunity to hire experienced people beyond the confines of their profile. Frankly I'd rather be doing telecom than manual labor. I'd even settle for doing telecom for really low wages. But I'm 52 years and while I have a couple decades of network and telecom experience -- none of it is from the last 16 years (gasp!). The corporate HR people hide now behind SAS cloud architecture and don't deal directly with humans anymore. Their process and criteria is heavily jargon based and peppered with psych evals that favor young liars.

    One day I within five minutes I received ~70 'so sorry' rejection emails from a company, one for each position I had applied for going back two years. "Hey, your queue shouldn't look like that. Here, let me fix it."

    --
    <blink>down the rabbit hole</blink>
  21. Re:all major providers.. by AHuxley · · Score: 1

    Thanks very much for your link.
    I think the main idea was to remove all on site union staff and replace them with networks to report back an error to a gov mandated min count of engineers to cover any 'state".
    Crews of contractors could then be dispatched to repair as needed and could be hired or replaced as workloads changed over the years.
    Long term network care of all networks was now just fix on failure.
    The idea sounds great to upper management but the networks are not robust enough for the "engineers" to just change over to another ready network in real time while the crews works for hours or days. Savings go to generational shareholders, stock buyback or big bonuses unrelated to network performance.
    The other issue is the loss of battery power due to it never working or just running out a few hours later. The lack of gas and other longer term power per site then fails due lack of service, or falls apart needing another crew hours away to fix it.
    Wireless devices rather than fix wireline beyond an outside tree or an above ground break will be policy soon.
    No more truck rolls up the copper network for a fault unless its a medical device that depend on a wired phone connection.

    --
    Domestic spying is now "Benign Information Gathering"
  22. Single point-of-failure: found... by gweihir · · Score: 1

    Unless it becomes criminal to be so negligent, nothing will change.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  23. This was only a test.. by interstellarsurfer · · Score: 1

    The NSA is just live-testing to make sure they can turn the internet off and on again at will - in case Snowden has more to say, or Assange spills the beans!