Storm Causes AT&T Outage Across Midwest

dstates writes "AT&T left users across several Midwestern states without cellular phone service yesterday. The outage apparently resulted from a power failure at a Michigan switching center and spread to affect level3 Internet communications. The powerful windstorm also left 400,000 users without electricity. Interestingly, except for a few reports in Chicago and Indianapolis papers, AT&T has managed to keep this out of the mainstream media. Widespread communication failures also followed Hurricane Ike in Texas earlier this year. With the increasing trend for users to drop landlines and rely only on cell phones, this is becoming an emergency preparedness issue." Yes this included me. Still does. At least my office still has power — maybe we'll just camp here tonight. :)

Comments

Roaming?

[girlintraining]

The problem isn't the cell phone network per-se, but rather the inability of these providers to peer with each other. AT&T may have been down, but what about T-Mobile, the other GSM provider in the United States? When a major failure like this occurs that locks out only some cell phone users in a given area, the problem is not technology but politics.

Why, given how critical cell phones are during an emergency, this is allowed to continue is beyond me. Congress seems to care more about protecting corporate profits and reputation than providing a robust cellular network for its citizens. Hey, homeland security, are you listening? Fix this.

Re:Roaming?

[Lumpy]

AT&T/Comcast/AT&T burned a LOT of bridges when they became Cingular. I used to be able to roam almost anywhere, and if a roaming tower was the best strength I connected to that. After cingular got involved they pissed off a lot of other carriers. Now my phone refuses to talk to any nearby roaming towers but tries to connect to that single AT&T tower about 12 miles away that gives me barely any signal. I have to hack my phones to disable this configuration to get decent cellphone service out of them.

Re:Roaming?

[zappepcs]

They are trying to fix it, much the same way that Sarbanes-Oxley fixes accounting problems. Communications providers are required to keep an 8 hour power backup on all sites and 24+ backup on 'important' sites like switching centers or something along those lines. The idea is that storms like those that hit New Orleans would not cause the problems that they did. This storm is exactly the thing this measure by the FCC is supposed to fix... HAHAHAHAHAHAHAHAHAHAHA

Legislators (Goodbye FCC) do NOT know how to run businesses. Some perhaps, but on the whole they are terrible business advisers and this legislation only proves it in the aftermath of this storm. I hold a harsh opinion of this situation because AT&T should have had backups in place to handle this situation. All Communications providers deal with such things and AT&T has enough history to know what to do... shame on them.

Re:Roaming?

[yelvington]

We're staying with relatives on a farm south of Chicago. All the AT&T phones lost their ability to dial out, yet they could receive incoming calls. Our T-Mobile phones were fine.

You're right, this is a case of corporate power struggles trumping customer service, as any of these phones should automatically fail over to another GSM network. In an emergency, dialing out is essential.

Re:Roaming?

[zappepcs]

BTW, besides those rescuers you see on television after a storm, remember that there are ordinary heroes sitting in a truck babysitting a generator, or climbing poles, or renting a snowcat to get to the tower site so that your phone will work when you want it to. They are suffering the elements, usually alone, and bear the responsibilities of ensuring your comfort with little or no thanks. They are up all night watching the weather, planning and preparing to go babysit that tower(s) so your phone or pager will work. They work almost tirelessly for the simple comfort of knowing that when the shit hit the fan, the equipment they are responsible for did not fail. They are little appreciated on a normal day, and unseen during the emergency, but it is their dedication that you count on and not the system or the company.

Re:Roaming?

[Shakrai]

AT&T/Comcast/AT&T burned a LOT of bridges when they became Cingular. I used to be able to roam almost anywhere, and if a roaming tower was the best strength I connected to that. After cingular got involved they pissed off a lot of other carriers. Now my phone refuses to talk to any nearby roaming towers but tries to connect to that single AT&T tower about 12 miles away that gives me barely any signal

I don't think that really has to do with burning bridges. It has to do with AT&T not wanting to pay money for you to roam. It costs them money every single minute that you are using another carriers network.

I used to have a T-Mobile phone (had to ditch them for Verizon when I moved in with the GF -- no signal at her house) and they did the same thing. They would disable roaming on AT&T/Cingular in areas where they had coverage. Even if you were in a zone with no T-Mobile service you couldn't hop onto Cingular. To be able to roam on Cingular you had to drive out of the county where T-Mobile had native coverage -- then you'd be able to connect to and use the Cingular network. If you were within the county where they had native service but happened to be in a dead zone you were SOL -- roaming wasn't allowed.

I have to hack my phones to disable this configuration to get decent cellphone service out of them.

I'm surprised that worked. With GSM your home network decides whether or not you will be allowed to connect to that roaming partner based on the location area code. If that LAC indicates an area where they have native service they probably won't let you connect to the roaming partner. If it indicates an area where they don't have native service then you stand a better chance of being allowed to use that roaming partner.

Re:Roaming?

[Shakrai]

You're right, this is a case of corporate power struggles trumping customer service, as any of these phones should automatically fail over to another GSM network. In an emergency, dialing out is essential.

T-Mobile has been known to enable unrestricted roaming during natural disasters. During non-disasters they limit the areas that you can roam based on where they have native service. If they have native service in your city you will never be allowed to connect to AT&T no matter how crappy the T-Mobile signal is. During some natural disasters they've removed this restriction and you can connect to AT&T (and other GSM providers) at will.

Comes in handy if the T-Mobile network goes down or is congested. I've never been in that situation but a few friends of mine have and were very thankful that they removed the roaming restrictions.

Re:Roaming?

[Shakrai]

I wish I had mod points for you. I used to work for a WISP and had the "privilege" of climbing towers in god-awful weather after storms to restore service to our customers. It's scary enough to climb the things in normal weather. Doing it Upstate New York in January after a storm has coated the tower with ice is absolutely horrible.

The worst part was that was my first job and I only got paid $10/hr to scale the friggen things. Looking back on it I wasn't making nearly enough money to be risking my life like that. At least our customers were appreciative though. That helped more than you can imagine.

Re:Roaming?

[Shakrai]

I would love to see the part of the Constitution that says "Congress shall provide a robust cellular network for its citizens."

Don't worry -- someone will come along sooner or later and twist the interstate commerce clause until they manage to come up with that interpretation. Remember, all parts of the Constitution should be interpreted as liberally as possible, except the 2nd amendment of course. That clearly provides for a collective right and doesn't apply to the states.....

Re:Roaming?

[Lumpy]

Nokia phones can get set to have a preferred tower ID. I get into them and set the preferred tower id to a roaming tower that gives full strength at my house. I used to have a blackjack, but got rid of it because it cant do that.

the preferred tower setting overrides it somehow and it works. I've been doing this for the past 4 years and they still have not canceled my account.

Re:Roaming?

[bberens]

Land lines were put in place a long time ago, when businesses and government were still foolish enough to consider common citizens in their decision making. Therefore the land lines have MUCH better redundancy systems in place when compared to the wireless systems.

Re:Roaming?

[Shakrai]

Does this kind of situation explain why we in North America are a little bit "behind" Europeans and Asians when it comes to the "cell phone" and exploiting its maximum potential?

No. All this situation relates to is which networks you are allowed to roam on. Europe works much the same way. If you have Deutsch Telekom phone you probably aren't going to be able to connect to and use Vodafone's network in an area where DT has native coverage. Why should they pay Vodafone a per minute rate for you to roam when they have a native network in the area where you happen to be?

I hear the "cell phone" elsewhere in the world is capable of so much more than simply making calls and texting, which are the bulk of what we use cell phones for over here.

*shrug*, we have a smartphone market. I haven't been in Europe for a few years but the last time I was over there I was actually disappointed with the state of 3G. It's probably better now but when I was in Europe their 3G offerings weren't any better than ours.

Japan and South Korea are different animals -- they are a full generation ahead of Europe and the US and people use their phones for all manner of things over there. That's as much cultural as anything -- how many Americans don't even see the point of SMS let alone internet browsing? Most people I know with phones regard them as phones and don't care about the extra features.

Re:Roaming?

[Opportunist]

I don't know about landlines in the US, but in Europe most of them are in the ground. A storm doesn't really bother them.

Re:Roaming?

[Shakrai]

Then your network must allow roaming in that particular area. With GSM the network that you connect to (even if it's the native network) contacts your home location register to find out if your phone is allowed to connect to that particular part of the network and what features are enabled on your account.

If your provider saw fit they could disable roaming and no amount of hacks to your device would override it.

I've been doing this for the past 4 years and they still have not canceled my account.

I doubt they ever would, unless you are predominately using the roaming partner instead of your native network. AT&T and T-Mobile both have policies in place to cancel the accounts of customers that go over a certain threshold of minutes used on roaming partners. For AT&T I think it's 40% of your minute usage. T-Mobile is 50% IIRC.

Re:Roaming?

[awyeah]

There are two things at play here: The ability to control network selection on the handset, and what the cellular networks allow you to do.

On GSM devices, there's a flag on the SIM card that tells your phone whether or not to show you the "manual network selection" menu. With AT&T, their SIM cards are configured to disable this menu when you're in the US, but enable it when outside the US.

However, on many devices, you can force them to ignore the SIM setting and have manual network selection enabled always. With Motorola phones, you can do it via SEEM editing, and there's obviously a way to do it on Symbian as well. This is what Lumpy is doing.

Shakrai, what you're talking about is the actual roaming agreements between providers. This also affects network selection. Providers can specify which phones are allowed on their network. Legally, all phones must be allowed to associate with all GSM towers to provide 911 capability, but they can be limited to just that. For example, when I only have T-Mobile coverage, my AT&T BlackBerry shows "SOS" where the signal bars usually are.

AT&T and T-Mobile have been doing this for a while. They had roaming agreements where specific cell sites would allow the other operator's phones in areas where the other operator's coverage was spotty.

So when Lumpy uses manual network selection on his phone, which he had to enable by modifying something, the rules that the operators set forth on their networks still apply. If he tries to associate with a T-Mobile tower in certain areas, he will most likely get locked out, but in other areas he may not.

Re:Roaming?

[JWSmythe]

    Several years ago, I was driving across the country from Florida to California. I was only a couple days behind a hurricane that had made a mess. No, it was way before Katrina.

    Every hotel along I-10 for hundreds of miles had utility trucks from all over the place. I usually drive at night to avoid traffic, and I know these guys need to at least get a little bit of sleep. I know the utility guys get sent out from all over the place to fix problems induced by bad storms. It never really hit me that it wasn't just a few hundred sent, but an entire army. I would stop at hotels, and they would tell me that they were completely booked up because of the utility guys. Not just their hotel, but every hotel in the city. "Try the next town, 50 miles down the road." It's not like they were hogging the rooms, they were stuffed in. One guy per bed, and a guy or two on the floor. This is our civilian army, that keeps things working after a disaster.

    Unfortunately, all the general public knows is "they don't have my power on yet.", even though it is an army working hard to repair everything. People like instant gratification. They think it should be a light switch fix (hit the switch, it works).

    It's a job I wouldn't want. High voltages, dangerous weather, and long hours.

Re:Roaming?

[Shakrai]

Because the native network is not as strong of a signal, and it would be a better service for the customer? Seriously, if the companies were FORCED to allow this, they'd either 1) continue eating the cost or 2) improve signal in the affected area. If they did 3) raise rates and do nothing else, they'd quickly lose customers to the provider with better coverage.

Raising rates is the likely outcome of a mandate like that. I doubt many people would switch to the provider with "better coverage" because "better coverage" is very subjective. Yeah, AT&T might have better coverage inside Wally World than T-Mobile but if T-Mobile works everywhere else do you really see many customers switching over it?

I'm not a fan of Governmental mandates but if you want to impose them on the wireless industry I can think of much more important things to fix than mandated roaming.

Re:Roaming?

[lysergic.acid]

there are major cultural differences between Japan/South Korea and the U.S. to be sure, but there are also fundamental socioeconomic & technological differences as well. these things are inextricably tied to one another i think, so you really can't discuss one without the other.

one major point of divergence is Japan's more progressive approach to public infrastructure. whereas the US favors privatization and deregulation, the Japanese government takes a more pro-active approach in promoting technological progress. for example, the government owns a 1/3rd stake in Japan's largest telecom/cellular phone carrier/ISP, NTT (Nippon Telegraph & Telephone). this hybrid private/socialized approach is similar to Japan's health care system, which, while provided by the private sector, is heavily regulated through price controls determined by negotiations between the government and industry leaders ever couple of years.

the Japanese government also actively funds the sciences and technology. in the mid 90's Japan invested 2.6% of their GDP into R&D, which is about on par with the US, which invested 2.5% at the time. however, whereas US funding is focused primarily on defense, Japan's funding has been focused on non-military R&D, which far exceeds the US. and while government funded (non-defense-related) R&D has been decreasing in the US over the past decade, R&D funding in Japan has roughly doubled--largely due to efforts to intensify international research cooperation (creating world class research facilities within Japan and abroad) and also to strengthen Japan's human and physical infrastructure for basic sciences within universities.

but Japan's rapid pace of technological progress isn't just due to publicly funded basic research. there have also been reports in the media that Toyota's hybrid gas-electric technology was largely subsidized by the government, which is in line with the Japanese government's history of working closely with domestic industries. and through NTT the Japanese government has also provided its citizens with faster and cheaper broadband. as a result, Japan has the highest FttH penetration in the world.

so what came first, the Japanese government's interventionist policies or Japan's technophilic culture? it's hard to say, but whichever is the case, this system clearly has its advantages. Sweden is another country with similar public policy, and in both cases it seems to serve the public better than a strictly free market approach. not only do individuals enjoy better/more advanced public infrastructure (and at a far lower cost), but the Japanese economy has proven extremely resilient even during global economic downturns.

Re:Roaming?

[kimvette]

Crap, I just made a similar post above before I saw yours. If I'd seen yours first I'd have modded you up.

That is exactly the problem; because we built our infrastructure back when everything was bleeding edge first-generation technology, the world has passed us behind. Our internet infrastructure is still based on ARPANET-era lines in spots, our ISPs are still using first-generation broadband and because of municipalities granting monopolies they are raping us on pricing (I paid for unlimited internet that you advertised to me, MAKE IT UNLIMITED for God's sake! Let your yea be yea and your nay be nay, doing otherwise is FRAUD. It doesn't matter that I've never even gone over 20GB, I don't like the fact that I have ANY limit besides bit rates), using infrastructure paid for in full BY US (taxpayers), not them, and of course the electric companies are still riding on the backs of taxpayer-paid lines and they won't make the investments to run new cables underground whenever a road is repaved.

That should be law; whenever a street is repaved, ALL utilities are moved undground. It's amazing how "clean" streets (mostly in private housing and industrialdevelopments) feel when there isn't a rat's nest of overhead lines and utility poles all over the place, cluttering up the landscape.

Re:Roaming?

[Nimey]

Interstate Commerce is such a huge loophole. It's used to pretty much neuter the powers of the state governments as Congress sees fit. Pity the Supreme Court didn't nip that in the bud back in the day; nowadays the Supremes would probably be loath to do it because it would cause chaos.

If All You Have Is a Cell Phone...

[littlewink]

then you're out of luck. Most landline phones have independent power and will work in an emergency. That's one reason I always have a landline.

Re:If All You Have Is a Cell Phone...

[Wapiti-eater]

That requires a license - training - practice - effort - learning - preparation - actually doing something rather than just paying some one else take care of your needs (cell co) and then whining when their stuff breaks.

Least with my HF rigs - only infrastructure I depend on for communications are the laws of physics and the presence of time/space.

Interesting in this consumer society where paying a bill insinuates the right to whine. Kudos to those that do rather than gripe.

Not conspiracy, but AT&T has not been forthcom

[neapolitan]

I would argue that the OP has a point. I am a doctor, was on call (I'm not kidding), and missed several important messages due to my cellphone going out (my blackberry just silently stopped receiving all work mail, all internet functions went dead, full 3G signal but "tunnel failed.") Granted, there is a lot of redundancy in communications, so my pager later started going off with a lot of people saying "where are you???", and I then called them on a landline.

I thought it was my phone, rebooted 3 times, and only today did I find out that it was a national outage (saw here, confirmed all over the net.) I think AT&T should just have sent a free txt saying "We are having problems" or made an large scale announcement via voicemail, which would have helped me (and others) plan. I was about to get a replacement phone from a friend and plug my SIM into it.

The point is we start to rely on these devices, and blackberries, for better or worse, are used for very important things in business, health care, and otherwise.

Office camping party!

[twilightzero]

Camping at the office is a time-honored tradition here in Minnesota, and now that the offices have internet access it's WAY more fun! ;)

Will AT&T repay me for the days my service was

[freedom_india]

First Question of any contract: Any contract in which any of the party is unable to fulfill the terms of the contract will be is liable to either NOT collect remuneration of the said contract for that quantity, OR reimburse the amount for that period.
Will AT&T send me a check for the days my service was out?
Because last i checked, weather is not a cause for NOT fulfilling a contract. For the same reason i cannot claim weather for not paying my mortgage.
Question is, will AT&T refund the amount for the period of outage.
If not a class-action suit can be filed in coordination with other users.

Press coverage

[machine321]

I was going to notify the press, but I couldn't get any calls on my cell phone to go through.

Re:Not conspiracy, but AT&T has not been forth

[ceejayoz]

If AT&T's service was down, how would they send you a text or voicemail?

Re:Will AT&T repay me for the days my service

[cthulu_mt]

Most contracts include a "Force Majure" clause that absolves the service provider in the event of a natural disaster.

Re:Will AT&T repay me for the days my service

[macx666]

The inability for AT&T's datacenter in Michigan to have power backups that can last more than a day should hardly be considered a natural disaster.

I'd love to see something happen in terms of getting money back, but somehow I doubt most subscribers care enough to push for it.

It is easy to keep that out of the news

[erroneus]

They are major advertisers and can pretty much control what is reported about them most of the time. All they had to do was make a few calls... oh wait...

Not a conspiracy

[jmkaza]

AT&T has managed to keep this out of the mainstream media

I'm in Arizona, and I saw that AT&T service was down in the midwest from multiple sources, before I finished my first cup of coffee. If there's been any lack of information reported about this, my guess is that's because the press is more concerned about hundreds of thousands who are without power in below freezing conditions, rather than a few people who can't make phone calls.

New News and Wireless Service

[mpapet]

The summary is full of *very* misplaced expectations regarding wireless service.

A. There was never an expectation that the service would ever be plain old telephone service (POTS) quality. Thinking otherwise just sets you up for disappointment. Telco's pretty much hate POTS because it was designed and regulated to be extremely reliable. Get a POTS line and move on.

B. ATT doesn't care if individuals go without service. A few hundred thousand users having downtime for hours is nothing because it can be blamed on an "act of God." They care if they have to go before their regulators because that costs campaign contributions.

C. I have a bank of dial-up modems as the very last line of defense in our NOC for just this reason. We deal with messages, so it would work in a bad situation. Not ideal, but I'll take it and our customer's PHB's are generally pleased we think that carefully.

POTS is good. Long live POTS.

Re:Will AT&T repay me for the days my service

[jaredmauch]

If the facility had the roof blown off due to the 60mph+ winds we had, and caused a safety hazard due to exposed wiring, etc.. I certainly can see a case, but this is all conjecture. Unless you (and I don't) have facts to support your postulation, we can go on feeding the echo chamber more and more!

Re:What about the recent ice storm in the Northeas

[haruchai]

Welcome to Canada - we see that all the time in Montreal; it's actually quite beautiful, until it gets heavy enough to snap trees, down powerlines, make sidewalks and roads unnavigable.

Thats all a nice homespun story and all but..

[Viol8]

.. if "the company" didn't pay them, they wouldn't get out of bed. Lets not pretend they're up those poles out of the kindness of their hearts.

Unsung Heros

[Archangel Michael]

Exactly right!

Most bean counter types don't have a clue why they have all those over priced techies on the payroll, and when cost cutting comes along, they make an easy target.

I don't have to go around in bad weather fixing crappy equipment, as I'm a Network Analyst, but the details could easily fit my job.

Most of the time, I'm watching, monitoring, tweaking, updating, and so on. That's my job when the shit isn't hitting the fan. Most of the time I can avert disaster by seeing the shit before it hits the fan.

BTW, our department is going down to 60% of staffing, and when we were fully staffed we were "understaffed". I'm not sure how much longer I can keep the shit away from the fan.

Re:Not conspiracy, but AT&T has not been forth

[monomania]

Here in Des Moines, I lost EDGE data service all morning but could still call out and receive calls. I tried every customer number for AT&T but got the "all offices are closed, call next business day" and there was no message (automated or otherwise) about outages. I was left to wonder if it was an account problem, etc. (WiFi worked fine). Even after service was restored in the early afternoon (locally) there was no message or information regarding the outage, nor any info to be found on their website. Less than impressive customer care.

emergency calls do whatever it takes

[dominux]

Put the keylock on and dial 112, 911 or 999 on any mobile, watch as it punches straight through the keylock and will dial. It will place the call over any mobile network it can reach, roaming or otherwise. Now try it with no credit on a pay as you go SIM. still works. Now take the SIM out. Still works.

Re:Infrastructure!

[squidguy]

Wasn't the bridge inspected, and passed, by the State?

Making AT&T pay...

[freedom_india]

A Credit is NOT the same as a check.
Reimbursement needs to be in the same terms of original contract.
You don't give them CREDIT for providing you service. They take your money: period.
Similarly, ask for a check or money order sent to your address. If they refuse, sue them in small claims court for violating a contract.
Why should you accept CREDIT when they don't accept yours?
A Credit is just an interest-free loan to these guys.
Refuse to accept unilateral changes to your contract and demand the repayment from them in check or cash.
Better yet, do the following:
1) Send a registered letter to their local office demanding financial compensation for the days not in service and quote the contract. Give them 7 calendar days to pay (not working days).
2) Wait for 7 days and when they don't respond, file a complaint with small claims court. Ask the clerk to send a notice to their local exchange in telephone directory with another 7 calendar days to respond.
3) They still wont respond for $5 or $10.
4) Enter a default judgment. Tell the judge they insulted him/her by deeming this court to be beneath their status (appeals to vanity and not logic). The judge will be furious on their own to consider MAXIMUM enforcement.
5) Get the judge to declare that AT&T is in default of a debt to you. This is very important. Because this disassociates the original contract from the debt. In other words, in the eyes of law, AT&T is indebted to you for the said amount as if they borrowed money from you (in a way true).
5) Now the judge will ask what do you want to do: Request that the judge allows you to seize their assets for payment of this debt. Get a bailiff order.
6) Call your close friends/relatives and state there (from a pay phone or get somebody else to call) to gather at the local AT&T office for a fire sale.
7) Get the Sheriff and a deputy. Go to the AT&T office and paste the order to their door stating their assets are being seized for discharging a debt. Throw every employee out. Ask any protesters to be considered as disobeying a judge's order.
8) Ask the sheriff to seize their equipment and conduct an auction at the doors with Sheriff and his officers as guards.
9) Your friends and relatives should have arrived by now. Make them bid 10 cents or 20 cents for iPhones, telephones, routers, computers, etc., and sell it to them at that price.
10) Finish the sale within 15 mins enough to collct your debt. The longer you delay, the exponential the probability that some retarded employee will call a AT&T lawyer who gets the judgment suspended.
11) Now you have a nice collection of worthy items for the $10 you were owed by AT&T. Plus AT&T credit is screwed because you had a lien and auction of their property.

If you had owed 30 cents on a mortgage that was overdue, ANY bank would do the same to you.

Re:Making AT&T pay...

[devman]

Most people just say IANAL (I am not a lawyer). Instead of proving it so dramatically as you just did.

Re:Making AT&T pay...

[freedom_india]

Most people accept corporate overlordship without questioning. Iam not one of them.

A major reason not to cancel POTS service

[TheHawke]

You cell phone users just don't get it, do you?
One of the major reasons why they want you away from your landline service is that they don't have to comply with the state or fed rules, tariffs, and laws forcing them to maintain POTS service even through the worst of weather.

Lose a cell tower? Fine, two weeks to get it back up.
Lose a phone line, depending on your state, from 12 hours to a working week in compliance with PUC regulations (in Texas it's 5 days, then Austin gets froggy).
Business landline goes down, 3-5 hours, as fast as a tech can get on site after getting pulled from a lower priority job.
Business cell service breaks, ok, duh, you get the point now?

What is $15-$25/mo for basic POTS service that is there when you need it in comparison to $60+ cell service that is still not as dependable as we like it to be?
I'll keep my POTS service and call forward from it to my cell, keeps the telemarketers at bay.

Re:Will AT&T repay me for the days my service

[macx666]

That's fine. If a tornado ripped through their datacenter, I could see that being Force Majeure. Failure to have a backup generator (or other power protection mechanism) is not force majeure and you would be hard pressed to find a judge that would say otherwise. Failure to have power for any reason is considered a predictable event that any datacenter operator should be able to deal with for 24 hours.

Ice storms and winter weather are nothing new

[rickb928]

And neither are technology problems.

In 1998 Maine suffered the worst ice storm in decades. Power, telephone, and cellular service were affected. Yes, cable TV also.

In Gray, Maine, I was without power for 11 days. My sister in Searsport was without for 17 days, 2 of which were unnecessary - her house was about a quarter-mile in the woods, and the crews missed her line. She had power restored a few hours after calling in and reporting she was still out, and could see lights on at neighbors' houses. Darn.

Among the events that would inform the Midwest utilities:

1. Bangor Hydro-Electric, serving North-Central and Downeast Maine reported virtually 100% loss of transmission lines and 100% of customers affected. Central Maine Power reported most customers affected north of Portland, and most transmission lines down. Both utilities reported to major customers that restoration would take weeks, and they pretty much beat thet estimate. Not bad for rebuilding either 70% or 100% of their transmission network. BHE in particular had to replace completely many miles of hi-v transmission line, with poles snapped off. Availability of basic equipment like insulators became the limiting factor. In light of this, customers such as Verizon and cell carriers were told they were genuinely SOL.

2. The Verizon maintenance supervisor for the state had just relocated from Cape Cod, where he survived a similar event a year earlier. He immediately commandeered all generators, battery packs for SLCs etc, and emergency equipment from Mass, lower NY state, and beyond. Upstate NY was also affected and could spare nothing. His actions permitted his team to keep swapping the batteries out of SLCs, recharging them, and swapping to keep basic phone service running. He also asked for and got fuel from the Maine National Guard to keep the trucks and generators running. Most gas stations were down for lack of power.

3. As is the nature of winter storms, power lines suffer the most because they are highest on the poles. Telephone is next, and cable TV is usually lowest and suffers the least. Cable companies didn't bother much for restoration, since TV is the luxury you give up when the generator needs more gas than you have. Thankfully, this also meant most telephone service survived, and all they had to do was keep their gensets running. 'That's All'... It was a massive effort.

4. Cell service then was TDMA and CDMA, and NAMPS. It was good, despite the problems of the carriers having to do their own bucket-brigade battery swapping. They did terrically.

5. From my observations, quick action by carriers to put plans into action, clever thinking, and looking beyond the usual boundaries of support saved the day.

6. And one saving grace - the NBC affiliate in Portand broadcasts on Channel 6. Audio was available on most FM radios, way down on the band. When HD kicks in, this will be lost. No replacement I see.

It appears that AT&T is caught here with a central switch/datacenter that is stranded. We'll dissect their planning, no doubt, but ultimately they needed to plan for a week of power failure. I know that sounds preposterous, but my hospital clients at the time were even parking water trucks in the lot in case power outages resulted in public water supplies failing. Diesel tankers also came in. One hospital had backup privileges with a sister facility in Pennsylvania, and we would have transferred back-office processing there and flown/driven key personnel for a week to keep paychecks, billing, and patient care data current. Fortunately, my old stomping grounds were no longer my business. That hospital was out for 5 days, and ended up with a National Guard generator on site. The Guardsmen went without power for their armory to do that, sleeping in trucks and tents. Fortunately, it was not that cold for January. If it was 10 degrees colder, a lot of people would have died, never ready for that sort of trouble.

I escaped to friends in New Hampshire. Yes, I'm a wuss.

AT&T should own up to bad planning, despite the unusual weather. Redundancy is crucial, expensive, and worth it.

People are used to this now. Standards are lower!

[ScottFree2600]

Never had a call drop? Never been someplace where there is "no network"? Never had a conversation that you simply couldn't understand because of the "stacked" aggressive compression? C'mon! Thanks to the wireless companies, people have lower standards now, in terms of audio quality, reliability and availability. I used to work for Jabra years ago, before they had any market share and weren't really sure what direction to take. I was brought on to improve audio quality for various products. One was the small "all in ear" headset. It had terrible audio due to the lack of "proximity effect", there was really no way to "fix" this problem. I used to piss everybody off by calling it "an ear mounted speakerphone" in meetings. People would never accept the poor quality on land line phones (the headset market at that time). Poof! Along comes wireless and the lack of quality is expected by the consumer. Result: sell product and then company! People who have only a cell phone are nuts, and deaf!

Re:Coming soon...

[ekidder]

I worked during the last strike. I was doing repair line duty. And then we had those massive storms in the midwest and my life was very miserable for four days. It was really really depressing talking to all of those people.