BlackBerry Outages Across North America
TheHappyMailAdmin writes "BlackBerry service in North America is out: no email, no BB Messenger and no web browsing. Last carrier estimate I got was 24 hours until service will be restored, with others saying they've gotten estimates from support from between 3 hours to 2 days. BES and BIS services are impacted, and it's across all carriers. Bad timing for RIM as people are wrapping up their holiday shopping..." Updated 18:11 GMT by timothy: Reader notheusualsuspect pings with a note that the service has been restored.
I did a test message from/to my BB too.
RTFA
* FINAL UPDATE: Things are back to normal. RIM Statment to follow. ...
Bing.
RIM seems to be particularly odd in chosing an architecture that gives a single point of failure.
Then again, given most crackberry users.. nothing of value was lost.
And stockvalue goes up up up...
BB users are the biggest type-A douchebags around. They differ from their hipster iPhone douchebag brethren by typically wearing suits, talking loudly on their phones while waiting in line, and driving faux-retro American sedans. I knew when I woke up this morning that it would be a good day, as if millions of douchebags cried out and were suddenly silenced. Merry Christmas to all.
I want to delete my account but Slashdot doesn't allow it.
Damn /. - more and more lately the posts on the site are running days behind in the news. This was reported on Engadget a day and a half ago. Fail.
http://www.engadget.com/2009/12/22/blackberry-services-down-in-north-america-yet-again/
This is like the third time in three weeks that BB has gone down. Remind me again why my wife wants me to get one of these?
I call it 'The Aristocrats'
A neo-con Rovian plot!!! I blame George Bush!!!
My Blackberry has once again broken so I haven't been impacted by this outage. I haven't even had time to set up BB mail on my newest replaced Crapberry.
This is the first and last Blackberry I will ever owned, but because of Blackberry's poor quality, I'm now on my third one. Just trying to survive a 2 year contract on T-Mobile, America's worst cellphone company.
I don't know what phone I get next (Android or iPhone) but I promise I will never own another Blackberry as long as I live.
How long RIM's model of interposing their own(seemingly rather unstable) services lasts.
Obviously, when the carrier has some major fuckup, email/web aren't going to happen because the packets are being routed to their deaths, like so many binary lemmings, somewhere within the series of tubes.
RIM's presence in the loop, though, seems like an increasingly useless liability. Back when Blackberries were little more than pagers, in terms of hardware spec, RIM's service made sense. Now, though, phones are powerful enough to speak the same protocols as computers. Why, if my carrier is passing packets properly, and my mailserver is up, should RIM be standing in the middle?
Panic panic panicpanicpanic
Wait, I am posting this from my blackberry via BIS (RIM internet)...
Oh well, apparently the Armageddon is still a few days off.
My mom uses her crackberry to text me when she's buying presents for my son. I imagine a lot of people use their blackberry's that way. So now we are back to Christmas shopping circa 1985. It's positively barbaric!
This is my sig.
Actually, Blackberry has been advertising frequently lately, and if you were thinking of buying one for a Christmas present, and hear about the outage.... maybe you reconsider.
As soon as I read this I tried to go online and send a BB message and all the fun and pointless stuff my crap berry allows me to do. Everything worked perfectly and with pretty good speed. It's possible that the outage only effects certain carriers or maybe just certain data plans but as far as my phone goes everything works
RIM buys their email servers from a company called Mirapoint. Mirapoint, on the other hand, is big into offshoring to India, especially their QA. That's why this stuff keeps happening on a regular basis.
Except the outage is already over and has been since yesterday.
another outage, huh? Well then, rag about AT&T's shitty network all you want. My wife's iPhone outage count as of this morning: 0
The vast majority of BB users are business users and many people are already on Christmas vacation, so I'd say the 23rd of Dec. is a very lucky time to have such a severe outage. Unless you're a BB engineer who must work around the clock until it's fixed.
This was yesterday's news, typical slashdot.
Crap, no work emails on Christmas Eve? Whatever shall we do?
Just because you sold your soul to the devil that needn't make you a teetotaler. --The Devil and Daniel Webster
Maybe the cause is a disgruntled BB Engineer who didn't get a Christmas Bonus.
Service has been restored for hours. CmdrTaco is just an idiot who posted this story long after the fact.
As a TV Master Control honcho in a previous life, I read stuff like this and I shake my head... hours?? DAYS?! In broadcasting, that's not an outage, that's a carefully orchestrated attack by space aliens. Why does anyone on the corporate management level even remotely tolerate this? What, there's not enough money changing hands over at RIM to merit hiring the right professionals and institute the proper safeguards and procedures? The infomercial that aired at 3AM on Channel 11 has a better back-up plan than RIM's entire service? It boggles...
I've noticed a lot of these kinds of outages lately, not just with RIM but with other network providers. They usually seem to follow a failed routine-maintenance cycle. Do carriers really not design their networks and systems to support rolling upgrades and the like? More importantly, has there been a breakdown of the test-and-release cycle that's supposed to catch these things before service dies for everyone?
I guess the other thing might be all the third-party hosting and outsourcing that goes on in IT...how many people want to bet that half the outage time was trying to figure out where exactly the fault was? From experience, that gets a billion times harder when your system is hosted by a third party who won't say a word to you so they can avoid taking blame (and SLA hits) for it.
Makes me wonder about cloud computing...the technology concept is great, but how many large organizations will trust all their data to machines they don't directly control? These days it doesn't make sense to host everything yourself, but companies really have to be careful to choose competent service providers!!
... from the site linked in the article: "* FINAL UPDATE: Things are back to normal. RIM Statment to follow."
This is the second outage in a week apparently (http://www.businessweek.com/news/2009-12-23/rim-reports-second-blackberry-outage-within-a-week-update2-.html) .
ITProPortal has the funniest story about this (http://www.itproportal.com/portal/news/article/2009/12/23/rim-blackberry-service-hit-yet-another-e-mail-problem/): "The substantial number of users on online forums whining about the issue indicates the gravity of the matter and how widespread the issue is."
Problem is that I depend on a T Mobile powered GPhone - and while T Mobile have been pretty solid, Gmail has had its problems - also my home ISP is always messing around with DNS servers or disconnecting me for magically stupid reasons.
We really need some legislation to mandate a minimum service provision.
In the meantime, the worldwide SMTP / POP / IMAP still works fine and serves millions (if not billions) of users with standards-based protocols.
Is this still a problem? My blackberry is working fine... I havnt had any problems all day or yesterday and I've been on it hourly at the least. In fact it almost seems to be faster right now than it has been in a long time! Maybe thats because everybody else is out! haha In any case, I have t-mobile.
Well I got my BIS service back today, and it looks like they pushed a bing! app out. Coincidence? I think not.
Or a BB engineer who gets a nice load of cash for being on call and an even nicer load of cash if they have to do anything... :)
--- Users are like bacteria -> Each one causing a thousand tiny crises until the host finally gives up and dies.
I received emails all night long on BES. My wife's BB on BIS is also working fine.
The last outage didn't affect me either.
"A plan fiendishly clever in its intricacies"- Homer Simpson
It took me a few minutes to realize that my BBMs were not going through. I ended up just calling. Funny how after you are used to BBMing and emailing, that having to make a phone call and actually talking to someone seems to bother me.
Today's vices may be tomorrow's virtues.
I'd love to know if there was a drop in vehicular crashes during the BlackBerry outage.
UPDATED 6:00AM CST (bambenek) - It appears Blackberry's network is back up. The outage affected only those applications that needed to go through that network. Native IP was working fine, but seemed to be all providers.
http://isc.sans.org/diary.html?storyid=7798&rss
And yet strangely I can post this comment from my 'berry.
My Babylon
I have a Storm on Verizon, and it's been working fine all morning. Email is being pushed and Gmail is working fine... you sure it's not just your carrier or segment?
I hope they have given the Engineers who will fix the fault something else other than a Blackberry phone ;)
RIM (the company that runs the BB services) is a Canadian company that operates globally. So the original post is correct in saying North America.
"A plan fiendishly clever in its intricacies"- Homer Simpson
Channel 11 did not have a backup on Nov 22, 1987.
Mine's down and I've had the most productive day that I can remember. Thank you, RIM!
body massage!
I use Opera mini as my browser and have the gmail app for my email and calendar. That seems to avoid these problems. I've had my BB for almost a year now and like it a lot.
"Do the Right Thing. It will gratify some people and astound the rest." - Mark Twain
Shouldn't they built in some sort of redundancy and allow for failure modes. I mean just how difficult is it to move bits from A to B .. ?
The Blackberry business model predates the arrival of the current generation of smartphones. RIM charges telcos a monthly fee for each subscriber using the various Blackberry services (messenger, mail and data). Licensing the server technology to cell providers would cost RIM a fortune in monthly license fees, because no doubt the wireless providers would negotiate huge discounts. I also suspect that the blackberry.net infrastructure is a tangled mess that would challenging to support when run by countless telcos around the globe - it was never supposed to get this popular.
Well, show me the way
To the next signal bar
Oh, don't ask why
Oh, don't ask why
Show me the way
To the next signal bar
Oh, don't ask why
Oh, don't ask why
For if we don't find
The next signal bar
I tell you we must die
I tell you we must die
I tell you, I tell you
I tell you we must die
And yet it was still back on the air less than two minutes later. That's still less than 1% of the expected RIM outage.
TheHappyMailAdmin writes ...
My Blackberry seems to be working fine. Perhaps the Happy Mail admin has been indulging in Christmas Cheer.
Does anyone out there think this should be a non-story? Is this an end of the world event that some people cannot text or browse the web on their cell phone for 24 whole hours? Geez, in the last 10 years I have had 3 or more instances where I lost power to my house for 8 hours or more. I have had at least 6 instances where I lost all water to my house for at least 12 hours (bad water system). And I never saw more than a few lines in the local newspaper about these highly inconvenient events. Yeah, I understand that lack of electrical power or water is not quite as dramatic as losing my ability to send a text message but really!
Hi
I am from India, it is very sad to see how much you western folks worry about work and down time and not bother normal human life..
In my are in india i would loose power atleast once a day and in summer 3 hour daily power outage....
I think we should learn to use that time to chill ourself and look at the world rather than banging head on the pc or gadget
I'm posting this from my blackbe
I can't stand blackberry's BIS & BES. Phones these days are clearly powerful enough to just speak the same protocols computers can, why have mandatory middlemen for everything? gah.
I hate my iPhone for a lot of reasons, but I still use it because its wayy better than BlackBerry and being forced to use special blackberry plans to have access to use BIS & BES. Fuck that.
You can tell how powerful someone is by the magnitude of the crime they can commit and be able to get away with.
Funny thing. I received the RIM server outage notification from my blackberry. Then I looked for news reports about it via my phone's browser. I then sent some BBMs to my friends and co-workers to test the service. I did experience a 10 minute hiccup in service last night around 5 to 6 cst, however it was just that, a hiccup. BBs are great corporate phones, and that's the reason I have one. What's with all the hate? Most wouldn't classify me as a corporate whore, but I consider my blackberry an indispensible tool for completing my job and maintaining connectivity. I work infrastructural IT in an enterprise environment, I can't really afford to not know what is going on. I've been through various smartphones before finally caving and going to BB. I've got to say, with a BES in place, the constant VPN like connection is a god send.
Or are Blackberrys the equivalent of the Palm Pilots of years gone by? A hardware platform that at the time was innovative and ground-breaking, only to be surpassed by the next wave of competing devices. Most of the people I know with a Blackberry are a few fries short of a Happy Meal when it comes to technology. So perhaps that's the right device for them. But with other alternatives out there why settle for one that's also bundled with a somewhat-unreliable back end infrastructure?
I use my Blackberry for everything but making phone calls. Right now, all it can do is make phone calls. This is unacceptable.
At my company we have a change freeze from mid-December to mid-January to avoid problems such as this. With a large (40B+) company, you need to have a stable environment to perform year-end financial activities, and an outage like this would be completely unacceptable.
While I don't personally use a Blackberry, I would be asking some serious questions about their change policies before I relied too heavily on a BB for business purposes...
This is why I carry a BoostBerry! Opera Mini for Web GMail BB App for email GMaps BB App for mapping and nav TwitterBerry for Twitter jmIRC for IRC No reliance on RIM for ANYTHING! Granted, my data rates are slow as sin on iDEN, but it does it's job.
Who is this 'Blackbetty' to whom you refer?
Santa and the elves are all on BlackBerries. They love the push email features. Now how the hell are they going to coordinate all those late night pickups and dropoffs? And Mrs. Claus won't be getting her usual midnight sexts via BBM this year. This is truly a crisis.
The outages refer to e-mail. Users can still make an old-fashioned phone call.
Using any e-mail system for time-sensitive communication demonstrates a lack of understanding about how e-mail works. Most of the time it's fast and dependable, but problems can always occur along the way that will cause messages to be delayed. Most MTA's in default configuration will retry for days to deliver a message if the receiving server is not responding.
If you need to contact someone urgently, e-mail is a poor choice.
Let's see you reply in thread...
Who is this 'Blackbetty' to whom you refer?
Classic rock, dude.
Who-oh-oa, Blackbetty...
Blackberry's an aging platform, but the things it does right have keyboard ninjas like myself completely hooked. Since this discussion will devolve to OS/UI-bashing and platform comparisons anyway, here's my list of smartphone must-haves:
1) Home screen keyboard shortcuts (m for messages, o for options, etc.) Having to search for and click an icon is just inefficient.
2) Customizable shorthand (hig > how's it going, fm > from, etc)
3) Lag-free handling of 5k+ messages
4) Keyboard-activated select/cut/copy/paste
5) Proper multitasking (I can simultaneously SSH while running a search through server-side+local messages AND zipping a folder)
Is there another platform that can do all this? I'd love to migrate to better hardware + UI, but it all seems gimmicky and plain inefficient in comparison to my customized Blackberry setup.
Most of us forget that the first single-point-of-failure is probably a cell tower.
I think you're extending this concept of a "single point of failure too far". Don't get me wrong, I think blackberries are, by and large, well designed and I have a belief why they maintain their proxy system (i.e. to control their lucrative discriminatory pricing/licensing strategy).
Blackberry proxy design is deficient for end users though and represents a true "single point of failure". This is because, unlike in your examples, a problem with their proxy specifically affects large numbers of blackberry users.
A problem with a tower is not a single point of failure. It's one of thousands of points of failure for a carrier in the context of the whole network.
I manage both iPhones and BES at an office of about 100 devices. Here are a couple small anecdotes about the 2 technologies: 1)iPhone support was an after thought in Exchange or at most, an added feature for Exchange 03. This doesn't really make me feel too confident in the technology. 2)iPhone remote wipe feature does not always work for some reason. 3)iPhones have huge hard drives and give people opportunities to save content to the local device. There are no hard disk encryption technologies that I know of that support the iPhone. The amount of data you could grab from a company then jump off the cell phone grid is unsettling 4)Crackberries have policies, controls, filtering options etc that sys admins love to see. 5)Crackberries are corporate issued in most instances. Corporate assets given to individual users do not get the same respect as hardware bought by the users. I have yet to see a company start giving out iPhones as a policy. This being stated, I tend to think people treat Crackberries with a lot less respect then iPhones. 6)End to end encryption 7)Support that is not based on the whim of Microsoft. I could go on forever. People that use cellphones for personal and not work related matters and do not have significant knowledge of back end processes and phone management will never get blackberries and last time I checked, no one who uses a blackberry in the manner it was supposed to be used ever really wanted anything more then a blackberry.
I bought a Curve for myself, as a personal phone (out of work baby!). I can tell you at least 3 reasons I bought it none of which involve c-level thinking: 1) it's not tied to either Verizon or AT&T (I cause enough bullshit in my own life without the help of these service providers) 2) it looks/feels nice to use and carry 3) decent media player (although I use flipside mostly as my media player) 4) lots of useful application (two of my favorites are midpssh and logicmail).
To make the bb phone even more usable try operamini. Oh, and I've just installed google voice which looks like fun.
Naturally I'll be moving to an android when 1) they look/work a little more iphone/blackberry slick (am I the only one who hates HTC phones?) 2) I can actually afford one.
Quack, quack.
I recall when the floodgates from AOL were opened and we had to listen to this "ping" this and "ping" that everywhere on usenet and web forums.
Because, you know, AOL people were cool and said things like this, even though they had no clue what a ping was.
Moral of the story: Slashdot journalists now do it so it's time to move on to greener pastures. This place will never be the same again.
---
Mobile Phone Feed @ Feed Distiller
buy wholesale copy blackberry from http://www.chinaecarts.com/