Slashdot Mirror
UUNET/WorldCom Backbone Diffiiculties
FearlessFritz writes "UUnet seems to be having a bad time recently. Several sites in the SouthEast of the US have been slow or down. Here is Worldcom's quote from their web page: 'WorldCom is currently experiencing an interruption of service in various hubs in the U.S. We are working to restore a routing anomaly, and making necessary progress toward resolving this disruption in service.' There are several rumors abounding, but the best is that they performed a hardware upgrade that failed. Is anyone outside of the Southeastern U.S. experiencing the effects of this outage? (I am peered to several providers so I can post!)"
Must be a nice upgrade...
When you die, on your deathbed, you will receive total consciousness. So I got that goin' for me, which is nice.
One hosting company that I've used has been up down since AM EST. They're in LA...
"oohhh... I didn't know Schopenhauer was a philosopher!"
Sure, the internet's slow today, and so is news.
Therefore, I ask you all: What do you think of Slashdot's new arrangement in the search (Older Stuff) section?
It will take a while for the 3 network techs that havent' been fired yet some time to fix this.
man Sprintlink has been having troubles too...this isn't new or anything
Yeah, I'd like to see you afford a hardware upgrade like that. C'mon, you know how times are these days. They can only afford to pay the CEO a paltry 23 Million. How the hell will he feed his kids?
"Oh no, 3 horny women and only 2 condoms...Thank god I read slashdot"
as a sysadmin i know all about the "it's an anomoly" excuse. What? You're monitor doesn't work? It must be an anomoly. In reality I stupidly forgot to plug it in...but you don't EVER tell users it was your fault :P
"Herbivores eat well cause their food never, ever runs."
We use 'em in new york city. Net access is shot to hell... slashdot access is good, at least.
How can we expect good service when they use hubs?!?
(the voice from the movie WarGame after the first wave of Russian missile launches hit:) "We're still here!"
I was having problems accessing our corporate intranet yesterday, when i called our tech support team, they said that half of texas was pretty much down. Since we take most of our orders via the net, our business flow was severely disrupted.
Who's to blame in a case like this? what if this keeps on happening, what should we do when relying on such a big provider?
I have had very slow internet access most of the day in the upper midwest. The problem started at about 8:15 CT this morning.
im glad they added the "feature" to "improve" their "network"
- what is the definition of simultanagnosia?! I've been meaning to look it up!
I need a friend interested in any of the following
Linux on a floppy disk
They Might Be Giants
Diapers (especially Pampers 6)
I've had problems accessing some websites lately, perhaps this is why. They had better fix it, 'cause Tom is deprived of good old Ultima Online!
Im in Alexandria, VA, and I've had horrible service all day long. I could get local sites, but nothing far away. Pinging slashdot wont even work half the time :(. And no google....
Maybe the recent hurricanes knocked over the trailer containing the routers.
"Would it kill you to put down the toilet seat?" -- Maya Angelou
..."Upgraded" to RH8.0?
I can verify this issue. I work for a company out of the DC area and our data lines are provided by UUNet. I live in Kansas though and do all my work via SSH to the servers in DC. This morning my SSH sessions would randomly seem to hang. After a bit of investigation I started noticing it was taking like 600ms per hop once I got to the UUNet network. So that is North-East there.
Unstable Apps: Our Android Apps Don't Suck
If you're not here, raise your hand! If you can't get online, send an e-mail to the network admin!
Good judgment comes from experience.
Experience comes from bad judgment.
Yeah it was a real mess here, and we're in hackensack NJ.
It's finally starting to improve here.
wondering why it took so long to see posts, and then realized, everyone must be on UUNET and can't race for f.p.
Had a major outage for most of the day here in Pittsburgh.
---- nohup: appending output to `/nev/dull'
Has been pretty spotty. Times inside of Worldcom's network have been pretty slick across the country (15ms trip time from Cleveland to most anywhere), however almost anything that goes over to a different provider seems to have some pretty horrific lag times (at least a second or two).
wasn't MCI/Worldcom/C&W involved in lawsuit a few yrs ago for similar problems, but they went on for 3 days ?.. back then they got sued for loss of business, imagine whats gonna happen now.
You would think they would have learn't. But they're still hiding information from people.. great. Maybe it's gone with the 6 billion dollars...
Hi, I'm a linux sysadmin and in my office we use Linux computers with 7 or 8 ethernet cards to route packets around the office. We have about 6 or 7 of these computers for our 14 computers in the office. This works well as Linux provides a flexible and stable solution for routing information with ipmasqing and firewall services. My company develops software under the GPL and use the Linux Business Model to make money. We use transmeta chips in all our computers as to facilitate the ease of making our office compeletely reliant on pedal-power and solar power. Also, an 802.11b wireless network connects us together.
I was affected this morning and we disabled that T1 and things seem to be settled down. Of course they are slow since we only have one provider.
Anyway here is the link on msnbc.com http://www.msnbc.com/news/816663.asp
Only 8 months left on our contract!
some packets were lost today across the world in various network transactions.
http://www.naildrivin5.com/davec
Been down since approx. 8:30 this morning in the NW. I guess someone should go wake up the network admin and tell him to reboot the router. Just be thankful it didn't happen on a friday.
Vieniel It's not a bug it's a feature and I didn't write that feature, I wrote the other one...
They're just embarassed because they can't figure out how to get CowboyNeal to get down off of their router.
-S
We Apprentice Developers and Designers
Hub: Normal
Outages: Normal
this is from their network status page, i try to abstain from being a smart-ass but outages are normal?
-tid242
With a few exceptions, secrecy is deeply incompatible with democracy and with science. --Carl Sagan
same deal here
UUNET has a big center out in ashburn va, maybe there are problems there too
Bring back the old version of slashdot.
a whole lot of red over at the InternetTrafficReport any other good informative sites?
May this post be indexed by spiders, and archived for all to see as my Internet epitaph.
I think his petswarehouse.com site's had so much traffic over the last couple of hours it's exploded and caused a huge chain reaction ;-)
Code, Hardware, stuff like that.
I work for a company in the Detroit area that is on UUNet, we've also been having slowdowns and stops all day long.
I work at a small hosting company and our UUNet connectivity (Central California via Anaheim hub) has been screwed since around 6am pacific time. Up and down all morning with latency between 500 and 2000 ms when it is up. Yay worldcom.
hi there! asl
- the entire town of Holland, MI
...seems to be fine.
Oh, come on. Laugh! You know you want to.
Here at work (not served directly by UUNet) service to various websites has been intermittently down for up to a few hours at a time.
This brings to attention.... when our backbones fail... what do we do? Whens the last time a major internet problem (other than a DoS) caused a large outage? What precautions are there to backup a backbone?
- what is the definition of simultanagnosia?! I've been meaning to look it up!
Check it out here
Must be slowing down from trying to filter all :) JK
that porn after being slapped by the Pennsylvania
State Government
WorldCom Forced To Block Questionable Sites
Im currently gathering quotes for a new leased line as part of a office move to new premises. Dont know how they got hold of our details, but i had a call from worldcom today about arranging a visit from a sales representative for a leased line quote. I wonder how they react when i ask them about this?
I have had prior dealings with Uunet as one of our customers use them, and to be honest, their support is dire. One of their DNS servers was not refreshing its cache well at all, resulting in a client not being able to access our website at random periods. Wierd error, one minute he would get "proxy errors, no website at " where ip was a old ip we no longer used, and the next, he would get us fine.
Lost about 1/3 of pipe here....
Yesterday morning, I got to work. Net was down. Phones were down. I got a message from our network support. It said that AT&T service (our bandwidth and long distance provider) was down all over the east coast. It came back about an hour later.
What the hell happened? Nothing on the news, nothing obvious on AT&T's site. You'd think that a hour long outage of an entire coast would at least hit the newswires.
www.msnbc.com/news/816663.asp
Yep I'm a karma whore...dunno why...
We are having tons of problems up here. I had to do some driving around with floppy disks to get needed files today from some of our remote people. I guess I can't complain. Got out of the office and sped around the countryside. But then again that means no DSL when I get home. Well I guess having Satelite internet at work has it's advantages
We use AOL and MSN messenger clients heavily at work. (yeah yeah, but it's what we can teach the PHB's to use) A lot of people have been having trouble signing on and/or staying connected. I know Raleigh and Austin are both having issues. (I suppose I should try to take into account where the IM servers are, but nah... )
Bellsouth DSL here in Nashville (at least in my office) has been kind of crappy.. lots of timeouts, etc. I switch over to the XO T1 and its fine.. Bellsouth has been improving throughout the day though.
18/m/atl gatech
My network failed over to my other provider. At about 11:30 EST the net started to act funkey. Since I have turned them off things are back to normal... The only thing worse then a failed T1 line, is a silently failed T1 line. What a pain.
http://www.merit.edu/mail.archives/nanog/msg040
nothing concrete and MIDS doesn't show anything on the weather reports (not that it means anything).
I am a WCom customer in NYC. We have a hub-and-spoke VPN from them, hub in NYC and spokes around the USA.
We have had problems today around the country including NYC. Most of them seem to be resulting from routing issues across their backbone.
and this is an anomoly caused by the usual "government contracts out for equipment while getting fucked in the ass"..shoddy contract shit ..
A Good Troll is better than a Bad Human.
And all this time we were blaming our upstream provider. It's real fun when some of your subnets work just fine to another IP, and others (less than a /20 away) don't go hardly anywhere. And all the ones that had trouble were going over a *.cw.net router...
How nice it would be to have to patch my routers and switches too!
The internet hasn't been working for me all day.
Have had problems all day, though it seems to be clearing up now.
Most of our issues have been problems resolving names, in fact hitting IP addresses has been possible throughout our problems.
When I called this AM I heard the automated message and left it at that. After 1pm EST, I called again, and spoke with a technician who said "the problem has been escalated from what we originally thought...our gateway routers are going down, and even after we reboot them, they go back down..." Gateway routers will put a hurtin on one's infrastructure, eh?
I've been seeing odd intermittent packet loss across sprint and worldcom all day. I started checking itr and saw 25% average packetloss across north america, with about 20% of the routers they monitor passing 0% traffic and turned on CNN... Figured something had to be happening...
01:36AM up 426 days, 2:46, 1 user, load average: 0.14, 0.11, 0.05
This morning around 10:30AM I couldn't get anywhere on the web. When I logged in again later, this was part of the daily message from my ISP:
"10/3 Issues with our backbone provider were impairing access outside the SpiritOne/Aracnet network from 10:20AM until 10:55AM this morning. The backbone connection is still down but at the moment all traffic has been diverted to our secondary backbone connection."
Webpage: WorldCom is currently experiencing an interruption of service to the website, a.k.a. Slashdotted.
The problems with WorldCom's Internet backbone today explains why on a number of sites I visit frequently things are slowing down quite a bit. No wonder banner ads are not showing correctly.
THis is gonna cut back on the pr0n leaching.
All Troll + "offtopic" mods are meta moderated as "Unfair", because you abused the system.
Digex mnages hosting for a key service my employer provides, and they're in and out intermittently.
Our VPN link keeps going up, down, down in one direction, around in circles, several times per minute.
http://www.internettrafficreport.com has some fun results for you, too.
Even Jesus hates listening to Creed.
How can the backbone be bad if you got no spine?
It's gotta be RIAA..
Internet Traffic Report has a page where you can follow traffic. Sure is a lot of red today.
Stop the brainwash
You've really done it this time /.
Who is John Galt?
That is very odd, I haven't seen any prob
We have a T1 Worldcom line here in Toronto, it's fine for the most part, but we have some servers hosted (?somewhere?) in the US with Level3, and we've had a horrible time connecting to them today. Through my home cable Internet connection, the connections to our servers are fine.
I'll have something intelligent to add one of these days...
9 p1-0.chcgil2-cr8.bbnplanet.net (4.24.9.46) 71.206 ms 74.431 ms 71.261 ms
10 p6-1.toucham2.bbnplanet.net (4.24.224.58) 82.329 ms 133.483 ms 71.456 ms
11 chi1-core-02.tamerica.net (66.62.7.2) 1397.469 ms 1374.084 ms 1261.074 ms
12 den1-core-01.tamerica.net (66.62.3.29) 1320.134 ms 1295.474 ms 1297.648 ms
I guess touch america is screwed up too.
Right now in the southern portion of the United states they've been hit by a hurricaine.
Might that be a reason for disruptions? Falling telephone poles, Floods of water, Winds taking Satellite dishes and well, Making satellites from them?
_ _ _ Go for the eyes Boo! GO FOR THE EYES!
Intermittent outages here since about 10:00am PDT. Traceroutes just stopped at the border of the UUNet/Worldcom network.
SF area to Seattle area around 5-7pm PDT. Things were generally intermittantly down, and 100-200ms slow.
We need everybody who cannot connect to Slashdot to leave a message here stating so..!
Thanks!
Since when did Slashdot become the defacto place to announce outages? Slashdot isn't NANOG, people.
Ooh, ooh, my T1's down. I better post to Slashdot!
I've been getting emails from Exodus all day reporting intermittent loss of connectivity in all Exodus IDCs due to heavy congestion at UUNET peers. I can access everything with no problem, but I'm sitting about 5 miles from the IDC, which is in Irvine CA. Just think.. somewhere out there, a group of UUNET engineers are having their asses reamed right now... i can almost feel it.. -JE
A 6? Time to potty train. Unless they are for you...
Started @ 8:30am ... seems to be better now for us.
First post! ... no wait.
Look a monkey!
Heard the LRF (Little Rubber Feet) router upgrades didn't go as planned.
i d=3944 713
Credit where credit is due:
http://slashdot.org/comments.pl?sid=36650&c
kenny
I have been seeing an enormous number of netbios (port 137) hits on my firewall over the last few days. I usually get a few here and there (in between ssh and ftp hits from Asia. . .) but it's been the majority of stuff over the past coupla days.
I am a believer of momentum and curves.
But How does this affect karma ?
I'm a droid .
I haven't been experiencing any problems here, and my father up in DC hasn't experienced any problems there. I still can't play my DAOC though. I will slashdot the day away instead... and maybe class work...
This page was generated by a Barrel of Circus Midgets, and that is the way I like it!!!
So they are having routing problems and you put a link to their web page up. Nice of you.
You'd thiink someone would make the obviious post about the use of the letter ii in the subject. II mean, iif they ediited the storiies a liittle closer, the'd not miiss such obviious spelliing errors.
Lowmag.net
I have been completely down for over 5 hours now. Things look like they are back, but this actually started as intermittent outages around 6:30am EST. There was a scheduled maintenence window this morning. I think the upgrade thoery holds quite a bit of water.
Had I been asked I would have replied, "Network problems? No sir/maam. There's just been rapid increase of online gamers since UT2K3 has been recently released. Our stuff works fine, it's Epic's fault."
What I usually do as soon as I wake up in the morning is check the ip traffic on major US backbones such as exodus. you can find plenty of open route servers in this page www.traceroute.org. And I can say that the load was unusally high this morning(sh ip ?).
worldcom wouldn't let me post! oooh, ooooh! i'm just north of chicago btw.
haiku
/haiku
Router's out? Let's see...
T1 under fresh storm surge,
ignore our admins.
This space for rent.
I've been lagging/not lagging off and on on IRC, about 83ms-100ms pings to google (slightly above normal), apparently there was a big outage or something because when I came back my BNC running on my router had disconnected. For a few minutes or so, I lagged horribly on IRC and AIM, and had no ping anywhere...
--j
about three waves. Why would a grunt,
such as Walker, know about this stuff?
Read the story here:
Walker Spills It
Does the Cheney-News Network actually believe
the U.S. proleriat would fall for this junk?
It can't be all that bad... as long as the donkey works.. mmmm donkey...
I've been in downtown Atlanta all day and have no problems at all. Well, non of the mirrors on Redhat's download site work though....
We have a branch office connected via NewSouth Communications in Atlanta. They were fine all day, then about 30 minutes ago lost their UUnet connection (but were still accessible via other networks.) It appears to have come back up as of moments ago.
The problems started at about 4:30EDT this morning in New Jersey...
use CPAN;
Cable's Black and White
routing loops and busted BGP sessions on the east coast.
My bad, I fixed the hardware problem. Everything should be working now. -- Al Gore
-- jimmycarter
Noticable slowdowns around 9am PST - which is when I rolled into the office, so could have been happening far earlier. Corporate IT sent out email around 10am saying they had confirmed that our ISP was having difficulties, but no mention of the national problems. Seems to be better now...
Mythic is taking the Dark Age of Camelot servers down until Worldcom clears the problem. Too many people going LD and spamming customer service.
There's been discussion of this on the NANOG list, and my DS3 in Chicago was taken down hard by this. Physical layer okay, but traffic died once it was two or three hops into UUnet/Worldcom's core. First outage was from 2am to 8am, second outage from approx. 10:45am (CST) to 2pm. The master tickets for this outage are 651744 (DS1 and below) and 651751 (DS3, OC3 and above). I just got off the phone with Worldcom's NOC and the story I got is that all the border routers that took a dive are back up save a few that they're bringing back up here in Chicago. Worldcom has provided confirmation that the Reason For Outage was a wildly unsuccessful BGP config propagation.
. We've got computers, we're tapping phone lines, you know that ain't allowed - Talking Heads, "Life During Wartime"
The problem is pretty clear - they are working to restore a routing anomaly rather than correcting the ones they still have. I would tell them that if they continue to restore anomalies things will only get wrose, but I can't get through to them.
I'm an American. I love this country and the freedoms that we used to have.
they upgraded some equipment, and later the new upgrades took a dump. when they fix one, another breaks.
I was going to post this story but I didn't have internet access.
You can't post to slashdot? You poor babies.
We were having all sorts of trouble this morning and throughout the day - we've got multiple UUNet circuits in Cleveland and NY, and various other sites around the country.
UUNet explained that this had something to do with the pending hurricanes and a NOC in Louisiana - apparently there is either already an issue, or they're prepping for disaster by routing traffic every which way other than through Louisiana.
We also started seeing trouble with sites on AT&T and other nets routing back to our sites.
Needless to say, it's been a wonderful day...
"The internet's slow, can't you fix it?!?"
"Well, seeing as we don't actually own or control the Internet, there's not a whole lot we can do - consider it an act of god"
"But...well, can't you just reboot it??"
*sigh*
Here is an autoupdated ping time for major US routers. Also includes a trendline graph of relative network strength. The Internet Traffic Report for North America.
And Novell's MyRealBox server is down because of this (I'm guessing).
--sig fault--
They've shut down dark age of camelot, as well. I guess eveyone is feeling the lag.
"Diffiiculties?"
Oh, man, it's affecting data transmission quality now.
-Waldo Jaquith
You want http://www1.worldcom.com/us/tools/noc/status.xml
News Performance: Normal
DNS Service: Normal
Backbone: WorldCom is currently experiencing an interruption of service in various hubs in the U.S. We are working to restore service as quickly as possible.
Dialup: Normal
Hub: Normal
Outages: Normal
One of the big problems here is that Woldcom still operates various units as separate entities, virtually no integration has been done to get UUnet working with MFS working with MCI. It's a lot of fun troubleshooting a circuit and having techs tell you "the problem is with MCI, I work for MFS." !!!!! They all work for Worldcom!
Okay, rant mode off.
. We've got computers, we're tapping phone lines, you know that ain't allowed - Talking Heads, "Life During Wartime"
We have a UUNET T1 here in NY, we have been down most of the day. Very intermittent though.
Hi, I'm not an Anonymous Coward who does work and finds the time to post to slashdot every once-in-a-while. While sometimes my posts are offtopic, or not insightful, I usually add something to a discussion. My personal computer uses quite a bit of proprietary software, with some open source software. I do prefer Mozilla as my choice of browser, and have taken quite a shine to Open Office, but I still like Windows over Linux or *BSD (I have installed both FreeBSD and suse). My home network is a cheesy 10/100 LAN setup.
There have been some outages here in PA...at least for certain sites (google, hotbot)...oh well..
...the token fell out and we haven't found it yet!
Anything routed to UUnet from Comcast (AT&T) has been picking up a 800ms lag. It has been doing this off and on for the past week or so.
"God slashdots USA"
Maybe the Redhat release is the culprit? I don't know about you, but I'm still having trouble getting it!
Redhat running the worlds webservers.
Redhat bringing the net to it's knees!
I'm in GA, and my Net access has been very bad for the past day and a half or so. Download speeds dropping well below 2Kbps, sometimes below 1 k per second. No fun!
does anyone else get the eerie feeling that this may end up being a forecast of what will happen to the net when/if UUnet as a backbone goes dark as a result of the Worldcom bankruptcy?
-Lx?
Slashdot effect reached critical mass! RUN!
Or the RIAA attempted to take down P2P networks and did so with the success similar to a Britney Spears anti-piracy campaign.
Last night (circa 9PM MDT) I could only reach sites via Level3 or ATT (via L3), according to traceroute, for about an hour or so. Nothing else got anywhere at all, so it might have been local ISP problem.
-- Alastair
So this is where online distribution is taking us...
Word has it that they lost a couple of high-profile Juniper boxes and some 8000 clients are offline.
I'm in the mid-south and I've seen spotty connection to anything outside of the mid-south. I have been able to get good service connecting to servers in Kansas City however.
my routing from COX (apt name) across uunet is fine, but when I route from a box on the sprint network it get's all hosed at the routers in NYC...possible peering issues?
I'm connected to DCA3 (or is it DCA1?), and have been having intermittent problems all day. Oddly, these problems have not affected ALL my connections, just some of them. Or it could be that it's affecting all of them, but some are more resilient than others.
For twenty minutes this morning my traffic to the east coast was being dropped at XL2.SEA.ALTER.NET
He is basically the go between for the Tech and customers...he says downtimes like this happen everyday, it's just an extremely bad day today. :-)
Derek Greene
Wednesday afternoon was really boring at work; Costa Ricas main provider also had trouble
Check out Website development, maintenance and accesibility cons
petswarehouse.com has been /.'ed. Keep up the good work!
The network outage was unrelated to WorldCom's bankruptcy, and the cause is unknown, Burns said.
I have this image that in order to save money, the are routing all of the Southeast's traffic through and AOL dialup using Windows internet sharing.
Do not taunt Happy Fun Ball(TM)
I can't even get to the Pets Warehouse site!
echo 656472616c73746f6e406d61632e636f6d0a|xxd -r -p
Redhat 8.0 ISO distributions are out there.....somewhere.....getting ftp'd.....who knows where......
No problems here in Florida. I don't see what all the fuss is about. Someone's made all this up haven't they? ;-)
KMSMA (WWBD?)
I will give you your so called "Internet" back as soon as you declare me King of the World! Pinky, gnaw on that wire some more.
But Brain, it hurts my teef.
Pinky! Destiny awaits us!
Narf!
Brain taps foot, frowns at Pinky standing alone covered in electrical char with a wire in his mouth.
intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
Following is WorldCom's maintenance announcement about today's work, which I recieved because WorldCom is my company's broadband ISP.
During the Normal operations window on Oct 3, 2002
WorldCom will be performing the following scheduled maintenance
activities.
This activity is scheduled to take place from 3:00 a.m. to 6:00 a.m.
(local hub time) in the contiguous US and elsewhere from 3:00 a.m. to
7:00 a.m. (local hub time) and may affect your connectivity. The
following
customer ID will be impacted: XXXXXXXXX.
If you have any questions, please contact our local Customer Network
Support Center. Please reference the internal ticket number 645346.
Quality System Management-Global Maintenance Planning
Worldcom (http://www.uu.net)
1(800) 900-0241 / +1(703) 886-5440
WorldCom United States 1-800-900-0241 (select the following options in
order: 2, then 4, then 1)
WorldCom Denmark (45) 80.30.50.50
WorldCom Italy (39) 02.3600.1887
WorldCom Sweden (46) 8.750.88.50
WorldCom Switzerland (41) 1.580.86.11
I don't have much to say. I see some very non-intrusive maintenance done on the switches and routers yesterday. No major internal discussions that have crossed from the networking group over into my jurisdiction, though. I noticed the company's internal VPN was a little up-and-down from 8-9am CST, but that's about it.
AC'd to protect me.
-AD
I'm in atlanta on a T1, I haven't noticed anything big. Wachovia.com wasn't coming up for a while (20 minutes) in the late AM, but besides that everything has been working fine. Maybe its because our stupid ISP routes all traffic through san francisco first or something, who knows.
They were cheaper than UUNET on a burstable T1, and I haven't had any issues today - related to UUNET. No that still sounds bad. They've been good, I don't see what the poster see's :)
:P
They've been rated #1 or #2 the past few years on Boardwatch (Savvis could own it for all I know), based on latency and ping time, IIRC.
They do multiple peering, and supposedly are dynamic, so with UUNET down, supposedly they're rerouting my traffic across another provider to reach those spots..
Of course, if a site is actually ON UUNET, there might no be any other way to get there.. get it?
"I can't give you a brain, so I'll give you a diploma" - The Great Oz (blatently stolen sig)
In the UK.
I was a fairly high-ranking technical manager with WCOM during the 1999 outage. The cause was a failed software upgrade for the WCOM Lucent switches (the Jade load, if you're keeping score). Option 1 (former Worldcom) networking was completely 86'd by the problems for about a week. CBOT (Chicago Board of Trade), for one, was furious at us, since they never got a clear idea what went wrong or how long it was going to take to fix it. (Yeah, lots of fun conference calls with the executive team that week.) The problem finally was resolved by former MCI engineers out of the Richardson office with the help of Lucent, but it was touch and go for a while.
I can't say that it's another Lucent upgrade that's causing this problem, but it's certainly a possible culprit. If WCOM's getting around to bridging Option 1 and Option 2, that could also be a factor. Whatever it is, there's precedent inside the Worldcom (not the MCI!) network for failures like this. Hopefully, this time it'll turn out to be nothing.
It's the geeks and wanabees downloading Psyche!
Actually I like the fact of such interruptions - it may convience more and more managers, architects and developers to use asyncronous transactional messaging protocols (like JMS or SOAP or even SMTP if with confirmation) vs decent client server ones (CORBA, proprietary).
Less is more !
..is it called bankruptcy?
Man is born free; and everywhere he is in chains.
Costa Rica was affected (the whole country!!!!), since we have a connection through a US provider that had problems....)
I'm at MSU.
Merit, the provider for most Michigan schools, had some major problems yesterday. This is totally unrelated to Worldcom.
On a related note, our OC12 connection to the outside world has been saturated since classes started a month ago. Damn students and their MP3s.
ÕÕ
That's my speculation to add to the rumor.
'SBEMAIL!' is better than a goat!!
for hours now here in SF. Thought it was just my employer but I feel better now.
errr....umm...*whooosh* *whoosh* Is this thing on ?
It's just all the geeks trying to download Redhat 8.0 ISO's
"Eve of Destruction", it's not just for old hippies anymore...
My colo is at JC and we took a hit yesterday. Tech support later told me UUNET had said there was a DDOS going on and it was dragging us down. I wonder if he was feeding me a line of B.S...
Pedro
----
The Insomniac Coder
I definitely noticed things were slower here than usual. I had SSH failures, and very long page loads, and intermittant downtime. But we are up and running.
...yeah, so if one of my providers goes down, so what! GBP+HSRP saves the day again!
bugger off all you technology have-nots!
As of 4:30 PM (EST), Worldcom is reporting that their network is stabilizing, and that they're continuing to monitor the situation.
The Internet Traffic Report for North America is still trending down, though...
"For every right, an equal responsibility..."
No, everything seems to be fine over here in Atlanta. I've already downloaded 600,000 feature length films today and it's not even 5:00 yet.
Anyone who's done any kind of IOS upgrading on some of the upper-end Cisco routers and Juniper routers knows that the upgraded images aren't always the most stable items around.
At one point, there was a severe outage at Genuity referred to as "Black Tuesday", when an IOS upgrade sunk a majority of the network and caused a ripple that made for a really shitty morning.
That was a few years ago, though. I can't go into the specifics of the RFO...but the failure was a very visible issue which resulted in modifications to the testing and change management processes.
Unfortunately, sometimes testing production software doesn't sufficiently break until actually put into production.
// Agent Green (Ian / IU7 / KB1JQO)
// IEEE 802.3: All 10base Are Belong To Us
Ive been having slow internet access for about 7 years here in the Midwest.
Although you have re-posted the funny part in your "correction", so I hope not. ;-)
We have a site in the Billerica MA facility, and it was intermittently unavailable for most of the morning. Seems to be better now.
" Is anyone outside of the Southeastern U.S. experiencing the effects of this outage? "
So let me get this straight: You want the users of Slashdot to report internet outages? And how are we supposed to rule out that Slashdot didn't cause them?
It's for this very reason that people should be more supportive of WorldCom's current financial situation. Some days I wish WorldCom would just shut down the IP side of things for a day, to make people realize how dependant they are on WorldCom.
outage my arse.
The government is using this as a cover to install their snooping systems.
Significant increase in demand.
Redhat 8.0 ISO's
Mandrake 9.0 ISO's
UT 2003
Things were a bit up and down for me at work after lunch but they seemed to settle down about 4ish.
It was almost as if there was some sort of downside to routing all of the outward bound network traffic though machines thousands of miles away.
Could be worse,I'm still trying to work out if it was a joke when they sent a mail around a few months ago about the local lan printers not working because of router problems in the good old us of a.
3 p4-0.bstnma1-cr5.bbnplanet.net (4.24.88.49) 0.803 ms 0.628 ms 0.982 ms
4 so-4-3-0.bstnma1-nbr2.bbnplanet.net (4.24.4.202) 0.711 ms 7.707 ms 0.730 ms
5 p9-0.nycmny1-nbr2.bbnplanet.net (4.24.6.50) 7.479 ms 6.889 ms 6.805 ms
6 p1-0.nycmny1-cr10.bbnplanet.net (4.24.8.170) 13.089 ms 6.918 ms 6.892 ms
7 a1-0.xnycmny4-uunet.bbnplanet.net (4.0.6.142) 12.375 ms 7.299 ms 7.390 ms
8 0.so-6-0-0.XL2.NYC9.ALTER.NET (152.63.18.222) 10.262 ms 7.462 ms 7.461 ms
9 0.so-4-0-0.TL2.NYC9.ALTER.NET (152.63.23.129) 11.792 ms 7.521 ms 7.391 ms
10 0.so-1-2-0.TL2.DCA6.ALTER.NET (152.63.3.194) 17.924 ms 12.677 ms 12.660 ms
I've have heard from lots of people (and myself!) from all over South-Western Ontario having difficulties reaching most websites (mostly in the US). It seems to be off and on, right now, though.
Our colocation hosting had problems, they are in Springfield, VA.
Half of the traffic (they have links to at&t and uunet) was not going through since early morning till 1:30PM approximately.
Hmm... so the internet is supposed to be able to withstand a nuclear attack? Yet some misguided admin can bring it to its knees by botching an upgrade? Interesting...
People these days can't even be bothered to have computers do basic things for them, like spellchecking.
And they'll rip your head off for suggesting otherwise.
Pretty sad, really.
Hokey statistics and ancient misconceptions are no match for a good thought in your head, kid!
Its obviously NOT a backbone problem....Redhat 8.0 just came out a few days ago...of coarse traffic is going to be nuts, and slower than hell, ITS 5 CD'S NOW!(including source, mind you)
In college, really poor, need a flatscreen.
Perhaps the folks at Worldcom wanted to show the US government that the Internet would melt without a cash bailout of their firm.
The outage hasn't stopped all the pop-up ads that normaly darken my day.
http://www.washingtonpost.com/wp-dyn/articles/A388 08-2002Oct3.html
UUnet router anomoly or FBI upgrading Carnivore?
It is actually a URI, not a URL.
There must be a lot of spammers on this backbone. By this time of day, I've normally received over 50 unsolicited commercial e-mails. Current count: 3.
No wonder I'm not seeing as much spam in my inbox right now...
Judging by ITR the big crash happened around 8 am Eastern time... maybe everybody got to work in the Boston-to-DC corridor, checked their email and said "A bugbear? That sounds cute", sending millions of emails and backdoor remote attack sessions over an internetwork that is already having trouble because of a hurricane.
Meanwhile, everyone who was on a system that doesn't use Outlook was slamming the FTP servers for RH8 or Lunar 1.
All's true that is mistrusted
Heh, and here I thought my trouble with the Internet lately was just this ^%$@* work computer.
grumble stupid Windoze mutter Excel interface curse BSOD growl tech writer grumpy imprecate need antidote snarl
I'm not a geek, I'm just a clever script.
I was wondering why it was taking so long to donwload "the Two Towers" this morning.
LongTail SSH Brute Force analysis tool is here!
im in western PA, and my internet school is having probs.. teachers keep getting disconnected, making the classes go much faster =). take a look.
I recieved the following from my ISP a few minutes ago:
Trouble Ticket #22048416
Type of Event: Outage
Affected: DED1.CLEVOH
Description: Dear Ameritech Customer,
For several hours today, UUNET, our Global Service Provider in the Ameritech region, suffered a severe routing issue, which impacted most of the Ameritech Internet Services, as well as many other providers who use UUNET as a backbone service. Losses of routes, BGP failures, routing loops, and over-utilized circuits during this time were caused by these issues within UUNET (alter.net). By working with the network engineers at UUNET, we at SBC were able to assist in providing a working resolution for this issue, and we are currently working with UUNET to try and ensure that such an issue does not occur again. As all providers' networks begin to reconverge their routing tables, customers may continue to experience mild latency over the next few hours, but this should disappear in a matter of time. We thank you for your patience and understanding in this matter and apologize for any trouble or inconvenience that this issue may have caused.
"Because I have balls like atom bombs, two of them, 100 megatons each. Nobody fucks with me."
i spent about two and a half hours trying to get somewhere in boston from overseas. from my point of view traffic stopped at an alter.net atm router in new york. somewhere around 18:30 GMT packets started getting through again and everything seemed fine, but until then i was showing the same 1.2 sec times to anything alter.net in the US.
...vividly encapsulates that post-Watergate/pre-punk/coked-up moment when you could trust no one, least of all yourself.
From an inside source (Won't mention names), it happened during the maintenance windows last night, a major router was misconfigured, and well, the meltdown happened because of that. They currently have most of their routes fixed (Atleast no PL) and are working to get it more "smoothed" out.
The page said that earlier, but when I did a reload just now, it no longer has that message - are things back to normal?
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
our DSL provider tells us our network outage (yeah, we can see their router but no further) is due to the Worldcom debacle. Possibly, though they can be a little flaky themselves sometimes.
Plus there were those pings that had thier TTL expire because they kept bouncing back and forth between two alter.net routers...a whole lotta crap going on today.
[still No Text]
Haven't noticed any congestion to _any_ us-based sites what so ever here from Sweden. *looks for a +2 informative but realizes most Americans only belives icebears live in Sweden... Or was that Canada? (Phun intended)*...
i know people who worked for Worldcom. they had been working on migrating various little databases into one central databases (this was wrt their modembanks, routers, etc). there had also been various other things going on as far as integration of the separate parts goes, people shuffling, duties transferred, etc.etc.
such integrations take a long time, particularly when you're dealing with real data that changes all the time and must be accessible all the time, and even more particularly when you lose all financial credibility and have to dump most of the people working on such integration projects and even even even more particularly when your former ceo's and financial officers skip town with most of your assets.
Having Diffiiculties? Perhaps a spell checker somewhere seized up, causing a massive burst of traffic as people rush to post about yet another slashdot spelling mistake.
A couple of years ago, MCI had a frame relay outage that went on for a couple of weeks, at least for some parts of the network. I don't remember the details of the cause, but Google or the Wayback Machine probably do. IIRC, it was some combination of software bugs, equipment capacity limitations, and flapping in response to failures, which they hadn't found in testing before trying a configuration in the real world.
The worst part of an outage like this is the users always blame you for any connectivity problems. "I can't get to the D&B website, when are you going to have it fixed?", you patiently explain the circuits to your provider are fine, your provider's circuts are fine, and the problem is either with D&B's network or their provider. "Yeah, whatever, when are you going to have it fixed?", lusers are utterly hopeless, unfortunately you have to at least humor them when they sign your paychecks.
Happy Fun Ball is for external use only.
Central New Jersey is experiencing the same issues. The local loop is fine, but as soon as you try to crawl out of Worldcom territory, the latency is ridiculous.
Categorization
Status: cust_time Type: unplanned Item: network Scope: 1site
Service Elements
Component Type: interface Component Name: xwashdc4-uunet/washdc3-cr12.oc12
Life Cycle
Problem Started: 10-03-2002 13:02:00 GMT Source: noc-bbone
Ticket Opened: 10-03-2002 13:23:17 GMT by mcook Owner: noc-bbone
Ticket Updated: 10-03-2002 14:18:30 GMT by mwest Support Area: noc-bbone
Description:
Genuity customers may be experiencing degraded service or the
inability to transverse networks when trying to reach sites on
UUNet's Network.
The servicing provider reports they are experiencing routing instability on
their network, impacting interconnecting with other providers. They are
currently working to resolve and once they have resolved routing customers
will once again be able to transverse networks as normal.
If it can go wrong it wnetscape: Segmentation Fault, Core dumped
Perhaps it is because WorldComm is bankrupt. Remember what happened when Excite@Home ran out of money? Cable modem pings went from >20ms to 600+ms.
It sucked, you never know how much you depend on the 'net till you lose it :(
Beyond the fact that people in central Massachusetts aren't real stable anyways - the Internet coverage out here was dicey from 9:00am through 3:00pm EST...
Bad enough that I had to bail from my place of power - the SysAdmin Mission Control...... well okay - it's a really small office with more monitors than deskspace....and go to my Colocation providers datacenter to get a decent connection...
Rogue(n): 1. One who is playfully mischievous;
Campus community:
Summary: Our Internet Service Provider has informed us that they are
having serious performance problems with their connection to the
Internet. The internal campus network and off campus dial-up access
should not be affected.
Details: Our Internet Service Provider, PenTeleData, maintains
connections to several Internet backbone providers, including AT&T,
Sprint, and Worldcom. Worldcom is currently having serious network
problems, due in part to the recent BugBear virus outbreak. Our
Internet Service Provider is currently attempting to route network
traffic around Worldcom.
Thank you for your patience during this outage and we regret any inconvenience it has caused.
ISR Tech Desk
x77777
techdesk@bucknell.edu
If you celebrate Xmas, befriend me (538
Every once in a whine the internet just cuts ou---
I told the NOC boys that sending those BGP tables to dev/null on the Juniper's would be a good idea since they were starting to take up too much disk space... (too many MCSE's in here anyway!) Now with a few keystrokes I will finish reclaiming their diskspace and deleting their accounts... there we go, and now I am off to "get a cup of coffee" and gather their office toys while they are being escorted out of the building. They won't interupt me from grepping emails again. In the spirit of my mentor, BOFH.
Like the subject says, I have dsl with a provider that resells the old rhythms network that wcom acquired, and I ahve been down awhile.
Where do you want to be, What are you doing to get there.
I work for this big hotel company... and all their reservation systems run on UUNet, so when it went down earlier, nobody could make hotel reservations!! (6C owns several large hotel chains like Holiday Inn, Crowne Plaza, Intercontinental, and Staybridge Suites)
Both taken from NANOG today.
For T-1 customers, the master Ticket Number is 651744
For customers with DS/OC gear, that master ticket number is 651751.
And on the funny side from nanog:
Subject: Dont you love it when FC updates are better than NOC status report?
This is an automatic email from Fuckedcompany.com. A new rumor has been submitted on October 3, 2002 9:37AM that matches your keyword "Worldcom".
Huge Worldcom Outages
WorldCom
http://www.uunet.com
UUnet is having a massive network outage. You can't even get through to tech support -- they just have a tape repeating "Worldcom is experiencing network outages in multiple locations throughout the United States". Shit, I can't route through NYC
This space intentionally left blank.
--I'm in rural north georgia, A-OK here on local telco dialup. I call it "Zeke's ISP and Hog Rendering, c'mon out back". Appears to be as slow as normal, but it's here!
my ping when playing americas army is usually 90 or so, yesterday it was average 150. I was wondering what the fuck happened.
Has anyone else been watching the "internet storm center" (isc) at incidents.org? It's been showing a massive increase in port 520 reports over in Europe, labelling them as EFS. But, oddly enough, it's only EFS traffic if those reports are for 520/tcp. If they're 520/udp, that's RIP. As in routing protocol. Am I nuts, or is this an odd coincidence?
Not to worry, it's just everyone on slashdot attempting to DL all 3 gigs of RedHat 9. Things should be back to normal in a week or so.
# Important Stuff: Please try to keep posts on topic. # Try to reply to other people comments instead of starting new threads. # Read other people's messages before posting your own to avoid simply duplicating what has already been said. # Use a clear subject that describes what your message is about. # Offtopic, Inflammatory, Inappropriate, Illegal, or Offensive comments might be moderated. (You can read everything, even moderated posts, by adjusting your threshold on the User Preferences Page)
The current status message, at approx 6:00 PM EDT is:
If you wish to speak with our network support staff, please call us at 1-800-900-0241.
Nothing about outages, but no status info either.
Isn't this a bit like "Keyboard Error: Press F1 to continue..." or even, "My e-mail is down. Really, send me an e-mail about the problem."
Perhaps we need a salshfault.org to contain this new brand of comedy.
Hammy
Maybe the hurricane last night snapped that major backbone that goes through coastal Louisiana. ;)
A client called me "Are you having problems with your systems? We can't get our email from here, but one of our sales people who uses AOL can get his email."
Pretty sad when AOL works better than a UUNet/Worldcom connection.
Oh..Us? We use Qwest. Not an outage since I put in the T1, except due to power outage city wide (ice storm this last winter/spring)
= Grow a brain...
Hey, I tried!!!
I was doing an internet-dependent demonstration over a month ago at a place that had a T1 from UUNet, and the connection was witnessing such horrendous ping times that I had to cancel the demonstration. The problem was completely UUNet's fault, and the organization still has the same problems to this day. Ping times jump from 100 ms to 4000 ms, and some packets simply do no go to their proper places (like the server I was trying to contact). The head IT guy there just kind of shrugged his shoulders and said, "It does this all the time." I was really surprised that a 'networking' company could have such a lousy connection and still do business.
Kinda puts network outages in perspective.
Best Slashdot Co
Could this explain the high number of /.'ed sites lately?
My company (in CT) uses genuity and UUNet. Genuity's routers also shit the bed today- coincidence?
They (genuity) rebooted the routers twice during the day, then claimed they would perform an IOS upgrade at 3pm with 15 minutes notification and 15 minutes of downtime. Also, they claimed because of the UUNet problems they were going to disable the genuity/uunet peering point.
Can someone please come down and fix my internet? Or is the "the server" down?
I'm going to lunch between 11:30 and 12:30, so that should be a good time for you to fix it.
Thanks!
The network engineers at Worldcom should have known better than to do an upgrade during a time of high solar activity.
What were they thinking?
Everything comes up as "Normal". There is no mention of service disruptions.
"Do I dare disturb the universe?"
While the Wired News article says that some people were speculating that it was the Slapper worm, other people were speculating that it was a fiber cut, but it first quotes the UUnet page which says they're having a routing anomaly and that it was affecting multiple gateways. That means it's not likely to be a cable cut, because that would be more localized, and it's also not likely to be the Linux worm because the routing stuff isn't happening on Linux boxes - it'd be either Cisco or Juniper, and I'm not aware of any reports that the worm affects those platforms.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
See the Day Star.. I't something new and different!
"It's not like your minds are as open as the source you love..." - Me to the majority of Slashdot.
They are working to "restore a routing anomaly"??? Is that desirable??? I would think they would want to "eliminate" or "rectify" or just plain old "remove" the "anomaly". Sheesh, they can't even logic-out an english sentence, what hope do they have??? Reminds me of the horrid lack of creative dialog in Star Trek...
I hoped on my favorite European mirrors (I'm in the US, and admit it :), in the Netherlands all day yesterday and today, and had clean, clear, full thoroughput downloading. It was wonderful. Not only was I able to get my redhat 8.0 iso's in record time (a few hours), but I also grabbed a set of Mandrake 9 since that was so quick and a few other things while the downloading remained good. It seemed strange that this mirror was not at all overloaded (like it so often is), but now I see why...I gather most people just couldn't get to things.
Anyway, the /. staff correctly typed the key for the ligature "ffi" and the spell check program (which the /. staff does use, despite what all their detractors think..), not being bright enough to recognize a ligature for what it was, stupidly inserted yet another "i" after the "ffi".
So it's not poor spelling on the part of the /. staff, but rather a crappy spell-checker.
hmm..
Probably from Micro$oft...
t_t_b
I'm on PJ's "enemies" list! Are you?
My ISP (located in Chattanooga, TN) has an OC-level link to UUNET in Atlanta, and about the same time everyone else mentioned, I started having problems. I could surf most of the net, but did have a few problems.
... but it works.
For one, my personal server is co-located at the office, which uses US LEC (which is multi-homed) for connectivity. I couldn't reach my server from my ISDN connection, but I could SSH to another shell server and then back to mine without a problem. Traceroute died somewhere in Atlanta.
I never was able to get back in, but I got my cablemodem today and it seems to be working fine. Weird part is, I'm linked to a gateway halfway across our state and it's linked to Kansas City through qwest
Yeah we were affected last night aswell, little US traffic, i.e. we could get www.microsoft.com but not www.google.com where we all actually wanted to be :(
When our ISP was affected:
Here
I supe at a virtual isp services provider, our biggest call driver for the last month had to do with worldcom/uunet pops, we have dialups all over the us having problems, so yes virginia there is equality in telco entropy.
I admin an ISP in West Palm Beach, Florida. My circuits went down for 2 hours thismorning, and about 4 hours two weeks ago. When they're not down they're definately slower than usual.
Calling BellSouth's support line resulted in them telling me I was using 217% of one of my T1's (wtf?! that's not possible!) and calling their NOC resulted in "Yes, we're experiencing difficulties with our upstream connection to UUNet."
My incoming terminal server line's also went down this month too... Thank you InterMedia.
Common sense is not so common.
apologies if this was posted earler... from:http://www.dotcomscoop.com/worldcom.html#outa ge
LATEST NEWS
Thursday October 3, 2002 @ 4:31 PM EDT
Have fun with this one:
FLASH SUMMARY
FLASH NUMBER 20021003023
ORGANIZATION UUNET
SEVERITY LEVEL CATA
CRITERIA 100,000 AOL User drop
IMPACT LOSS OF DATA AND CONNECTIVITY
NETWORK IP
SUBNETWORK UUNET CORE NETWORK
STATE VA
CITY ASHBURN
COUNTRY USA
OUTAGE START DATE 10-03-2002
OUTAGE START TIME 12:29:00 GMT
OUTAGE END DATE none
OUTAGE END TIME none GMT
DURATION
EQUIPMENT N/A
CAUSE OF OUTAGE N/A
CORRECTIVE ACTION
TICKET SOURCE REMEDY
TICKET NUMBER 60138
LEC/OCC TICKET
PVC/CKT Affected
WEBSITE oasis.wcomnet.com
COMMENTS
10-03-2002 12:52 GMT
UUNET NOC has identified a catastrophic outage. Multiple routers across the core network are unreachable. TAC and NOC engineers working to isolate the problem. Information bridge VNET # 211-5675 PIN # 236044
10-03-2002 13:29 GMT
UUNET reports 1462 dedicated customers affected. Senior TAC engineers still working to isolate/resolve the outage.
10-03-2002 14:13 GMT
UUNET NOC reports 13 routers and 240 customers are still down. NOC and TAC still working to restore those devices and customers. No firm reason for outage.
10-03-2002 14:49 GMT
UUNET NOC reports continuing to reload CISCO routers to restore line cards. Approximately 500 T1's and 100 multi-meg customers are down.
10-03-2002 15:25 GMT
UUNET NOC is continuing to troubleshoot disabled line cards. At this time there are 3 GW routers and 5 BR routers that are down. There are 332 T1 customers and 60 multi-meg customers that are affected.
AOL has reported 15,000 new user drops since the last update. CISCO and Juniper representatives are involved in the troubleshooting process.
10-03-2002 15:46 GMT
UUNET NOC reports they are continuing to work with Cisco to determine the cause of the line card outages. Dedicated customers at the T1 and Multi-Meg level continue to lose connectivity.
10-03-2002 16:08 GMT
UUNET NOC reports currently have 97 Multi-Meg and 824 T1 customers down as line cards continue to become disabled. Ashburn NOC reloading routers as necessary to restore service. 11 GW's and 9 BR's are down. Filters are in place to capture crash information in order to provide core dumps to vendor representatives to isolate reason for outage.
10-03-2002 16:54 GMT
UUNET NOC reports they continue to gather card crash information from the various filters set throughout the network. 8158 T1 customers down, 360 Multi-Meg, 14 BR's and 45 GW's are down. Current strategy is to gather more info from filters to isolate reason for outage.
10-03-2002 17:43 GMT
UUNET NOC reports they are working with the vendor on the router crash data. They are also reviewing route updates from 12:00 GMT to identify a possible bad route update that may be causing the line cards to become disabled. There are 608 Multi-meg customers, 10 BRs and 34 GWs down at this time.
10-03-2002 18:32 GMT
UUNET NOC reports the network has been stable for approximately 50 minutes. The NOC is working on restoring 11 BRs and 22 GWs. There are approximately 2800 T1 and 326 Multi-Meg customers that remain down.
Here in the Midwest (Iowa) we are being affected by this outage as well.
I was having some real issues with some instant messangers working (and no this isnt normal) when i called bellsouth's ADSL tech center they told me there was some problem cause unknown starting at approx. 8.30am EST and resolution time unknown. could this be the same thing?
If you can't see the value in jet powered ants you should turn in your nerd card. - Dunbal (464142)
does this remind anyone of the ATT switch crash from back in the late 80's early 90s(???). Where one switch failing kept passing the bad code and/or load on down the line until the whole network took a shit.
Please corraborate/deny this similarity. It was before my time.
I run a small ISP in Portland, OR who's been down for two days because my network got deleted from the RADB from which the backbone ISP builds their routing tables. It's been working fine since I started using it almost a year ago, and magically stopped working the evening of Oct 1 (first of the month, in the evening when the backbone updates their tables), so I think a policy change topside is the "routing anomaly" that has barfed up everything. At least I'm supposed to be back online later this evening...
"The football is pretty much getting fumbled," Johnson said. "We and other carriers are putting the football up in the air. It's getting caught in the other end, but the guy isn't holding on to it or is not knowing what to do with it."
So the Internet is like a football game? Well that explains it. I think I'll go over to the Budweiser site, pay 800 Flooz for a beer, and wait this problem out.
-Sy
Our great computers fill the hallowed halls
hell, a couple years ago i was working in the it dept of a moderately sized bank and there was a really bad storm that came through and knocked out most of EDS's datacenter and knocked out much of their atm card processing facilities. it was a major hassle as 1) you can't do a damn thing about it and 2) you can't explain to your customers that it isn't your fault their card isn't going through but the fault of your card processors (also one of the biggest companies on the planet, but nobody seems to know who they are). customers blaim the bank and drive off angry.
most people don't know it, but most financial instututions rely on a service like EDS's and if they are down, a key component of your business is down with it. it really isn't a laughing matter...
Large print giveth, and the small print taketh away
put together a paypal tip site and help worldcom out so they can keep the internet going. har har har.
Large print giveth, and the small print taketh away
'WorldCom is currently experiencing an interruption of service in various hubs in the U.S. We are working to restore a routing anomaly, and making necessary progress toward resolving this disruption in service.'
Maybe it's just me, but shouldn't they be trying to remove they anomoly?
Hell, I've been fighting this problem for the last 5 weeks on my KC router. Trouble is, it's intermittent as hell. By the time I get a tech on the phone, the problem is gone.
Now I know how the UFO folks feel when they try to share their experiences.
Just once, I'd like it if someone called me "Sir".
Without adding, "You're creating a scene."
Anyone who's done any kind of IOS upgrading on some of the upper-end Cisco routers and Juniper routers knows that the upgraded images aren't always the most stable items around.
So try Redback's Smartedge. It uses a separately-developed code base.
B-)
Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
Based on a preliminary investigation, WorldCom blamed the outage on problems with a "route table," or software map that directs traffic to the proper destination. The company declined to identify the route table manufacturer.
Was it from IKEA?
I just chalked up the entire week's slowdown to the release of RedHat 8.0.......and the subsequent massive downloads
From an email we received from the Genuity Customer Care Center:
"UUNET reports that this issue has been resolved and all traffic on their network is stable. The root cause of this outage has been attributed to an incorrect routing announcement, which corrupted the routing table. UUNET Engineers null routed the statement, which has resolved the issue. No further updates will follow, unless warranted."
That's what happens when you let contractors touch your routing tables! LOL
We're in St. Louis and have been sloooooow for a few days.
Well the company I work for has a location in the San fran Bay area of California and Central minnesota. We have been experiancing a few problems with the Cali area but have not noticed any performance problems with our minnesota location what so ever
ITWorld articles from last Thursday and Friday briefly spell out what happened. From what I understand, someone screwed up some routing tables and brought down part of the 'net.
You know you've been sitting in front of your Lisp machine too long
when you go out to the junk food machine and start wondering how to
make it give you the CADR of Item H so you can get that yummie
chocolate cupcake that's stuck behind the disgusting vanilla one.
- this post brought to you by the Automated Last Post Generator...