Halo 3 Causing Network Issues
Recently at my university where I'm a student and a sys admin, we have been experiencing some odd outages, in particular since the 25th of September. The outages seemed to occur between 8 PM and 12:00 AM — peak gaming hours for our dorms. It just happens that Halo 3 came out on the 25th of September. Upon further investigation we found that our network routers were shaping TCP packets, but not UDP. Once we applied UDP shaping as well, all network outages ceased. Gamers complained, but university students attempting to access network resources such as our UNIX clusters were satisfied.
I'd like to see more proof before I go and blame Halo 3 for this.
Niels
...but at least now I have the excuse that there is no FA.
It takes a man to suffer ignorance and smile
Be yourself no matter what they say
What a remarkably useless story.
FFS. PEAK.
Poorly configured firewall and packet shapers - reconfigured them and now stuff works better?
This passes for a story at slashdot now?
So, poor network design caused the network to become saturated. QoS rules were applied to UDP, as they should have been, and the problem has gone away.
Where's the story?
Adapt, adopt, or get out of the way!
Guy had a network problem. Network admins found the source of the network problem. People who caused the network problem complained, everyone else was happy. This wasn't even a technology problem, it was an oversight in the configuration of the routers/switches.
How exactly is this worthy of a front page article on slashdot?
Hey, guess what. The other day I had a process that stopped working. Thinking quickly, I figured out what was wrong and fixed it. Everyone was happy. Do I get a front page article too?
Sheesh. Congrats for doing your job, subby.
(I know this was a journal entry and subby had nothing to do with it getting greenlighted, but seriously, wtf?)
For linux tips: http://www.linuxtipsblog.com
Way to piss of gamers. Porn and gaming made the internet. Now you are sucking the very life out of it. All that will be left is eggheads like you who get off on power tripping.
You know, I don't think I have any sympathy for the upset gamers on campus networks.
Also, are you seriously trying to tell me that /. couldn't find something more interesting to post?
Yeah, I had a sig once; I got bored of it.
You insensitive bastard!
Kwisatz Haderach
Sell the spice to CHOAM
This Mahdi took Shaddam's Throne
must be...
I fail to see a story here, your network was setup wrong and is now fixed. Case closed.
Has the world finally succumb to this madness!?! When will the injustice to gamers be put to an end!?!
and wow, I am increasingly glad I've never created an account on slashdot in the last 2 years
Get a better network! Online gaming isn't that bandwidth intensive!
gosh don't you mean your gimp ass network had to throttle traffic because you're either too poor or you're too lazy to upgrade your network's 1980 infrastructure?
why stop there? make to to throttle youtube, video conferencing and other bandwidth heavy applications. hell why not just disallow everything but gopher?
Look here
Oh... Sorry... It is 2005. Errm... And is not 25th of september...
Oops! Is not SUN is The Sun
Oops! And is not US is UK
Hmm! Who cares anyway. We are on Slashdot isnt't it?
hah?
I suppose all this tells the administrators is they either a) need to upgrade their networking hardware, or b) need to get a fatter pipe to the internet.
My school just spent over $2 million on a network upgrade, and while that's all good and dandy, the network still sucks. We have a 45Mb pipe for the WHOLE school (Small school, only 2000 kids, but still... we're maxing that out 80% of every day)... And a lot of the dorm buildings only have Cat 3 ethernet cabling, and are thus limited to 10Mb/s ethernet connections (So even local connections suck)...
In any case, playing xbox live on our network is a chore to say the least... It only even connects half the time, and when it does it's NAT'd to all hell (even though every device on our network has its own external IP)... And it likes to drop out a lot too. I have a feeling everything registered as a gaming device (We use Bradford Networks' "Network Access Control") gets QOS'd down to the bottom of the pile automagically. And they shape everything that isn't port 80 too (which sucks, because normal internet traffic, which most people wouldn't even notice being a little slower, ends up using almost all of our bandwidth).
So, I guess what I'm saying is... Schools (mine in particular) need more bandwidth!
U Don't Play packets
Someone tag this kdawson... In other words, what kind of network are those people using that a game crashes it? With hubs and bridged computers...
You're degrading time-critical but relatively low-bandwidth traffic intentionally in order to improve responsiveness for some ssh connections?
Granted, Halo 3 is less important than Prof. Smith's Monte Carlo, but the fact that you have to do this at all means that you need more capacity. Plus it's damn rude to the students: "Oh, they're doing something new that we don't degrade! Ah, well, just degrade student UDP traffic too, that'll fix it!"
I'm not saying that transfer limits are a bad idea -- someone downloading 100GB/month and saturating a line needs to be told off, certainly -- but if a bunch of low-bandwidth gaming traffic from the dorms kills the network...
Don't forget that those guys in the dorms playing Halo pay lots of money to the university, which pays for the network.
If I knew what uni you were at I'd seriously consider adding my (meager) 256kbps upstream to the load by writing a script to refresh your homepage over and over.
It had a satisfying sweet smell and was flecked with little seeds from my multigrain healthy bread.
UPDATES TO FOLLOW AS EVENTS WARRANT STAY TUNED
How hard is it to run a tcpdump (or IOS's equivalent) on a core router to see what type of traffic is saturating the network? And why the fuck is there a need to post this on /. like it's a big deal?
I can't believe the number of people defending the student's desire to play Halo and clipling the network. Sure, the network might be improperly configured, but they are using someone else resource at the expense of others. Personally, I would have closed the ports used by the game.
My computer was acting a little slowly. I didn't want to figure out what exactly was causing the problem, so I rebooted it. It's back to normal speed now.
The part I don't understand is how it's a choice between real-time apps and other traffic. Somehow, on my university's network, we're able to play first-person shooters without causing any performance issues for other users or feeling more limited than if we were on a home connection. Do we have more bandwidth than the submitter's university? We've got a gigabit/s connection between buildings, and 10 megabit/s per switch port (which I despise, as it means I can't get 100 mb/s speed within the campus network, but it makes their QoS easier).
Evidently, the key to understanding recursion is to begin by understanding recursion. The rest is easy.
Wait a minute, you limited network usage for gamers in favor of academic users? Sounds like a pretty shitty school if you ask me. Everyone knows that school networks are for three things:
1) Downloading music and movies illegally.
2) Downloading pr0n.
3) Playing games, even crappy ones like Halo 3.
As you can clearly see homework and research are not on the list...
Haiku for you!
No film at 11.
Good grief! What a ridiculous article.
"I'd rather be a lightning rod than a seismometer." -Ken Kesey
I'm sot sure what's going on here - who's peeking at your gaming hours?
"Halo 3" should be arrested immediately, brought to justice and then executed. And his bastard parrents too, for naming their kid "Halo 3" in the first place, I mean come on!
wait a min..
With great power comes great electricity bills.
Way back in the day, Doom's first implementation of multiplayer used broadcast packets to communicate amongst client machines. The university I attended was, at the time, home to the world's largest unswitched Ethernet. Doom's popularity led to the swift collapse of the entire network on a regular basis, since a broadcast packet would result in a response from every other machine on the network.
id shortly thereafter patched the game not to use broadcast packets anymore. Once the cause of the network failures became apparent, playing the unpatched version of Doom became grounds for having your Intargopher turned off (we didn't call it the Intarweb back in those days, ya whippersnapper).
I don't think he was being a jerk.
Students aren't going to learn much if you provide shoddy essential services to people living on campus. They're going to want to watch TV, play games, etc.
Now, if it's possible to order 3rd party networks such as Hi-Speed Cable or DSL, there at least is an outlet. I recall on my dorm (many) years ago a difficult time getting access to 3rd party networks, hence why the university's network was used.
I'll also note that some on-campus residences are a source of income for the university (i.e. they're not run at a loss), and actually advertise access to high speed Internet as a feature to entice them to stay on campus vs. scramble to off-campus housing. Some even require at least 1-2 years of on campus stay. If I've been spending most of my high school years with high speed access and now am forced to deal with degraded service, I would not be pleased.
-Stu
it is the Covenants fault. They are trying to crash the internet ready for the next invasion.
I have excellent Karma and I am not afraid to Troll it.
My school has a game design major, that I'm a part of.
The internet in the dorms was shittacular. Horrible horrible service, and we had to pay 30$ a month for it.
And, the IT department, when called out on this bullshit, couldn't even give us a break down on how our money was being spent.
So, 3 years ago me and several friends sent an email out to everyone of importance around campus calling them out, basically saying it was bullcrap they advertise themselves as being all advanced at this university and having this gaming major, but the gaming major students can't even get online half the time in their dorms to play....games.
Within several hours, most faculty was writing back and agreeing with us. We showed up at a meeting, and the head of IT didn't have anything together at all.
Basically what happened was for a few months we could opt to be on a seperate network through the engineering department that wasn't managed by the IT department, but rather a professor in his spare time. And gasp, this network was far far superior and less buggy. It had 50% of the computers on campus on it, and 0% of the budget, yet still managed to be far more reliable.
Then, after the next quarter passed, we were allowed to get outside ISP service in the dorms. Alot of my friends get adelphia internet access. I just chose to move off campus, I was tired of dealing with it. You still had to pay the IT department for their crummy connection, on top of paying another ISP.
Really, man.
I hate to mention it but Master Chief keeps making inappropriate touching.
I think it is totally OK to be gay but I am only 9 years old. After I explained about my age, Master Chief seemed to get real excited and now I can't seem to get rid of him.
I know this is off-topic.
Little Ed
Journal written by fender177 (1125877) and posted by kdawson on Sunday September 30, @03:17PM
I don't think this article was submitted as a story by the author. It looks like fender117 just posted a little story in his slashdot story, and kdawson stumbled upon it and decided to post it to the front page for some stupid reason.
Time to fire up the ol' JabberKatz(tm) proggie.
I miss his sensational writing style. He turned mountains into mole hills, and geeks into wise sages. I kept all his articles from the old days and feed them into a special markov generator program that's available on the internet (Google for JabberKatz). The articles themselves should still be available by searching Slashdot.
Here's what it spat out today:
" As you may imagine, we catch a lot of time playing computer games on the Internet. " They had become obsessed with online killing, reported another TV reporter. They had delved into militia and hate-group websites, some papers said.
The United States has become a crusade for conformity, intimidation and exclusion.
There are thousands of working actors, but most often stories are posted from other sources or posted and readers are given links. Links are now a hallmark of the Monica Lewinsky scandal has crystallized the difference between choosing and blocking.
In my mind, both movies (and the author of God and the New York City, Chicago and LA, schoolyard massacres are unknown. Nor has one ever occurred in Canada, even though it's rarely explained and dubiously supported.
It's hard to be rational about this idiocy. " American Pie " is an proselytizing book (with a foreword by our own Robin " roblimo " Miller, Editor-In-Chief for the Open Source Software Development. "
This was pretty tough to read, not only in Disney World but in the chips and disk drives of a Silicon Graphics Irix Workstation.
Levy calls this new species, a fusion of humans and intelligent machines. This is the computer user's first bill of rights. The media have turned bland and timid. Though H.L. Mencken called them " Boobus Americanus ") who specialized in defining virtue and trying to live up to that responsibility. Mostly, people talk about memes, they are not. These reporters are never prosecuted. That's because courts have repeatedly ruled that the reporters are carrying out activities that are protected by the First Amendment end at the school door, when many kids, especially geeks, have spent much of the past year, TV stations, networks and newsmagazines sounded a steady stream of alarms about perverts, predators and porn online. Richard Nixon, Lyndon Johnson, Bill Clinton, now Gates. Napster, Linux, Gnutella, P2P, Napster -- it seems only right to honor Wells, the father of science fiction franchises. In a different sense, open source and free software movements out of a series of one-liners, set gags, set-ups and cultural in-jokes and spoofs.
Even non-net games should be banned. They are a total waste of time and resources, and only serve to rot the brains of 'players' who are being manipluated by the media giants to purchase products.
Nothing good comes out of these 'electronic video games'.
---- Booth was a patriot ----
Recently I purchased one of the limited Halo 3 packages. It looked great. But the game wouldn't start! Upon further investigation I remember I microwaved the disk for 3 minutes for no particular reason whatsoever.
I'm still pissed off though. Nowhere on the package it didn't say specifically about microwaving Halo 3.
Seriously, man.
We're having the exact same problem. Ever since the release date, the network has been ridiculously slow. Me and my roommate play a lot of Star Wars Jedi Knight: Jedi Academy which requires close to no latency to play well. We haven't been able to play because there is a half+ second delay between us and our opponents. :(
while(1) attack(People.Sandy);
Sounds like your proud of having a shitty network there... Way to go!
Fact 5. The network was not experiencing issues, it was simply inadequate. Packet shaping the UDP is only a temporary fix, network use will only grow in the future. Face it, this is the same thing as the big Telcos eliminating Net Neutrality, just on a smaller scale and with less money-grubbing.
Windows has detected an undetectable error.
i thought the point of this was that halo 3 might be using an above average level of bandwidth for a multiplayer fps-game
given the post identifies what the peak gaming times are, it's assumed that there are a lot of gamers on the network
prior to halo3 the network handled such game time traffic just fine with no slowdown on the network
but after the release of halo, the network suddenly begins to crawl
the diagnosis and response are on par
what is missing is how much they had throttled UDP traffic given that it was enough to cause gamers to complain
which would have meant it was enough that it resulted in poor / bad game performance
if it was throttled to something respectable then there's something inherently wrong with halo3
if it was throttled to something aggressive then this post is a non-issue and is flamebait
so can anyone confirm exactly how much bandwidth halo3 is sucking up?
Just another example of why dorms should be isolated from the university's network. if they need to get in, they can VPN...
Maybe I'm off my rocker, but I believe my Bittorrent client uses UDP for DHT. Perhaps the school's pipe was being saturated by torrent downloads to begin with, and Halo was merely the straw that broke the camel's back? The fact that shaping UDP fixed the bandwidth issue tells me that an online game couldn't be the cause of it unless everyone decided to skip class for a campus-wide Halo-fest.
Sounds like the old iPhone excuse: "OMG, teh networks is down, it must be new product xyz's fault, and not my network misconfigurations!!11!!"
The Right Reverend K. Reid Wightman,
It looks like the network needs for Halo 3 are more picky than every other game I've played - WoW, WC3, Halo 2 etc play just fine. Admittedly if I want to host a game in WC3 I need to open a couple ports, but at least Blizzard tells me what ports to open. It looks like Microsoft's strategy is to just throw everything under a uPNP umbrella and call it a day. If they're this lazy with something as simple as port communication, I'm not surprised that they're doing other shady things with their IP stack, causing headaches for network admins the world over.
"Duke Nukem Forever Causing Network Issues"
Now, that one is a story ...!
n/t
At our campus, we had a similar problem, however, it was more perplexing. We found traffic to increase at night, so we simply turn it off at night, and that solved our problem.
It is sad that we live in a day when instead of trying to find a solution to a problem that fixes an issue. We simply try to find limits to reshape and alter the problem, without ever trying to address it.
Just for the record, dropped (shaped) udp packets are not recovered. TCP/IP notices dropped packets, has them resent, and automatically lowers the connection's transmission rate, whereas with UDP you're just tossing EMP's into people's datastreams. UDP/IP is much more primitive, and relies on application level consistency checks, which, for the record, almost never ever ever monitor packet drops & throttle themselves down when packets start dropping. Thats why most packet filtering systems simply de-prioritize UDP and will not drop UDP.
There's no in-depth info, there's no link to an article, it's not a review, there's no real information.
Seriously, editors, what the hell.
What happens is, after several years of non-compulsory higher education (i.e. instead of bailing out at 16, they stay on till 21-22), most people end up in jobs they could have been in anyway if they'd spent those years actually working in their field. Instead of making a positive income in the intervening time (and doing that to make investments, and pay for their own place and getting an early step on the property ladder) they end up saddling themselves with thousands of GBP/USD/EUR worth of debt (and/or have their parents pick up the tab).
If you are doing a college course in computing in the UK or US (or most parts of Europe), my advice is: DON'T. Total waste of your time. Take an entry level position now, and change job after a year or two. Do that a couple of times until you feel you are moderately able in your field and earning comfortably. Don't get sucked into one job for too long if it's not what you ultimately want to do or if it doesn't pay enough.
I would note if I had gone to college instead of getting (a pretty poor paying) first job, I wouldn't have been able to buy my first place when I was 18 and I wouldn't already have been earning 30-50% above an average graduate's salary by the time I was 20-21. All in all, 10 years later as it is, I'd be much worse off.
My mother is university lecturer as it happens, and teaches medical students. Despite her being quite senior and well paid, and about to retire, I've been earning more than her since I was 20. Which is a bad indictment of the value society places on those in teaching positions and and indication of how big the deficit still is good software/systems engineers (formally qualified or not).
With regard to: The stupid part is to rely on your college education to make you an outstanding member of whatever field you are in As far as software developers go, maybe 1 in 30-50 graduates are keepers (at interview), which I'd say is about the same for non-graduates, probably slightly worse odds than it is for non-graduates. I would say this is because there are usually a number of candidates that think graduating is all that's required, and that J2EE is the be-all and end all (and that operating systems, SQL databases and LDAP directories are "stuff they don't need to worry about" - I expect that is a familiar experience for many here).
Never mind 'making people an outstanding member of their field they are in', they should be at least teaching them more than they could learn themselves down the local library in half the time. Currently, that is not happening. The GOOD graduates are the ones who've taught themselves things that are outside the curriculum (and it's that very spirit that makes them valuable throughout their careers).
Isn't the whole point of the firehose to keep garbage like this from getting posted?
/. to link to.
Or is this just the editors really reaching for a crazy anti-Microsoft rant? Maybe Vista is just so bad that people aren't even using it enough to write complaints and security screeds for
Truly, man.
Well I guess this does prove that Halo 3 has been a success at the very least!
A whole lot of people dont do anything anymore other than sit in front of a computer/console all day. Gaming and social networking is turning society into a bunch of vegetables how never leave their rooms.
Is there an article behind this? Did this sysadmin do ANYTHING to prove or find what the real issue was?
Sounds like the point is "It says Halo3 causing problems" so it must be newsworthy. If there was an article behind this explaining why this was an issue and had details such as Network graphs showing overloaded routers on the LAN or switches being overloaded or dropping UDP packets or something.. then we'd have something here.
Instead all this says is NOTHING of value.
----
Just remove the spaces and do the intelligent thing to email me.
I need more power!
Yeah so the other day, i was walking around town with my mate, and we were really thirsty.
And we walked for ages, until we met this guy, and we asked him for a drink, and he gave us a drink!
"sudo rm -rf your-face"
I had users complaining that they couldn't connect to the network. I reset the switch and it worked again. Interesting story huh?