Slashdot Mirror
How Do Businesses Scale Their Bandwidth Needs?
onebadmutha asks: "I'm technology admin for a very rapidly growing company. We've gone from a fractional T-1, to supplementing that with a snappy DSL line, and now we're running out of reasonable options. I've looked at routers that load-balance, but do so horribly. I've considered splitting up my network users to use several incoming DSL lines, only to be confronted with intranet accessibility issues. None of these provide the kind of redundancy and control that I'd like, and certainly not with a nice pleasant UI that doesn't cause me great grief. I've looked at Open Source router distros (like routerOS, and others) and I've looked at using the full gamut of Microsoft madness. How do other businesses solve this problem of scaling bandwidth needs, without completely unlimited budgets for redundant OC-48 runs?"
I'm not sure if you are in an area where you can get Speakeasy service, but htey allow you to bond up to four T1 lines. I have no experience with the service, but I understand that it is cheaper than a fractional T3 and they provide you with hardware that does it for you transparently. I don't know if there are other service providers that have something similar, but it seems like a good idea.
That's how real tech companies do it. If you can get Yipes, Cogent, AboveNet, or some other dark fiber provider to serve you Ethernet service, that's the cheapest way to get a lot of bandwidth (10-100Mb/s range). If you can't, then you get a fractional DS3. Most real providers will let you dial the bandwidth up and down reasonably, so you could start out with a 5-10Mb/s circuit and grow from there.
Bonding T1s and DSL is neat and all, but if your business actually depends on the Internet working, go with one really good fat pipe and then maybe a thin one (T1 or so) as a backup. Don't mess with complex setups. Complex = new ways to fail.
Well, at my company, we were recently faced with the same dillema.
;)
There are a couple of options available, though. Although my organization appears to be a bit larger than yours, we've decided to utilize a spare T1 that simply sits there for disaster recovery purposes with Policy Based Routing (We're an all Cisco network, although this can be done on a variety of platforms, including Linux..) This directs traffic from a certain IP (and possibly port, I believe) to a specific interface, so that important data (Citrix, etc) has access to our main pipes while web traffic gets the shaft, so to speak. It uses policy maps to do so; I'm relatively noobish to IOS so maybe someone else can shed some light on this.
I'm hopefully certain you have explored QoS and are currently implementing it, but even QoS has limits.
I'm pretty sure a combination of the 2 methods listed above should take care of you. As a network admin, I could care less if web traffic gets dropped on a cheap DSL or cable connection.
Just my 2c, hope it helps
Then, ask yourself what kind of traffic you are handling. If you're looking at users surfing the web, you probably needn't be overly concerned with load balancing; if you're receiving tons of inbound traffic to your servers, on the other hand, not only do you need load balancing, but you probably also need to seriously consider co-location solutions for your servers.
The adminstrative traffic is typically a much lower priority in most companies. I don't know how many users you're talking about, or what they're doing, but most small companies just live with a single (full) T1 until they absolutely need to bond another T1 (where "need" is subject, but should be kept in check, especially given that last bit about not having unlimited funding).
I guess this is not much of an answer, but these are all important questions you need to be asking yourself well before seeking specific answers. I'm not sure where you're coming from, and I don't mean to accuse you of anything, but taking the approach that you'll know the right answer when you see it is usually flawed from the start.
Slow down there, chief. Exactly what kind of company would be going from fractional T-1, to DSL, to... an OC-48? (I sssume you were exaggerating on the OC-48)
Couple questions:
1) How many employees are we talking about here?
2) What are they doing on the internet that is so demanding?
3) Are you running any web/streaming servers onsite?
4) Have you gone to any lengths to diagnose exactly what your bottleneck might be?
5) Are you sure you don't just have a couple of hogs downloading porn all day?
I know 200+ employee companies that get by with a single T-1 just fine. I'm a little suspicious of your bandwidth needs.
But if you really meed that much bandwidth for web browsing (I doubt you do), the next step would be a DS-3 circuit at about 45Mbit. But that can be pretty costly for the circuit alone. It would, however, allow you to scale because you'd probably be paying for the bandwidth used and not the full 45Mbit. If you are in a building with other companies who have similar needs, you may be able to split the cost of the circuit and share it.
Also, depending on your location, you may be able to setup a wireless (not WiFi) deal with someone. Something with real gear, of course. Not just a couple Linksys' with Pringle can antennaes.
-matthew
"THERE IS NO JUSTICE, THERE IS ONLY ME." -Death
In all honesty, after looking over the intouchtechnical.com site, I'm going to go out on a limb here and tell you that you need to find which of your techs is running bittorrent all the time and either teach him how to set upload and download limits or cut him off entirely. As others have said, your posting is all over the map. You openly dismiss more than a few technologies that work quite well in competent hands. You mention fractional T1s, DSL, and OC48 as if you don't even know what they are. It really sounds like you aren't qualified to be the technology admin for a company whose business revolves around providing tech support to other businesses. Hate to say it, but that's what I see from where I'm sitting.
Be a real patriot: Question authority. Think for yourself. Formulate your own conclusions.
Have you tried dialing zero and asking for one of these technicians?
-Peter
Looks like the good folks over at In-Touch Technical *really* need to update their computers page
They would have uploaded a new page, but they're having some trouble with their internet connection...
It's tragic. Laugh.
The users hated me because they couldn't stream music to their desks. I would always bring them a Best Buy ad turned to the page with portable radios, CD players, and MP3 players.
First thing to do is get a hold of your firewall. Block all traffic, in and out. Then create rules to only let in and out specific traffic types with specific end points. Outbound http should only go through your web server. SMTP through your mail server. Don't let ssh out at all unless you must, and even then see if you can determine specific hosts to permit it to and from. Rate limit ssh to make it usable for remote shell access but painful for port forwarding other application types (forwarding http through ssh is an old trick to get around the company logging your web surfing activity).
Notice I mentioned a squid server. Yes, you need one of those. And yes, you need to force everyone to use it. There is a very good chance your router can do this for you transparently.
Users will scream. Loudly. Prepare yourself and your management for this. Anyone who thinks they are being treated unfairly needs to submit IN WRITING a business justification for the traffic they want you to permit, which must be approved jointly by IT and HR.
With an arrangement like this, I was able to keep over 500 users happy on a pair of bonded T1 lines. 3Mbps for 500+ users. The biggest consumer of bandwidth was the 5 person IT department pulling patches for all the different OS's we had to support. Every now and then one of the software developers would think he was being clever and find a way around the outbound blocks on the firewall using an exception in the rules that their manager got approved, but it would end quickly with a very embarassing personal visit from our Director and their own boss within a few minutes of the music streaming starting.
Broadband to the home has been a mixed blessing. People have gotten too used to having bandwidth-hungry apps at home which is fine when you have 3Mbps+ all to yourself but when you are at work and have to share it, it's time to leave the toys at home and be a considerate network citizen.
Luckily I don't have to be network cop these days. Someone else gets to do that. Someone that doesn't have a good handle on their network so they are buying way more bandwidth than they really need.
>fascist?
Lay off the bong hits kid. Grownups understand that they aren't supposed to be torrenting all day on the boss's network connection. Anyone who quits because they won't be allowed to torrent porn all day does the boss a favor.