Slashdot Mirror
Monster Bandwidth for a Month?
ourcoolroom asks: "I work for a small regional ISP and we are facing a problem which I'm sure anyone who has tried to read a slashdotted article is well aware of. There are times when a large amount of bandwidth is needed for a short period of time. In our case, a few years ago we had a little 250kB Shockwave Christmas card developed. Any suggestions for hosting something that needs a pile of bandwidth for only 4 weeks or so a year would be appreciated."
"We weren't particularly impressed with the results so we didn't distribute it, but we did have it on a sub-domain of our website. It sat around for a year or so, and then about the first week of December all of our data circuits were buried. Apparently a link to the card had started to make its way around in an email. We were able to find a place to host the Shockwave file last year, and towards Christmas transferred around 230GB a day just of the Shockwave file. We don't really stand to make any profit so we can't put a huge bankroll on this project, but we would like to have it up for holiday goodwill (that and it's really cool for a company our size to have a page with over 1,000,000 hits/day). We have thought about distributed downloading via BitTorrent, etc, but we feel many of the people who would view the card would not be that savvy."
Just Coral Cache it.
which offer unlimited traffic for only about $20/month. Pick one of them.
Specifically, their EdgeSuite.
From what I remember, you only pay for what bandwidth is consumed and since most folks will consider your e-card spam, that won't be many. The cost was fairly reasonable as well.
Mind the gap...
Pass out CDs.
*runs away*
Is it true that more people vote for the winner of American Idol, than vote for the president? -Ali G.
Link? :)
-
As you are a small ISP, have you thought of restricting access to the shockwave/flash file to your customers only (by IP address range)?
This can be done programmatically at the ASP/PHP/etc level, or by configuring the virtual directory on the webserver.
I'm all for spreading Christmas cheer (and my love to the ladies but that's off topic), but your business shouldn't suffer economically, and the bandwidth used should not interfere with the service you are providing to your customers. Restricting content based upon the visitors IP address should help.
Just an idea, from cloudy Melbourne.
http://www.akamai.com/en/html/about/overview.html/
Akamai is the global leader in distributed computing solutions and services, helping organizations grow their online businesses without growing their IT infrastructures. The company created the world's largest and most widely used on-demand distributed computing platform, with more than 14,000 servers in 1,100 networks in 65+ countries.
Now is the time to show how little I know from working with a company that housed servers for Akamai.
Akamai is basically a huge cache system. Many of the internet favorites that people hit on a regular basis are Akamai customers. Apple, BMW, FedEx, etc. They are all companies that know they have a pretty big userbase and need to be able to give those customers a good chunk of bandwidth. However it is impossible and impractical to install the needed bandwidth for one site .... say IBM.
Now, I know you say "But IBM is this huge goliath of a company that has customers worldwide." That doesn't mean it is cost effective for them to install 14,000 OC-128's to handle all the traffic. Akamai provides a way of distributing your information in a way that allows people to pull that information from a site that is technologically near to them.
Let's not go into how a certain cable company goes to *New York* before passing any traffic to *California* So I did not mean geographically near.
Anyway .... I know nothing about their rates or services or even if they are cheaper than running 14,000 OC-128's to your office. I like to exaggerate and embellish, ok. I'd hate to see the SONET gear needed to switch 14,000 circuits. But they would be a good bet for you. Because your customer would hit your site. Click the link for whatever 4 Meg, etc app you need them to run, the link would find the closest Akamai center and bam .... they'd probably be downloading it from Japan when they are in Wyoming .... but hey, what are you going to do with technology, right?
Just my three cents.
"Genius may shine aloof and alone, like a star, but goodness is social, and it takes two men and God to make a Brother."
If its not mission critical, I would go with Server Beach - for about 100 dollars you get 2000 GB of bandwidth! there is no contract, and server set up only takes a day in most cases. I went with them for a 3 month short term project where we used the server for DNS purposes. Customer service was EXCELLENT.
Good luck!
Since yours is static, maybe you could talk to the MirrorDot folks and see if they would host it.
P.S. I just turned on the environmental senors for the christmas webcam, so stop by if you want a real-time look at Colorado weather.
Hulk SMASH Celiac Disease
no, don't talk to mirrordot. their uplink is also my uplink =)
vodka, straight up, thank you!
There are many things you can do, some which will help lower bandwidth and requests, others will simply cost money to implement.
First, put a meta cache tag in the web page, and make sure your webserver responds properly to "Has this page changed" requests. A lot of downloads are simply going to be people playing it over and over again - by going to your web page. Let the proxies and caches do their job by making sure they know your page isn't changing for a month.
Second, lower the bandwidth. The music is one obvious spot - select a lower quality encoding. Simplify the flash as much as possible. You may not be able to do much, but if you completely re-think it you will be surprised how small a high quality flash can be.
Develop the website properly. Put in a message that says "Please wait while loading..." since many web users will impatiently click on the url over and over if they don't see the flash immediately, causing extra stress and bandwidth on the server. In the extreme, consider limiting downloads and queuing visitors. "Your card will show in 25 seconds, please wait."
Also be aware of content thieves. Make sure your server is configured to upload the content only to users who have specifically requested your webpage (not just the file on the page). If you look through the server logs of old you may find a lot of referrer tags coming from sites that embedded your url on their page and got revenue on your work, without paying for the bandwidth, nevermind obeying copyright laws.
Third, you need at minimum a bandwidth of 25Mb/s (assuming you meant 230Gbytes, and not 230Gbits). The real minimum is actually closer to twice that since the bursty traffic will be at least twice the average traffic. This means you need to host a dedicated server with someone who has a T3 or greater dedicated to your use. This is big bucks. You may find that it will be cheaper working with a content distribution service such as Akamai.
Lastly, while notriety is nice, and it's fun to see everyone looking at you, make sure you are weighing all the costs - including your sanity - against the percieved benefit. For this type of thing, if you aren't making money then it usually isn't worth it.
-Adam
We've slashdotted akamai!
Try any P2P system, plus bittorrent. Host it up on edonkey, DC++ kazaa etc, and hand them a link or unique name.
Many home computers have at least one of the P2P app installed. I get invited to many friends' girlfriends houses to install 'something to get music', so you can be sure it'll get delivered.
"Give orange me give eat orange me eat orange give me eat orange give me you." -Nim Chimpsky
You can configure your apache webservers to only allow each connection a limited amount of bandwidth depending on which IP the connection is coming from. It can be setup to allow more bandwidth for your customers or less from connections outside your network. This can be configured for the entire site or just for the file that is getting hit hard.
This is a simple and inexpensive solution.
~.Evanrude
- Freecache
- MirrorDot is for web pages mentioned in Slashdot articles only.
Good luck!and towards Christmas transferred around 230GB a day
Spam or not, that would indeed seem like a sizeable amount of bandwidth.
Your best friend Mr Google has many high bandwidth cheap short term hosts conviently listed under the search term Bullet Proof Hosting . Compared to what you normally pay for bandwidth these guys can hook you up good.
SD
âoeWho knew something as harmless as willful ignorance could end up having real consequences?â
You could take a look at SAVVIS Communications
they purchased Cable & Wireless USA who in turn had purchased Digital Island a few years ago.
They have a similar Content Delivery Network to Akamai but they are much more sensible price-wise.
and they are reliable (they do most of Microsoft's traffic)
email: sales@savvis.net
P.S. "NO - I'm not an employee).
Slashdot is the ant crawling up the elephants leg with lust in mind. Did I hurt you darling?
None of them can see the clouds; The polished wings don't care.
../let's you get 2TB of data transfer for less than $150/mo. Get two of those servers for two months and you're talking less than $1G.
Set the embed tag on your page to a colocated/shared server at a big ISP.
For instance, I use 1&1. They have a package that's $20/mo for 100GB of transfer, plus $1/GB of traffic after that. You can set a cap on $/mo you want to spend right on the control panel.
For your quarter-meg Christmas card, that's like 200 views per Cent you spend for the first 400000 views and 40 views per cent after that. That's pretty damn cheap advertising.
My God, it's Full of Source!
OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
How about scaling to multiple systems? Sign up for inexpensive hosting plans from a variety of vendors.
-If it is a media file for download
>use a simple cgi/php/asp/j2ee/jsp/whatever to rotate users to each of the sites round-robin style. I'm sure there's pre-made ones on the net or on freshmeat
-If it is text/images
>host the primary HTML on the main site and reference the images or accessory HTML/CSS on the other sites
-If content is dynamicly generated
> that's another discussion entirely
I mean, people shouldn't need to to download the file from *you*. Even if you wanted to advertise or something, just put the advertisement in the media file instead of on the page hosting it.