Slashdot Mirror
Data Center Move Goes Awry for TypePad
miller60 writes "Problems during a switchover between data centers have slowed TypePad, the popular blog hosting service. Typepad maxed out its data center space and all available power at Internap, and is in the process of moving to a new data center. The transition has not gone smoothly, causing the Typepad service to slow to a crawl amid very public complaints by its blogger customers. TypePad operator Six Apart promises things will improve soon."
I'm sure our linking to them will help immensely with the slowness!
Let's help their site get back to speed by posting a link on slashdot...
But that's why we love bloggers! We wouldn't expect any less.
1. Hear about ailing server /., including a link to the site.
2. Post story about said ailing server on
3. ???
4. Whatever you're expecting here, it ain't profit.
09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0 Whoops, silly middle mouse button...
At least myspace and livejournal aren't down, I'd hate to see the damage the roving bands of displaced angstbombs and emo kids could inflict upon the internet.
1. mysqldump -uroot -pPINHEAD TYPEPAD001 > TYPEPAD.SQL
2. zip TYPEPAD20051026.zip TYPEPAD.SQL
3. sz TYPEPAD20051026.zip
when they ban enctryption only criminals wi$21*J *#JF$%!@#$':
I wondered why I wasn't able to read WWdN:iX today...
And here Wil had been considering moving to TypePad for his next site upgrade....
Support FSF: Stop thinking with your wallet, and think with your imagination. (cc/non-commercial)
3: Mushroom cloud!
...causing the Typepad service to slow to a crawl amid very public complaints by its blogger customers.
Or so we assume. Of course, we can't actually access the blogs to double check, but it's a safe bet.
Maybe they need to change their name to "StickyPad".
In the dot bomb era, I was working at a very large porn site. We moved our site twice to escape bills. This is essentially how it goes down:
1. Get all your DNS updates ready.
2. Shut everything down all at once at your low peak use time.
3. Submit your DNS changes (or move your own dns servers in advance to new location).
4. As fast as you can pile servers, routers, firewalls, switches, etc into vans, trucks, etc.
5. Drive at 80 miles an hour to new data center hoping to fuck that pot hole you just hit didn't fuckup some scsi drives.
6. As fast as you can unload all servers and re-set up your system.
7. Spend about 24-48 hours fixing shit.
8. Get drunk.
I'm not kidding. I did this twice with more than 100 servers.
nobody was reading your stupid blog anyways?
"Typepad maxed out its data center space and all available power at Internap..." Am I the only one that finds the name Internap a little ironic here?
My humor is probably your flamebait
Hey, if it happens, we'll have to post a link about the Akamai outage and see if it happens again.
RichM
Data Center Knowledge
If Typepad was utilizing Sun's $1 per gigabyte and per hour of processing time then such slowdowns wouldnt be a problem...
"But that's why we love bloggers! We wouldn't expect any less."
As opposed to the silence you hear when Slashdot hiccups.
Before we committed our 3 racks of servers to a data center, one of our primary research factors was the availability of growth capacity for our data center.
To that end, we chose to host our servers in an Emeryville data center rather than the same provider's Sacramento data center.
They were able to contractually guarantee 5 more racks, and 100 more amps of power, giving us the room to grow.
You can buy cheap, but it ends up biting you in the butt. Make sure that you look at your long-term goals when deciding where to set up shop.
The least intrusive way to move data centers is by using remote hot backups. That costs. A lot.
The second best option is to estimate your downtime, double it, and raise it to the next unit of measurement. If you think it will take 2 days to move if everything goes according to plan, tell your customers it will take up to 4 weeks to iron out all the kinks.
Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
How do bloggers complain when they can't blog? Are they smart enough to handle email?
Internap is by far one of the best hosts out there, and I believe they are expanding their facilities to keep up with demand. Instead of jumping ship, Typepad should have waited for Internap's capability to provide more space/power... If they could not wait, then they should have brought up a few boxes at temporary locations until they could move them back to Internap. Anyone with experience with Internap already knows that they are probably the best of the best...
Kyler
I host my own blog using WordPress on my own domain. No problems with getting slashdotted as it is only linked from a quite obscure site.
.txt file using Notepad on my standalone laptop.
Come to think of it, I might was well blog to a
TypePad operator Six Apart promises things will improve soon.
I don't want to sound like a troll post. Sadly, there may be no other way to actually make sense with my question. We're talking about the same Six Apart that consistently gets in the way of free speech, suspends accounts, paid or not, for the absolute most whimsical reason, and the very same Six apart that will delete your community if it doesn't serve their consumerist policy? (like my LJ community DIERIAA {legal links to music offered freely for public download on the net by the record labels/copyright owners themselves} was terminated for no reason, never even had it's first post made, it just got wiped out, just for it's name.)
We're talking about THAT Six Apart, right? The one that doesn't give half a shit about you, as long as they can steal your money Six Apart? Thank the deities that I never paid for one of their accounts. I've said worse on my webpages and not once has the Secret Service complained, not until Six Apart took over LiveJournal, that is.
I apologize for this seeming like a troll post. I've had my own horrible experiences with LJ/SA, and for once, I had a chance to vent out my frustrations, and let it be known what I see LJ/SA to be. This is a personal opinion, so if you are in possession of better experiences, let them be known and put me into my place, please. But I still wish to know.. Improve? What are they going to improve upon, their volunteer idiots to ban and suspend journals or communities without even following their own set policies? Surely you're joking.
Still waiting on Serviscope_minor to wake up to fucking reality and realize that Jessica Price isn't going to fuck him.
Is it just me, or does "TypePad" sound like a feminine hygiene product?
Good thing The Speaker of the House didnt use TypePad!
There is truth in humor.
Don't forget that movabletype/typepad is powered almost completely by Perl which from my experience with movabletype has massive CPU loads during blog recompiling. It might not just be a bandwidth issue.
Is this still Slashdot or some lame promotional board? Who the fuck cares what caused problems for some unknown random server? Problems with hosting happen everyday. How much did they bribe you, CowboyNeal, to post this article?
I just had a one-time client do this. Called me up one day this summer, asking if I could help them move their data centre that very evening. "Sure," I said, "if you pay me cash up front", and they did, not even negotiating my obvious overcharging.
Legitimate data centres around Europe don't let anyone take out machines until everyone agrees all bills have been paid. It limits the damage from pr0n websites pulling this stunt. The courts had seized all their bank accounts and given the money over to the data centre, the ISPs, and all the rest of their creditors. They actually had quite a large stash of money, but the boss was a big time cheat who just didn't like paying bills. Once their bills had been paid, they were told they had 24 hours to clear out their operation.
It was a disaster, of course. Their DNS $TTL was a week, they had all kinds of affiliate programs who broke for a while. The new data centre was an old office building in a dodgy office park, so it didn't yet have the cooling for 3000 servers or a redundant electricity supply. There was a single fibre connection passing nearby, and I had to find 200 metres of monomode to get fused and in operation in a matter of hours. While I set up their new data centre routers and switches, they hired a bunch of students to load up a couple of moving vans starting at midnight. Piles and piles of cheap, crappy DIY servers, and two huge cardboard boxes of cables. Then they drove 230 Kms, arriving at 7:00 AM, and started setting things back up. By noon, they had only 150 servers back up and running.
I think they had over 50% machine failure and it took them 2 or 3 days just to install the 2500+ machines in the new area. They did lose most of their customers, but wrote it off as normal churn in the pr0n hosting biz.
the AC
Hemos is like...sci-fi fans;he thinks technology is cool, but he hasn't bothered to understand the science it's based on
Scott Adams uses them for his new blog...
It only scares me because we're moving our data center and 30 users. Of course we've taken the time to plan and map contingency but I've still got this creepy feeling.
And we all know what happens when you piss off the blogosphere.
sulli
RTFJ.
The Slashdot effect might take down small personal servers on shared hosting (e.g. where there's 10,000 websites on one machine running at capacity), but it barely touches major websites. e.g. the current stats are that a Slashdot hit increases the visitor count temporarily by 18-20% on some major sites.
Whooopie.
It this case the problem is a lack of capacity (even though the link is directed at the problem), but I doubt Slashdot's herding compares with the continual massive herding in the blog sphere.
Most porn sites are hosted by big porn-friendly (and porn-specific) hosting companies. They tend to offer package deals -- server space, all the scripts required to accept payment and handle accounts, and sometimes even porn to sell. (Ever wonder why a lot of sites have the same pictures? That's why.)
It's because most hosting companies have some restrictions on "naughty" content in their TOS; or they did, last time I was in the market. So if your business depends on hosting porn, you really want a host who is totally ok with it. (I went with Dreamhost for my vaguely naughty site. It seems to be a good choice.)
So it's possible that the GP was talking about a master porn site, with a whole lot of other sites hosted. It's also possible that it was just a decent sized independent site. I'd imagine that serving large hi-rez pictures and movies isn't something you can do with just a handful of servers for any sort of reasonable customer-base.
- "I'll probably get modded down for this."
Maybe people should get a real webhosting account and stop bitching.
My Blog