Wikimedia Simplifies By Moving To Ubuntu
David Gerard writes "Wikimedia, the organization that runs Wikipedia and associated sites, has moved its server infrastructure entirely to Ubuntu 8.04 from a hodge-podge of Ubuntu, Red Hat, and various Fedora versions. 400 servers were involved and the project has been going on for 2 years. (There's also a small amount of OpenSolaris on the backend. All open source!)"
I did not know that ubuntu was a player in the server market.
How is this news?
Well they either should have stuck with 7.10 or waited for 8.10.
That's news...
Summation 2
In related(ly boring) news, Sun Microsystems replaced 200 old worn-out keyboards on their office workstations. Also, a handful of Microsoft employees patched their OSes, and some guy in Phoenix got a paper cut on his finger.
8.04 is a LTS release. Which is obviously the reasoning behind the version choice.
News for nerds. Check.
Stuff that matters. Well, to some, probably. Semi-check.
For such a large effort, it seems wild they had so many different distros running in their environment.
What do you guys think?
ACK
If its been going on for 2 years, it may well BE the BreezyBadger. Is Ubuntu the most reliable distribution for a high performance server farm? I;d say a stripped down and extremely customizable distribution such as Gentoo might be a more reliable way to go..
This may sound like I am trolling, but I am really trying to figure out how this is at all news worth of in any way amazing...
I can see if perhaps they went from all MS servers to Linux that would be interested, but to go from older versions of Ubuntu to a newer version just seems...obvious.
So I ask seriously, can someone explain to a slight ubuntu user like myself; whats the big deal?
Cos a general purpose distribution isn't exactly ideal for providing scalability, particularly when your machines pretty much all provide the same service.
The network is the machine.
Deleted
So it's unlikely the decisions were influenced heavily from a budgetary standpoint. If they wanted to stay with a free RHEL derivative linux that's essentially identical to the one you pay for, they'd be using CentOS.
They chose Ubuntu. Maybe they just like it better? I think you can factor cost of out the equation.
How is this news?
Well they either should have stuck with 7.10 or waited for 8.10.
That's news...
8.04 is a long-term release. In the world of servers, that counts for something. Also, there were changes from 7.10 to 8.04 that were probably things Wikimedia wanted to take advantage of.
Bearded Dragon
I love Ubuntu, I've been playing with different distros since early 2000 and when I tried Ubuntu in 2006, I got hooked. I've been using it as my OS ever since. I've switched my parents to Ubuntu because I find it easy to administer and it makes it easy for me to help them. Plus, I can SSH into their box to solve problems remotely. Bottom line, as a desktop distribution I love Ubuntu. It may not work for everyone, but for me it's a perfect fit.
But as a server distro, I'm not so sure. I'm surprised that Wikimedia didn't go with a distribution that's more established for server needs.
It's right up there at the top of the page giving the Ubuntu version as 8.04, which is called Hardy Heron, which BTW is an LTS release (Long Term Support).
8.04 is rock-solid stable and has all the stuff in it to be a lean, mean, yet well-equipped server platform right from the base install.
I've been running Hardy Heron since May 2008 without a problem, after switcing from being a long time SuSE/OpenSuSE user.
Another one has fallen for the hype about Ubuntu. You have to remember that that popular does not always equal good. But then again, what is good depends on what you see in it. Personally it only caused me headaches because it got bugs and issues that were long resolved in other distros, like utf8 support (yes, it has it now, but it did not by default in 6.x), does not want to support /boot on xfs, did not do 64-bit correctly until recently either, and to add my personal opinion, the defaults suck -- the Xresources database is practically empty, meaning Alt- does not work in xterm/mcedit, and the "less" pager does not automatically use lesspipe meaning displaying a .gz file will get me garbage whereas on fed it will autodecompress (now everything may have its place, but when was the last time you wanted to look at binary .gz output with a pager...)
homogeneousness (homogeneity?) is bad, wether its open source or not.
My finger hurts too. You know those bits of skin just above and behind your nails? Part on that the left side of my left index finger has gotten torn a little and now it's like a flap. The problem is, I don't need to alter the aerodynamics of my finger because I can't fly. It's really just painful, instead of useful, like on an aeroplane.
Actually, does anyone know how that happens?
I would definitely have stuck with an 8.04 LTS. I recently tried kubuntu 8.10, and the dual combination of the new Xorg ditching its config file (uh why?!? just to annoy the hell out of people, that's why), and KDE4 changing everything else just about drove me mad.
The KDE4 change reminded me of when Redhat dumped sawfish for that f-ing atrocity called Metacity (which in turn drove me to KDE). After the 8.10 nightmare, reinstalled 8.04, and now I'm hoping the LTS lasts long enough to make everything else settle out or go away.
They are called cuticles :-) Which is a total misnomer because there is nothing cute about them.
This was because the patch system got really stupid and eventually caused one of the load balancers to die unexpectedly so they standardised all their platforms
the cuticle doesn't properly detach itself from the nail as it grows. The nail's growth slowly tears your skin apart.
Under the influence of Post-Cyberpunk Gonzo Journalism
I'm sure Xorg and KDE4 are high on their priority list for their web servers.
You wouldn't believe how much nicer Squid and MySQL look in Compiz.
http://rocknerd.co.uk
I'm sure Xorg and KDE4 are high on their priority list for their web servers.
The point being 8.10, not being an LTS, they shoveled a whole bunch of radically new stuff in. That's always great fun on a server, yes?
This is a good day for being a penguin and even better day if your colors are orange.
If I had stocks in ubuntu, I would be doing a happy happy joy joy dance
BUT WHO WAS DOOR?
Right now where I work was running 6 different OS's. Right now all the Point-of-sale system are XP-based, the laptops are a mix of Dell's and Apple, the router/firewall runs off Gentoo, and they have a couple OpenSuSE workstations.
On the server side, the webservers were a mix of Debian, the application server and database server were both OpenSuSE. They remote monitor a number of digital signage/interactive kiosks using another Linux package (Debain-based I believe). At the end of the day each system had it's quirks based on the developer who worked on that particular project. Bottom line it was a mess.
It was time for new hardware and the shop is going to OSX for everything in house, Mac Mini's & MBP's, shifting to a customPOS system based on OpenBravoPOS running off a Mac Mini and then all our remotely hosted items are being shifted to all FreeBSD based servers managed by Pair.
End result is that my life becomes much easier and we can shift my attention towards development projects instead of maintaining the system.
"The problem with socialism is eventually you run out of other people's money" - Thatcher.
The article is very fallacious. So, they had a mess of different versions of RedHat and Fedora... they moved to Ubuntu and the problem is solved.
Er... How does this solve the problem at all? Moving to Ubuntu will magically prevent further mess of versions? Couldn't they just upgrade the older installations to newer versions? If stability and costs were problems, why didn't they consider CentOS? They would be able to retain the experience already built by using RedHat and Fedora.
This switch looks much more likely to be personal preference than any stability or cost arguments.
I'm sure Xorg and KDE4 are high on their priority list for their web servers.
The point being 8.10, not being an LTS, they shoveled a whole bunch of radically new stuff in. That's always great fun on a server, yes?
I'm sure that's really relevant to a professional business regarding their production servers, yes?
Hey, it worked for Vista.
No kidding!!! What do you say at this point?
You'd think that, but consider this:
If you install Redhat, it costs money, because they support it.
If you install CentOS, it's free, but if you need support, there is none. You can get support from third parties, but not Red Hat. To get support from RedHat, they'd need to move from CentOS to RHEL.
If you install Ubuntu, it's free. If you need commercial support, you can pay Canonical. They could, for example, pay Canonical for a year, and, if they can handle it on their own, not renew their support contract. They also can choose later to go back to them. That's a lot more freedom than Red Hat can give, and unlike CentOS, they have someone to fall back on if they need help.
but where the heck is Ubuntu?!
SMQ 90AE4B2BC4F6BEAF7340F0B40BA2DEF7340F6BC2D0392
OK, now I'm curious. The summary mentions a touch of Open Solaris, but the article doesn't. What did they decide to use it for and, more importantly, why did they make the exception?
400 servers were involved and the project has been going on for 2 years
Sounds more like Gentoo though.
Just tear it off...
;-)
Warning: Animated grossness, requires QT/QT equivalent, maybe NWS depending on your work environment, but funny as hell nonetheless. And also COMPLETELY offtopic, I'll see you all in -1, Offtopic HELL!!!
Seriously? How are you on Slashdot? You sound like the typical manager. Are you saying that there are no commercial entities which provide support for Centos for a fee? If you want to make the argument that there is no first party support, fine. But don't say that there is no support for Centos for those who want to pay.
"Thanks for all the money you paid to us. We've used it to buy off ISO among other things" -Microsoft
Your tax (deductible) dollars at work!
I wonder if they're going to take it to the next step and use a tool like cfengine or puppet to manage all of the servers in a consistent fashion. I've found that two sysadmins can effectively manage hundreds of servers using such tools, and without putting in more than a standard 40 hour work week.
According to their web site, it's only supported for five years. You must have some bizzaro-world definition of "long term."
Slashdot: Failed Car Analogies. Amateur Lawyering. Anecdote Battles.
[citation needed]
Regarding software, 5 years is a *VERY* long term.
Michael J. Ryan - tracker1.info
BIG, big fan of your work. Your edits are bar-none, the most fappable out there. When do you plan on adding more pics to your profile?
A nail clipper works better to remove the "flaps". And applying cocoa butter or shea butter to the area afterwards, as well as the area between the nail and the finger.
I'm actually pretty surprised. I know Ubuntu == Debian in a lot of aspects, but... To go to a distro that is *mainly* geared toward the desktop market (I know they have a server version, blah) for something as huge as Wikimedia, I'd think they'd rather go to Debian since it's considered more stable (although maybe more outdated as well). I have been a Debian zealot since the mid 90's and moved my DESKTOP to Ubuntu later on - but still think Debian is a best fit for servers.
Of course, there's always the whole "Ubuntu offers real support contracts" thing. That, in itself, is enough for any larger company to make the choice, right there.
It is pitch black. You are likely to be eaten by a grue.
Seriously, every "Off-topic"-modded post I've seen is only -1.
Perhaps it's for the best, as a -5 offtopc-mod would surely catch the attention of everyone. Oh look at this (_(_) (_|_) (_)_) Da Buttdance!
NO! NOOO! DON'T MOD ME -5 OFF-TOPIC!
Disclaimer: Been drinking too much Chimay tonight.
If you quote this signature there'll be 72 copies of Windows ME waiting for you in Heaven.
Yeah, much better now, that all of their servers can be taken over at once through a single exploit...
In Soviet Washington the swamp drains you.
Please, offer some suggestions for commercial support for CentOS -- because the companies that I see when I google for centos commercial support are small and extremely shady (including the overused stock photo of a smiling female support tech). I wouldn't be convinced any of those companies could manage servers for an operation as big as Wikipedia.
You have the only seniority that matters here:
12369 < 662363
Those are my principles. If you don't like them I have others. -Groucho Marx
For home computer users, yes. Not for businesses.
Slashdot: Failed Car Analogies. Amateur Lawyering. Anecdote Battles.
It is a lot longer than 1 year
Climate Progress - Hell and High Water
They did the same thing in 8.04, which is part of why it kind of sucks as a LTS release.
Climate Progress - Hell and High Water
>new Xorg ditching its config file
You can run xorg without a config file now, but you don't have to (I believe that was also true in xorg 7.3). And every version recently has been making more of the old config file redundant or unneeded. Instead it relies more on autodetection and sane defaults, which is a good thing. But you can still use the config file to override, if needed.
Climate Progress - Hell and High Water
Well it's much longer than for the regular ubuntu releases though I agree it's still not really long enough. Redhat's is a couple of years longer but then redhat is a much bigger company than canonical.
Sadly linux's fast evoloution makes it pretty expensive for a distributor to provide good support for a release for a long time.
note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
It is when a new license costs $0.00. Other than deployment costs, there's no reason not to upgrade frequently.
nice, but you forgot the big one.
"the neutrality of this article has been disputed"
https://www.gnu.org/philosophy/free-sw.html
If you install CentOS, it's free, but if you need support, there is none. You can get support from third parties, but not Red Hat. To get support from RedHat, they'd need to move from CentOS to RHEL.
Ummm... I don't think he's saying there are no commercial entities which support CentOS; he's saying that RedHat does not support it. Which is a very valid thing to point out, may I add...
Cheers
The range is -1 to +5
There is no -5 Off topic, but I've heard there is such a thing as the mythical +5 Troll
Jeez, I hate it when that happens.
Saying "I'll probably get modded down for this" in a post is the best way to get it modded up.
erm breaking wikipedia.
IranAir Flight 655 never forget!
But you can still use the config file to override, if needed.
Thanks for that info. All I remember is that when I tried it, the default xorg.conf file was nearly empty, with some ambiguous line that said "whatever you set here is ignored or set elsewhere via autodetect" (or something to that effect). On my config autodetect just doesn't cut it, and I really doubt that it would autodetect some things (such as the need to have backingstore turned on for some of my apps). I tried to find some documentation on Xorg 7.4, but I don't think the docs are updated yet (and at the same time I didn't have a previous xorg.conf to try so I didn't go down that rather obvious route).
There is always risk involved when upgrading or deploying systems. Businesses don't upgrade just for the sake of upgrading. They will weigh the risks against the benefits and proceed if there is a clear advantage to upgrading. Like the saying goes, if it ain't broke, don't fix it. The cost of licenses can be minuscule compared to deployment costs, so much so that many licenses might as well be $0.00. Deployment costs can be some of your largest costs. How many people will it take to upgrade? What is their cost per hour to the business? Multiply that by the number of people involved. Have you deployed on an identical test system and tested your software to ensure that it will continue to function as required on the new production system? Do you have test scripts so that you can validate that it performs as required? Will you have to make changes to software or hardware to accommodate the upgrade? Will you need to update your documentation? What is your contingency plan should the upgrade fail? What will be the cost to the business if the system is unavailable outside of the deployment window?
Some systems, like SAP, may take years to be deployed throughout an organization. Your favorite distro might reach the end of support before deployment even completes. For other systems, your time line for product upgrades and support may not be entirely within your control. What if your system is part of a product that needs approval from the FDA? With five years of support you may have eaten up three years of that during product development and FDA approval, leaving only two years of support for the OS on your products. That could leave you with a short product lifecycle or mean that you have to perform significant upgrades in the field.
Other operating systems, such as Solaris, Windows, AIX, and HP-UX are supported for 10 and sometimes 12 years. The only saving grace for these enterprise Linux distros is that the source is available. But when the five years are up, then what? Will you still be able to pay Red Hat or Canonical to support your end-of-life Linux distro? What if they have made a business decision not to support end-of-life distros no matter what? If they will support it, it's safe to assume that your support contract will cost more than it did during the previous five years. And if you go somewhere else and hire some linux experts to support your distro, they won't have access to the information that the distro creators have. They won't have the documentation about why certain patches were applied, or specific changes were made, or other internal decisions. You better hope that your new support company is very careful and thorough.
So then, would it have been a better investment to pay for Solaris and 10 years of support, pay for 10 years of Linux support, or pay to upgrade your systems every three to five years? I don't know. It depends on your goals. Clearly Wikipedia likes to move faster than the average business. They seem to be continually upgrading their wiki software and like staying on the leading edge. From reading about their server setup, they appear to have a lot of redundancy and can reduce their risk when upgrading. Three to five years of support for their operating systems is probably sufficient for their needs. But don't let that lull you into thinking that five years is long term.
Slashdot: Failed Car Analogies. Amateur Lawyering. Anecdote Battles.
A lot of folks seem to fail to realize that Linux has distributions. The kernel is the core of every linux system. From there, various organizations, Canonical being one of them, package the userland, a package manger, and an update service together, and call it their own. It's how Linux has worked for many years.
That being said, what you're really shopping for when seeking a Linux distribution is all the stuff around the Linux kernel. That is where Wikimedia found the benefit. Regardless the timeline, Canonical offered them a pro-bono support contract, there is evidence of long-term update availability, and an overall 'good' package set.
Also, for the record, Canonical does offer a server-edition of Ubuntu. See their website for more information.
tbh, mine never tear. They're all nice and even and smooth. Always have been. I have good cuticles ... obviously a more evolved fingernail grower :-)
- Michael T. Babcock (Yes, I blog)
For home computer users, yes. Not for businesses.
Compared to microsoft? Server 2003: EOL 2010.
Besides which, you're forgetting this is linux we're talking about. Support runs out? You can open the hood and support it yourself (or pay someone else to do so). It's not like ubuntu would turn down paid support beyond the 5 year lifecycle of an LTS release.
"I think it would be a good idea" Gandhi, on Western Civilisation
Debian GNU/Linux is the distro for real men. That's what I use for desktops and laptops (lenny/testing with a bit of sid/unstable and custom things) and servers (etch/stable with some custom things) and it works extremely well. Debian-based distros are not the real thing. Debian is the real thing and that's what real admins use. It's a shame that Wikipedia overlooked Debian. Some people may think that other distros have "predistable releases" but that's a myth, because you can always get some new stuff from the testing and unstable branches, which contrary to their name are working very well. When all other distros and all other OSes die, Debian will be alive and totally ready to run all PCs and servers with extreme stability and security. I think that they chose another distro just because they didn't researched Debian's advantages well enough. See also this interesting bit here. We, Debian people, should help them understand why Debian is the best distro out there and why it should run their servers.
though if we could do ZFS on Linux without jumping through scary hoops we'd happily to that instead!
How about test-driving the early ZFS support in FreeBSD 7? It's already there and can only get better with time and exposure, esp. from Wikipedia! Plus managing a bunch of FreeBSD ZFS hosts is (IMHO) way easier than managing OpenSolaris servers, esp. for people with a Linux admin background.
cpghost at Cordula's Web.
Are we going to finally get English Wikipedia dumps now??!
You METROSEXUALS leave our cuticules alone!!
ubuntu!=redhat
yum || apt
nothing related to WM look and feel.
is there a reasonably effective way the common person might prevent that?
Spot the professional...
I would point out that RedHat now offer seven years support on their OS, for at least RHEL5 if not RHEL4 as well.
I would also point out that *any* computer hardware that is over seven years old is on it's last legs. Many of the components within will be well beyond their design life, and the whole thing could go tits up at any moment.
Please, offer some suggestions for commercial support for CentOS -- because the companies that I see when I google for centos commercial support are small and extremely shady (including the overused stock photo of a smiling female support tech). I wouldn't be convinced any of those companies could manage servers for an operation as big as Wikipedia.
As has already been pointed out by others, the bulk of your machines run CentOS, then you buy a minimal amount of RHEL licenses.
That wasn't hard, now was it?
Believe it or not, there actually are a lot of organizations that do just that, so quit being a hardheaded twit calling people who don't agree with you names while you demonstrate your ignorance: support companies don't "manage servers".
I have several systems like that too, for instance if i connect a computer to my TV it thinks it can only do 1080i, but you can force it to do 1080p with the xorg.conf file, i cant get windows or osx to do 1080p on that screen.
http://spamdecoy.net - free throwaway anonymous email - avoid spam!
Enterprise-class server hardware tends to be built to last longer, and is maintained and monitored constantly to ensure it's still working within acceptable bounds. And if it's not, it can be field serviced for much less than the cost of upgrading a distro version.
Sam ty sig.
1. gentlemen will want to keep their nails trimmed short, approx. 1/8th - 1/16th of inch below the tip of the finger.
2. ladies will generally not need this howto and will not be addressed specifically.
3. file the sharp corners on your nails to a smooth edge.
4. use the edge of the nail file to press the cuticle away from the tip of your finger
5. if the cuticle will not separate. File the cuticle down to the surface of the nail.
6. If you still have problems with torn cuticles you may want to try using moisturizer. this will help to elasticize the cuticle, making it more likely to stretch and less likely to tear.
If all else fails you can a)get a girlfriend to take care of your nails (she will also likely want to pluck your eyebrows) b) ask your mom (awkward, might hurt her feelings that you don't already know also) c) get a pedicure and pay close attention, ask questions, treat it like going to the dentist.
Under the influence of Post-Cyberpunk Gonzo Journalism
Most businesses go bankrupt in 3 years time, so...