Slashdot Mirror
Google Two Years Into Overhaul of the Google File System
El Reg writes "As its ten-year-old file system — GFS — struggles to keep up with Gmail, YouTube, and other apps it was never designed to support, Google is brewing a replacement. According to the company, it's two years into a GFS sequel designed specifically for customer-facing apps that require ultra low latency."
Google File System.
Well I'm no expert on Google's internal workings, but are any of these protocols or file systems they've developed been released outside of Google for public use?
Local music(to upstate NY). http://gnarfel.com/ radio.
It's GoogleFS.
GFS refers to the Global File System, which is commonly used in Linux clustering environments.
By comparison, GoogleFS came second, is basically a no-name filesystem unknown to most of the IT world, because it's not available for use, hasn't been released as a product, compared to the well-established global filesystem.
It would certainly seem like the Global File system would have priority claim over the name GFS...
So let's stop calling Google's filesystem, which we'll probably never get to use GFS :)
but God help us all if they ever do turn evil.
In the article, it's stated that the load on the google file system has grown orders of magnitude greater than it was ever intended to handle. And one of the algorithm changes is that the chunks in the new file system are 1 megabyte in size rather than 64 megabytes. This is to reduce latency, which makes logical sense...but dividing a gigantic database into pieces that are 64 time smaller doesn't make intuitive sense...
Whats up with you trolls! You guys on a union break or what!!
Laters Sol "Have you found the secrets of the universe? Asked Zebade "I'm sure I left them here somewhere"
Seriously folks, is there no already existing file system that can already meet these needs? If not, then what are Google's competitors using?
Is that no one else has yet to face up to this issues properly and this is a huge competitive advantage for Google, or is it simply NIH?
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
You need to change your terminology, because if you are saying that developers are not part of Information Technology, you are full of shit.
I'm impressed that all of these Reddit users had the attention span to stay long enough to get mod points. But nobody likes a guest who overstays their welcome. Besides, I think somebody posted an animated gif of an old man falling down or something. GO CHECK IT OUT!!!1!1one
Let me put it this way:
Poorly run companies have HMOs and patients.
Less poorly run companies have HMOs, doctors and patients.
Well run companies hide the fact that there are HMOs.
You need to change your terminology, because if you are saying that developers are not part of Information Technology, you are full of shit.
Oh dear dear dear. I may be uh, compostally privileged, but I am pretty much across the industry. I even started a bit of it (not hard when you enter the industry in 1969). "IT" or "ICT" is commonly used to denote network, server and desktop infrastructure these days. Development, that is COTS package development or bespoke customisation is usually abstracted and referred to as -- well, "Development".
I asked my daughter once what genus Dragons were most closely related to - were they a type of bird? "No, silly daddy! Dragons are Dragon-type".
So I'd classify Developers as Developer-type, and leave the term IT to the wire-pullers and server-pluggers.
Do not mock my vision of impractical footwear
... shouldn't list both the acronym and its constituent words.
http://en.wikipedia.org/wiki/Information_technology
Just think about it, you're George Bush or Dick Cheney and The Google is just sitting there ripe for the plucking. Done deal dude. The USA Government very likely has all the access they want at Google to anything at all in real time with all details. If it's not true assume it is to be on the safe side.
Your comment and his moderation are an exact copy of what astroturfers has been doing for MS for years on public forums (paid marketing spin). Unfourtunately slashdotters seems to be easily deceived by the G word. :(
What's in a sig?
Reddit groupthink: Although we work day jobs in call centers and as photoshop jockeys, we have figured out The One True Path (a mixture of populist liberalism, lolcats and outrage at anything that might make us leave our W.O.W.-enabled terminals for more than 30 seconds) and consider all of you who have not seen it to be beneath us. Even as we ask you to work with us while we fix this driver issue together.
Futurist Traditionalism
...is "no".
Catalin Braescu
Ofaly.com
Let's see what their TOS are for Chrome. Since OS's are another crown jewel of computing, if they sufficiently open it up to really let the devs make a Baskins Robbins 31-Flavors (Service Mark) of Chrome, *without* trying to copy Apple's secrecy, *and give back to Debian core*, they could unleash a force of nature.
My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
Cool, but where can we download it?
Oh we can't?
It's an internal project and it will remain an internal project just like the previous version. So what's the point for the rest of us?
I'm really more excited about projects like Elliptics Network, because at least, they can be useful to everyone, not only to Google's employees.
{{.sig}}
I have not doubt that the new file system will be great, but after reading this summary, the first thought I had was that I should back-up all that Gmail before they cut it over. I've been putting it off for far too long, but I'll just have to burn a couple of days of attention to do it.
****
"I'd never want to join a club that would have me as a member" - G. Marx
astroturfers has been doing for MS for years on public forums (paid marketing spin).
That's simply not true.
Squirrel!
Feck.
Squirrel!
Your comment and his moderation are an exact copy of what astroturfers has been doing for MS for years on public forums
You're implying he's being paid by someone to express certain opinions. Where's your evidence? Or maybe you have none?
Is it really so unlikely that someone might simply have an opinion different to yours and want to express it? Or is it that you are so insecure in your belief in the strength of your position that you feel the need to attribute different points of view to evil corporate conspiracies? Or is it that you are so utterly arrogant in your belief that things should work a certain way that you cannot fathom that anyone might prefer an alternative?
It just irks me that instead of expressing your opinions and arguments properly and letting them stand on their own merit, you resort to making baseless accusations that, frankly, seem rather paranoid. Oh and if that's the best response you can come up with to the GPs argument, then it suggests there's not much substance to your own.
Amnesty International
You have to be careful comparing your search experiences from 10 years ago.
if you are saying that developers are not part of Information Technology, you are full of shit
IT (as an area of work) usually refers to IT support staff such as network administrators. Development is, generally, the writing of software.
IT as a general term can refer to pretty much anything directly or indirectly related to something using a microchip, so in that sense I suppose developers work in IT. But this use of the definition is so generic that it's not really useful at all, so dividing development and IT (as most people do) makes more sense.
you are full of shit
That was pretty senseless, wasn't it?
Amnesty International
goats.ex?
This sig isn't original enough, it's time to come up with something witty...
Your irrefutable facts and infallible logic have convinced me. I mean, you're *so* right! And think about it - North Korea sees Teh Google just sitting there. It only makes sense that they have total access too!
"Ignorance more frequently begets confidence than does knowledge"
- Charles Darwin
Why should Google give up a competitive advantage when that would only increase their competitors' reach into their market? Even the inventor of the light bulb filed a patent, so that anyone willing to build the device for their own factory could do so. They just wouldn't be able to sell the product.
The secretary will be thrilled that you just promoted her to IT staff, just for playing solitaire and typing letters instead of hand-writing them.
Watch for Penguins, they eat Apples and throw rocks at Windows.
They should've called it GOOFS.
I stated developers are in IT. Are secretaries developers? Since you are having trouble understanding, I can only assume you are a developer, and obviously you don't want to be in IT. I will recommend that all developers report to HR rather than the IT Manager.
are you so amped up about the healthcare debate you wanted to start slinging buzzwords here? astroturfing and spin? really? is there some sort of secret plot by google to own peoples minds? do you also fear black helicopters?
i wage a holy war against the apostrophe.
There is a wee little thing called the Patriot Act dude that they used to spy on Americans telephone calls and internet messages so hooking into The Google wouldn't be a problem at all.
You're a twat. The warrantless wiretapping program was established by executive order, not the PATRIOT Act. The companies involved were telecoms like AT&T and Verizon, who voluntarily installed NSA equipment on their networks. It was likely illegal, but the courts refused to grant standing to anyone who tried to bring a lawsuit, so the matter probably won't ever be decided.
This is all very well-documented and well-attested. What is not well-documented or well-attested is your paranoid assertion that Google gave the NSA free run over their network. Your assertion is also stupid when one considers the corporate culture and TOSes of the relevant companies: AT&T and Verizon are fucking dicks, and their TOSes pretty much deny any semblance of liability if they leak your data, whereas Google has a good history and makes good promises on the subject of user privacy.
In short, please STFU or at least do some reading before you post on a complicated subject. Slashdot is full enough of loud, uninformed morons.
Meh. Somewhere in there I was a sysadmin for about ten years too. Also DBA. We had to wear many hats, talent was hard to find and the schools weren't turning them out yet. And if you'd read my post you'd see my work does involve a computer - I've been in the computing industry continuously for forty years or so and have done pretty much every thing in it at least once, including designing cables and setting up some rather large networks. Out of all that, I'm really only proud of the development work I've done, and a few innovations that made it into ITIL. The rest was just a job. Respect? Well, you're allowed to insult your friends.
Do not mock my vision of impractical footwear
Somewhere there is a village missing its idiot.
Do not mock my vision of impractical footwear
"You're a twat. ... In short, please STFU or at least do some reading before you post on a complicated subject. Slashdot is full enough of loud, uninformed morons." - AC
Ok, that's a great way to start off a dialog. Oh, right you're attempting to incite a flame war. How interesting.
"The warrantless wiretapping program was established by executive order, not the PATRIOT Act." - AC
So what? It's irrelevant, not that I agree with the accuracy of your statements. The point that you miss is that they can spy on us if they want to and it's better to assume that they are than that they are not especially after the entire wiretapping that they did do illegally.
Actually, network admin for a small ISP.
Though I do write scripts from time to time.
I have friends who are developers, and they wouldn't classify themselves as IT. I personally think it requires more than use of a computer to be in IT. If you repair, replace, install or upgrade (also known as "service") the computer systems that are used by the staff or customers, including network equipment, desktops, and servers, you just might be in IT.
Watch for Penguins, they eat Apples and throw rocks at Windows.