New Linux Petabyte-Scale Distributed File System

An anonymous reader writes "A recent addition to Linux's impressive selection of file systems is Ceph, a distributed file system that incorporates replication and fault tolerance while maintaining POSIX compatibility. Explore the architecture of Ceph and learn how it provides fault tolerance and simplifies the management of massive amounts of data."

Comments

Is it ready for primetime?

[Meshach]

The headline in the Ceph wiki: Ceph is under heavy development, and is not yet suitable for any uses other than benchmarking and review.

Re:Is data integrity really necessary for large da

[CoderJoe]

Google's BigFile/BigTable architecture is a distributed filesystem. if a node goes down, the data that was on that node gets copied to other nodes to keep the replication count up.

Facebook is using apache cassandra, which adopts similar designs.

Re:Is data integrity really necessary for large da

[morgan_greywolf]

Nothing. They can always go back and regenerate that data. It's just a matter of time.

You just contradicted yourself. You're right; it's just a matter of time. Only, thing is, this is the Internet. How long to recreate that data? Weeks? Months? Years? 6 months is an eternity on the Net.

If all the accounts and stories were lost on Slashdot due to a massive database failure, how many people would come back, creating a new account and so forth? How many long would it take before there was enough content and accounts to make it interesting again? Now realize that Slashdot is a drop in the bucket compared to Google.

Re:Do niggers use linux?

[Ethanol-fueled]

It was noble of you to try to wrest control of a troll thread, but your comment loses a lot of credibility for being titled "Re: Do niggers use linux?"

Would it hurt to at least change the title while you strive for visibility and relevance? When I saw the title of your post, I half-expected to see a poorly-written diatribe against Jamal Jackson for playing basketball and chasing caucasian women.

Thank you, kind sir, for listening. We all must do our part to prevent trolling!

Thread titles vs Trolling

[MichaelSmith]

Would it hurt to at least change the title while you strive for visibility and relevance?

Well you didn't change it

Re:Is data integrity really necessary for large da

[ProfMobius]

First, Facebook & Google data are not possible to regenerate, as they are personal things, like emails, messages, posts, etc.

Second, you have other sectors producing large amount of data beside your favourite networking website. One example is the LHC. It is going to produce terabytes of data per DAY (15 petabytes per year). Another are space telescopes. Those data can't just be 'regenerated'. 1 day worth of data is incredibly expensive to produce.

Distributed file systems are already there, and people use them. Maybe not on your level of computer usage.

When you don't know what you are talking about, I think it is better to just keep quiet.

Re:Totally not ripped from a webcomic...

[jedidiah]

> Having a rats nest of audio and video apis doesn't help the situation. You freetards should be happy what you get for your piece of shit OS.

The ffmpeg developers can manage yet the "professionals" at Adobe cant?

"freetardry" is the only reason h264 acceleration is supported under Linux.

If we waited for the nickel-and-dime-you approach to come to the rescue we would still be waiting.

At least with MacOS, Adobe had a real excuse.