Large Scale Web Apps Built on Open Source

← Back to Stories (view on slashdot.org)

Large Scale Web Apps Built on Open Source

Posted by michael on Tuesday September 21, 2004 @07:31AM from the running-out-of-south-park-characters dept.

prostoalex writes "Brad Fitzpatrick presented at OSCON with on overview of his little project. Interesting facts about the evolution of the Livejournal back-end architecture."

10 of 213 comments (clear)

Typical Livejournal by Anonymous Coward · 2004-09-21 07:37 · Score: 5, Funny

OMG! Today I had CEREAL!!!!!

With MILK!!!! OMG!!
1. Re:Typical Livejournal by Anonymous Coward · 2004-09-21 07:48 · Score: 5, Funny
  
  How true
  
  From link --
  speakin of french and korea did u no they both opposed the war in iraq? 1 is a comunist country and the othr is a no-fight-anytime country. mabye there in this 2gethr to squash the american gold medals an make ppl think there strong! HEY KOREA WE BLEW U UP IN WW2 W/ TEH ATOM BOMB WE'LL DO IT AGAIN. an french ppl suck.
2. Re:Typical Livejournal by MC+Negro · 2004-09-21 08:38 · Score: 5, Funny
  
  Haha. This part got me here --
  
  without a doubt Jesus would've been the best president ever. When he was only 12 years old he went to the temple to preach to the Jews and was just amazing everyone. Think how much better the U.S.A. would be if Bill Clinton wasn't Bill Clinto but instead was Jesus? Do you think we'd be fighting a way? NO!! We'd all be loving each other because thats what Jesus was about! LOVE! There isn't enough love in the world! Jesus would also be great because hes not only the son of god, HES A PRINCE OF PEACE!!! Hed probably do things differently. Even George W Bush could learn from Jesus (and thats why George W Bush is a christian and we need to keep him in office!!)
  
  LiveJournal -- Convincing teenage girls that someone cares about what they have to say since 1999.
  
  --
  "You and your third dimension."
Re:.sxi format? by Higman · 2004-09-21 07:42 · Score: 5, Informative

Are you serious?

In the off chance that you are, it's one of the OpenOffice.org formats, inheritted from StarOffice... it's supposed to be their answer to MS PowerPoint.

--
-- [insert sig here]
Maypole! by Anonymous Coward · 2004-09-21 07:47 · Score: 5, Informative

Maypole is a Perl framework for MVC-oriented web applications, similar to Jakarta's Struts. Maypole is designed to minimize coding requirements for creating simple web interfaces to databases, while remaining flexible enough to support enterprise web applications.
Livejournal Images by tinla · 2004-09-21 07:50 · Score: 5, Funny

Ok, so most of the Journals lack even a scrap of entertainment value... but the data feeds are normally fun. Is there anyone left that hasn't wasted a few bytes on the following url?

http://www.livejournal.com/stats/latest-img.bml

Hint - its a constantly updating list of all the new images posted to journals. After a while you give up waiting for a hot chick to post and decide crazy survey graphics are as good as it gets. And then some hot chick posts her birthday party pictures, but she's only 14 and suddenly you wish you'd spent the day doing something else.

--
0daymeme.com: Great stuff.
Porn by Neil+Blender · 2004-09-21 07:51 · Score: 5, Interesting

Back in the .com days, I worked at a huge (now defunct) porn site. We had about 50,000 active hosted sites, 500,000 hit counters and a bunch of other stuff. We were getting tens of millions of page views daily, maxing out two 100 megabit circuits at times. It was all FreeBSD, a little Redhat, Perl, mysql, squid, apache, mod_perl and C. The only real closed stuff we used were BigIPs and traffic monitoring software.
Re:lamp! by Nos. · 2004-09-21 07:51 · Score: 5, Informative

Actually, LAMP can also refer to PERL and Python as well as PHP.
Re:Get a clue by Anonymous Coward · 2004-09-21 08:01 · Score: 5, Insightful

It's a pervasive belief among the suddenly famous. IBM, MS, or Sun doesn't need this. It's the small website with a bright idea that is all of a sudden gaining popularity which goes through almost each of the stages described in this document.

This is for people with absolutely no budget and infinite traffic. This is how to live through that and come out winning like Brad apparently has.
Re:Large scale? by xb95 · 2004-09-21 08:56 · Score: 5, Interesting

Most of the time those numbers are four or more times that high. It's early in the afternoon, this isn't a peak time.

Anyway, those are only the number of entries being posted. For every entry being posted, there are a ton of inserts actually going on:

* log2 table to contain some metadata about the entry
* logtext2 table to contain the actual text
* logprop2 table (multiple rows, 3-5) containing other metadata about entry

So, four times the traffic, about 6 inserts each, 2400 updates per second--and that's just for posting entries. We get a lot more traffic from people posting comments (which also do 3 or 4 update/inserts each comment), plus people editing their userinfo, uploading new userpics, ...

While LiveJournal definitely isn't a huge site, it's not a lightweight, and definitely doing pretty good for having around 80 machines and doing 30-40 million fully dynamic page views a day.