Slashdot Mirror


Building/Testing of a High Traffic Infrastructure?

New Breeze asks: "I'm currently working on my first web 'application', and have discovered that I know less than nothing about setting up the infrastructure to manage a high traffic system. Where does one go to learn about setting up the infrastructure required to host something like Slashdot? Or do you just say, 'Not my area!' and help them find a consultant?" "My experience is pretty much limited to:
1. Install the web server on one box, the database on the same box if it's a small installation or a separate box if performance seems like it will need it. Add more memory and processors based on SWAG criteria. (Scientific Wild Ass Guess)

2. Contract with a hosting company.
I had a potential customer ask what I would recommend if they wanted to self host, they have around 300 remote locations and would have multiple users from each location hitting the application at the same time, so saying a couple of beefy servers probably isn't the right answer.

I haven't a clue. The last place I worked with on something like this hired a high dollar consultant who spend a huge pile of their money setting up a load balanced, oracle parallel server redundant everything system.

How do you test it? I've worked where they actually had a room with hundreds of systems on racks that they would configured to run test transactions against different servers and software builds for stress testing, but that's not in my budget..."

12 of 231 comments (clear)

  1. A Beowolf Cluster of Course by l810c · · Score: 4, Funny

    That one was easy, ...Next

  2. Post a URL by MarkusQ · · Score: 5, Funny

    Post a URL here and we'll help.

    -- MarkusQ

    P.S. Clever use of the text describing the link may help you control how much trafic you get, from low ("M. Moore Nude!") to high ("SCO caught robbing courthouse").

  3. Simple Flow chart for learning by drachenfyre · · Score: 5, Funny

    1. Submit Link to slashdot with your webserver hosting a lot of large video files supporting the link.
    2. Have link approved (Note - duplicate any story just posted is probably the best way to get approval and lots of people crying dupe)
    3. Learn what caused the webserver to melt and how long it took to melt.
    4. Fix the problem that caused step #3
    5. Repeat 1-4 until server doesn't melt.
    6. Congrats! You've learned how to host a high demand web server.

  4. Re:Ask a Pr0n serving company by AndroidCat · · Score: 4, Funny

    Okay, let's put it to a real test. Post some good pr0n links and we'll try to slashdot them!

    --
    One line blog. I hear that they're called Twitters now.
  5. PLEASE by asadodetira · · Score: 5, Funny

    Please don't tell him. We don't need another slashdot. Servers worlwide surrender

    OK.It's easy. There are three steps involved
    1.Build a low performance infrastructure.
    2.Put a RT sticker and chromed exhaust pipes
    3.Done

  6. If your sites are acting fruity... by Anonymous Coward · · Score: 0, Funny

    You have a serious problem. I suggest you start accept their newfound sexuality and let them be who they are... they say its genetic, and anyway its unlikely your efforts to make them more masculine will only backfire.

  7. Re:Experience is key by xrayspx · · Score: 2, Funny

    Fuck me. I'm ripping the "K" and "Y" keys from my laptop right now. I can't believe that post. I sound lie some bonehead owledge engineer.

    eep it real.

  8. Re:most porn companies are clueless by AndroidCat · · Score: 2, Funny

    I think their current economic model consists of getting rich off of each others' click-throughs and showing thumbnails of each others' thumbnails.

    --
    One line blog. I hear that they're called Twitters now.
  9. Re:most porn companies are clueless by AK+Marc · · Score: 3, Funny

    They get a MAJOR SCREWING from hosting companies that charge big $$ to figure out how to handle the load.

    Well, if you are in the porn industry, you should expect a major screwing. However, I would expect the porn industry to know how to handle a load.

  10. Re:Ask a Pr0n serving company by Guitarsenal · · Score: 1, Funny

    "Incredible Uptime" would be an excellent name for a porn site!

  11. Re:most porn companies are clueless by lastmachine · · Score: 0, Funny

    How come when Joe gets his rocks off, it's Bill who comes?

  12. Re:(File throughput) != (database connectivity) by Anonymous Coward · · Score: 1, Funny
    Popular porn site likely do lots of bandwidth, but that doesn't necessarily mean lots of database hits.
    Agreed. Many of the ones I visit use straight HTML pages rather than database driven pages, which helps lower server impact.