Slashdot Mirror
Load Test the New Slashdot Setup
As many of you have noticed, Slashdot has been pretty bogged as of late, but the end of that is at hand. The new setup has a dedicated SQL box and 3 load balanced http servers. We've been spending the last few months getting everything ready, and now its time for the final check. I'd like to ask you help testing the load balancing stuff: You can access the new system at this address. Its a slightly out of date mirror of Slashdot, but it should be more than enough for us to determine if the new setup can cleanly handle the load. Thanks for you help: If this all goes well, we'll transition to the new setup in the next few days. (And just in time, Slashdot was kicking out like a thousand pages (pages, not hits) a minute earlier today and stuff was really bogging down)
god....another troll.....sorry, but i'm just upgrading from NT to Linux.... ok, so moderate it down cuz it's not even funny.
I'm not feeling that clever this morning.
And just in time, Slashdot was kicking out like a thousand pages (pages, not hits) a minute earlier today and stuff was really bogging down
/. is using Microsoft's IIS. We all know linux can't handle a load like that. I guess the Mindcraft study was valid after all.
Good thing
Now excuse me whilst I wipe my tears of laughter.
Linux - Because Mommy taught me to Share.
mySQL is really fast... It lacks features that some people need (stored procs, transactions) but it is SOOOO fast that if you don't need those features, it's really hard to beat.
RateVegas.com - Vegas Reviews
You do know Windows2000 has a virus in it? It's called Microsoft...
Obviously you don't use linux. If you did, you wouldn't be dropping Slack 4 for Win2K, you'd be going from Slack 4 to some other distro...
Besides, it's not like anyone will help you, considering how much of a peice of flamebait this is.
(Ensue, ensue... I don't think that's a real word.)
:) .. it means to start, take place, happen or begin.
/.'ers out there. I tried hitting reload a few times on three separate links to the pages and all reloaded about 5 times quicker than the regular /. .. of course it's probably not FULLY loaded yet, so maybe a true test is yet to come.
:)
Yes it is
The new server is pretty quick (to add an 'aye, mate' to the other
Good stuff, Rob.
Delphis
And how do you propose slashdot generates income?
the poor bastard's been down since you hit him with the slashdot effect last week
Depending on your router tables, this may be a bad idea. If you use a default route and are on a ppp link (or forward it to another machine that does the same thing), it'll forward your query to 10.1.1.1 to your ISP, which may bounce all the way out to a major backbone before getting icmp unreach'd. In which case, it will spend another 4-5 hops getting back to you.. for a round trip of around 300ms.
The correct solution would be to set it to 127.0.0.*, which is guaranteed to have a fast turnaround. Depending on your setup, you can spit back a conn refused right away, or 404 when it accesses your local webserver.
Or perhaps you could investigate the 'reject' option to route? That's the "proper" way of doing it.
Dumped me 1st try 5.36pm (GMT + 12) been back & forth - in & out + a couple of AOL!'S since - sometimes fast - sometimes freezes.
ftp'd Peanut last night - up till 2.30 - does anyone else use it? - the guy has a sense of humor.
still haven't run Xconfig - not good to be root when you're typing '1' as '!' & cant find '+'
Full plate and packing steel! -Minsc
So the Slashdot effect has finally come home to roost. I have seen a few references to Slashdot on other sites recently and it is our turn to suffer now.
Mielipiteet omiani - Opinions personal, facts suspect.
maybe now i can turn on the pix again?
na, why waste bandwidth?
Nice to see that every system has its weaknesses... :-)
So will this new setup mean we can finally get rid of those annoying CommentLimits of 25 comments per page?
10 PRINT CHR$(205.5+RND(1)); : GOTO 10
Slashdot uses HTML tables to organize the web page "newspaper-like". The problem with HTML tables is the browser cannot draw their contents until all of the table data arrives at the browser. With a dynamic site like Slashdot, some data might take longer to pull out of the database than others. If Slashdot used fewer tables, then at least a portion of the page could be rendered. The users could read the top half of the page while waiting for Slashdot to generate the second half of the page.
cpeterso
Wow! And I though our requirements (600 calls/min) was bad. FTHWTK, this is in the telco industry (IN Platforms) providing services such as number translation (0800, 0900, etc), number portability, etc. BTW, assuming there are 720000 phones in NZ (not unrealistic, there's ~3 million people) and each phone makes one call a day, that's 500 calls per minute.
Bill - aka taniwha
--
Leave others their otherness. -- Aratak
they changed it, I noticed that blazingly fast 1000 WHOLE pages an HOUR also. Funny how the 'Net can make you a liar very quickly.
+&x
No one seems to have mentioned this, but if you try to post a comment on the new servers, takes you back to the old slashdot server, ["Bad absolute links! Bad!" -ed.] so that aspect of the new servers isn't getting tested.
Well, (Score: 5) (Score: 1) makes it kinda obvious.
The new system seems quite fast so far, except for one thing, the poll. For some reason the poll on the new setup is extremely slow.
-Dan
Linux sux, Hemox sux, and all slashdotters sux ('cept for the ones that enjoy squishing avocados between their toes.) MEEEEEEEEEEEEEEEEEEPT!!!!!
It's called Coconut by Harry Nilsson, available on the Reservior Dogs soundtrack.
Consultancy: If you're not part of the solution, there's money to be made in prolonging the problem
Netcat for NT (zip file) at ftp.technotronic.com
There 'ya go, all fixed.
"...America's great minds of today, teaching America's great minds of tomorrow. Poor bastards." -- A Beautiful Min
How much do you get paid to do this?
I had a feeling that a little extraneous verbosity might assist in the conveyance of the impression that the path chosen by the various routers in the succession of transfers between the origin and the destination points of my query seemed to be rather prevaricated. My application of the indefinite article to the continents and oceans covered by the journey was intended as a comparison, not as an indication of plurality. And yet I had to abbreviate my composition for fear of repetitive use of the term "the width of..." and out of a desire not to wax overly loquacious, as occasionally I am wont to do.
;)
But I digress...
Ahh - My eye!
The doctor said I'm not supposed to get Slashdot in it!
Two words: Internet Junkbuster.
--
Yes, that *is* a real email address...
Never mind Spamassassin. When's Spammerassassin coming out?
The correct solution would be to set it to 127.0.0.*, which is guaranteed to have a fast turnaround. Depending on your setup, you can spit back a conn refused right away, or 404 when it accesses your local webserver.
--
I'm not sure if you were trying to "throw another shrimp on the barbie" but, if you were, you say "g'day" not "good day". (an eye for an eye, a clue for a clue :)
(I hope the pseudo tags come through the formatting)
Ahh - My eye!
The doctor said I'm not supposed to get Slashdot in it!
I can't seem to get the new link to work. But I am kinda dumb.
How many surrealists does it take to screw in a lightbulb?
Fish.
I used to be "Ungrounded Lightning Rod."
Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
Seriously: making it more cachable would have cut the load DRASTICALLY - and still will for the new config. When a user tries to follow a thread, he hits the server again when he pops back up to the level above, doubling the number of hits on the servers.
It also is a pain in the tail when the servers are slow - which even the new config will eventually become.
Bantam Dominique roosters crow a four-note song. Once you've heard it as "Happy BIRTHday" you can't NOT hear it that way
Anonymous users still require dynamic content. They must still be able to retrieve updated news, etc.
It's 10 PM. Do you know if you're un-American?
So is the server in place? I've been getting unusually fast page loads. I thought it was my cache or something, but I cleared that. Even the adfu ads are coming up fast.
It's 10 PM. Do you know if you're un-American?
Just tried it. Fast. Good. Nice. Do it.
I was always wondering why slashdot is so heavily depending on dynamically generated pages. Even if just the main page had proper caching information, you could already hand off all the anonymous users (people not logged in) to the worldwide caching hierarchy out there.
See what the cacheability engine on ircache.net has to say about slashdot.org. At least the gifs are cacheable, but why is that "Expires"-Tag set? Do you expect the gifs to change every week?
I'll be very happy not to see "system overload showing first 30 messages" again.
---
The day Microsoft makes something that doesn't suck,
---
I'm going to live forever, or die in the attempt.
post a good evolution or FreeBSD article exclusively on it with a link from the normal /. to it, then sit back and watch the load rise....
Just did my two cents Canadian over there, and now doig it over here. Much quicker to do it over there. Can't wait for the new server to be up.
-- I'm sure this is amusing to someone.
Nobody is using it yet.
It seems to me that my browser pauses the longest when waiting for adfu.blockstackers.com...
well, that makes 16 per minute.
is it my calc that's gone wrong or is it that your server is reeeeeally waaaaay too slow ?
-- x
I went to the new site, did a couple of reloads. Reloads on current site usually take about 10 seconds (384 kb DSL). New site takes about 2 or 3 seconds. So hurry up and move over!
-BH
---- El diablo esta en mis pantalones! Mire, mire!
That's a good point, but that only speeds things up on the client end (not counting the few bytes taken up by the table elements themselves.)
That Slashdot is immune from the 'Slashdot Effect'. Slow yes. Dead no..
:)
Nice to see the new server(s?) are still breathing....
jf
Oh and AFAIK the database is queried before the complete page is sent. It's constructed and then sent.
Um. There's only one each of Australian, African, and North Ameican continents, and one each of the Indian and Atlantic oceans. Interesting (and cute) way of putting it, whether you meant to or not. :)
---
"'Is not a quine' is not a quine" is a quine.
"'Is not a quine' is not a quine" is a quine.
Quine "quine?
Well, Bones?
Dammit, Jim! I'm a doctor, not a webmaster! ...It's dead, Jim.
Well, maybe not exactly dead...
Hehehehe, that was fun.
"...America's great minds of today, teaching America's great minds of tomorrow. Poor bastards." -- A Beautiful Min
>> word.)
> Yes it is
> happen or begin.
Hmm, someone's not a _Sam and Max_ fan.
-=-=-=-=-
-=-=-=-=-
My mom's going to kick you in the face!
Even so, my browser oftens prints the Slashdot menu and sidebars, but hangs for a looong time waiting for the long list of messages. My browser has to wait for all (say) 200 message titles to download before printing even the first title. If the message list used no tables, the first title could be printed immediately. The message list could even be broken down into multiple tables, stacking them vertically. That way, my browser could print the title list in chunks of (say) 20 titles per table. Of course, this would need to be benchmarked. :-)
cpeterso
perhaps this is just another way of "testing" slashdot? although he's testing the wrong server, dagnabbit. He's supposed to be flooding the _test_ server, to see how it stands up. Ha.
/. admin type people: maybe you should consider adding a special "flood" category to the Moderator list, along with Offtopic and Troll.. then set up the servers in such a way that anything with a "flood" rating would immediately be given a much much shorter amount of space to run before the cutoff for "Read the rest of this comment.." happens. That might help to cut down on scroll times when floods like this one happen, without hurting posts that just happen to be really long.
:P
A note to Taco-san or other
and God dammit, what the hell IS the name of that "put the lime in the coconut, drink a bowl up" song? that's a cool song but nobody seems to know where i can find it.
-mcc-baka
INTELLECTUAL PROPERTY IS THEFT
Irritable, left-wing and possibly humorous bumper stickers and t-shirts
True, I have a slow connection. Funny, though, how other sites like Yahoo or photo.net have snappy performance on the same Internet connection.. :-)
Please see Jacob Nielsen's The Need for Speed. As the Internet grows, the mean bandwidth per user decreases. Most new users are using modems, not T-1s. Web sites should design for the common case and minimize response time.
cpeterso
She's fast like the speed (2.2Mbps DSL, Ottawa). Almost as quick as my LAN, I like it. :)
--- Bigger bits, softer blocks, tighter ASCII.
Ok, so how does this "automatic load balancing" work anyways? I'm curious about the underlying mechanisms behind it.
Disclaimer: I am a moron. I only play a computer geek on the Internet. I'm really a ChmE by training....(I play with explosives, not networks ;) )
--
"... the deep things in science are not found because they are useful; they are found because it was possible to find them."
"the deep things in science are not found because they are useful; they are found because it was possible to find them."
do i have to tell you were to put that cocnut? uP dA bUtt0ck5
"If you can't make it good, at least make it look good." - Bill Gates
Check my user info and read the various other threads I've been engaged in recently regarding quines. Failing that, read "Godel, Escher, Bach: An Eternal Golden Braid," which is, as far as I'm concerned, gospel.
---
"'Is not a quine' is not a quine" is a quine.
"'Is not a quine' is not a quine" is a quine.
Quine "quine?
Oops... didn't realize those threads had expired already. Um. Look it up on Everything. :)
---
"'Is not a quine' is not a quine" is a quine.
"'Is not a quine' is not a quine" is a quine.
Quine "quine?
Vignette doesn't count as good.
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.
Please contact the server administrator, malda@slashdot.org and inform them of the time the error occurred, and anything you might have done that may have caused
the error.
More information about this error may be available in the server error log.
Apache/1.3.6 Server at linux360.dn.net Port 80
This was brought on by holding CTRL+R
It runs a lot smoother than the current one, especially with my dial in at work. I probably won't notice that much at home.
/. ever be completely dynamic or is that just a ridiculous idea? And finally, I'm me-tooing the note about blockstackers. If anything times out during my loading of /., it's adfu.
At what point is the line drawn between dynamic data, and static layout? (I know probably should read the FAQ, or something, but I imagine that someone here probably can throw a quick answer to me.)
Will
Can't wait to see the new server up for public consumption.
ALL HAIL BRAK!!!
-- adFU.blockstackers.com. "We put the SLO in SLashdOt"
Step 2) Download ApacheJMeter
Step 3) Point ApacheJMeter at the new slashdot.
Step 4) Watch fun and hijinks ensue
(Ensue, ensue... I don't think that's a real word.)
-=-=-=-=-
-=-=-=-=-
My mom's going to kick you in the face!
Rob, Getting a server error at //209.207.224.40/article.pl?sid=99/08/19/0212235&m ode=thread&threshold=0 Lando
http:
/* TODO: Spawn child process, interest child in technology, have child write a new sig */
I liked it when cachedot.slashdot.org was available for reading slashdot via slightly out of date static pages. It was much faster. Please bring it back!
-- I can't say enough in 120 chars!
Before anyone starts with the "How'd this get a score of 5?"
He typed "How's it being done? (core5)" in the subject.
I wait a good 20 seconds for the focalink ad server
"Let him go, Ralph. He knows what he's doing." --Otto Mann (simpsons)
Comment removed based on user account deletion
Try jmeter from the apache group. You can find it at the Java Apache site
Come play Heroes of Might and Magic Mini online.
I was going to post this comment in response to someone's comment on the mirrored test site:
their topic: Hell
My comment:
hell? faster!
"You're driving like a bat outta Hades!"
But I couldn't post the comment because of 500 Internal Server Error, or something like that... oh well
Insert mind here.
Or, if you prefer, an Australian continent, an Indian Ocean, an African continent, an Atlantic ocean and (at least) a North American continent. Check out this snippet of traceroute
---
11 Pos1-0-0.wel-core1.Sydney.telstra.net (203.50.6.46) 207.687 ms 1968.950 ms 519.342 ms
12 GigabitEthernet5-0-0.wel10.Perth.telstra.net (203.50.113.37) 337.857 ms 369.053 ms 548.711 ms
13 Serial1-0-1.paix1.PaloAlto.telstra.net (203.50.126.2) 781.644 ms 609.641 ms 409.682 ms
---
For the geographically impaired, that's the East coast of Australia to the West coast of Australia to the West coast of the US! (Huh?)
Hmm, just tried it to slashdot.org, and the intercontinental part of the route seems a tad more sane (i.e. Sydney straight to San Francisco), but this time it was 24 hops overall! (WTF?)
No wonder /. always seems slow from here!
Just where in the US is /., anyway? North, South, East or West?
Ahh - My eye!
The doctor said I'm not supposed to get Slashdot in it!
wtf does that mean? do you know what a bottleneck is? it's something that keeps stuff from getting through as well... why would we want "the bottle" (whatever that represents) to "break"?