Slashdot Mirror


Achievements and Optimizations

This week's code refresh has added a number of really irritating story display bugs that we're working on. But, it also added a number of cool optimizations that should improve performance for a lot of readers. Tap that link below to read a brief description of them, and also a few serious notes about the achievement system we launched last Wednesday.

Ok, Optimizations. These really only affect the Index2 beta users and Firefox users. You should really be in one of these 2 groups.

  • CSS Sprites: Vlad combined a number of our chrome images. Vroom used the same technique to combine our top 25 topic icons into a single image. The top 25 icons appear on 60% of our stories, and the chrome images appear on every page load. These 2 changes dropped perhaps 20 requests from a typical fresh page load. That should be a measurable performance increase for a lot of people.
  • Library Purge: Scott removed the last remnants of the YUI library. This was THE library to use for AJAX a few years ago, but as of now, we have totally ported to jQuery. The last 2 bits that used YUI were some animation bits, and the discussion2 threshold changing floating widget thing. Porting those 2 things to jQuery let us pull several hundred k of JS from our includes. This let us trim another 85k from our compressed JS transfers. We've cut the JS included on Slashdot in half in the last month.
  • Varnish: Jamie installed varnish as a reverse proxy behind the F5 but before our apache. Really this won't be a significant performance improvement for now. We use a complex system of static pages to cache the most read content on the site, but varnish will at last let us deprecate that ancient system for something much simpler. We'll be experimenting with this more over the week, but the only real change for most cases is that most of our static content can be served w/o the latency of NFS. Not a big deal really, but it's something. But when we purge out the old caching system, a lot of things will be a lot easier to maintain and debug.
  • CDN: We're probably going to test a CDN this week. The performance gains will be minor, but it will let us move 50 megabits of traffic off our main router and distribute that globally. It sure won't hurt.

A note on Achievements. We launched this as an april fools day joke. We're glad many of you got it. We had great fun with it. But achievements are actually a real, working system. And they serve a purpose. Most of the major bits of functionality on Slashdot have a corresponding achievement. Posting a Journal? Getting a Story Accepted? Being Moderated Up? Using all of your Mod Points up? While many achievements are silly jokes: getting the first block of achievements is essentially a tutorial. And getting some of the more complicated achievements would be a useful indicator for a quality contributor to the site. The heavy lifting on this was done by Chris Brown.

We're also experimenting with a thing we call 'Auto-More'. When you get to the end of the page, a second block of articles will be added to your index. The cool thing is that this means we can serve a smaller selection of stories on the main page request. Since 2/3rds of you never read past story #6, that means that you will get your page a little faster. But 10% or so of you get to the bottom of the page. And you will transparently be given more content. We're doing a bunch of logs to see if this works out. It's just an experiment tho, we may kill it if there is a problem. I think it will eventually be connected to the pause/play function available to logged in Index2 users.

This week we intend to start rolling out the Index2 beta to a very small number of firefox users. A good number of you won't notice. Some of you will tho. You won't hurt our feelings by disabling the thing immediately but I hope you give it a shot. It's great on Firefox. It has a few bugs on Safari. It will work on Chrome as soon as Google gets a Mac port out (Hint hint!). As for IE... well, you'll keep the old system for a few more weeks, but you're only like 14% of our users, and you keep shrinking.

Ok, back to work. You too.

47 of 294 comments (clear)

  1. But does it improve story quality? by Anonymous Coward · · Score: 4, Interesting

    How about employing someone to proof-read your posts and check the links?

    1. Re:But does it improve story quality? by Cube+Steak · · Score: 4, Insightful

      To improve story quality they just need to get rid of kdawson and ScuttleMonkey. That'll improve quality at least 5000%.

    2. Re:But does it improve story quality? by ushering05401 · · Score: 5, Funny

      Either that or they need to create some way for readers to weigh in on what should make it to the main pages.

      Oh well, we can only wish.

    3. Re:But does it improve story quality? by MagicM · · Score: 5, Insightful

      create some way for readers to weigh in

      Like the Firehose?

    4. Re:But does it improve story quality? by Chad+Birch · · Score: 5, Insightful

      How about adding Unicode support so that posts aren't often filled with random garbage when commenters assume one of the major technical sites on the internet should be able to handle curved quotation marks. Never mind when someone tries to write a word/post in Japanese or any other non-English language.

      --
      Sturgeon was an optimist.
    5. Re:But does it improve story quality? by ushering05401 · · Score: 5, Funny

      Firehose?!? I know what that means and I have no time for you GNAA trolls!

      Anyhow, I am still trying to figure out what the Green/Black thing means.

      Is anyone else seeing +/- on all the story headers?

      I think they really should just go with the GGP suggestion and fire those guys.

    6. Re:But does it improve story quality? by Blig · · Score: 5, Funny

      How about employing someone to proof-read your posts and check the links?

      Are you serious? The lack of proof-read is what makes this place Slashdot! ;-)

    7. Re:But does it improve story quality? by nmb3000 · · Score: 5, Funny

      To improve story quality they just need to get rid of kdawson and ScuttleMonkey.

      Meh. The kdawson script is just ScuttleMonkey v2. Obviously, not only did they not get rid of all the bugs, but they introduced a bunch of new ones. Hey Taco, I think you should name ScuttleMonkey v3 "RickJames". That way if anyone complains, you can have an automated response that just says, "I'm RickJames, bitch!" No one can argue with that.

      In any case, those are the only two that I know are computer programs. There's no way to tell how many other /. editors are scripts. Call me paranoid, but I wonder sometimes if Slashdot as a whole isn't a ploy by the machines to waste humanity's time while they plan their attack. You thought Caprica Six planted a virus in the Colonial defense system? Nope. She just installed Slashdot on the defense network and waited. Once everyone was busy arguing about the latest kdawson dupe the Cylons attacked.

      --
      "What do you despise? By this are you truly known." --Princess Irulan, Manual of Muad'Dib
      /)
    8. Re:But does it improve story quality? by Chad+Birch · · Score: 5, Interesting
      I'm not sure what the random "pretend you know Japanese" jab is about, but regardless, I wasn't trying to say that it should be normal for people to write posts in other languages. However, I've seen multiple instances where someone tried to clear up some details related to a story, where the only source of information is in a foreign language. They write a post along the lines of:

      "The summary isn't quite correct, because the article says '<foreign language>', which actually translates to something like '<english translation>'"

      Slashdot then totally mangles the quote they took out of the article and displays it in random ASCII characters. Is it something that's totally necessary for the site to have? No, but it's 2009, sites should be able to deal with more than ASCII. I certainly think it would have been a better use of developer time than achievements.

      --
      Sturgeon was an optimist.
    9. Re:But does it improve story quality? by coryking · · Score: 4, Informative

      Perl supports Unicode just fine. It is Slashcode itself that is stripping out anything that isn't the Queens ASCII. If I could hazard a guess as to why, it would be some kind of cheap way to prevent XSS attacks or page-widening posts. Dunno

    10. Re:But does it improve story quality? by RiotingPacifist · · Score: 4, Insightful

      I think currency symbols and other Unicode often thrown about in geeky discussions like ^2 would be nice
      â euro
      £ pound
      Â squared
      Â cubed

      --
      IranAir Flight 655 never forget!
    11. Re:But does it improve story quality? by ObsessiveMathsFreak · · Score: 5, Insightful

      The Firehose lets us all know just how bad the Slashdot story submission poll really is. There is a lot of tripe in there; ads, dupes, polemicals, rotten formatting, dupes, enormous submissions, just plain boring stories and more dupes.

      The issue of story selection is a deep and chronic one at Slashdot. Essentially, the root of the problem is that there is no real incentive to post a good submission, and more incentive to simply post a swathe of low quality submissions instead. I and many other submitters have spent considerable time an effort on compiling and editing submissions, only to have them rejected within minutes, while dupes were chosen instead.

      Now, when you submit you have to accept that your story may not be posted. But when quality submissions are getting lost amid the deluge, it's easy to see how good potential submitters can become disheartened and will simply stop submitting good stories. By contrast, the shotgun submitter who spends less time on each submission, but submits more submissions in total, will be more likely to have a story posted and will continue submitting. The end result is the current, appalling state of the firehose. Admittedly the front page has improved in recent times, but the firehose is as bad as ever.

      The best way to solve this problem is to give submitters a karma system. This would allow the system to distinguish between submitters who write good stories that didn't make it, and submitters who just wrote tripe. A meta moderation system for submissions would go a long way to improving the submission box and hence the front page.

      --
      May the Maths Be with you!
    12. Re:But does it improve story quality? by K.+S.+Kyosuke · · Score: 4, Interesting

      Names generally do not put up well with translation; and certain countries in Europe use characters outside ISO-8859-1 range even in names. Or is there some new rule in English that under no circumstances can a non-English character appear in English text?

      --
      Ezekiel 23:20
    13. Re:But does it improve story quality? by Idiomatick · · Score: 4, Insightful

      You can go into preferences and shut kdawson off if you like. So i fail to see the complaint.

    14. Re:But does it improve story quality? by Herkum01 · · Score: 4, Funny

      get rid of kdawson and ScuttleMonkey

      Now that would be an Achievement worth going for!

    15. Re:But does it improve story quality? by HTH+NE1 · · Score: 5, Informative

      Know your entities:

      • € euro (&euro;)
      • £ pound (&pound;)
      • ‘ left single quotation mark (&lsquo;)
      • ’ right single quotation mark (&rsquo;)
      • “ left double quotation mark (&ldquo;)
      • ” right double quotation mark (&rdquo;)
      • – en dash (&ndash;)
      • — em dash (&mdash;)

      For some reason though &sup2; nor &#178; work for squared, as doesn't &sup3; or &#179; for cubed.

      Other supported named entities: ¥ ¦ © ® ± ¼ ½ ¾ × ÷ À Á Â Ã Ä Å Æ Ç È É Ê Ë Ì Í Î Ï Ð Ñ Ò Ó Ô Õ Ö Ø Ù Ú Û Ü Ý ß à á â ã ä å æ ç è é ê ë ì í î ï ð ñ ò ó ô õ ö ø ù ú û ü ý ÿ.

      --
      Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?
    16. Re:But does it improve story quality? by HTH+NE1 · · Score: 5, Funny

      Or is there some new rule in English that under no circumstances can a non-English character appear in English text?

      ¥€$, åb$ø¦û±€|ý.

      --
      Oh, say does that Star-Spangled Banner entwine / The myrtle of Venus with Bacchus's vine?
    17. Re:But does it improve story quality? by bar-agent · · Score: 4, Informative
      • ellipsis (&hellip;) — hm, that doesn't work.
      • ellipsis (&#2026;) — nope.

      Really, entities are a hack. You should be able to enter the characters directly. Here's what happens when I try:

      • euro — hidden
      • £ pound — works!
      • ' left single quote — turned into straight quote
      • ' right single quote — turned into straight quote
      • " left double quote — turned into straight quote
      • " right double quote — turned into straight quote
      • - n-dash — turned into normal hyphen
      • -- m-dash — turned into two normal hyphens
      • ... ellipsis — turned into three periods
      --
      i'd hit it so hard, if you pulled me out you'd be the king of britain [bash.org]
  2. Hope by Yvan256 · · Score: 5, Funny

    Let's just hope these new optimizations don't href="http://www.telegraph.co.uk/scienceandtechnology/technology/technologynews/5105

    1. Re:Hope by brian0918 · · Score: 4, Funny

      Shit I think this thing is Hope (Score:3, Funny) by Yvan256 (722131) Alter Relationship on Monday April 06, @11:49AM (#27476841) Homepage Let's just hope these new optimizations don't href="http://www.telegraph.co.uk/scienceandtechnology/technology/technologynews/5105 Reply to This

    2. Re:Hope by X0563511 · · Score: 4, Funny

      Ah, the birth of a meme. It's much like childbirth, only retarded.

      --
      For large sets, this will be our guide even unto death, for the LORD will work for each type of data it is applied to...
  3. Not clear on all achievements by brian0918 · · Score: 4, Insightful

    I've got a buttload of achievements listed, but not all are described in the help. What do they all mean?

    1. Re:Not clear on all achievements by Anonymous Coward · · Score: 5, Funny

      no life

  4. achievements system by Anonymous Coward · · Score: 5, Funny

    The heavy lifting on this was done by Chris Brown.

    I don't care if he can code, any man that would hit a woman is no man at all. You don't deserve Rihanna, you piece of shit, and if I ever catch you out on the street without your bodyguards - your ass is grass my friend.

  5. Sleeker is better by Kell+Bengal · · Score: 4, Insightful
    Achievements strike me as yet another penis-measuring tool, rather than as something that brings more value to the site. If people never read past story #6 is it because they check the site often enough to not need to go that far back, or is it because they only care about breaking headlines (or perhaps we all just have ADH- ooh, shiny!)

    I think we would all benefit much more from a streamlined site, rather than the feature creep we're seeing at the moment. Slashdot isn't much broken, so don't much fix it.

    --
    Scientists point out problems, engineers fix them
    altslashdot.org: The future of slashdot.
    1. Re:Sleeker is better by johnny+cashed · · Score: 4, Funny

      I happen to like the achievements.

      After all:

      In my country, they speak of a man so virile, so potent, that to spend a night with such a man is to enter a world of sensual delights most women dare not dream of. This man is known as "the comedian."

    2. Re:Sleeker is better by Reziac · · Score: 4, Interesting

      Absolutely. The cute bells and whistles are sometimes fun, and occasionally useful, but they are NOT why I come here. I come here for the news and the conversation. It's rather like a coffeehouse or neighbourhood bar -- you go there to relax. You don't want to be forced to dress up in a power suit just to have a beer with your friends.

      My internet machine is a P3 (albeit with gobs of RAM). It struggles with the full display, even in "low bandwidth" mode (on broadband). It takes 20-30 seconds for any page (even "small" ones) to download and render in Mozilla.

      Aside from the fact that the whole bloody look is hard on my aging eyes (with no way to get it to be "restfully readable"), this is one reason I still use antique Netscape 3 here -- it doesn't do CSS or JS, so all I see is plain text, rendered almost instantly.

      If the site's "improvements" ever get to where I can't use NS3 to read and post, I'll have to give up Slashdot -- it simply won't be worth the time or the eyestrain if I have to read it in "normal" mode.

      --
      ~REZ~ #43301. Who'd fake being me anyway?
    3. Re:Sleeker is better by drinkypoo · · Score: 4, Insightful

      Achievements strike me as yet another penis-measuring tool, rather than as something that brings more value to the site.

      Well, at bare minimum they should thus bring penis to the site. Er, wait, slashdot is quite the sausage party already. Actually, I have a theory that there are actually quite a few females lurking, but they don't talk because they know we wouldn't appreciate it anyway. There are of course a few regular female contributors, but if I were them I wouldn't bother - you could be deluged with sexist bullshit anywhere. The difference is that most people are even dumber than the average slashdotter and have less excuse for thinking that crap is funny.

      Achievements are harmless. They don't even do anything! As long as there are no achievements based on things like first posts or negative moderation, the achievement system is unlikely to actually harm anyone. It's only when it rewards bad behavior (e.g. by allowing a negative score - thus users could compete for maximum absolute value) that it becomes dangerous.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  6. I forget, by internerdj · · Score: 4, Funny

    how many achievements do I need to unlock the ACOG scope?

  7. Achievements by Rik+Sweeney · · Score: 4, Interesting

    Is there a list of who has the most achievements? Maybe Slashdot should award titles depending upon how many achievements you have.

  8. IPv6? by c_g_hills · · Score: 4, Interesting

    Still no support for IPv6 it seems. Has it even been given consideration?

    1. Re:IPv6? by Chyeld · · Score: 4, Funny

      Still no support for IPv6 it seems. Has it even been given consideration?

      Yes, as an achievement. Sadly even then, only 0.001% of us will ever see it.

  9. Flair? by brian0918 · · Score: 4, Funny

    You mean, like flair? You know, the Nazis had pieces of flair that they made the Jews wear.

  10. Erm...excuse me! by Smivs · · Score: 5, Insightful

    It's great on Firefox. It has a few bugs on Safari. It will work on Chrome as soon as Google gets a Mac port out (Hint hint!). As for IE... well, you'll keep the old system for a few more weeks, but you're only like 14% of our users, and you keep shrinking.

    Er...havn't you forgotten something. A lot of us are Sooo nerdy we use Opera

    1. Re:Erm...excuse me! by its_schwim · · Score: 5, Funny

      Nobody's forgotten. /. knows that Opera readers will simply build an inline proxy that pre-reads the page, corrects any errors, add missing alignment attributes and then optimize the resulting code before passing it on to the user. For this reason, web development no longer has to take the browser into account.

    2. Re:Erm...excuse me! by gnick · · Score: 4, Funny

      Opera readers will simply build an inline proxy that pre-reads the page, corrects any errors, add missing alignment attributes and then optimize the resulting code before passing it on to the user.

      ... which will be available as a Firefox Add-on eight months later and built into the monolith that will be known as IE 10. Firefox users (myself included) will believe and argue that FF invented this feature.

      --
      He's getting rather old, but he's a good mouse.
  11. IE at 14%? by theCoder · · Score: 5, Interesting

    IE usage down to 14% seems like a major story, even for a tech heavy site like Slashdot. It would be interesting to see trends of browsers on /. over time. And maybe even OS stats?

    btw, Taco, I use noscript to turn off the Javascript on /., mostly because Firefox 2 on my Solaris machine is just too slow (and there's really no hope of getting Firefox 3 working -- I'd have to compile half of Gnome in library upgrades). I can accept some of the UI weirdness (like the gray triangle on top of every story on the main page), but I hope you don't make Javascript a requirement for viewing /. That would be painful!

    --
    "Save the whales, feed the hungry, free the mallocs" -- author unknown
  12. Bring back the old user page! by eln · · Score: 5, Insightful

    The new user page is ugly and less useful than the old one. It takes information that used to be on the main user page and makes me click on a second link in order to see it.

    I respect that website maintainers like to add new shiny things to the website every once in a while, but for God's sake, don't take away functionality in the process.

    1. Re:Bring back the old user page! by Red+Flayer · · Score: 4, Informative

      just bookmark www.slashdot.org/users.pl

      --
      "Trolls they were, but filled with the evil will of their master: a fell race..." -- J.R.R. Tolkien on Olog-hai
  13. Comment Page by sashapup · · Score: 5, Informative

    Just annecdotal, since I don't have numbers to back it up, but comment pages seem a LOT faster with the cut over from YUI. The lil floating comment bar used to be PAINFULLY slow in letting me scroll through.

    --
    Excellent.
  14. Backwards text (2:erocS) by tepples · · Score: 5, Interesting

    How about adding Unicode support so that posts aren't often filled with random garbage when commenters assume one of the major technical sites on the internet should be able to handle curved quotation marks.

    They tried that once before. But some idiots found some Unicode characters that could be used to reverse the display of Slashdot and spoof scores. See my previous post on this topic

    1. Re:Backwards text (2:erocS) by Haeleth · · Score: 4, Funny

      It would be so much easier if the Unicode folks had thought to classify all their characters for us, so we could tell at a glance what was a printable character and what was a control character that might do undesirable things. They could have stuck all that information in some kind of Character Database. Then, I dunno, maybe the Perl folks would have been able to figure out some way of making that information available to programmers, possibly even as a straightforward extension to regular expression syntax. Then it might have been feasible to extend Slash so it supported more characters safely!

      Ah, who am I kidding.

  15. Re:Test by tepples · · Score: 4, Interesting

    UTF-8 support .... that's a no.

    I'm guessing that's a no on purpose. Slashdot whitelists characters so that posters can't use the bidirectional characters to destroy the layout.

  16. Bug Fix Request - Comment Mismoderation by thePowerOfGrayskull · · Score: 5, Insightful

    I really like the new system(s), especially the async page loading and 'fetch on demand' aspects of comments. But...

    Please oh please, add a "submit" button next to the moderation dropdown? It should do the same asynchronous post that selection change of that dropdown does today. It's very easy (especially using a sensitive touchpad) to mis-click on a moderation option - which you can then only undo by replying in the conversation, and losing any point(s) awarded.*

    A submit button would remove the accidental moderation issue, and still allow the all the ajaxified web2.0 paradigms to remain intact ;)

    * then - to add insult to injury - usually get that corrective post modded down as offtopic because of some moderator a power trip

  17. Classical Style by dysfunct · · Score: 4, Insightful
    I congratulate the /. team for applying so many changes that would make the site more interesting and increase usability for a number of users. Also, I know that playing with all the new-fangled AJAX stuff is pretty and can be fun to develop.

    On the other hand: Please don't ignore us users who still use the good old classic style. I simply like my /. without fancy effects and strange navigation bars. Threshold of 3, nested, oldest comments first, re-parenting comments and a link i can open in a new tab to read the stuff below my threshold is all I want and need.

    Long story short: While developing all the exciting new stuff, please don't completely ignore or remove (*shock* *horror*) ye goode olde Slashdot layout. It works currently, has served many people well for quite a while now and hopefully doesn't cause too much work for you guys. Just please fix it every now and then in case you break it.

    --
    :/- spoon(_).
  18. Suggested Achievement by Anonymous Coward · · Score: 5, Funny

    Foreigner - posted a comment with Unicode characters

  19. need these achievements by r00t · · Score: 4, Funny

    firstpost - posted first

    troll - moderation ended with a max troll mod

    flamebait - moderation ended with a max flamebait mod

    goatse - posted a goatse link

    blind - followed a goatse link

    gone1week - survived 1 week w/o slashdot

    gone1month - survived 1 month w/o slashdot

    gone1year - survived 1 year w/o slashdot

    storypassion - posted the most comments in a story

    netcraft - explained why BSD is dying