Achievements and Optimizations

This week's code refresh has added a number of really irritating story display bugs that we're working on. But, it also added a number of cool optimizations that should improve performance for a lot of readers. Tap that link below to read a brief description of them, and also a few serious notes about the achievement system we launched last Wednesday.

Ok, Optimizations. These really only affect the Index2 beta users and Firefox users. You should really be in one of these 2 groups.

• CSS Sprites: Vlad combined a number of our chrome images. Vroom used the same technique to combine our top 25 topic icons into a single image. The top 25 icons appear on 60% of our stories, and the chrome images appear on every page load. These 2 changes dropped perhaps 20 requests from a typical fresh page load. That should be a measurable performance increase for a lot of people.
• Library Purge: Scott removed the last remnants of the YUI library. This was THE library to use for AJAX a few years ago, but as of now, we have totally ported to jQuery. The last 2 bits that used YUI were some animation bits, and the discussion2 threshold changing floating widget thing. Porting those 2 things to jQuery let us pull several hundred k of JS from our includes. This let us trim another 85k from our compressed JS transfers. We've cut the JS included on Slashdot in half in the last month.
• Varnish: Jamie installed varnish as a reverse proxy behind the F5 but before our apache. Really this won't be a significant performance improvement for now. We use a complex system of static pages to cache the most read content on the site, but varnish will at last let us deprecate that ancient system for something much simpler. We'll be experimenting with this more over the week, but the only real change for most cases is that most of our static content can be served w/o the latency of NFS. Not a big deal really, but it's something. But when we purge out the old caching system, a lot of things will be a lot easier to maintain and debug.
• CDN: We're probably going to test a CDN this week. The performance gains will be minor, but it will let us move 50 megabits of traffic off our main router and distribute that globally. It sure won't hurt.

A note on Achievements. We launched this as an april fools day joke. We're glad many of you got it. We had great fun with it. But achievements are actually a real, working system. And they serve a purpose. Most of the major bits of functionality on Slashdot have a corresponding achievement. Posting a Journal? Getting a Story Accepted? Being Moderated Up? Using all of your Mod Points up? While many achievements are silly jokes: getting the first block of achievements is essentially a tutorial. And getting some of the more complicated achievements would be a useful indicator for a quality contributor to the site. The heavy lifting on this was done by Chris Brown.

We're also experimenting with a thing we call 'Auto-More'. When you get to the end of the page, a second block of articles will be added to your index. The cool thing is that this means we can serve a smaller selection of stories on the main page request. Since 2/3rds of you never read past story #6, that means that you will get your page a little faster. But 10% or so of you get to the bottom of the page. And you will transparently be given more content. We're doing a bunch of logs to see if this works out. It's just an experiment tho, we may kill it if there is a problem. I think it will eventually be connected to the pause/play function available to logged in Index2 users.

This week we intend to start rolling out the Index2 beta to a very small number of firefox users. A good number of you won't notice. Some of you will tho. You won't hurt our feelings by disabling the thing immediately but I hope you give it a shot. It's great on Firefox. It has a few bugs on Safari. It will work on Chrome as soon as Google gets a Mac port out (Hint hint!). As for IE... well, you'll keep the old system for a few more weeks, but you're only like 14% of our users, and you keep shrinking.

Ok, back to work. You too.

Comments

But does it improve story quality?

[Anonymous Coward]

How about employing someone to proof-read your posts and check the links?

Re:But does it improve story quality?

[Qzukk]

tries to write a word/post in Japanese or any other non-English language.

I think the point is that the site wants to remain in English. There's always slashdot.jp if you want to pretend that you know Japanese.

I do admit that having a submission filter fix the most common copy/paste issues (ellipses, em dashes, curved quotes, etc) should be high on the wishlist for slashdot.

Re:But does it improve story quality?

[esocid]

Look at the color scale. The ROYGBIV(and black) is a scale of hot to cold. Like a story, push the +, don't think it's good, push the -. If a story gets to yellow or above, they usually pick it up. But sometimes they pick up ones for reasons beyond my understanding, and overlook others.

Which brings me to my point. "Fire" kdawson.

Re:But does it improve story quality?

[Chad Birch]

I'm not sure what the random "pretend you know Japanese" jab is about, but regardless, I wasn't trying to say that it should be normal for people to write posts in other languages. However, I've seen multiple instances where someone tried to clear up some details related to a story, where the only source of information is in a foreign language. They write a post along the lines of:

"The summary isn't quite correct, because the article says '<foreign language>', which actually translates to something like '<english translation>'"

Slashdot then totally mangles the quote they took out of the article and displays it in random ASCII characters. Is it something that's totally necessary for the site to have? No, but it's 2009, sites should be able to deal with more than ASCII. I certainly think it would have been a better use of developer time than achievements.

Re:But does it improve story quality?

[K. S. Kyosuke]

Names generally do not put up well with translation; and certain countries in Europe use characters outside ISO-8859-1 range even in names. Or is there some new rule in English that under no circumstances can a non-English character appear in English text?

Re:But does it improve story quality?

[Andy_R]

The problem with blocking kdawson is that you lose all the stories that are posted by kdawson. We don't want to get rid of the content, we just want to get rid of the editor.

Re:But does it improve story quality?

[evanbd]

Exactly. Sometimes kdawson manages to post what could have been a perfectly decent story (good topic, good article) with a horrible summary. Then no other editor will post about it because it's a dupe (I can dream, right?), and so we miss the whole /. discussion on the subject. What we really want is no kdawson, which means that those stories would be handled by a (somewhat more) competent editor.

Achievements

[Rik Sweeney]

Is there a list of who has the most achievements? Maybe Slashdot should award titles depending upon how many achievements you have.

IPv6?

[c_g_hills]

Still no support for IPv6 it seems. Has it even been given consideration?

IE at 14%?

[theCoder]

IE usage down to 14% seems like a major story, even for a tech heavy site like Slashdot. It would be interesting to see trends of browsers on /. over time. And maybe even OS stats?

btw, Taco, I use noscript to turn off the Javascript on /., mostly because Firefox 2 on my Solaris machine is just too slow (and there's really no hope of getting Firefox 3 working -- I'd have to compile half of Gnome in library upgrades). I can accept some of the UI weirdness (like the gray triangle on top of every story on the main page), but I hope you don't make Javascript a requirement for viewing /. That would be painful!

Re:IE at 14%?

[Cube Steak]

And yet despite your claim of it not working at all in any version of IE, I was able to post this comment in IE6. Strange, eh?

Re:Sleeker is better

[Reziac]

Absolutely. The cute bells and whistles are sometimes fun, and occasionally useful, but they are NOT why I come here. I come here for the news and the conversation. It's rather like a coffeehouse or neighbourhood bar -- you go there to relax. You don't want to be forced to dress up in a power suit just to have a beer with your friends.

My internet machine is a P3 (albeit with gobs of RAM). It struggles with the full display, even in "low bandwidth" mode (on broadband). It takes 20-30 seconds for any page (even "small" ones) to download and render in Mozilla.

Aside from the fact that the whole bloody look is hard on my aging eyes (with no way to get it to be "restfully readable"), this is one reason I still use antique Netscape 3 here -- it doesn't do CSS or JS, so all I see is plain text, rendered almost instantly.

If the site's "improvements" ever get to where I can't use NS3 to read and post, I'll have to give up Slashdot -- it simply won't be worth the time or the eyestrain if I have to read it in "normal" mode.

Backwards text (2:erocS)

[tepples]

How about adding Unicode support so that posts aren't often filled with random garbage when commenters assume one of the major technical sites on the internet should be able to handle curved quotation marks.

They tried that once before. But some idiots found some Unicode characters that could be used to reverse the display of Slashdot and spoof scores. See my previous post on this topic

Re:Backwards text (2:erocS)

[Cube Steak]

But fixing things requires actually doing hard work rather than cheap hacks.

Re:Test

[tepples]

UTF-8 support .... that's a no.

I'm guessing that's a no on purpose. Slashdot whitelists characters so that posters can't use the bidirectional characters to destroy the layout.

Re:Not clear on all achievements

[Anonymous Coward]

If AC had an account, I'm sure AC will get all the achievements. Yes, including the one achievement that requires one to get all the achievements.

Re:Sleeker is better

[clang_jangle]

Using elinks is definitely the way to go when reading slashdot. Even on my screamin' new intel Mac, slashdot takes forever to load in any graphical browser.

Mark all posts as read when hitting "more"?

[Briareos]

I know posts get marked as read when using keyboard navigation, but since I don't want to do that could hitting the "Get More Comments" button at the bottom of the page and/or the "More" link in the slider thingy please mark as read and/or collapse all already shown posts?

That would really make finding the newly added posts a lot easier...

np: Gui Boratto - Mr. Decay (Chromophobia)

Suggestion.

[LWATCDR]

How about having the username field get focus when you log in.
It would save a little time when logging in.

Re:Bug Fix Request - Comment Mismoderation

[Garridan]

When I've got mod points, the huge number of dropdown boxes makes the page very slow to load and scroll around on. Perhaps it would be better to switch to something more "2.0" than a dropdown box? Each comment gets a +/- corner like stories on the firehose, and when you click one, you get the usual options in the same format as moderating stories. This would require two clicks as always, and I think it should satisfy thePowerOfGrayskull's needs -- also, it has the added benefit of being 99% implemented already, and improving design coherence overall.

Re:Sleeker is better

[Reziac]

Elinks? Another descendant of Lynx? this one? http://elinks.or.cz/ Thanks, I'll have to try it, next time I have a non-Windows system up (I don't see a build for Windows, and I gather it's not available as a binary??) The screenshots remind me of some of the old DOS-based graphical browsers, which were a good start but never really got to where they were useful to me. This looks more mature.

Re:10% of 1%

[achurch]

Those of you with functioning brains prefer larger downloads

No, those of us with functioning brains realize the download size doesn't matter -- it's the response speed. Since the majority of the download is auxiliary content (graphics, Javascript, what have you), a few kilobytes of text one way or the other won't make any noticeable difference

and waiting for full page loads before replying

Some of us like to, you know, Read The Fine Article first.

and after moderating?

Honestly, the delay had never registered with me. Maybe my ADHD quotient is too low?

Ah, right, and having to refresh the page every time you change your threshold?

I haven't changed my threshold in... good grief, I can't even remember. Years, anyway.

I've actually tried the new-style discussion interface several times since it was introduced, and frankly I just can't bring myself to like it. Partly because I hate floating widgets (they flicker too much), partly because I can't (i.e. haven't felt like taking the time to) figure out how comments are ordered, and partly, well, just because; maybe it's the Office 2007 ribbon effect of being annoyed by an arbitrarily changed interface.

Tags

[religious freak]

I still don't understand how the hell the tags work. I brief help page write-up would satiate my curiosity - I'd be willing to bet I'm not the only one.

* Exactly how heavy of a beta are tags still under? You're aware that not every tag works (when you click the triangle sometimes you end up on your user page, or elsewhere)
* How does the algorithm work (and how the hell do some of the crazy one of a kind tags get chosen)?
* How much /. human intervention is involved (i.e. Do you guys just sometimes say "screw it, this tag is stupid, so I'll remove it")?
* Any plans for future development (suggestion: if you are using an algorithm, show the tags about to be promoted in a different color, so users can input those if they agree).

A fully automated tag system is not an easy thing to do (I would think), so I'm not griping. I'm just genuinely curious (but admittedly still too lazy to look the code up).

Re:10% of 1%

[X0563511]

And, to expand...

The old interface took 1-2 seconds to load a full page.

The new interface takes 1 second to load the page, and anywhere from 1 to 30 (yes, 30!!!) seconds to process the script. While it does this, I/O with the browser is blocked.

Yep. I can really see the advantage here.

Re:10% of 1%

[HTH NE1]

Those of you with functioning brains prefer larger downloads, and waiting for full page loads before replying and after moderating? Ah, right, and having to refresh the page every time you change your threshold?

Some of us are at workplaces that treat every page fetch as 5 minutes of slacking off. Web 2.0 can make you look in the logs like you're wasting 40 hours a day.

Re:10% of 1%

[thePowerOfGrayskull]

Some of us like to, you know, Read The Fine Article first.

What does that have to do with anything? Click reply. Wait for the reply page to load. Article is in a different tab and already read...

But anyway - to summarize, you're saying that I don't need the services I think I need, because you don't, and therefore nobody should. Does that about cover it?

I've actually tried the new-style discussion interface several times since it was introduced, and frankly I just can't bring myself to like it. Partly because I hate floating widgets (they flicker too much), partly because I can't (i.e. haven't felt like taking the time to) figure out how comments are ordered, and partly, well, just because; maybe it's the Office 2007 ribbon effect of being annoyed by an arbitrarily changed interface.

Fair enough, but again yours is not the only user experience. Clearly sufficient numbers of slashdotters have left it enabled and continue to use it - therefore see some value in it.

Tangentally - flickering? Actually not sure what you're referring to here, I haven't seen anything like that.