Slashdot Mirror


Alexa, Amazon's Most Flawed Idea

Rub3X writes "The Alexa ranking system is naturally flawed. The data should never be treated as accurate, as it's easily manipulated, and not supported for most browsers in the world. It's an estimate, and nothing more. " I've been saying that forever, but unfortunately for me, since it's a number on a website that is considered "Real" to some, I'm supposed to take it seriously. I imagine this is a problem for many webmasters out there.

14 of 113 comments (clear)

  1. File Upload Sites & their ranking by in2mind · · Score: 4, Informative

    Services like Megaupload.com force Non-American/Non-european users to install Alexa toolbar to download the file.

    That explains why Alexa has file-upload sites such as Megaupload,rapidshare in the top 10 sites of most countries...

  2. Error in article by tont0r · · Score: 3, Insightful

    According to the article:
    "Alexa has no support for FireFox, Opera or Safari at all. "

    According to Alexa's Wiki:
    "Users running any browser except Internet Explorer and Mozilla Firefox are not represented. Thus users of Opera, Safari, mobile phone (WAP) browsers are all ignored. Nevertheless, this is still the vast majority of the browser market."

    So its half right :P

    1. Re:Error in article by hclyff · · Score: 3, Informative

      According to this, there is no FF version. There are third party plugins for monitoring only.

  3. The data shows there are problems by technoextreme · · Score: 4, Interesting

    I've pointed this out before. There are weird statistical anomolies that should show that Alexa's webratings are not perfect. Take a look at this data for Slashdot and Digg. The traffic ratings both shoot up withing a s short amount of time. It just doesn't make much sense. http://www.alexa.com/data/details/traffic_details? &range=2y&size=medium&compare_sites=www.digg.com&y =r&url=www.slashdot.org#top

    --
    Ooo man the floppy drive is broken. No wait. The computer is just upside down.
    1. Re:The data shows there are problems by jamie · · Score: 5, Interesting

      If so, it kind of makes the case that Alexa data is less than useful.

      But that's not all that's going on. In Nov-Dec 2005 it shows Slashdot's traffic roughly tripling, then settling down to roughly double its previous level, in the space of about a month. I have our traffic logs from that time. They were basically flat. All of the variance was Alexa anomalies.

    2. Re:The data shows there are problems by badasscat · · Score: 5, Insightful

      f so, it kind of makes the case that Alexa data is less than useful.

      It's not "less than useful".

      In fact, this is both a completely obvious and a completely stupid article submission. The "duh" tag is appropriate, both because none of the current ranking/statistics systems are accurate, and because despite that, they are still useful.

      When you're looking at numbers like total reach, or you're comparing one web site with another, nobody needs statistics that are 100% accurate. I don't need to know if CNN has 4 million unique visitors per day or 4,409,765 unique visitors per day. You're using these services to get a general idea. If I'm running a web site, for example, I know what my own stats are - I don't need Alexa to tell me. But I can still use Alexa to tell me the basic gist of a competitor, and if they're not as accurate as internal stats would be, what does that matter?

      Moreover, Alexa's stats are no more or less accurate (or easy to manipulate) than those of major organizations like Nielsen. The fact of the matter is any system that's not using actual server logs is going to have some inaccuracies (and if you think otherwise, then you've just bought into marketing spin). You live with it and accept it. The main difference is that Alexa is free, whereas other stat compilers charge thousands of dollars per year.

    3. Re:The data shows there are problems by Anonymous Coward · · Score: 3, Interesting

      I remember about 5 years ago we were making a new website and it wasn't launched yet, but it was publicly visible. About 5 of us had the Alexa toolbar installed and we were spending a bit of time on the site checking it and making sure links worked etc. A couple of weeks in to it - before we had even launched the site we had an Alexa ranking of around 60,000.

      Honestly Alexa must know it's a big joke. It still annoying to see it given any relevance.

  4. Duh by UbuntuDupe · · Score: 3, Interesting

    I remember for a while LewRockwell.com, which promoted alexa for its readers, was top-500, beating out worldnetdaily.com and gamefaqs.com. Now, nothing against LewRockwell.com, and it is indeed surprisingly popular, but there's no way in hell it's a top 500 site.

  5. The people that matter by truthsearch · · Score: 4, Insightful

    Everyone who owns or develops web sites knows this. Anyone who hints in a forum the numbers may be accurate immediately gets slapped down. It's the non-technical advertisers who don't know this. And they're the only ones who care about this ranking in order to gauge how much to spend on purchasing web site advertising. Since almost no web sites publicly display traffic info advertisers find Alexa rankings very convenient and probably just don't understand why they'd be useless.

    Until advertisers "get it" or a much more accurate public metric is made available, Alexa rankings will unfortunately matter to web sites that are supported by advertising.

  6. Yeah and MOST for slashdot is not IE by technoextreme · · Score: 3, Insightful

    The problem is that statisically it's nice to say that 30% does not make a majority but Im sure that spreads changes from website to website. Imagine looking at the statistics for a Linux website. The majority there better not be IE.

    --
    Ooo man the floppy drive is broken. No wait. The computer is just upside down.
  7. Useless or Used Wrong? by logicnazi · · Score: 3, Insightful

    Now it's clear that the rankings from this system are heavily skewed and misses a substantial portion of the user base.

    This suggests it is useless as a way to estimate how much to pay for advertising on a web site (though since this is usually per click/per display I don't see why ranking matters here). However, it doesn't show that this data can't be usefull for other things. For instance it could be quite usefull to know what other sites the users (or IE users) of a site visit.

    In other words the data seems useless for any statistical analysis but it could be quite helpful to know what sorts of users visit a site. Sure slashdot's traffic might be underrepresented but I bet you the data still show that slashdot users are quite likely to go browse gadget purchase sites or programming related sites. If you want to know where to advertise your new fancy gadget or a fancy new programming enviornment that would be very usefull information even if it wouldn't support a rigorous statistical analysis.

    --

    If you liked this thought maybe you would find my blog nice too:

  8. BZZT. by Rob+T+Firefly · · Score: 5, Insightful

    One fact TFA and the Slashdot title both got wrong, is Alexa wasn't Amazon's idea. Until Amazon bought it in 1999, Alexa was the commercial offshoot of archive.org for three years. Alexa is still what gives the Wayback Machine its web crawls.

  9. Re:But is supported for the #1 browser by daeg · · Score: 4, Insightful

    It doesn't matter, though, since the distribution of toolbars is not uniform across all Internet users. A good example is the website I work on. We know our traffic, yet Alexa under-reports us. We also know a local competitor's traffic -- both sets of numbers are generally public information that advertisers use. They have a nice site but get about 1/2 of our traffic, yet Alexa over-reports them over us by a factor of 3-4.

    You can pull accurate statistics if and only if your data points are distributed correctly. Because Alexa has no way to randomly and accurately assign toolbars to users, their data is not reliable in any form.

    A similar example is how political polls are taken. You can get accurate numbers with 1,000 adults if, and only if, those 1,000 are random throughout the entire population. You can skew the poll numbers by polling 1,000 Democrats or Republicans only instead of 1,000 random. Your results are only accurate to your surveyed population -- in Alexa's case, their numbers are only accurate so far as "Rank ### amongst Internet Explorer 6.0 users who speak a limited number of languages who have voluntarily installed our toolbar to submit their surfing habits to us for analysis and are subjected to trade secret methods of ranking".

    The only way that you could pull accurate numbers would be through all ISPs selecting random data points to find what hostnames people were using. It would have to be filtered, though, to produce accurate numbers in terms of actual "website hits" instead of just "website requests". Keep-alive would further impede accurate results. As would proxies, DNS caches, and HOSTS files.

  10. Wikipedia editors constantly need to be smacked by Anonymous Coward · · Score: 4, Interesting

    Wikipedia constantly uses Alexa to see if linking to a website or profileing a website is "notable". Despite outrage by the people who submitted the content, usually everything that gets nominated for deletion has some editor cite alexa as a reason to delete it.