Slashdot Mirror


A Statistical Review of 1 Billion Web Pages

chrisd writes "As part of a recent examination of the most popular html authoring techniques, my colleague Ian Hickson parsed through a billion web pages from the Google repository to find out what are the most popular class names, elements, attributes, and related metadata. We decided that to publish this would be of significant utility to developers. It's also a fascinating look into how people create web pages. For instance one thing that surprised me was that the <title> is more popular than <br>. The graphs in the report require a browser with SVG and CSS support (like Firefox 1.5!). Enjoy!"

30 of 294 comments (clear)

  1. We've come a long way by suso · · Score: 3, Funny

    if the tag isn't on the top elements list.

  2. Blink by suso · · Score: 4, Funny

    the tag.

    1. Re:Blink by mysqlrocks · · Score: 3, Funny

      the <blink> tag.

      I must have blinked, I didn't see it the first time.

    2. Re:Blink by ReverendLoki · · Score: 4, Funny
      Still, the only good use I ever saw for that tag was the line:

      Schrodinger's cat is <blink>not</blink> dead.

      Every other usage just caused me to browse elsewhere.

      --
      09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0
  3. is more popular than by InsideTheAsylum · · Score: 5, Funny

    well when people talk like this and dont bother using punctuation spacekeys or any of the skills that they have been taught in school its no wonder why webpages turn out like this not to mention those long runon sentences and also all that broken code that are the fist attempt at a webpage by a twelve year old kid who tried to steal someone elses layout and replaced the word with his own then you start to look at all of those dynamically generated webpages and the layouts and the style sheets and its no wonder why the good old br tag never get a work out.

    1. Re: is more popular than by aussie_a · · Score: 5, Funny

      Never been scared your girlfriend was pregnant? Oh wait, this is slashdot. Nevermind.

    2. Re: is more popular than by Anonymous Coward · · Score: 5, Funny

      Women and Compilers... miss a period and they go wild.

  4. Finally... by RandoX · · Score: 5, Funny

    An un-slashdottable server.

  5. BR tag? by p0 · · Score: 5, Insightful

    With css power you really do not need to use br, maybe that is the reason for the small stats for the tag's use?

    --
    This is my sig. There are thousands more, but this one is mine.
    1. Re:BR tag? by masklinn · · Score: 3, Interesting

      Small stat? are you joking?

      This is about the number of sites that use the tag, not the number of tags out in the wild, and <br> is used on more pages than <table>, there are as many pages with at least one <br> than pages with at least an <img> tag

      That's freaking huge, for a tag that should almost never be used.

      --
      "The way we can tell it's C# instead of Haskell is because it's nine lines instead of two." -- wadler
  6. Not complete by Anonymous Coward · · Score: 5, Funny

    It didn't have everything of course. Some elements were censored on behalf of the Chinese government.

  7. what's the point of a 1 billion page sample? by ecklesweb · · Score: 3, Interesting

    I have to ask, what's the purpose of a 1-BILLION page sample? That's the beautiful thing about statistics. If you can say something about the distribution of characteristics within a population, you don't have to survey the entire population to get meaningful results. Are the study authors proposing that no standard distribution can be applied to the entire universe of web pages? If that's the case, then do the statistics they apply to their sample of one billion really say anything predictive about the entire population?

    Aside from the cool factor of saying they sampled a billion pages, I don't see what extra benefits are gained from that extra effort.

    1. Re:what's the point of a 1 billion page sample? by Anonymous Coward · · Score: 5, Informative

      You get a decrease of the variance of the mean.

    2. Re:what's the point of a 1 billion page sample? by Durinthal · · Score: 5, Insightful

      If you can have a larger sample, why not use it? It's more accurate that way.

  8. \. shows up in the Web Authoring Statistics by digitaldc · · Score: 4, Funny

    The 'br' element

    The br element is a simple one, yet used on so many pages that it is the 8th most-used element. It is used more than the p element.

    clear, style, class, soft, id, and \.


    Wow! I never knew you guys were that popular.

    --
    He who knows best knows how little he knows. - Thomas Jefferson
    1. Re:\. shows up in the Web Authoring Statistics by shrikel · · Score: 5, Funny
      You're confused. Backslashdot is across the street.

      (sheesh)

      --
      Any sufficiently simple magic can be passed off as mere advanced technology.
  9. Best bash I've seen in a long time: by Benanov · · Score: 4, Funny
    From TFA, the classes page:

    The rest of the top 20 classes are either presentational or otherwise meaningless (msonormal, for example, which is one of the classes that Microsoft Office uses in its "HTML" output).
  10. Some of these results... by Dracos · · Score: 3, Insightful

    Prove that most people (and WYSIWYGs) don't know how to produce valid and accessible markup. The img alt attibute (an accessibility requirement) was found significantly less than width, height, and border.

    I'm working on a site now where the project owner is continually reducing usability and accessibilty of the entire site (Never mind that he secretly had a third party come up with an ugly design and ambushed the dev team with it).

    I keep telling everyone to deconstruct the adage "form follows function". It means function comes first. He doesn't care what anything *is* or how it *works*, only what it looks like. And, of course, that it's ugly.

  11. Re:No GOTOs? by the+computer+guy+nex · · Score: 4, Funny

    How about:

    IF(Post=Old_And_Tired) GOTO Mod_Down

  12. Ad for anti-IE by jamienk · · Score: 4, Insightful

    It looks like a subtle push against IE: many mantions of the HTML 5 spec (which is being written by WHAT a workgroup that includes many browser companies but not MS); use of SVG; written by a major FF developer.

    Way to go Google! Pour on the pressure!

    1. Re:Ad for anti-IE by Bogtha · · Score: 3, Informative

      written by a major FF developer

      I don't believe Ian Hickson has been involved with Firefox; if I remember correctly, he used to hack on Mozilla, but then started work at Opera before Firefox took off.

      I don't think it's a jab at Internet Explorer, it's just that he knows that the target audience is likely to have a decent browser, so he's used the features likely to be available.

      --
      Bogtha Bogtha Bogtha
  13. Opera also supports SVG by TheJavaGuy · · Score: 4, Informative

    FYI, Opera also supports SVG. I'm surprised that Ian Hickson didn't have Opera also mentioned on that Google page, after all he worked at Opera until a few months ago.

    --
    Opera Watch - An Opera browser blog.
  14. Heh by Z0mb1eman · · Score: 3, Interesting
    This reminds me of the old joke that there only ever was one 'make' script, and everyone else modified it.

    I wonder how much of what they found is influenced by how people learned to write HTML - which in all likelihood was to copy code from existing pages... might explain parts of what they found, such as:

    Most people (roughly 98%) include head, html, title and body elements. This is somewhat ironic, since three of those four elements are optional in HTML
    --
    ClutterMe.com - easiest site creation on the Net. Just click and type.
  15. table with no by saigon_from_europe · · Score: 4, Informative
    From the article:
    If someone can explain why so many pages would use a
    <table>
    tag and then not put any cells in it, please let us know.
    I don't know if they counted dynamic pages, but I guess they did. In dynamic pages, an empty table is quite normal.

    Your code usually goes like this:
    <table>
    <% for each element in collection %>
    <tr><td> something </td></tr>
    <% end for %>
    </table>

    So it is quite easy to get the empty table if the collection is empty.
    --
    No sig today.
  16. The reason not to do this by winkydink · · Score: 4, Informative

    Capitalization makes all the difference in the sentence:

    i helped my uncle jack off a horse

    --

    "I'd rather be a lightning rod than a seismometer." -Ken Kesey

  17. Re:Beford's Law by EvanED · · Score: 3, Interesting

    I had an interesting run-in with Benford's law a bit ago. I had this typed up already, so here goes (description of the law omitted; read the Wikipedia link in the parent -- it's really cool):

    You see, my hard drive crashed about two weeks ago. It had three partitions on it, and two of them are still perfectly readable. The third is pretty well shot. (Fortunately, it was the most useless partition; it's main contents was Windows itself. This does mean ANOTHER Windows installation -- after having to do one a few weeks before -- but really that's no biggie compared with my actual data. And while I'm on that subject, I had two hard drives; when I got the newer one, I put all my work stuff on it as well as a new Linux installation specifically because it was less likely to fail, and I look back at that decision now with great happiness, because it is that foresight that has made this no big deal at all.)

    I've been trying to recover data off of the third partition, and it seems that if you do a full scan of the partition it appears as if the data was just deleted. Most of the time it's able to recover information, but not always: folder names are often lost. They show up in the recovery programs I tried as just Folder2393 for example. (Numbers ranged from 2 to 5 digits.)

    The folder numbers approximately follow Benford's law.

    Here is the approximate distribution:
    (M. S. Digit) (% of folders) (Ideal Benford %)
    1 32 30.1
    2 15 17.6
    3 12 12.5
    4 12 9.7
    5 19 7.9
    6 03 6.7
    7 03 5.8
    8 02 5.1
    9 02 4.6

  18. Re:Dumb by Spad · · Score: 4, Insightful

    It's even dumber to state that someone is presenting pictures with Flash when they're actually using SVG.

  19. For folks does not (want) to run Firefox by Ilgaz · · Score: 3, Informative

    http://www.adobe.com/svg/viewer/install/main.html got suitable plugins for browsers/OS of choice.

    Notice that I got SVG plugin installed for ages, Safari didn't display the graphs. Is it because I am not using "a browser with CSS"? Well, nevermind really...

    This is the thing why I and others have negative views against firefox, svg and even .ogg. Rootless promotion of this kind...

  20. Re:BR tag? is used in 7 out of 8 pages by TekGoNos · · Score: 3, Informative

    The summary got it wrong,

    the study states that there are more pages using title, than pages using br. NOT that more title tags are used than br tags.

    Approximatly 98% of all pages have a title tag and approximatly 7 out of 8 pages have (at least one, probably more) br tags.

    --
    I have discovered a truly remarkable proof for my post which this sig is too small to contain.
  21. Fix for Firefox 1.5 by bigbadbuccidaddy · · Score: 3, Informative

    If your Firefox 1.5 doesn't display the graphs, or crashes, do the following as suggested by the Google webstats author:

    Apparently there's a problem in Firefox 1.5 regarding SVG images if you
    had SVG in the registry. Try following the steps described here:

          https://bugzilla.mozilla.org/show_bug.cgi?id=30358 1#c3