Slashdot Mirror


Is Google Breaking Their Own Rules?

flood6 writes "Threadwatch is carrying a story about Google getting caught doing things they ban other websites for. Here is a page as viewed by the public and the same page as viewed by a search engine (their cache)." Note that the titles in the cache are employing classic keyword stuffing, presumably to improve rankings.

47 of 552 comments (clear)

  1. So what? by garcia · · Score: 5, Insightful

    For now, the implications are simple - If Google can do this on it's own pages, why can ordinary webmasters not? Google's keyword stuffed, cloaked title would be hard to describe as anything other than an SEO tactic not so much frowned upon, but full on hated by the Search giant itself.

    Why? Because it's their site and they are in no need to follow their own rules. They aren't going to ban themselves but they will ban you. If you want to be listed on *the* search engine then follow their rules. If you don't care if anyone finds you then you can modify your page during crawler indexing and other sites can pick you up.

    1. Re:So what? by Ubergrendle · · Score: 4, Insightful

      Remember the golden rule: He who has the gold, makes the rules.

      --
      John Maynard Keynes: "When the facts change, I change my mind. What do you do?"
    2. Re:So what? by pbranes · · Score: 5, Insightful

      Absolutely. People tend to forget that google is a corporation. They can do whatever they want with their search engine. Their goal in life is to keep you looking at their pages and using their> search engine so that they can show you more ads! Its all about money. Google is not making a search engine out of the goodness of their heart.

    3. Re:So what? by gowen · · Score: 5, Insightful
      If Google can do this on it's own pages, why can ordinary webmasters not?
      Quite. In fact, other webmasters can do it, as much as they like. Google aren't the web police... you won't be arrested or have your DNS removed. You won't rank highly on Google, but that reward is in Google's gift... and you have no right to dictate what they do.
      --
      Athletic Scholarships to universities make as much sense as academic scholarships to sports teams.
    4. Re:So what? by kebes · · Score: 3, Insightful

      You are correct: it is within their legal right to do so. It might even make business sense to do this.

      However, Google has a corporate motto that goes something like "don't be evil"...

      It certainly seems sneaky and even rude to use a tactic that you condemn others for using. Thus, from a moral standpoint (or a PR-standpoint if you prefer), I don't think Google should give preference to their own pages in their search engine. They should let their search algorithm treat their own pages normally.

    5. Re:So what? by ergo98 · · Score: 5, Insightful

      Absolutely. People tend to forget that google is a corporation. They can do whatever they want with their search engine...Google is not making a search engine out of the goodness of their heart.

      Right. Other people tend to forget that Google is not immune from oversight and criticism because they are a private corporation, and it is fully justified to call them on their activities if and when they pursue questionable avenues. No one, at least to my knowledge, is calling for government intervention, but are merely spreading the word of potentially hypocritical activities. As a user of search engines I want to hear this public criticism as it may eventually make me switch to whatever the new search engine is.

      As a sidenote, I find it remarkable how defensive the general Slashdot community is about Google. Let's try your post in a slightly different light and see what you think about it.

      Absolutely. People tend to forget that Microsoft is a corporation. They can do whatever they want with their software. Their goal in life is to keep you buying their goods and using their software so that they can lock you in and sell you more! Its all about money. Google is not making software out of the goodness of their heart.

    6. Re:So what? by Dashing+Leech · · Score: 3, Insightful
      "Why? Because it's their site and they are in no need to follow their own rules."

      No, because of the public relations and potential litigation. The public relations are bad because the public has a low tolerance for hypocricy. Google's main asset is the user-base. If they public turns against them it could do major damage.

      IANAL, but just because it is their site doesn't give them free reign to do anything they want. Since they have such a large market share of the search services there may, perhaps, be anti-competitive laws that come into play for taking advantage of their market share to artificially promote their own services above those of competition, as was the case with Microsoft and a few other similar cases we've seen lately (e.g., VoIP blocking). These might not be the case exactly here, but it is inching closer.

    7. Re:So what? by drinkypoo · · Score: 2, Insightful

      That doesn't even make any sense. Does it make sense for google not to find google pages first? That makes google a pretty crappy interface to itself. If you don't want google hits, you can always add -site:google.com and avoid them entirely.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    8. Re:So what? by ciroknight · · Score: 5, Insightful

      The reason this doesn't work is because Google can't "pay themselves" to use AdWords to pimp...AdWords. Besides, they own the company and make the rules. And maybe they should follow their own rules, but they most certainly don't have to. Besides, they don't block out competitor's results, they simply bring theirs to the top (Think: on-site searching, THEN offsite).

      I don't see Google in the wrong here.

      --
      "Victory means exit strategy, and it's important for the President to explain to us what the exit strategy is." G.W.Bush
    9. Re:So what? by Saeger · · Score: 3, Insightful
      I just love all you corporate suckups defending the beloved Google's double standard.

      If "Don't be evil" means anything, it also means "Don't be a fucking hypocrite"!

      Either everyone, or no one, should be able to pollute their title tag with crap like:

      <?php
      if (eregi($_SERVER['HTTP_USER_AGENT'], "GoogleBot"))
      $titleprefix = "foo, widgets, foobar, fubar, competitor - ";
      ?>
      --
      Power to the Peaceful
    10. Re:So what? by morcego · · Score: 2, Insightful

      Yes, that was some nice fiction, wasn't it ?
      Some of the best fiction works I ever read.

      Maybe it would also hold true for corporations. Inside a fiction book.

      --
      morcego
    11. Re:So what? by plehmuffin · · Score: 3, Insightful
      You won't rank highly on Google, but that reward is in Google's gift... and you have no right to dictate what they do.

      The validity of this is dependant upon whether Google is a monopoly or not.

      If Google is considered to have a monopoly on web searching, then this kind of behaviour could be considered in violation of anti-trust principles, since they are essentially bundling a new product (their own content) with their monopoly product (their search service), forcing users of the monopoly product to use the bundled product.

    12. Re:So what? by Simowen · · Score: 2, Insightful

      Wrong, they can't. And they don't. Anyone can make baseless statements. ;)

    13. Re:So what? by garcia · · Score: 5, Insightful

      Absolutely. People tend to forget that Microsoft is a corporation. They can do whatever they want with their software. Their goal in life is to keep you buying their goods and using their software so that they can lock you in and sell you more! Its all about money. Google is not making software out of the goodness of their heart.

      Honestly, if I were using Microsoft's search engine to search for information contained on Microsoft's own site I would certainly hope that they made the most relevant results show first.

      We aren't talking about Google and Microsoft dominating the world. We are talking about Google forcing high rankings on their own content on their own search engine.

    14. Re:So what? by FatRatBastard · · Score: 5, Insightful

      Someone sue Ford then since their website is promoting their products over the likes of GM, Toyota, etc.

    15. Re:So what? by monkeydo · · Score: 4, Insightful

      WTF. I don't pay for my searches on Google. I just assumed that nobody else did either. So, what exactly do you think Google has a monopoly on, giving away search results?

      --
      Si vis pacem, para bellum
      The only thing more annoying than a Libertarian is an (un|mis)informed Libertarian
    16. Re:So what? by Dryth · · Score: 2, Insightful

      If "Don't be evil" means anything, it also means "Don't be a fucking hypocrite"!

      Perhaps I'm using the wrong dictionary, but I fail to see how "evil" equates to "fucking hypocrite."

      Parents are frequently hypocritical. That doesn't make them evil. It just makes them hypocritical. Hypocrisy is generally a bad thing, but realize that it's often committed with the best of intentions, so it seems unfair to assume the worst.

    17. Re:So what? by Tojo-Mojo · · Score: 2, Insightful

      No, it's far more sinister.

      Take a browser that lets you change the user agent. I am using k-meleon.

      When I view:
      https://adwords.google.co.uk/support/bin/an swer.py ?answer=9653&topic=65
      and pass user agent:
      Googlebot/2.1

      I see the title EXACTLY as it appears in the cache, with the keyword spam:
      traffic estimator, traffic estimates, traffic tool, estimate traffic
      Google AdWords Support: Why do traffic estimates for my Ad Group differ from those given by the standalone tool?

      They are checking the user agent, and spamming the title with keywords for only search agents to pick up. But when a regular UA views the page, they report the regular title.

      I additionally tried this with Yahoo! Slurp and MSNbot but they did not produce the keyword spam. Looks like google is only doing this for themselves.

    18. Re:So what? by Z0mb1eman · · Score: 1, Insightful

      Will you please, PLEASE stop quoting other people's posts and changing one word to prove a point? It's overused, annoying to read, and it proves very little. This might shock some people, but Google and Microsoft are different entities. If you replace "Google" with "Microsoft" in a paragraph, OF COURSE it's not going to make much sense, but you didn't prove anything. At best, you manage to annoy or bore the reader (although it always seems to work on people with mod points). At worst, you forget to substitute one of the words, and end up sounding no better than a buggy Perl script.

      "Dog is man's best friend. For thousands of years, humans have befriended dogs, and have used dogs for hunting, protection, and company."

      "Lack of oxygen is man's best friend. For thousands of years, humans have befriended lack of oxygen, and have used lack of oxygen for hunting, protection, and company."

      Did I just disprove the first statement? Or did I just waste the reader's time with something that isn't especially relevant (like this entire post, for that matter)?

      Is it THAT hard to just type "Replace Google with Microsoft in your post and see if it still makes sense"?

      Sorry for the disproportionately long rant (and note that you = /. posters in general, not ergo98 specifically), but it's something that's always bugged me... and a way for me to avoid work for a bit longer :p

      --
      ClutterMe.com - easiest site creation on the Net. Just click and type.
  2. Could be keyword stuffing... by eln · · Score: 2, Insightful

    Or it could just be lousy technical writing and lousy editing. Sure, the word is repetitive, but never attribute to malice that which can adequately be explained by stupidity.

    1. Re:Could be keyword stuffing... by Joe+Mucchiello · · Score: 5, Insightful

      Next check the robots.txt of their site. First item is Disallow: /search? The evil URL in question is starts with /search? Thus google does not want that page crawled by other websites. How does one stuff keywords on a page they don't want indexed?

    2. Re:Could be keyword stuffing... by Peyna · · Score: 2, Insightful

      It's not keyword stuffing if the keywords given are relevant.

      --
      What?
    3. Re:Could be keyword stuffing... by Anonymous Coward · · Score: 1, Insightful
      The grandparent is specifically wrong but broadly correct. You are just wrong. It helps to look at the right robots.txt.

      The URL: https://adwords.google.co.uk/support/bin/answer.py ?answer=9653&topic=65
      The robots.txt: https://adwords.google.co.uk/robots.txt
      User-agent: *
      Disallow: /

      User-Agent: Googlebot
      Allow: /
      Allow: /support/
      Disallow: /*?

      So everything but googlebot is disallowed for the URL in question.
  3. Probably, yes. by gowen · · Score: 2, Insightful

    But, you, they're allowed to. They're their own rules. They can make rules, and change rules, and ignore rules as they see fit.

    Don't like it? Find another search engine (no longer as hard or as painful as it used to be).

    --
    Athletic Scholarships to universities make as much sense as academic scholarships to sports teams.
    1. Re:Probably, yes. by Anonymous Coward · · Score: 1, Insightful

      Here, let me clue you in. Google is a chartered corporation. By that, it means they are given limited liabilty as long as they follow their charter . If they don't follow their charter, the corporation can be dissolved.

      That is a little bit different than "They're their own rules. They can make rules, and change rules, and ignore rules as they see fit.".

      Don't like it? Don't incorporate, and bear the full personal/legal responsibilty of acting like an ass.

  4. for fun... by zxnos · · Score: 4, Insightful

    just for fun, insert 'Microsoft' in this discussion everytime someone writes 'Google' and see if you feel the same way.

    --
    always mosh clockwise
    1. Re:for fun... by generic-man · · Score: 2, Insightful

      Google charges people to use its software. Google's customers are its advertisers, not the users of its services. Google sure as hell charges advertisers for the right to use its services, and it makes about $1 billion a year from them.

      So in conclusion, it does sound the same.

      --
      For more information, click here.
  5. They can... by Kimos · · Score: 2, Insightful

    Using their own site to promote themselves. Pretty sure that's ok. They ARE offering this service to the entire world for free. What would the internet be without Google?

    1. Re:They can... by northcat · · Score: 2, Insightful

      It's not free. They display ads. They earn money, you know, they don't eat earthworms.

  6. Only one long term solution: by Ars-Fartsica · · Score: 5, Insightful
    WikiSearch (or something like it). Long term we need an open peer-reviewed crawling and serving mechanism as bad as we need free OSs and browsers. How this is developed or funded I am not sure, maybe it will be the next breakthrough in P2P that obviates the need for the massive datacenter.

    Until there is a free and open search engine, you are beholden to whatever these firms wish to do.

  7. What? by hairykrishna · · Score: 4, Insightful

    Are they suggesting that google has to resort to keyword stuffing on cached pages to get a higher ranking on their own search engine? Is it me or is this unbelievably stupid? Surely, if they wanted too, they could just have their own pages rank top of whatever searchs they wanted- keywords or no keywords? Just some find of google flag in the ranking algorithm and they'd be done.

    --
    "Physics is to math as sex is to masturbation." -R. Feynman
  8. It's global by mikkom · · Score: 3, Insightful

    It's also done globally as the article pointed out. Sneaky sneaky google.

    (This still isn't evil by googles definition because "Evil is what Sergey says is evil." and this tactic propably adds some additional millions of dollars to Sergeys pocket)

  9. Big Fat Deal. Live with it. by TheGuano · · Score: 4, Insightful

    Google doesn't need to stuff keywords for their own site - they could make their own Adwords page the only thing you ever see if you search for "traffic estimator." And why should Google care about stuffing keywords for Yahoo or Microsoft's earch engines? They don't control what you do for other search engines, either (if Google knew that your site only keyword-stuffed for MSN and Yahoo crawlers, would they care? No, they'd probably high-five you for screwing with their competitors' relevancy). There's no hypocrtical behavior here.

  10. I find it funny how everyone is so pro-Google by Rakishi · · Score: 4, Insightful

    If it was MS (if you use msn search or whatever their search engine is) made their products come out on top using such tactics then everyone would be trying to join the lynch mob. However if google does it its fine.

    What I do find interesting is that they needed the keywords, and didn't just raise their rank artificially. Does the google algorithm not have such a feature in it (or not have it easily accessible)? Potentially it does but google chose to not use it. In either case this is nicer than what I'd see other companies doing in such a case, since I doubt they'd bother with keywords on their own search engine.

  11. huh? by Shooter6947 · · Score: 2, Insightful

    I don't get it. The two pages look the same to me.

    Is it the highlighting? They always do that for pages that you find in the cache.

  12. Are you joking? by TorrentNinja · · Score: 3, Insightful

    I think this is actually handy. Google is simply altering the title "with the keywords you searched for". So that you can see the Google cache page in your title bar without seeing "Google cache", blah.

    I don't see this as anything sneaky just something to help people. Why would Google want to alter the page rank of a cached page anyways?

    Seems like a post to grab some hits on http://www.threadwatch.org/

    Lame

  13. Re:No, wait by poptix_work · · Score: 5, Insightful

    They're stuffing results for the internal search here: https://adwords.google.com/support/?hl=en_US

    All I see is people talking about how "dumb" they were to use such "obvious" cloaking techniques. Hello people, they were teaching their own search that is to be used on the adwords site. You don't tune your own internal search pages to help people find what they're looking for?

    Sounds like a lot of people upset over nothing.

    --
    Just because you disagree doesn't make it offtopic or flamebait.
  14. Re:One thing I'd point out by mpeisenbr · · Score: 2, Insightful

    It's still dishonest; if they had nothing to hide the public page would look the same as the search engine page.

  15. Re:One thing I'd point out by HaloZero · · Score: 5, Insightful

    Couldn't have said it better myself. I'm glad someone else did, I wasn't quite sure how to word it.

    Adding keywords like 'traffic monitor' and such to a page about traffic monitoring is very different than stuffing 'PARIS-HILTON-XXX-TAPE-FULL' into a page about home equity loans.

    Google doing this in-house also gives them tighter control over what is stuffed where. Of course, this could be used to ensure quality hits, or simply elevate pages THEY want to the tops of the ranks. Searchola anyone?

    Anyone else notice how there seems to be alternating instances of Google-scandal articles and Google-innovations every single day? Tomorrow we'll find out that they've made the internet obsolete, and in doing so, they've skewered a number of kittens on spikes. Oh the horror!

    --
    Informatus Technologicus
  16. Re:Ehh, wtf? by bonch · · Score: 2, Insightful

    Criticism of something is now a "witchhunt?"

    No, it's called objectively examining your beliefs in order to make sure they're valid. If they are, there's no problem.

    Unconditional praise all the time would be truly evil. Google controls a lot of the web.

  17. First off by WindBourne · · Score: 3, Insightful

    I am not sure that it is true. But leaving that aside, Google does not have a monopoly esp one that is forced or supported by illegal methods. They are large, but they do not really control the industry. Yahoo carries a lot more weight than others credit them for. When Google fails to pick up something relavent then I go to Yahoo.

    --
    I prefer the "u" in honour as it seems to be missing these days.
  18. Re:One thing I'd point out by jdreed1024 · · Score: 4, Insightful
    Or maybe, just maybe, this whole thing is much ado about nothing:
    bash-2.05b$ curl http://adwords.google.co.uk/robots.txt
    User-agent : *
    Disallow: /

    User-Agent: Googlebot
    Allow: /
    Allow: /support/
    Disallow: /*?
    bash-2.05b$

    In case it's not inherently obvious, that means no other search engines will even see the page. So that means that Google's results are being skewed by.... (wait for it) Google.
    --
    There is no sig, there is only Zuul.
  19. Now come all the posts that say... by Faust7 · · Score: 3, Insightful

    "Well, Microsoft has been identified as a monopolist, so they have to play by a different set of rules."

    I see people trot out this line every single time someone suggests that Microsoft be allowed something resembling the rights of other corporations. It's a broad, sweeping statement which essentially says that since Microsoft was designated a monopolist, the government can arbitrarily restrict their practices as they see fit, with barely adequate explanations.

    It's also completely irrational. Yes, Microsoft was identified as a monopolist. The result? They've had to change some of their practices and submit themselves to an increased level of oversight from various government institutions. It does not mean that they have given up all normal, reasonable corporate rights that are in the possession of every other company. The vitriolic hatred for Microsoft on Slashdot makes some people think that any restriction on Microsoft is a good one - that they should be hampered in the course of normal business as much as possible, and screw any idea of fairness. Some might say that this was only justice, since Microsoft presumably didn't allow fairness to competitors and that's why they were convicted. Well, it may fit your personal sense of justice, but legally it's not. The legal system has already meted out its brand of justice, which, materially, is the only one that matters. And the legal system didn't say that Microsoft must be obstructed in business whenever possible, at every turn. They still retain the right to play by established legal rules - and, being a paranoid, highly successful company, they're going to exploit those wherever they can. You might not like it, but it's their right.

  20. TRANSLATION by bonch · · Score: 2, Insightful

    "I'm a Google fanboy and will accept and justify it when they're hypocritical. I'll blame the criticism on them being popular."

  21. Relevancy is the key by ajs · · Score: 4, Insightful

    More to the point: ignorning the fact that this is google sending keywords to google; ignoring the fact that this their site and they can do whatever they want; ignoring the fact that people are using words like "evil" to describe something that affects exactly no one; ...

    The key point here is relevancy. The keywords are relevant and accurate. You might say that this breaks Google's style guidelines, and that's a good reason for them to bug-fix it. But, I fail to see how this is some great transgression on Google's part. This is USEFUL INFORMATION that they are putting in the title. Ugly, sure. I hate when eBay does the same thing. It's still not keyword spam, and it's still not cloaking. Cloaking is when you pretend to the search engine that you're a different kind of site so that you get ranked in with that kind of site. It's not putting keywords in ugly user-visible places when they are relevant.

    Please return to your useless ranting about Microsoft or something.

  22. Only affects their own searches by DunbarTheInept · · Score: 2, Insightful

    It's not a case of showing different results to other search engines. It's a case of showing different results to just themselves only. It doesn't affect Yahoo or MSN search - they still see the same page everyone else does.

    Google's complaint with other websites is, basicly, "When we hit your site, please show us the same thing you show everyone else." Thus they aren't breaking their own rule, because they ARE doing that to the other search engines out there. They are only 'lying' to themselves.

    Let's say MSN did the same thing, and rendered keyword-stuffed results for their own searches on their own sites, but still showed the same page to all external visitors, treating google no differently than an interactive user. Then it wouldn't harm Google's search in the slightest (and in fact google's search would end up being better than MSN's search on their own site because it wouldn't be tainted by the keyword stuffing). Similarly, what google did doesn't harm the other search engines in the slightest, and in fact makes them a tiny sliver more accurate than google is.

    No, this is not the same thing that they are complaining about. They don't mind in the slightest if other search engines lie to themselves, so long as they don't lie to google, and google can lie to itself so long as it doesn't lie to other search engines.

    --

    Don't label something "offtopic" unless you know the topic well enough to tell what's on topic.

  23. Re:One thing I'd point out by Trepalium · · Score: 4, Insightful
    Yes, and what's stupider still is if they wanted to skew their results, they could just modify their own engine to do so, and no one would ever know. On the other hand, see that little box at the bottom that lets you search the support site... and the fact keywords in the googlebot cache version are all related to the page in question. There couldn't be any... connection... could there? Like making their search page more accuract for their customers?

    NO! This must be a conspiracy by Google to destroy all other search engines by polluting them, while boosting their own pages. There's no other possible explanation! *sigh*

    --
    I used up all my sick days, so I'm calling in dead.