Slashdot Mirror


Google Letting Users Rank Search Results

Myriad writes "C|Net News is running an article about Google testing out a new system which would let users rank pages. From the article, 'Two weeks ago, Google began quietly testing a Web page voting system that, for the first time on a large scale, could eventually let Web surfers help determine the popularity of sites ranked by the company's search engine.'" As someone who has a lot of experience with systems where users self rate content, let me just wish Google the best of luck. Especially since for many unscrupulous businesses, ratings in search engines directly translate to dollars.

21 of 332 comments (clear)

  1. Nothing but abuse... by night_flyer · · Score: 2, Insightful

    that is all that will happen, how are they going to stop multiple "votes"? by a cookie (that the voter can erase)? By tracking IPs (they wont put the resources into that large and complex of a system?

    I wish it would work, but it will be an abismal failure... in fact it wouldnt suprise me if some corperations hire people just to "vote" for their sites...

    just look at ANY top 50/100 voting sites and you know what I am talking about

    --


    Thanks to file sharing, I purchase more CDs
    Thanks to the RIAA, I buy them used...
    1. Re:Nothing but abuse... by closedpegasus · · Score: 2, Insightful

      That's assuming their voting interface will be a simple web page...I'm guessing they would write their own client-side application, similar to the google toolbar. With a google-written client communicating with their server, they should be able to come close (or at least make it very difficult to vote twice). There are lots of techniques that could work...dynamically generated keys, encryption, etc.

  2. Ugh, ugh, ugh. by Mr_Matt · · Score: 2, Insightful

    People who specialize in pushing sites into the top rankings--a technique known as search engine optimization--say the company's success has made Google a new frontier to conquer. And they assert that its system, like any other, can be outsmarted.

    This is particularly repugnant, especially given the goals set in the article (Google wants to make the search engine process more of a democracy, etc.) Is anybody else tired of soulless marketdroids essentially destroying all the good things that are the Net(C)(TM)(R)?

    On the bright side, maybe there's room to add Slashdot-styled moderation and meta-moderation to Google rankings - imagine a "+1 Funny" rank for the Onion or a "-1, Offtopic" page rank for every time you go surfing for something honest and end up at Yet Another pr0n Site. :)

    --


    But what does my opinion matter, I just vote here. It's not like I have any money or anything.
  3. Options by felipeal · · Score: 4, Insightful

    Even if the system works fine (i.e., without abuse), it would be nice if the user still have the option to use it or the not (as the current system works very well).

    Better yet, they could have a slashdot-like user customization mechanism (i.e., where the user can set the threshold and moderate/vote a search result in many ways).

    Anyway, I wish them luck too (Google rules :)

  4. Vote early and often. by DunbarTheInept · · Score: 2, Insightful
    Scenario: You just put up a new webpage and want to be sure it gets top hits on google.

    How you do it: After putting the page up, write a tool to hit google's voting engine over and over and over... giving yourself good ratings.

    Question: How would the system prevent this type of abuse from happening - especially the opposite approach - rating competitors' sites poorly to drop them in the list?

    Devil's Advocate Question: If you don't allow this abuse to occur, doesn't that then unfairly give extra ranking to sites based on age? A new site won't have accumulated as many votes as an old one yet, and so the ranking would always favor old (and likely to be out of date) sites over new ones.

    --

    Don't label something "offtopic" unless you know the topic well enough to tell what's on topic.

  5. Great, but .. by Eloquence · · Score: 5, Insightful
    .. this will only work when combined with trust metrics. There are certainly different views on what constitutes a quality site, and if you just let everyone vote, you get a fuzzy average (plus you have problems filtering false votes). So what you need is a system of identity where you can say "Show me all pages rated highly by people in my trusted user list".

    To establish such a system, Google needs to get users to create accounts. A more feasible solution may be cooperation with instant messaging providers, using their identity pool and friends lists as filter criteria. But if they want people to create accounts, they need to turn Google into a community. The first thing to do this would be to have an automatic discussion forum for every major website.

    That, again, would create a lot of traffic, so they might be better off using a peer-to-peer app residing on the users' systems instead, which would also allow you to add website-specific real time chat, file sharing, micropayments and other nifty things. It would also make it easier to create responsive user interfaces, which is always a problem with web UIs.

    1. Re:Great, but .. by talesout · · Score: 2, Insightful
      You call the Slashdot ranking process something that's "working"? Even somewhat? Are you mad?

      I wouldn't call this working. Not in a million years would I say that. It depends entirely on the mentality of the original moderators. Dissident opinions (or in Google's case, if they were fucking stupid enough to implement such a system, sites promoting different views) from the original moderators are not modded up, thus you never gain the ability to moderate. Meta-moderation is a hack job at best, a fucking beast of a problem at worst. And nothing fixes the original problem of Slashdot's moderation system. Groupthink is promoted, dissident views are demoted, no matter how well reasoned. You don't believe me? Check the score of this post after a few hours.

      --


      Bite my yammer.
    2. Re:Great, but .. by SEE · · Score: 3, Insightful

      Hmm. Then how in hell did I ever get to a Karma of 98? Or are you telling me that the /. groupthink has the following opinions (all expressed in posts that got net positive moderation):

      1) The antitrust actions against Microsoft were gross abuses of government power.

      2) RMS is fundamentally mistaken on the nature of property. The case for intellectual property is in fact stronger than the case for physical property, since IP is entirely the product of the creator's labor, while physical property includes preexistent matter to which no one can claim a natural right.

      3) Money doesn't corrupt governments; governments corrupt money. "Unchecked corporate power" isn't a problem on its own. The problem is that whenever a government allows itself to move beyond lassiez-faire, it creates an incentive for the entrenched corporate powers to pay for regualtions and laws that protect them and squash competitors.

  6. Re:The demise of a good search engine? by NineNine · · Score: 2, Insightful

    It's gonna keep happening... A "new" search engine comes out with little bias... First it was Altavista, then Google. But after spending millions on hardware, software, and personnel, these companies realize "hey, this is cool, but I think our owners want us to make some money." There'll be a new bias-less marketing-free SE after Google, and after a while, their owners will ask them for some profit. It'll keep happening for as long as I can tell. But, all that said, I'm happy with Google right now ;)

  7. A concern by zmokhtar · · Score: 2, Insightful

    I have seen all kinds of warez sites that force you to vote in order to get to parts of the site. Others could have frames that forge a vote each time a visitor comes to their site. While this is an intriguing idea, I don't see how it could work.

    The whole idea of Google's PageRank was to count each link from another indexed site as a vote. What was wrong with that scheme? Doesn't everyone currently think Google is the best engine out there? If so why "fix" it?

    I like the suggestion someone else made about showing the vote results but not having them acutally affect the search results.

    --
    Why aren't we told when editors moderate our posts?
  8. Taco fumbles again! by eAndroid · · Score: 2, Insightful

    Especially since for many unscrupulous businesses, ratings in search engines directly translate to dollars. Taco you moron have a little faith. This is google we're talking about. Name one feature they've screwed up that badly. If it can't be done so that companies can't take advantage of it realise that it won't be done at all. And taco, you ignorant bastard, you'd think that after you created a user-ranked web site companies can't take advantage of you would realise that anyone can do it.

    --

    I can't spell or type, but that doesn't mean I'm unusually stupid.
  9. Give Google some credit by FTL · · Score: 5, Insightful
    Google aren't idiots. Don't be so quick to post about how this will be a huge failure and how easy it will be to defeat the system.

    Think about it. According to the article, the system is currently just collecting information, it isn't affecting rankings -- yet. So in a couple of weeks Google will look at this new data, look at the corresponding pages, then figure out what should be done. Why are we assuming that they will just do a linar mapping between the number of happy faces and relevance?

    I wouldn't put it past them to dynamically map relevance with a far more complicated function. User rankings are another non-random data stream. All information (even negative information) is useful. Just as long as one strips it from its labels, and looks at it blindly. Can you say neural networks?

    --
    Slashdot monitor for your Mozilla sidebar or Active Desktop.
  10. Problems with moderation by Anonymous Coward · · Score: 1, Insightful
    I like the moderation features on this site; for the most part, the moderators themselves are scrupulous. The problem occurs when large parts of the voting bloc are biased, which leads to valid ideas being moderated down. It's easy for prevailing public opinion to be wrong. This is, of course, one of the primary arguments against the democratic process. I.e., if you have a medical problem, do you ask a select few doctors or do you take a poll of co-workers and run with the most popular result?


    In the current times lots of folks are happy to throw away their liberties in the pursuit of the vague concept of terrorists. Sites that decry this would likely be modded down because their opinions would be contrary to the masses.We've seen it on Slashdot when dissenting opinions (pro-Microsoft, pro-DMCA, pro-RIAA) are modded down without really looking at the validity of the argument.


    Maybe there should be a new category -- something like "Worthy argument, but..." which would remove the emotional connotation and focus on the validity of the argument.

  11. Meta-Rating by jeriqo · · Score: 4, Insightful

    As slashdot got Meta-Moderation, i think google should use Meta-Rating, so users could help detect spammers.

    Oh, by the way, if you're already a Slashdot moderator and want to know if you can Meta-Moderate, just check /metamod.pl.

    -J

    --
    Alexis 'jeriqo' BRET
  12. Re:Just disqualify the money element... by Bonker · · Score: 4, Insightful

    Users who perenially search outside of corporate sites could be able to customize their setting so that they'd have to select when they want to include corporate sites. Could it work? I don't know.

    Google already has a 'customized' interface that allows users to do things like change language, etc...

    I think the sugestion of separating corporate and non-corporate searches has its merits. I hate searching for an anime fanfiction and being directed to Best Buy's website because they happen to carry the anime title I mentioned in the search query.

    It has its problems too, however. Tagging each of the pages in Google's truly massive search database with a corporate or non-corporate tag is a non-trivial problem. For obvious reasons, website owners cannot be trusted to tag their own pages.

    You're also opening a can of worms here, since many website owners will protest either a commercial or a non-commercial tagging.

    Even if you tagged sites by domain, you'd still have hundreds of thousands... possibly millions of domains, not to mention sites that carry both corporate and private content like Geocities, Tripod, or other free webhosts.

    Then you have to consider what to do with semi-for-profit pages? Many pages have 'tipping jars' now. Many open-source software development pages have information about for-profit works, or are developed by for-profit organizations. Should companies like Redhat be excluded from non-profit searches? Probably. How about Vorbis Ogg? That's not nearly so clear. How about web-comics, almost all of which give away their content freely, but sell merchandise, dead-tree books, or other premiums.

    In the end, I think that I'd rather put up with having to sort through twenty or so highly relevant results to get the search result I wanted rather than having to search twice to make sure that I get all the possible relevant results.

    --
    The next Slashdot story will be ready soon, but subscribers can beat the rush and slashdot the links early!
  13. Re:Good idea but... by aka-ed · · Score: 2, Insightful

    The article clearly states that Google will use the results to supplement, not replace, current methods. So, if someone wishes to manipulate the results, they will have to combine several forms of cheating to succeed.

    The article also states that methods will be used to prevent this sort of abuse, though Google doesn't say (for obvious reasons -- why do spammers work for them?) what they are.

    But there are obvious ways to defeat abuse. One way is to do IP matching, and cull results originating from a single domain. Another would to use only a random representative sampling of votes, rather than every vote, in counting results. Another is simple human oversite (or good AI), looking for unusual ranking changes.

    Google's been great so far in avoiding the crapfloods. I doubt if they'd cut their own throats. The fact that they are testing this technology rather than just rolling it out is a good sign. When's the last time you heard of a search engine testing before implementation?

    Barely-relevant anecdote:
    The year that Excite debuted, I found my own credit card number, expiration date and phone number in their database. By pattern matching I found the same for a couple of dozen other people who had all patronized the same online bookstore (idiots momentarily had their customer database on the webserving machine, excite's spider found it).

    It took about a week to find someone at Visa who knew what the Internet was (a security VP). He informed me that Excite had been designed with no means to edit the database. I found that hard to believe -- still do -- but my personal info remained findable for several weeks thereafter.

    --
    I survived the Dick Cheney Presidency 7 to 9 AM 7-21-07
  14. OpenDirectory by Ratbert42 · · Score: 5, Insightful

    Maybe OpenDirectory could add a rate-an-editor feature for their users. If you wanna talk about abuse, look there, not to Google.

  15. Re:Might work if... by great+throwdini · · Score: 2, Insightful

    It'd be good to see something resembling peer review on the web after all.

    Don't You Yahoo! ???

    Seriously, there is so much out there that lofty goals fall apart for any but the smallest of niches. The original efforts of Yahoo! just couldn't keep pace with 'Net growth, leading to gridlock on entries and deletions and deterioration of its organization and review process.

    A more recent attempt, dmoz.org seems to have stagnated under the weight of the Web. All of the specific sections I visit lack moderation, and are about as useful as a random web search ("Gee! I wonder where they get the initial link collections.")

    Peer review is a great idea, and does take place, but requires a lot of effort and cooperation to pull off on any scale above microscopic. Been there, done that, got tired.

  16. Re:Unscrupulous Businesses? by Anonymous Coward · · Score: 2, Insightful

    Tsk, tsk. Google coders are smart cookies. They aren't gonna want 5,000,000 positive rankings from three IPs.

    Now, if one were to write Code Red III which forms a distributed network and ranks up websites that are injected into the network...

  17. Re:Other neat (cough) features: by _xeno_ · · Score: 2, Insightful
    I think what they were suggesting is that you had done something seemingly boneheaded like:

    User-Agent: *
    Disallow: /

    Think about it - how many people do you think are out there with a half-clue who decide that they want to prevent evil robots from indexing their site without realizing that they therefore won't wind up on search engines? Apparently Google seems to have run into this situation and now e-mails webmasters who have potentially accidently blocked all robots from indexing their pages.

    Now there may be a valid reason to completely block your site from all robots. But think about how pointless it really is - how many webmasters really want to drive away search engines? Most people want to show up on search engines, especially people whose site shows up as a domain (ie, http://slashdot.org/ as opposed to http://www.wherever.edu/~they/started/).

    Seriously, why did you block the entire domain from web crawlers? While there definately are good reasons, it seems sensible for Google to send a "are you really sure you want to do that" message, especially since the linked "spam" was sent to someone who apparently had four domains they had blocked off from search engines. This sounds like something that an amatuer webmaster may have accidently done without thinking about the consequences. In which case the e-mail makes sense: "Did you really mean to do that? If so, ignore this message - if not, here's a way to fix it."

    I really think you're overreacting to a fairly innocent e-mail.

    --
    You are in a maze of twisty little relative jumps, all alike.
  18. Re:Why not just monitor clickthroughs? by PhoenxHwk · · Score: 4, Insightful


    Becuase that doesn't tell if you clicked and didn't like the page. Just because one person clicks on a junk page doesn't mean that page should be higher rated for the next person.