Slashdot Mirror


The Need For Search Neutrality

wilsone8 writes "The New York Times includes an op-ed today arguing for Search Neutrality: 'Today, search engines like Google, Yahoo and Microsoft's new Bing have become the Internet's gatekeepers, and the crucial role they play in directing users to Web sites means they are now as essential a component of its infrastructure as the physical network itself. The F.C.C. needs to look beyond network neutrality and include search neutrality: the principle that search engines should have no editorial policies other than that their results be comprehensive, impartial and based solely on relevance.'"

29 of 203 comments (clear)

  1. Huh... by Ethanol-fueled · · Score: 4, Insightful
    TFA:

    For three years, my company's vertical search and price-comparison site, Foundem, was effectively "disappeared" from the Internet in this way.

    Inability to explain why. Credibility of your article nullified. Samzenpus is trolling.

    Because of its domination of the global search market and ability to penalize competitors while placing its own services at the top of its search results, Google has a virtually unassailable competitive advantage.

    Google, a company based in America, has an autocomplete-style guessing algorithm which showed "Michelle Obama monkey" as the first choice when one typed in "michelle". It was so fair that they had to alter their own results and provide a disclaimer for the sake of political correctness. Apparently that wasn't even the first time they'd dealt with that situation. I'd say Google is fair until assholes like article author started bitching and moaning.

    Google's treatment of Foundem stifled our growth and constrained the development of our innovative search technology.

    Try teaming up with Metacrawler, they are many times as powerful as google.

    Even AdWords and AdSense, the phenomenally efficient economic engines behind Google's meteoric success, are essentially borrowed inventions:

    Yeah, Toyota also borrowed the wheel from somebody. It's only a matter of time until they're sued in the East district of Texas.

    Will it embrace search neutrality as the logical extension to net neutrality that truly protects equal access to the Internet?

    I dunno, will you tell me exactly why you feel you've been shortchanged by Google?

    1. Re:Huh... by wizardforce · · Score: 4, Insightful

      Indeed. If you take a look at the site in question, there doesn't seem to be anything about it that jumps out as being novel. It looks like the author created a mediocre search/link site and expected to be in the top results. The telling bit about the whole affair is that the author claims that the site was virtually off the net in terems of searches for three years yet that would largely require the top two or three search engines to do essentially the same thing which probably more than anything leads one to suspect that there's something about the site its self rather than multiple search engines that is the problem.

      --
      Sigs are too short to say anything truly profound so read the above post instead.
    2. Re:Huh... by Anonymous Coward · · Score: 3, Insightful

      The author of TFA is upset because despite his best efforts to aggregate other people's information to drive revenues for his site (ie, leech off the actual stores) Google apparently decided that "Foundem" was a worthless piece of affiliate-link-baiting crap. It's essentially one step above making nothing but blog posts about different sites prices, all conveniently linked to one affiliate account.

      Any credibility the author of TFA *might* have had goes out the window when he claims that MapQuest was dethroned as leading map service because of Google's actions. Anybody who has actually tried to USE MapQuest knows why it lost - it SUCKS, much like the author's site.

      If "search neutrality" actually happened, there would be two results: first, any site that implemented it would be instantly filled with spamblogs and garbage like Foundem, and second, providers like Google would move offshore while pursuing massive litigation.

  2. Sure, that's great. by palegray.net · · Score: 5, Insightful

    Let's go ahead and regulate the living crap out of everything online... that's sure to do wonders for innovation.

    1. Re:Sure, that's great. by Col.+Klink+(retired) · · Score: 5, Insightful

      With neutrality rules in place, every search engine will:

      (1) Need a license or certificate showing that they have been tested and validated. This, in itself, is a barrier to entry.

      (2) Results of the search engine will expect to follow the pre-existing norms. Anything innovative, original or experimental will not likely fit into the existing set of regulations and will automatically be out-of-compliance.

      Supposed if I wanted to develop a search engine to promote free and open source software. It's not really intended to be a "general purpose" search engine but, instead, is designed to find free alternatives to commercial software. The idea is that you can search for "excel" and it will find you info about Open Office, koffice, etc. It's my own website that I'm paying for at my expense to promote my own personal beliefs.

      Along comes Microsoft, a licensed search company. They are, to be sure, not happy that a search engine helps people find alternatives to their software. They complain to the license board that I don't have a license and my site is shut down. Or, I suppose, I could get a license (and have to pass certification on topics unrelated to my search niche). And since the goal of this license is "neutrality," I can't have results that leave out proprietary software. In fact, my search engine can't even legally endorse free software.

      Licensing boards exist to maintain the status quo. Innovation is about changing the status quo.

      --

      -- Don't Tase me, bro!

  3. Fail. by girlintraining · · Score: 5, Insightful

    The principle that search engines should have no editorial policies other than that their results be comprehensive, impartial and based solely on relevance.

    The definition of comprehensive depends on the computational resources of the provider.
    The definition of impartiality depends on the morality of the observer.
    The definition of relevance depends on entirely subjective criteron.

    You can't legislate these things. They're intangible. And besides, Google (and many other search engines) rely on the ability to edit their results to defeat attempts to game the algorithms they use. Legislation that limits that would ironically worsen the very attribute it is attempting to improve! It would allow search engine spammers free reign. The solution here is not to regulate... If a search engine sucks, it'll be replaced by a vendor that offers an alternative that sucks less. But if you must legislate, I would take a minimalist approach -- only regulate that which is proven harmful.

    --
    #fuckbeta #iamslashdot #dicemustdie
  4. New York Times... by Anonymous Coward · · Score: 3, Insightful

    ...talking about "comprehensive, impartial and based solely on relevance."?

    Barf.

    1. Re:New York Times... by FictionPimp · · Score: 4, Insightful

      how can you determine relevance while being impartial?

      Well condoms are really not relevant to sexual education from a religious nut point of view. I mean sex eduction really just means telling them not to do it....

  5. Look that up in your Funk and Wagnalls by BadAnalogyGuy · · Score: 3, Insightful

    Encarta, possibly the most successful commercial digital encyclopedia of all time is based on the old Funk and Wagnalls encyclopedia which unfortunately was subpar to Brittanica and World Book by miles.

    Microsoft took that shoddy encyclopedia, added content, added media, added hyperlinks, and turned the paper volumes into the best digital encyclopedia you could (at that time) buy.

    But facts are facts. You can't really alter the information of an encyclopedia without someone calling you on it. In the same way, search engines categorize and comb through volumes of information and return data as best it can. Sometimes that data is useless (spam), but other times it is very pertinent (vanity searches).

    If Google or Bing can't restrict what is shown in their search results, the value of the search tool is reduced. As we have seen in recent years, Google's search results are getting worse and worse, being flooded by spammers and expertsexchange links that include a couple of search terms but either have nothing to do with the search or require registration to access.

    Leave the right to determine what they will return to the search providers. Guarantee that the tool remains useful by allowing them to cull the results responsibly.

    1. Re:Look that up in your Funk and Wagnalls by Nethead · · Score: 3, Funny

      I'm sorry, I haven't seen those ExpertSexChange links that include a couple of search terms but either have nothing to do with the search that you talk about. Are you sure it's not something to do with your search terms?

      --
      -- I have a private email server in my basement.
    2. Re:Look that up in your Funk and Wagnalls by TheRaven64 · · Score: 3, Informative

      As we have seen in recent years, Google's search results are getting worse and worse, being flooded by spammers and expertsexchange links that include a couple of search terms but either have nothing to do with the search or require registration to access.

      Add this to your user CSS:

      li h3 a[HREF*="http://www.experts-exchange.com/"] {display : none ! important }
      A[HREF*="http://www.experts-exchange.com/"]:after { content: " [IDIOT WARNING]"!important ; color: red }

      First line hides expertsexchange links in Google search results. Second adds a red idiot warning after any that you might come across elsewhere.

      --
      I am TheRaven on Soylent News
  6. telcos have been granted a natural monopoly by seanadams.com · · Score: 4, Insightful

    ... and in exchange, they deserve that we regulate the fuck out of them to just sell us the bits.

    Google's search is a free service with multiple competitors and negligible customer lock-in. See the difference?

  7. What an absurd idea by pclminion · · Score: 5, Insightful

    If "relevance" is a requirement, then the government will have to produce a definition of "relevance." Wow, I love this idea. Instead of allowing the advancement of technology, we have to conform to a government definition, and if we rank our search results contrary to that definition, our search engine is ILLEGAL. And I'm sure the government won't abuse their ability to declare certain results orderings to be illegal.

    Stay the hell away from my search engines. If I'm not happy with the one I'm using, I'll switch to another.

    1. Re:What an absurd idea by Cronock · · Score: 3, Insightful

      If I'm not happy with the one I'm using, I'll switch to another.

      Exactly, this is the reason why people started using Google in the first place. Everything else was absolutely full of spam, enough that relevant articles were sometimes first listed on the second or third page of results. I can see companies abusing this, but I suspect communities such as Slashdot will scream bloody murder when results are found to be skewed. From there, it's our choice to keep using it or move on to the next startup with a good search mechanism.

  8. Sour grapes by whoever57 · · Score: 5, Insightful
    Here is the motivation for the article:

    For three years, my company's vertical search and price-comparison site, Foundem, was effectively "disappeared" from the Internet in this way.

    What are the options?

    1. His site just never had enough incoming links to raise it in the rankings.
    2. His site employed tricks to artificially raise its ranking and was penalized for this.
    3. Google marked down his site for other reasons (competitive?)

    Really, what is the most likely answer? For yet another price comparison website?

    --
    The real "Libtards" are the Libertarians!
  9. Monopolies and the purview of the FCC by Pfhorrest · · Score: 5, Insightful

    Infrastructure is a natural monopoly. Broadcast spectrum even more so.

    The FCC's original mandate was to govern allocation of broadcast spectrum; the naturally monopolistic tendencies of wired infrastructure (the need for eminent domain to build it, mostly) provides a reasonable justification for extending its purview to that as well.

    But search engines are not natural monopolies. Anyone can come along, do it better than the other guys, and run off with their lunch money, so to speak. Just like Google did to all the search engines that they put out of business or pushed to the sidelines when they debuted. Sure, overturning a very popular brand like Google in the minds of users will be difficult, but that's mostly because Google is good enough for most people; if it sucked, people would be happy to try something new, and if a competitor search engine can't even carve out a little niche for itself to compete in, it obviously has nothing of significant benefit to offer.

    And unlike the inevitable Microsoft comparison, switching away from Google to another search engine costs the users absolutely nothing, compared to not only the cost of acquiring an alternative operating system, but of learning it and changing over almost all of your apps which depend on it. If switching from Windows to Linux or OSX or BSD or what have you were as cheap and easy as switching from Google to Yahoo or vice versa, I suspect MS wouldn't have nearly the stranglehold it has on the operating system market.

    Point being, there's absolutely no need to regulate search engines, because this is about one of the clearest examples of where the free market can handle itself best.

    --
    -Forrest Cameranesi, Geek of all Trades
    "I am Sam. Sam I am. I do not like trolls, flames, or spam."
  10. Article debunked here by Jim+Buzbee · · Score: 3, Interesting

    There's a good debunking of the article here

  11. Why?? by johnlcallaway · · Score: 4, Informative
    First .. the person writing the op-ed had been penalized by Google and is biased. They don't mention why, but probably from breaking some of the search engine rules regarding gateway pages or meta tags or something else. Anyone with any web skills could have contacted Google, found out why, and corrected the problem.

    Secondly .. Google got where they are because the majority of people probably like they way their search engine works, and how it is integrated with other tools. Just like Microsoft .. it didn't get to be the largest software by having the best software, just the one that most people used. If google was biased politically, I doubt that would have been the case. This guy is upset because his business was impacted because he didn't follow Google's rules and didn't bother to contact them.

    Lastly, there is NOTHING wrong with a biased search engine as long as the people using it understand the bias. Business, environmental, left wing, right wing, socialist, communist, capitalist and what-ever-ists might like to have a search engine that gives them results according to their political views. WHY does a search engine have to be non-biased?? Because this guy didn't follow the rules, was too lazy to fix it, and got hurt??? That's one of the reasons I think the Fairness doctrine is .. well .. unfair. Why can't I find a media source that has the same bias as I do so I don't have to read all the tripe from those that disagree with me. Free speech doesn't mean I have to listen to it. Free choice in search engines means I don't have to use those that don't return the results I want to see.

    Foundem is a SEARCH ENGINE. So I typed in 'price search engine'. Interestingly enough, Google was fourth on the list.....I couldn't find Foundem in the first 4 pages. Here are the meta tags on Foundem's home page ---

    vertical search, price comparison, compare prices, flight search, hotel search, shop, buy, online, compare, best deals, best buy, prices, electronics, reviews, computers, job search, property search.

    Wow ... no wonder they don't show up. They don't do anything UNIQUE. There are hundreds of companies doing the same thing. I guess they still haven't figured out how to get placement on a search engine.

    Personally, I will discount this op-ed piece as little more than whining by some company too lazy to figure out what their market is, create a unique product, and spend the time and effort to get it to show up on Goggle's search engine. Lots of other companies do that just fine.....they must have skilled web staff working for them.

    Or they figured if Google can't drive traffic to their web site, maybe the Times will. Seems the only advertising they want is 'free'.

    --
    I rarely read replies, it's my opinion and if you thought about your opinion a little more, I'm OK with that.
  12. Google maps and preferential search treatment? by rmcd · · Score: 5, Interesting

    A lot of this article is sour grapes.

    The statement that Google Maps beat Mapquest because of preferential search treatment is hilarious. When google introduced the satellite view I recall reading (Wall street journal maybe?) that a mapquest executive had said he couldn't envision any need for the satellite view in a mapping service. (I just looked for the quote and couldn't find it. Too bad. Does this ring a bell with anyone? Bad as it sounded then, it sounds unbelievably idiotic now.) Mapquest just got beat by better technology.

    1. Re:Google maps and preferential search treatment? by Xeno+man · · Score: 5, Interesting

      You can say the same thing about street view. At first though there is no piratical use of other than that's kind of neat but Google is out there with a custom car and hardware mapping out the cities of the world. Google is the first and so far the only ones to do that and it's that type of attitude that made Google as successful as it is.

  13. Exactly by headkase · · Score: 4, Insightful

    Google is a private company that lives and dies on the whims of the market. If they are incompetent and start to screw up their index, who knows it may happen, then people will leave. Geez, imagine if everything somebody didn't like had to be regulated? There is no law against being successful, well there shouldn't be unless you think like a loser. And furthermore, once you start regulating more than is absolutely necessary by "committee" you introduce inefficiencies into our wonderful free market system. Which may not be perfect but it gives us such an advantage that it would be stupid to throw it away over sour-grapes.

    --
    Shh.
    1. Re:Exactly by Darkness404 · · Score: 3, Insightful

      ..And the only reason why Microsoft is really allowed to dominate the OS market is due to artificial regulations put in by the government (software patents) and government sponsorship.

      --
      Taxation is legalized theft, no more, no less.
  14. Re:MALNOURISHED MONKEYS! by linhares · · Score: 4, Informative

    As Techdirt stated, this story was: Vetted By Malnourished Monkeys. Apparently the same this happened here. Yay.

    That's the link I was looking for. Mods take notice of parent's post please? Here is a tidbit:

    NYT Runs Quack, Self-Serving Anti-Google OpEd By Paul Kedrosky Monday, December 28, 2009 ShareThis There is a quack, self-serving, and silly search-related OpEd in Monday's NY Times that would be amusing, if it weren't so indelibly dumb. In it the founder of a company, Foundem, in the search business alleges that search company Google should be investigated and forced to do a better job of highlighting firms like his. Gosh, what a shocker. Someone in search with minimal web traffic -- Compete says Foundem gets a little less web traffic than The Fortune Cookie Chronicles does, which is to say around 1,700 a month -- wants someone in search with a lot of web traffic, Google, to send his company buckets of visitors. Amazing. The OpEd goes downhill from there. We get a litany of silly complaints, like the idea that Google doesn't innovate, that it just buys stuff from others, and that Google's Maps and other products have hurt other companies. Yeesh. I'll say this really slowly: Consumers want products that work together, simplify our lives, and solve problems. For this nitwit to want to throw us back to a world where we need point products -- maps here, directions there, product search there, email over there, etc. -- as some sort of full-employment act for me-too companies that can't get web traffic on their own merits is batshit nuts. Of course, there is a second level of stupid to this piece, and that goes to the NYT itself. It took until the fourth paragraph of the piece until we find out that the OpEd author is, you know, conflicted in that he himself runs a search company (albeit one with negligible traffic). Not only that, he has an axe to grind, as he goes on in paragraph four to arm-wavingly allege that Google "disappeared" his site from its results...

    It goes on from there. Excellent piece overall.

  15. I like Net Neutrality, but this idea is crap. by Anonymous Coward · · Score: 4, Insightful

    He probably broke Google's rules by doing shady SEO tricks and his site just isn't that popular. Why would people want to search for other search engines, anyhow? I want to find actual results, not endless pages filled with "searches" that lead to other searches but never have actual results.

    Anyhow, although I agree with net neutrality (because we *can't* easily change ISPs, due to their natural monopoly), this "search neutrality" is utter crap. I can change search engines on a whim. But *I don't want to.* If I don't like the way Google does things, I will drop them. It won't be the first time, either. I used to use Altavista, back when it was the most comprehensive. I still remember, and would use, other search engines, but thanks to Google... I just don't need to.

    If you want to get people to visit your site, make it something people want. Don't just whine if the search engines ignore you. You don't have any natural right to a certain ranking on search results (no matter how important it is to your bottom line), and I have to think that this would be an incredibly stupid thing to regulate.

    Of course, politicians like regulating things they have no business regulating. *sigh*

  16. Statism Masquerading as Net Neutrality by anglophobe_0 · · Score: 4, Interesting

    The reason it's so important for net neutrality laws to prevent ISP's from filtering or throttling traffic is because they have such a stranglehold on the market, and that monopoly/cartel is mostly government-protected. There's no way to bypass your ISP except via proxy or by switching ISP's, and many people have neither the technical knowledge to do the first, nor the availability of the second option. If you don't like the way a particular search engine behaves, just don't use a search engine, or switch to another. Telecoms are almost as impervious to market swings as the government itself, whereas there are new search engines popping up every day. Take cuil for instance. Besides, how are they going to regulate different types of search engines, for instance Bing vs. Google vs. Wolfram Alpha. Each of these engines has a very different idea of what is "relevant", even if you strip away any manipulation done for ulterior motives.

  17. Bah. Need to enforce NXDomain! by bingemaster · · Score: 5, Insightful
    Ya know, if a better competitor (from the public's POV, not from "Foundem" biased viewpoint) appears, Google will fade. Anyone remember:
    • wwww.com - the world wide web worm?
    • lycos?
    • yahoo?
    • altavista?

    I'm sure that Google will innovate/improve to keep that from happening, but it's not as if I don't have a choice between any search provider. OTOH -- I set that in my browser. Having the ISP (I'm looking at you, Charter) hijaack the NXDOMAIN to go to their own engine is causing me serious heartburn (especially since I'm trying to *telnet* to a valhalla.private address!

  18. I don't want search neutrality by holophrastic · · Score: 3, Interesting

    Why would I want search nutrality? I don't want all search engines to return essentially the same results. I want Bing to return more Microsoft-centric results, and I want Google to return Google-centric results. I want community-oriented search engines to return community-centric results, and I want product-oriented search engines to return product-centric results.

    When I want MSDN documentation, I want to go to Bing, search for javascript, and get the msdn javascript reference -- above the mozilla one.

    You know, like when you want a science book, you went to a science book store. And when you wanted a book by a british author, you called a british book store.

    It's all a part of considering the source -- in all senses of the words. I don't want everything to be the same.

  19. His site was probably marked down for linkspam. by Animats · · Score: 4, Informative

    If you look at the HTML source of Foundem, you find a set of meta keywords usually associated with webspam sites. Then there's a big block of ad-like links - Ipods, plasma TVs,"cheap flights", "fitness equipment online", etc. It looks like your typical junk link site.

    The Register reported their troubles with Google back in 2006. What they were bitching about was not that "Foundem" disappeared from Google, but that all the pages of "price comparisons" they put up were pushed way down in search results. They were also hit with an AdWords penalty. This was written up as a case study in SEO fail.

    However, at least they have a business address on the site.