Slashdot Mirror


The Need For Search Neutrality

wilsone8 writes "The New York Times includes an op-ed today arguing for Search Neutrality: 'Today, search engines like Google, Yahoo and Microsoft's new Bing have become the Internet's gatekeepers, and the crucial role they play in directing users to Web sites means they are now as essential a component of its infrastructure as the physical network itself. The F.C.C. needs to look beyond network neutrality and include search neutrality: the principle that search engines should have no editorial policies other than that their results be comprehensive, impartial and based solely on relevance.'"

44 of 203 comments (clear)

  1. Huh... by Ethanol-fueled · · Score: 4, Insightful
    TFA:

    For three years, my company's vertical search and price-comparison site, Foundem, was effectively "disappeared" from the Internet in this way.

    Inability to explain why. Credibility of your article nullified. Samzenpus is trolling.

    Because of its domination of the global search market and ability to penalize competitors while placing its own services at the top of its search results, Google has a virtually unassailable competitive advantage.

    Google, a company based in America, has an autocomplete-style guessing algorithm which showed "Michelle Obama monkey" as the first choice when one typed in "michelle". It was so fair that they had to alter their own results and provide a disclaimer for the sake of political correctness. Apparently that wasn't even the first time they'd dealt with that situation. I'd say Google is fair until assholes like article author started bitching and moaning.

    Google's treatment of Foundem stifled our growth and constrained the development of our innovative search technology.

    Try teaming up with Metacrawler, they are many times as powerful as google.

    Even AdWords and AdSense, the phenomenally efficient economic engines behind Google's meteoric success, are essentially borrowed inventions:

    Yeah, Toyota also borrowed the wheel from somebody. It's only a matter of time until they're sued in the East district of Texas.

    Will it embrace search neutrality as the logical extension to net neutrality that truly protects equal access to the Internet?

    I dunno, will you tell me exactly why you feel you've been shortchanged by Google?

    1. Re:Huh... by khallow · · Score: 2, Insightful

      I dunno, will you tell me exactly why you feel you've been shortchanged by Google?

      If it keeping moving, regulate it.

    2. Re:Huh... by Tynin · · Score: 2, Funny

      If it keeps moving, regulate it.

      Using that logic, in order to raise former President Reagan from the dead, all we would need to do is subsidize him.

    3. Re:Huh... by wizardforce · · Score: 4, Insightful

      Indeed. If you take a look at the site in question, there doesn't seem to be anything about it that jumps out as being novel. It looks like the author created a mediocre search/link site and expected to be in the top results. The telling bit about the whole affair is that the author claims that the site was virtually off the net in terems of searches for three years yet that would largely require the top two or three search engines to do essentially the same thing which probably more than anything leads one to suspect that there's something about the site its self rather than multiple search engines that is the problem.

      --
      Sigs are too short to say anything truly profound so read the above post instead.
    4. Re:Huh... by Anonymous Coward · · Score: 3, Insightful

      The author of TFA is upset because despite his best efforts to aggregate other people's information to drive revenues for his site (ie, leech off the actual stores) Google apparently decided that "Foundem" was a worthless piece of affiliate-link-baiting crap. It's essentially one step above making nothing but blog posts about different sites prices, all conveniently linked to one affiliate account.

      Any credibility the author of TFA *might* have had goes out the window when he claims that MapQuest was dethroned as leading map service because of Google's actions. Anybody who has actually tried to USE MapQuest knows why it lost - it SUCKS, much like the author's site.

      If "search neutrality" actually happened, there would be two results: first, any site that implemented it would be instantly filled with spamblogs and garbage like Foundem, and second, providers like Google would move offshore while pursuing massive litigation.

    5. Re:Huh... by AnotherUsername · · Score: 2, Funny
      --
      I don't like Linux. This doesn't make me a troll.
  2. Surprise, surprise... by dada21 · · Score: 2, Insightful

    ...the mouthpiece for the State clamoring for MORE State control.

    Shocking.

  3. Sure, that's great. by palegray.net · · Score: 5, Insightful

    Let's go ahead and regulate the living crap out of everything online... that's sure to do wonders for innovation.

    1. Re:Sure, that's great. by khallow · · Score: 2, Insightful

      Raises the barrier to entry for new search engines and related technology, for starters. Regulations have always favored the business that can maintain a herd of lawyers.

    2. Re:Sure, that's great. by Col.+Klink+(retired) · · Score: 5, Insightful

      With neutrality rules in place, every search engine will:

      (1) Need a license or certificate showing that they have been tested and validated. This, in itself, is a barrier to entry.

      (2) Results of the search engine will expect to follow the pre-existing norms. Anything innovative, original or experimental will not likely fit into the existing set of regulations and will automatically be out-of-compliance.

      Supposed if I wanted to develop a search engine to promote free and open source software. It's not really intended to be a "general purpose" search engine but, instead, is designed to find free alternatives to commercial software. The idea is that you can search for "excel" and it will find you info about Open Office, koffice, etc. It's my own website that I'm paying for at my expense to promote my own personal beliefs.

      Along comes Microsoft, a licensed search company. They are, to be sure, not happy that a search engine helps people find alternatives to their software. They complain to the license board that I don't have a license and my site is shut down. Or, I suppose, I could get a license (and have to pass certification on topics unrelated to my search niche). And since the goal of this license is "neutrality," I can't have results that leave out proprietary software. In fact, my search engine can't even legally endorse free software.

      Licensing boards exist to maintain the status quo. Innovation is about changing the status quo.

      --

      -- Don't Tase me, bro!

  4. Fail. by girlintraining · · Score: 5, Insightful

    The principle that search engines should have no editorial policies other than that their results be comprehensive, impartial and based solely on relevance.

    The definition of comprehensive depends on the computational resources of the provider.
    The definition of impartiality depends on the morality of the observer.
    The definition of relevance depends on entirely subjective criteron.

    You can't legislate these things. They're intangible. And besides, Google (and many other search engines) rely on the ability to edit their results to defeat attempts to game the algorithms they use. Legislation that limits that would ironically worsen the very attribute it is attempting to improve! It would allow search engine spammers free reign. The solution here is not to regulate... If a search engine sucks, it'll be replaced by a vendor that offers an alternative that sucks less. But if you must legislate, I would take a minimalist approach -- only regulate that which is proven harmful.

    --
    #fuckbeta #iamslashdot #dicemustdie
  5. New York Times... by Anonymous Coward · · Score: 3, Insightful

    ...talking about "comprehensive, impartial and based solely on relevance."?

    Barf.

    1. Re:New York Times... by FictionPimp · · Score: 4, Insightful

      how can you determine relevance while being impartial?

      Well condoms are really not relevant to sexual education from a religious nut point of view. I mean sex eduction really just means telling them not to do it....

  6. Look that up in your Funk and Wagnalls by BadAnalogyGuy · · Score: 3, Insightful

    Encarta, possibly the most successful commercial digital encyclopedia of all time is based on the old Funk and Wagnalls encyclopedia which unfortunately was subpar to Brittanica and World Book by miles.

    Microsoft took that shoddy encyclopedia, added content, added media, added hyperlinks, and turned the paper volumes into the best digital encyclopedia you could (at that time) buy.

    But facts are facts. You can't really alter the information of an encyclopedia without someone calling you on it. In the same way, search engines categorize and comb through volumes of information and return data as best it can. Sometimes that data is useless (spam), but other times it is very pertinent (vanity searches).

    If Google or Bing can't restrict what is shown in their search results, the value of the search tool is reduced. As we have seen in recent years, Google's search results are getting worse and worse, being flooded by spammers and expertsexchange links that include a couple of search terms but either have nothing to do with the search or require registration to access.

    Leave the right to determine what they will return to the search providers. Guarantee that the tool remains useful by allowing them to cull the results responsibly.

    1. Re:Look that up in your Funk and Wagnalls by Nethead · · Score: 3, Funny

      I'm sorry, I haven't seen those ExpertSexChange links that include a couple of search terms but either have nothing to do with the search that you talk about. Are you sure it's not something to do with your search terms?

      --
      -- I have a private email server in my basement.
    2. Re:Look that up in your Funk and Wagnalls by TheRaven64 · · Score: 3, Informative

      As we have seen in recent years, Google's search results are getting worse and worse, being flooded by spammers and expertsexchange links that include a couple of search terms but either have nothing to do with the search or require registration to access.

      Add this to your user CSS:

      li h3 a[HREF*="http://www.experts-exchange.com/"] {display : none ! important }
      A[HREF*="http://www.experts-exchange.com/"]:after { content: " [IDIOT WARNING]"!important ; color: red }

      First line hides expertsexchange links in Google search results. Second adds a red idiot warning after any that you might come across elsewhere.

      --
      I am TheRaven on Soylent News
  7. telcos have been granted a natural monopoly by seanadams.com · · Score: 4, Insightful

    ... and in exchange, they deserve that we regulate the fuck out of them to just sell us the bits.

    Google's search is a free service with multiple competitors and negligible customer lock-in. See the difference?

  8. What an absurd idea by pclminion · · Score: 5, Insightful

    If "relevance" is a requirement, then the government will have to produce a definition of "relevance." Wow, I love this idea. Instead of allowing the advancement of technology, we have to conform to a government definition, and if we rank our search results contrary to that definition, our search engine is ILLEGAL. And I'm sure the government won't abuse their ability to declare certain results orderings to be illegal.

    Stay the hell away from my search engines. If I'm not happy with the one I'm using, I'll switch to another.

    1. Re:What an absurd idea by Cronock · · Score: 3, Insightful

      If I'm not happy with the one I'm using, I'll switch to another.

      Exactly, this is the reason why people started using Google in the first place. Everything else was absolutely full of spam, enough that relevant articles were sometimes first listed on the second or third page of results. I can see companies abusing this, but I suspect communities such as Slashdot will scream bloody murder when results are found to be skewed. From there, it's our choice to keep using it or move on to the next startup with a good search mechanism.

  9. MALNOURISHED MONKEYS! by headkase · · Score: 2, Informative

    As Techdirt stated, this story was: Vetted By Malnourished Monkeys. Apparently the same this happened here. Yay.

    --
    Shh.
    1. Re:MALNOURISHED MONKEYS! by linhares · · Score: 4, Informative

      As Techdirt stated, this story was: Vetted By Malnourished Monkeys. Apparently the same this happened here. Yay.

      That's the link I was looking for. Mods take notice of parent's post please? Here is a tidbit:

      NYT Runs Quack, Self-Serving Anti-Google OpEd By Paul Kedrosky Monday, December 28, 2009 ShareThis There is a quack, self-serving, and silly search-related OpEd in Monday's NY Times that would be amusing, if it weren't so indelibly dumb. In it the founder of a company, Foundem, in the search business alleges that search company Google should be investigated and forced to do a better job of highlighting firms like his. Gosh, what a shocker. Someone in search with minimal web traffic -- Compete says Foundem gets a little less web traffic than The Fortune Cookie Chronicles does, which is to say around 1,700 a month -- wants someone in search with a lot of web traffic, Google, to send his company buckets of visitors. Amazing. The OpEd goes downhill from there. We get a litany of silly complaints, like the idea that Google doesn't innovate, that it just buys stuff from others, and that Google's Maps and other products have hurt other companies. Yeesh. I'll say this really slowly: Consumers want products that work together, simplify our lives, and solve problems. For this nitwit to want to throw us back to a world where we need point products -- maps here, directions there, product search there, email over there, etc. -- as some sort of full-employment act for me-too companies that can't get web traffic on their own merits is batshit nuts. Of course, there is a second level of stupid to this piece, and that goes to the NYT itself. It took until the fourth paragraph of the piece until we find out that the OpEd author is, you know, conflicted in that he himself runs a search company (albeit one with negligible traffic). Not only that, he has an axe to grind, as he goes on in paragraph four to arm-wavingly allege that Google "disappeared" his site from its results...

      It goes on from there. Excellent piece overall.

  10. Sour grapes by whoever57 · · Score: 5, Insightful
    Here is the motivation for the article:

    For three years, my company's vertical search and price-comparison site, Foundem, was effectively "disappeared" from the Internet in this way.

    What are the options?

    1. His site just never had enough incoming links to raise it in the rankings.
    2. His site employed tricks to artificially raise its ranking and was penalized for this.
    3. Google marked down his site for other reasons (competitive?)

    Really, what is the most likely answer? For yet another price comparison website?

    --
    The real "Libtards" are the Libertarians!
  11. Monopolies and the purview of the FCC by Pfhorrest · · Score: 5, Insightful

    Infrastructure is a natural monopoly. Broadcast spectrum even more so.

    The FCC's original mandate was to govern allocation of broadcast spectrum; the naturally monopolistic tendencies of wired infrastructure (the need for eminent domain to build it, mostly) provides a reasonable justification for extending its purview to that as well.

    But search engines are not natural monopolies. Anyone can come along, do it better than the other guys, and run off with their lunch money, so to speak. Just like Google did to all the search engines that they put out of business or pushed to the sidelines when they debuted. Sure, overturning a very popular brand like Google in the minds of users will be difficult, but that's mostly because Google is good enough for most people; if it sucked, people would be happy to try something new, and if a competitor search engine can't even carve out a little niche for itself to compete in, it obviously has nothing of significant benefit to offer.

    And unlike the inevitable Microsoft comparison, switching away from Google to another search engine costs the users absolutely nothing, compared to not only the cost of acquiring an alternative operating system, but of learning it and changing over almost all of your apps which depend on it. If switching from Windows to Linux or OSX or BSD or what have you were as cheap and easy as switching from Google to Yahoo or vice versa, I suspect MS wouldn't have nearly the stranglehold it has on the operating system market.

    Point being, there's absolutely no need to regulate search engines, because this is about one of the clearest examples of where the free market can handle itself best.

    --
    -Forrest Cameranesi, Geek of all Trades
    "I am Sam. Sam I am. I do not like trolls, flames, or spam."
  12. Article debunked here by Jim+Buzbee · · Score: 3, Interesting

    There's a good debunking of the article here

  13. Why?? by johnlcallaway · · Score: 4, Informative
    First .. the person writing the op-ed had been penalized by Google and is biased. They don't mention why, but probably from breaking some of the search engine rules regarding gateway pages or meta tags or something else. Anyone with any web skills could have contacted Google, found out why, and corrected the problem.

    Secondly .. Google got where they are because the majority of people probably like they way their search engine works, and how it is integrated with other tools. Just like Microsoft .. it didn't get to be the largest software by having the best software, just the one that most people used. If google was biased politically, I doubt that would have been the case. This guy is upset because his business was impacted because he didn't follow Google's rules and didn't bother to contact them.

    Lastly, there is NOTHING wrong with a biased search engine as long as the people using it understand the bias. Business, environmental, left wing, right wing, socialist, communist, capitalist and what-ever-ists might like to have a search engine that gives them results according to their political views. WHY does a search engine have to be non-biased?? Because this guy didn't follow the rules, was too lazy to fix it, and got hurt??? That's one of the reasons I think the Fairness doctrine is .. well .. unfair. Why can't I find a media source that has the same bias as I do so I don't have to read all the tripe from those that disagree with me. Free speech doesn't mean I have to listen to it. Free choice in search engines means I don't have to use those that don't return the results I want to see.

    Foundem is a SEARCH ENGINE. So I typed in 'price search engine'. Interestingly enough, Google was fourth on the list.....I couldn't find Foundem in the first 4 pages. Here are the meta tags on Foundem's home page ---

    vertical search, price comparison, compare prices, flight search, hotel search, shop, buy, online, compare, best deals, best buy, prices, electronics, reviews, computers, job search, property search.

    Wow ... no wonder they don't show up. They don't do anything UNIQUE. There are hundreds of companies doing the same thing. I guess they still haven't figured out how to get placement on a search engine.

    Personally, I will discount this op-ed piece as little more than whining by some company too lazy to figure out what their market is, create a unique product, and spend the time and effort to get it to show up on Goggle's search engine. Lots of other companies do that just fine.....they must have skilled web staff working for them.

    Or they figured if Google can't drive traffic to their web site, maybe the Times will. Seems the only advertising they want is 'free'.

    --
    I rarely read replies, it's my opinion and if you thought about your opinion a little more, I'm OK with that.
  14. Google maps and preferential search treatment? by rmcd · · Score: 5, Interesting

    A lot of this article is sour grapes.

    The statement that Google Maps beat Mapquest because of preferential search treatment is hilarious. When google introduced the satellite view I recall reading (Wall street journal maybe?) that a mapquest executive had said he couldn't envision any need for the satellite view in a mapping service. (I just looked for the quote and couldn't find it. Too bad. Does this ring a bell with anyone? Bad as it sounded then, it sounds unbelievably idiotic now.) Mapquest just got beat by better technology.

    1. Re:Google maps and preferential search treatment? by Xeno+man · · Score: 5, Interesting

      You can say the same thing about street view. At first though there is no piratical use of other than that's kind of neat but Google is out there with a custom car and hardware mapping out the cities of the world. Google is the first and so far the only ones to do that and it's that type of attitude that made Google as successful as it is.

  15. Exactly by headkase · · Score: 4, Insightful

    Google is a private company that lives and dies on the whims of the market. If they are incompetent and start to screw up their index, who knows it may happen, then people will leave. Geez, imagine if everything somebody didn't like had to be regulated? There is no law against being successful, well there shouldn't be unless you think like a loser. And furthermore, once you start regulating more than is absolutely necessary by "committee" you introduce inefficiencies into our wonderful free market system. Which may not be perfect but it gives us such an advantage that it would be stupid to throw it away over sour-grapes.

    --
    Shh.
    1. Re:Exactly by headkase · · Score: 2, Insightful

      You know what I meant ;) Our markets aren't perfect like the fact the Microsoft is dominate in operating system but they do work given time, as Linux has established a strong core and is extending as we speak from there. Going to committee nullifies that are we are all poorer for it.

      --
      Shh.
    2. Re:Exactly by Darkness404 · · Score: 3, Insightful

      ..And the only reason why Microsoft is really allowed to dominate the OS market is due to artificial regulations put in by the government (software patents) and government sponsorship.

      --
      Taxation is legalized theft, no more, no less.
  16. How about "News Neutrality"? by khchung · · Score: 2, Insightful

    "Today, news media like New York Times, Fox News, CNN have become the news gatekeepers, and the crucial role they play in dictating what news is prominently visible to the people means they are now an essential component of the society. The F.C.C. needs to look beyond freedom of the press (freedom to publish your own newspaper) and include news neutrality: the principle that news media should have no editorial policies other than that their results be comprehensive, impartial and based solely on relevance."

    I don't think it will happen in my lifetime though.

    --
    Oliver.
  17. Why is this such a bad idea? by wisnoskij · · Score: 2, Insightful

    I am surprised everyone seems so against this idea.

    I do not know about anyone else but i do not go about trying addresses in the address bar and hoping to get a relevant site. if it does not show up on the first page of google chances are I will never visit the web page.

    But, from what I have seen google does not seen to do much censoring, so i am not really worried at this point.

    and I would consider it important not to be censored from any part of the internet.
    Not that they should not edit out the people that try to artificially raise their relevant lvl, but web pages should not be filtered because some religions/ethnic group has a problem with the material.

    Not that we necessarily need laws and the government to regulate it, if their are enough people around that consider it important hopefully their will always be censor free searches around.

    While the article might contain some parts that sound like they come from someone upset that their business failed and are just blaming google because it is easy to do so, I believe the fundamental idea of search neutrality is something to want.

    --
    Troll is not a replacement for I disagree.
  18. I like Net Neutrality, but this idea is crap. by Anonymous Coward · · Score: 4, Insightful

    He probably broke Google's rules by doing shady SEO tricks and his site just isn't that popular. Why would people want to search for other search engines, anyhow? I want to find actual results, not endless pages filled with "searches" that lead to other searches but never have actual results.

    Anyhow, although I agree with net neutrality (because we *can't* easily change ISPs, due to their natural monopoly), this "search neutrality" is utter crap. I can change search engines on a whim. But *I don't want to.* If I don't like the way Google does things, I will drop them. It won't be the first time, either. I used to use Altavista, back when it was the most comprehensive. I still remember, and would use, other search engines, but thanks to Google... I just don't need to.

    If you want to get people to visit your site, make it something people want. Don't just whine if the search engines ignore you. You don't have any natural right to a certain ranking on search results (no matter how important it is to your bottom line), and I have to think that this would be an incredibly stupid thing to regulate.

    Of course, politicians like regulating things they have no business regulating. *sigh*

  19. Statism Masquerading as Net Neutrality by anglophobe_0 · · Score: 4, Interesting

    The reason it's so important for net neutrality laws to prevent ISP's from filtering or throttling traffic is because they have such a stranglehold on the market, and that monopoly/cartel is mostly government-protected. There's no way to bypass your ISP except via proxy or by switching ISP's, and many people have neither the technical knowledge to do the first, nor the availability of the second option. If you don't like the way a particular search engine behaves, just don't use a search engine, or switch to another. Telecoms are almost as impervious to market swings as the government itself, whereas there are new search engines popping up every day. Take cuil for instance. Besides, how are they going to regulate different types of search engines, for instance Bing vs. Google vs. Wolfram Alpha. Each of these engines has a very different idea of what is "relevant", even if you strip away any manipulation done for ulterior motives.

  20. Government keep your paws off the Internet! by flajann · · Score: 2, Insightful
    The Government should stay out of dictating to Google and the other search engines how they rank the searches. Period.

    If Google screws around, there are always rival search engines that would give you the content you are looking for.

    The real danger is that the Government might tell Google and other search engines to filter out what the Government considers to be "dangerous information", "State Secrets", or other nonsense.

    Basically, we are talking Search Censorship.

    EFF and others should lobby hard against *any* government interference into how online services conduct their service. We can decide for ourselves if the Search Engines are being fair, and if not, we can launch new search engines and watch the big ones loose market share.

    KEEP THE INTERNET FREE.

  21. New York Times hate Google as well by Anonymous Coward · · Score: 2, Insightful

    The New York Times has also struggled with getting people to pay for their shit, and right now is part of an effort to bring pressure against Google anyway it can.

  22. Bah. Need to enforce NXDomain! by bingemaster · · Score: 5, Insightful
    Ya know, if a better competitor (from the public's POV, not from "Foundem" biased viewpoint) appears, Google will fade. Anyone remember:
    • wwww.com - the world wide web worm?
    • lycos?
    • yahoo?
    • altavista?

    I'm sure that Google will innovate/improve to keep that from happening, but it's not as if I don't have a choice between any search provider. OTOH -- I set that in my browser. Having the ISP (I'm looking at you, Charter) hijaack the NXDOMAIN to go to their own engine is causing me serious heartburn (especially since I'm trying to *telnet* to a valhalla.private address!

  23. Just like... by joppinkaru · · Score: 2, Insightful

    the US health care system. We need *less* regulation...

    1. Re:Just like... by Cidolfas · · Score: 2, Insightful

      the US health care system. We need *less* regulation...

      From both government and private bureaucrats. Cutting middle men into people's health is a terrible idea. Who allowed that?

      Oh. Nixon.

      --
      I am become /dev/null, destroyer of data.
  24. I don't want search neutrality by holophrastic · · Score: 3, Interesting

    Why would I want search nutrality? I don't want all search engines to return essentially the same results. I want Bing to return more Microsoft-centric results, and I want Google to return Google-centric results. I want community-oriented search engines to return community-centric results, and I want product-oriented search engines to return product-centric results.

    When I want MSDN documentation, I want to go to Bing, search for javascript, and get the msdn javascript reference -- above the mozilla one.

    You know, like when you want a science book, you went to a science book store. And when you wanted a book by a british author, you called a british book store.

    It's all a part of considering the source -- in all senses of the words. I don't want everything to be the same.

  25. His site was probably marked down for linkspam. by Animats · · Score: 4, Informative

    If you look at the HTML source of Foundem, you find a set of meta keywords usually associated with webspam sites. Then there's a big block of ad-like links - Ipods, plasma TVs,"cheap flights", "fitness equipment online", etc. It looks like your typical junk link site.

    The Register reported their troubles with Google back in 2006. What they were bitching about was not that "Foundem" disappeared from Google, but that all the pages of "price comparisons" they put up were pushed way down in search results. They were also hit with an AdWords penalty. This was written up as a case study in SEO fail.

    However, at least they have a business address on the site.

  26. Oh, search neutrality is important..guess for whom by Tanuki64 · · Score: 2, Insightful

    Google is sued right and left for whatever reasons. Publishing companies lobby governments to have google pay for the "right" to make them visible. Of course, this only works well if Google is taken the power to retaliate by removing certain sites from their results at will. So search neutrality generally sounds good, but who benefits most from it?

  27. ah that Nice Mr Murdoch by mjwalshe · · Score: 2, Interesting

    is using his papers to bash his competitiors - welcom the the UK media where Murdocs papers regulualy run articles trashhing the oposition and plugging Sky. Private Eye a satirical mag even has a section dedecated to this.