Slashdot Mirror


Content Owners to Charge Royalties for Searching?

dwarfking writes in with a story that follows up on the impact of recent Google events: "Ok, maybe I'm a little dense here, but isn't this plan more of an impact to the content provider than to the search engines. From the article: 'In one example of how ACAP would work, a newspaper publisher could grant search engines permission to index its site, but specify that only select ones display articles for a limited time after paying a royalty.' So, ok, a search engine company decides it doesn't want to pay royalties and therefore doesn't index the provider's site. Now won't the provider actually lose readers since their articles won't be locatable by search anymore?"

203 comments

  1. Dumb by daspriest · · Score: 5, Insightful

    Sounds like one of the dumbest ideas I have heard, this goes alongside the MPAA and RIAA shenanigans.

    1. Re:Dumb by Anonymous Coward · · Score: 0

      iep. if they don't want me to read them, i won't.

      too many things to read anyway.

    2. Re:Dumb by Alef · · Score: 4, Insightful
      Sounds like one of the dumbest ideas I have heard, this goes alongside the MPAA and RIAA shenanigans.

      What makes it extra dumb is the fact that it basically is an inverse of Google's targeted ads, if I'm getting this straight. Site owners already pay Google to have their link shown when people search for related material. And now, apparently, some of them expect Google to instead pay them for the exact same thing? Really, really dumb...

    3. Re:Dumb by Deadstick · · Score: 4, Informative

      In fact, it's right up there with Radio Shack's policy back in the TRS-80 days.

      They claimed the exclusive right to control mention of their computer in print. If you published a BASIC program to run on it, or an article about how to use it, their lawyer would show up demanding that you pay royalties or desist. Magazines resorted to talking about "S-80 Bus" computers, which was sufficiently generic.

      They got their wish, of course: you can read all the computer magazines you want without seeing anything about Radio Shack computers.

      rj

    4. Re:Dumb by pipingguy · · Score: 1

      The suits now realize that they, as middlemen, are getting cut out of something so they are screaming bloody murder (in the suit-type manner of hiring lawyers - more suits). People who own the golden goose get accustomed to having others do the real work for them and get very pissed-off when their status/authority is challenged. I mean, it's not as if they have any real-world skills or anything besides "managing", so they get desperate.

    5. Re:Dumb by HiThere · · Score: 1

      I don't believe that the TRS-80 was an S-80 bus computer. S-80 WAS generic, but it was generic for something that the TRS-80 didn't attempt to be. (The S-80 bus could handle a particular design of plug-in card. The TRS-80 couldn't handle those cards.)

      OTOH, apparently their technical communication skills were such that you didn't even realize that. A great commendation for a technology marketing company.

      --

      I think we've pushed this "anyone can grow up to be president" thing too far.
  2. What's wrong with that? by neonprimetime · · Score: 1

    Many publishers feel, however, that the search engines are becoming publishers themselves by aggregating, sometimes caching and occasionally creating their own content.

    1. Re:What's wrong with that? by Ruff_ilb · · Score: 3, Interesting

      The problem is that the search engines aren't TRYING to be publishers. The entire point of the search engines is to direct you to the content that you want. Aggregation, caching, and content creation are means to further this end. On the other hand, creation and caching of content is the whole point of the publishers. That IS their end.

      Saying that search engines are becoming publishers because they create, aggregate, and cache content to help users FIND content from publishers seems to be just a little off the mark.

      --
      http://www.TheGamerNation.com/Forums
    2. Re:What's wrong with that? by Anonymous Coward · · Score: 0

      There's two sides to that coin. Searching, indexing and excerpting are fine and I can't imagine any publisher would object to that. The problematic aspects of search engine behaviour are aggregation and caching, because these actions don't drive visitors to the publishers' sites. On the contrary, aggregation and caching are added value that the publisher cannot compete with. Even though the name of the publisher is made more visible, the users don't actually need to visit his site anymore. If your business model is to sell a print publication and your online presence is merely advertising for your actual product, then you probably don't object to the increased visibility, even though it draws visitors away from your site. As long as people see your name, you're going to be fine. But if your business model relies on attracting visitors to your site, for example because you get paid for online ads on your site, then aggregation and caching diminish your revenue potential. A good first step would be to strictly follow meta information which instructs robots not to cache pages. If the publisher doesn't want his content cached or aggregated, don't do it. IMHO "caching" websites and republishing them under a different URL is a straightforward copyright violation, and so is aggregation if you use more than a short excerpt from the original text. A cache is a temporary unmodified copy which is delivered in place of the original when the original is requested. A copy of a webpage under a different URL is a copyright violation, not a cache.

    3. Re:What's wrong with that? by pacalis · · Score: 2, Interesting

      Search engines are distributors of information content, just like publishers. The 'entire point of search engines' is not to help 'the customer' find the content, any more than the 'entire point of publishers' is to direct customers to the content they want. Really the 'entire point' of companies is to profit for their shareholders. Profit models are slightly different but in the large, given that they both profit primarily from ad content, their interests look more similar than different.

      News publishers reduce consumer search costs by aggregating content basically using evolutionary improvements on hundred year old business model/technology. Search engines have a more targeted, more revolutionary present-relevant model/technology. Isn't it obvious that these are competitors?

    4. Re:What's wrong with that? by Frosty+Piss · · Score: 2, Insightful
      The problem is that the search engines aren't TRYING to be publishers.

      I think that searches such as Google really straddle the line with how they present their search results, presenting content almost like RSS aggregators.

      I think it's easy to make a good argument that they want to provide the same type of service but with the added value of more sources, so as to attract eyeballs. Googl's not in it for humanity, you know.

      --
      If you want news from today, you have to come back tomorrow.
    5. Re:What's wrong with that? by arminw · · Score: 2, Insightful

      .....Isn't it obvious that these are competitors....

      If they are competitors, then search engines such as Google should just de-list that publisher from ALL their searches until further notice from that publisher that they want to be listed after all. If said publisher notices a precipitous drop in their page views, they WILL come crawling back on their hands an knees to be re-instated.

      --
      All theory is gray
    6. Re:What's wrong with that? by yelvington · · Score: 4, Insightful

      "The problem is that the search engines aren't TRYING to be publishers."

      Sorry, but that just isn't true.

      Yahoo quite obviously is a publisher. In fact, Yahoo has formal distribution agreements in place with many news providers, including a number of major newspapers, and pays agencies such as Reuters and the Associated Press a considerable amount of money in licensing fees. The same is true of MSN and AOL.

      You may not regard Google as a publisher, but it is. The problem is that Google publishes content that belongs to others.

      Google scrapes content from websites and constructs news presentations that include headlines, photographs and summaries that do not belong to Google. It does not secure permission to reuse that content. It doesn't pay the writers or the editors or the photographers or the news agencies.

      I'm not at all convinced that the Belgian newspapers are responding to the situation in the right way. But a knee-jerk reaction that Google is good and the publishers are bad is very naive.

      If you look at Google's scattered EULAs and TOS documents you'll discover that they are very one-sided. Google can take your content and make pages containing ads. You can not take Google's content (RSS feeds, for instance) and make pages containing ads. If you sign up for Google's advertising programs you're not allowed to disclose certain information about the program to others. You can't put Google Adsense on the same page as any other content-targeted advertising. And so on.

      Sauce for the goose is apparently not for the gander. From the Google News terms of service: "For example, you may not use the Service to sell a product or service; use the Service to increase traffic to your Web site for commercial reasons, such as advertising sales; take the results from the Service and reformat and display them, or use any robot, spider, other device or manual process to monitor or copy any content from the Service."

      Google has made great hay out of its "Do No Evil" slogan, but some of its practices, such as collaborating with governments that do not recognize the fundamental human right of freedom of speech, make me wonder.

      The argument that search indexing is good for publishers has also several problems.

      First of all, whether it's good or bad for the publisher isn't relevant to the question of legality. If I steal an apple and tell 40 friends how good it is, the market may actually gain new customers and come out ahead. But I'm still stealing an apple. The question of whether Google's screen-scraping amounts to apple-stealing is one for the courts to resolve, and apparently the Belgian courts have taken a position not friendly to Apple.

      Second, the typical Slashdot poster's naive assumption that traffic == wholesome goodness isn't true. It doesn't work that way.

      Most newspapers, for historical reasons, have an economic model that is built on advertising by businesses that are trying to reach specific customers in a highly restricted geographic region. This is particularly true in the United States; models vary in other countries, but most have a strong regional press.

      Because of the global nature of the Internet, the vast majority of traffic brought in by search engines is of no interest to local and regional advertisers.

      "Noise" traffic actually works against the site by depressing clickthrough rates and lowering the apparent effectiveness of CPM-based advertising.

      As I said, I'm not jumping onto the Belgian publisher's bandwagon, but I'm also not jumping onto Google's. This is not so simple as that.

    7. Re:What's wrong with that? by Anonymous Coward · · Score: 0

      A good first step would be to strictly follow meta information which instructs robots not to cache pages. If the publisher doesn't want his content cached or aggregated, don't do it.

      So, kind of like every search engine already does and always has?

      The problem isn't that metadata doesn't exist, or that search engines don't respect it. It's that publishers don't bother to use it, and then when their page gets cached anyway they whine that they didn't realise that they were supposed to opt out.

      IMHO "caching" websites and republishing them under a different URL is a straightforward copyright violation

      If so, then copyright is broken.

    8. Re:What's wrong with that? by hazem · · Score: 1

      Really the 'entire point' of companies is to profit for their shareholders.

      Actually, the fiduciary responsibility of a publicly held company is to maximize shareholder value.

      Value and profit are two very different things. You can easily make a company profitable by liquidating the assets and firing all the employees. Your profit will be great for a quarter.

      The rub comes when you are determining "value", and most importantly, over what period of time. If you presume that shareholders want the company to last and to grow then decisions should be made by looking at the long-term. Sadly, this is rarely the case.

      Of course, a non-public company can have any purpose they choose.

    9. Re:What's wrong with that? by jtev · · Score: 1

      This is a total falacy. You CANNOT maximize profits by selling off all the company's assets. You can maximize cashflows (also known as bank accounts) by doing that, however the purpose for every asset the company has is that it belives that over the lifetime of the asset that it can make more money with the product than the amount it will spend on the product. Add into that liquidation costs, and quite simply selling all of the company's assets is a very good way to LOOSE a lot of money. Sometimes a company will need to liquidate assets, if it doesn't have enough liquidity to manage its obligations, however this is not considered a good thing.

      --
      That which is done from love exists beyond good and evil
    10. Re:What's wrong with that? by ultranova · · Score: 1

      Google has made great hay out of its "Do No Evil" slogan, but some of its practices, such as collaborating with governments that do not recognize the fundamental human right of freedom of speech, make me wonder.

      There is no reason to wonder. Google is a corporation. Corporations, on the account of having no heart, soul or conscience, are incapable of being anything but diabolical, in the D&D sense of the word (lawful evil, the ultimate being the devils). What this means is that a corporation will do anything it can get away with, in cooperation with lawful authority (since the corporate model is not really well suited for outright warfare - that's best outsourced to tyrannical governments).

      Google's "Do No Evil" is propaganda. Believing propaganda is rather foolish. The reality is that if cooperating with an evil dictator will give higher return of investment than not cooperating, then Google will cooperate.

      The same is true of every other corporation in the planet, and is the reason why capitalism absolutely needs a strong central government: it is the only thing capable of keeping the coporations in line. This is also the reason why globalization will end in a disaster: there is no global government to force global corporations to behave, and trying to form one will propably start either World War 3 or Apocalypse or both. Which, of course, won't stop some moron from trying...

      --

      Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

    11. Re:What's wrong with that? by pacalis · · Score: 2, Insightful

      Google is aggregating the content of the aggregators so that users see googles ads first. If you're looking for a NYTimes article through a search engine, google gets to present you with ads first, before you get the NYTimes page. If your ads are well targeted you make money from some before they see the NYT content (ads are a 1/10000 game). If they de-list NYT as you suggest, they don't deliver ads for NYT customers.
      Most of this board is discussing the wrong game. Content is a cost center - content providers will shovel out any shit if it would allow them to keep/grow their ad base. If search engines can get content cheaper they win on cost. If they can deliver more relevant ads they can also win on customer value.

    12. Re:What's wrong with that? by Anonymous Coward · · Score: 0

      I use the noarchive meta tag and I know search engines which ignore it. The big ones play by the rules, but lots of smaller ones try their luck with "stolen" content. Not only does this reduce the number of visitors to the original website, it also causes problems with Google, which punishes duplicate content by lowering the ranking. Copyright isn't broken (at least not in that regard), it just gets ignored a lot. Scraper websites are not only illegal, they are also one of the scourges of today's web and make it harder for the users to do their part in supporting the original producers of valuable content (which often simply means visiting the original website instead of a "cached copy"). Just because it's a search engine doing the scraping doesn't mean it's a cache and not an illegal copy.

    13. Re:What's wrong with that? by pacalis · · Score: 1

      Sure. Fine. But given that the phrase 'entire point' does not have the case law surrounding it that 'fiduciary DUTY', I think this point distracts like a post on a spelling correction. A discussion of fiduciary duty might be better suited to Brilliant's/Googles for-profit philantrhopy.

    14. Re:What's wrong with that? by hazem · · Score: 1

      I think you're making my point for me. People can make bad decisions that look good on paper today while sacrificing the future.

      I'm definitely not saying that liquidating assets is a good way to make a profit. But in a strict sense, if it makes more money come in than has left, then it's a profit. Anything projected for the future is just a projection and not guaranteed. By focusing on profits right NOW, the decision sacrifices the future.

      Now, this is an extreme example. But there are countless examples of companies using the very short-sighted/near-term thinking - making decisions that make things look good on paper today in exchange for a lot of pain in the future. As long as a company's stock price and a manager's bonus are tied to looking good "today" regardless of the future, we'll continue to have this situation.

      One possible solution is to make upper management compensation packages reliant on stocks that cannot be sold no sooner than 5 years after the executive leaves office. This would help ensure that they'll make decisions that will help keep the company profitable and valuable over the long term.

    15. Re:What's wrong with that? by jtev · · Score: 1

      No, I'm specicaly countervaling specifics about your point. There was a cost associated with those assets, the purchase price. If you do not make back the purchase price you are losing money. Period. There is no profit, there is loss. The quarterly statement will show a very large "liquidation expense" Corporations live on double entery accounting, not on cash accounting. If you don't understand double entry accounting, don't presume to say that something will be a profit. It pure and simple ISN'T. Even if your depreciation of assets was perfectly dead on, you still suffer a specific loss from the cost of liquidating the assets. A corporation that exists to maximize profits would never liquidate all of their assets, because it wouldn't be a profit. If it were the way to maximize their profits then they should go into the aftermarket sales of (whatever asset) instead of whatever business they were in.

      --
      That which is done from love exists beyond good and evil
    16. Re:What's wrong with that? by grimwell · · Score: 1

      http://news.google.com/ aka Google News doesn't have ads.

      --
      If the govt becomes a lawbreaker, it breeds contempt for law, it invites man to become his own law, it invites anarchy
    17. Re:What's wrong with that? by temcat · · Score: 1

      The problem is that Google publishes content that belongs to others.

      This by itself is not a copyright violation. There are fair use rights that permit you to do that to a limited extent (in regard to each specific work).

    18. Re:What's wrong with that? by pacalis · · Score: 1

      I don't work at google, but my guess is that offerings are clearly used to improve ad relevance rather than delivering ads... i.e. just becuase Walmart doesn't sell their shelves doesn't mean they're not a store
      "...And, since Google News is part of Personalized Search, you can view and manage your history of past searches and news selections (read more about Personalized Search). "
      http://news.google.com/intl/en_ca/about_google_new s.html

    19. Re:What's wrong with that? by grimwell · · Score: 1

      I don't really understand your analogy about Walmart & shelves. Your original post said news aggregators get first swing at displaying ads. Sure, no problem there... kinda obivous.

      I'll even grant ya that the search engine is tracking what news you read. But if you're searching or just browsing at news.google.com or even news.yahoo.com, there are zero ads.

      It would seem that the established search engines which do news aggregation have considered the pitfall you pointed out and choosen to avoid it. As for the tracking, that information won't become useful until you leave their news section and do a general search.

      --
      If the govt becomes a lawbreaker, it breeds contempt for law, it invites man to become his own law, it invites anarchy
    20. Re:What's wrong with that? by grimwell · · Score: 1

      Here's a related article http://www.time.com/time/magazine/article/0,9171,1 538652-2,00.html

      People don't pay for their news in traditional newspapers: they pay for the paper, which typically costs the company more than it charges for the finished product. So in theory, giving away the news without the paper looks like a good deal for newspapers, if they can keep the advertising.

      --
      If the govt becomes a lawbreaker, it breeds contempt for law, it invites man to become his own law, it invites anarchy
    21. Re:What's wrong with that? by pacalis · · Score: 1
      All I meant is that google doesn't have to put ads on every single service to have a single service consistent with their business model. There might not be a lot of value in adding ads to raw news headlines, so they may have decided just to drop the ads. But they could still use browsing history to deliver better ads when you are on their other services, or even to understand trend/traffic/content patterns of thier customers.

      The Walmart anaology might suck - but just like news on google, Walmart doesn't need to sell its shelves to justify the use of them. Obviously shelves are a cost walmart must suck up becuase it enables other parts of their infrastrcuture. Some elements of the business might not be justifiable on their own, but need to be considered within the broader business context (as I suggest above)

      Finally, this all might be obvious, but it leads to very different conclusions than the post I responeded to.

  3. Idiotic by Anonymous Coward · · Score: 0

    This is on par with charging money for getting lyrics online. Greed never ceases to amaze.

    1. Re:Idiotic by kfg · · Score: 2, Insightful

      This is on par with charging money for getting lyrics online. Greed never ceases to amaze.

      No more nor less stupid than charging money for any other form of recorded music/literature online. A recording artist makes money by selling his sound recordings, a lyricist makes money by selling his text recordings.

      If you purchase a sound recording or sheet to learn the lyrics, the lyricist gets paid. If you download a free sound recording or sheet, the lyricist does not.

      So the question, as always, develoves back to the root; the inherent validity of the copyright concept, whether or not you think that lyricists should get paid for using their works.

      At the moment I solve the issue by forcing you to come to enough of my live performances to memorize my work (at least those that I haven't "given away" by posting on Slashdot), or you could book a lesson, but not everyone sees it that way.

      KFG

    2. Re:Idiotic by SleepyHappyDoc · · Score: 1

      If you purchase a sound recording or sheet to learn the lyrics, the lyricist gets paid. If you download a free sound recording or sheet, the lyricist does not.

      So the question, as always, develoves back to the root; the inherent validity of the copyright concept, whether or not you think that lyricists should get paid for using their works.


      Good straw man. What about people who purchase a sound recording (thus paying the lyricist), then want to learn the lyrics...should they have to pay twice to the lyricist because the singer had marbles in his mouth?

      --
      Stasis is death. Embrace change.
    3. Re:Idiotic by kfg · · Score: 1

      ...should they have to pay twice to the lyricist because the singer had marbles in his mouth?

      Why are you supporting lousy singers who record on labels that do not provide lyric sheets with the recording?.

      For purposes of bias revelation I will point out that I have never downloaded an infringing mp3, but have a number of infringing midi and text files. I learn many of the songs/tunes I perform that way, I do mostly "covers" (goes with the territory of being a "folk" singer) and they are often better references than a sound recording (the lyricist/composer, at least in theory, gets paid if the works are under copyright. ASCAP and BMI are supposed see to that. BMI does a better job).

      I take it there's something in what I said that makes you think that I think it is always morally wrong to download an infringing lyric sheet? If so, you are in error.

      My preference, however, is for buying legitimate "fake" books, especially if the publisher has the good sense to spiral bind them.

      KFG

    4. Re:Idiotic by pipingguy · · Score: 1

      At the moment I solve the issue by forcing you to come to enough of my live performances to memorize my work

      Where do I sign up?

    5. Re:Idiotic by kfg · · Score: 1

      Ah, well, there's the rub. At the moment you kinda don't. I've already laid in for a winter of intense practice and a bit of composing in contemplation of doing some actual recording, not all of it my own projects.

      There are some local clubs where I go to see the musician type friends and test out material and such on a semiregular basis, but they're all within 25 miles of Albany, NY. Come spring I'll probably start wandering around the Adirondacks, Green Mountains, NYC and Boston again. I've been sticking to the Northeast lately.

      You'll note also that I don't do any online promotion at all as yet. I walk softly and carry a big stick; with holes in it. If clubs I play at happen to drop my name online there's nothing I can do about that but stop doing gigs entirely, which I'm not entirely prepared to do. I enjoy it too much.

      So I'm not quite ready to hide in a cave, but if you're not the sort of person who already comes to my gigs, you aren't likely to come to one of my gigs, because you aren't likely to find them. It's almost all word of mouth. Maybe I'll get over that someday, but not today.

      KFG

    6. Re:Idiotic by pipingguy · · Score: 1

      Like a Wiffle Bat? If I was still in Montreal I'd look you up.

      PAB

    7. Re:Idiotic by kfg · · Score: 1

      Like a Wiffle Bat?

      Keyless flute. It's a Zen Irish thing.

      If I was still in Montreal I'd look you up.

      Ahhhhhhhhhh, haven't been there in quite a while. Maybe I should add it to the next year's wandering list. There's people I'd like to see again, but I'm a "suspicious" looking charecter and I understand that US Customs can be real jerks these days. I hate that.

      KFG

  4. Robots? by TechyImmigrant · · Score: 5, Insightful

    So using the courts they have failed to get royalties and achieved what they could have achieved with some robots.txt files.

    --
    Evil people are out to get you.
    1. Re:Robots? by Anonymous Coward · · Score: 3, Insightful

      They just want more money for providing the same service. It is just like the big telecomm companies trying to charge twice for data going over their network (the anti-net neutrality non-sense). What can "publishers" do to prevent indexing? Robot.txt files, of course. But if they somehow feel these simple files telling others not to index their content do not do enough, they can always turn off public access to their content and go to a subscription only model with terms of service prohibiting indexing.

      Nobody is making the publishers make their content available publicly. But so long as publishers do so, others can remember their content, index it, and tell me about it.

    2. Re:Robots? by Tim+C · · Score: 1

      What can "publishers" do to prevent indexing? Robot.txt files, of course. But if they somehow feel these simple files telling others not to index their content do not do enough

      To be fair, robots.txt is only a request; search engines can ignore it (and I believe that some do).

    3. Re:Robots? by Anonymous Coward · · Score: 1, Insightful

      Search engines can get their asses banned if they ignore robots.txt. On top of that, they can get themselves into legal trouble when their ignorance causes them to buy 100 airplanes from the webshop that was off limits for robots. The web is a dangerous place for machines which don't understand what they're doing. They should take all the help they can get, especially the kind which was specifically created for them. Last but not least, obeying robots.txt is just good manners. If you cast common courtesy aside, don't expect me to treat you with respect either.

    4. Re:Robots? by cgenman · · Score: 1

      Google maintains an opt-out policy for both its Google News and Google Print services, saying any publisher can withdraw its content simply by asking.

      So that's two routes the publishers could have taken to achieve the same thing.

      It seems like the issue is that publishers want to remain in Google, they just want to find ways to get paid for it. They're looking for a third option between "Play by google's rules" and "take our content and go home."

      On the other hand, I was under the strong impression that "indexing" a site is completely legal, as you're not violating any 1.copyright or 2.trademark laws, and that really the issue is whether the reproduced blurb about the page exceeds fair use.

      Being a content creator myself, I do think that content creators should be compensated for their works. But there is fair compensation, and there is misunderstanding the technology and trying to pass restrictive laws to get all that you can grab. Thankfully, this seems to be somewhere in the middle.

    5. Re:Robots? by Pofy · · Score: 1

      >On the other hand, I was under the strong impression
      >that "indexing" a site is completely legal, as you're
      >not violating any 1.copyright or 2.trademark laws, and
      >that really the issue is whether the reproduced blurb
      >about the page exceeds fair use.

      Yes, as long as you don't make any infringing copies on the way or make public performances or make the work available to the public in an infringing way and so on. In many cases it seems Google for example actually makes complet copies of the page and provid through for example "cached page" options which probably would be copyright infringement in most countries. That is were they can go wrong, providing the content themselves. The indexing in itself and short quotes presented as part of the search results should probably be OK in basically every country.

  5. greed... by wulfbyte · · Score: 3, Informative

    is the worlds most common and least forgivable form of stupidity.

  6. NAA by ignipotentis · · Score: 1

    What do you expect? *AA like to use their size to affect price and generate revenue. This is their job. If the New York Times and Washington Post jump on board, wouldn't Google look foolish for not being able to return stories which match nicely to the search request?

    Although I do find it funny that the NAA (http://www.naa.org) is made searchable through a Google Mini appliance.

    --
    Don't waste time... procrastinate now!
    1. Re:NAA by Alioth · · Score: 1

      No - not at all. That sort of thing would be a huge opportunity for, say, the BBC or USA Today (or any other competitor) who doesn't keep their information from being indexed and found.

    2. Re:NAA by shmlco · · Score: 1, Insightful

      And who, in all likelyhood, is running the same wire service story anyway...

      --
      Any sect, cult, or religion will legislate its creed into law if it acquires the political power to do so.
  7. Submitter has hit the nail on the head. by numbski · · Score: 4, Insightful

    There's really not much more to say about this. Let 'em wallow in their own stupidity, and they'll come around. Sometimes, like children, you have to let someone learn the hard way, and they'll never do it again. :)

    "You'll shoot your eye out! You'll shoot your eye out!"

    Side note - anyone else lose their login cookie this morning only forced to log back in and fill out a captcha? Weirdness. Worse, I saw no option for the visually impaired to log in either. Tsk tsk tsk....guys, come on. I'm not meaning to toss flames around, but you've got to provide some sort of opt-out link for those who can't see your captcha images. :(

    --

    Karma: Chameleon (mostly due to the fact that you come and go).

    1. Re:Submitter has hit the nail on the head. by mrmeval · · Score: 4, Insightful

      The absolute second a pornographer sued Google they should have ripped anything by them off their server and made sure that would never appear on a Google search again.

      Any 'content holder' that whines needs the same thing done to them with no option for reindexing without paying enough to bleed them white or better donating a large chunk of their content to the public domain.

      --
      I'd go on a Vegan diet but the delivery time from Vega is too long. --brownkitty
    2. Re:Submitter has hit the nail on the head. by westlake · · Score: 1
      Let 'em wallow in their own stupidity, and they'll come around

      There are sites and services Google News must access to remain credible. The throw-away weekly shopping paper from Nowhere, Nebraska is not a substitute for the WSJ.

      Microsoft would like nothing better than to become the news channel, the portal, for the decision-makers in this world.

  8. Only if the search engines hang tough by jmorris42 · · Score: 2, Interesting

    The premise of the submitter only holds if ALL of the search engines hang tough. If only Google tells em to go piss up a rope, they lose most of the news sources and readers start using someone else. One of the failing search sites will pay (because for them the cost will be mimimal.... at the time) and with luck become successful. Then they give all the profits to the news providers and become a .bomb and we repeat the cycle until they are all dead except Google who only derives a small income from banner ads on Google News. See online music P2pP sites become DRMed music providers and then die for a template.

    --
    Democrat delenda est
    1. Re:Only if the search engines hang tough by kfg · · Score: 1

      The premise of the submitter only holds if ALL of the search engines hang tough. If only Google tells em to go piss up a rope, they lose most of the news sources and readers start using someone else.

      See my post about Wal-Mart shipping back DVDs.

      KFG

    2. Re:Only if the search engines hang tough by paeanblack · · Score: 2, Insightful

      I think the news publishers are in a worse predicament, given that 90% of non-local articles are verbatim reprints of AP reports. Unless they are all holding firm, the search engines will see the content. Google, et. al, also has the option of subscribing to AP directly and becoming a true publisher themselves.

  9. Lawsuit by ultranova · · Score: 5, Insightful

    So, ok, a search engine company decides it doesn't want to pay royalties and therefor doesn't index the provider's site. Now won't the provider actually lose readers since their articles won't be locatable by search anymore?

    Sounds like rounds for suing the search engine for lost revenue to me !

    "Your honor, by refusing to pay our fee the search engine is not only depriving us of our fair due, but also giving an unfair competitive advantage to our competitors. We demand that they add us to their search database and pay our very reasonable fee for accessing our pages."

    And if anyone mods me funny, well... that's one naive fellow, then.

    --

    Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

    1. Re:Lawsuit by JanneM · · Score: 1

      And if anyone mods me funny, well...

      Funny? Had there been a "-1 You're making me cry" moderation I would not have needed to write this.

      --
      Trust the Computer. The Computer is your friend.
    2. Re:Lawsuit by Morphine007 · · Score: 1

      I would hope that a US judge would throw that kind of stupid shite out the instant it crossed his/her desk... but given this kind of shenanigans your post deserves the "+1, sad but true" mod :S

    3. Re:Lawsuit by deblau · · Score: 1
      "Your honor, by refusing to pay our fee the search engine is not only depriving us of our fair due, but also giving an unfair competitive advantage to our competitors. We demand that they add us to their search database and pay our very reasonable fee for accessing our pages."
      Google: "Your honor, is opposing counsel really suggesting that we are required to do business with them against our wishes?"

      Of course, the suit would never get that far. Here's a summary of unfair competition law.

      --
      This post expresses my opinion, not that of my employer. And yes, IAAL.
    4. Re:Lawsuit by pipingguy · · Score: 1

      This reminds me of the deep linking silliness. It's sad, really, but at least it gives corporate lawyers and idle executives something to do.

  10. Not as clear cut as it sounds by joe545 · · Score: 1, Insightful

    These news sites are taking the point of view that not all publicity is good publicity. If they don't want their content to be aggregated into a section of another (and very popular) web site that they feel is encroaching on their business, then who are we to say that they shouldn't try to take action? If google decide to put ads up on Google News, then they'd be making money from others' content, why shouldn't they want and get a piece of that pie?

    1. Re:Not as clear cut as it sounds by ignipotentis · · Score: 4, Insightful

      I don't see this as making money on other's content. Google does link you back to the main story. It does not display a cached version.

      Google is making money on their unique ability to gather, index, and make sense of all of the seperate news articles being created. They can show you news stories about related items from different sources around the world. They are making money on the service which lets you actually see the news from different points of view.

      This is very different, and the content creators had nothing to do with this. This is a service on top of their service, and they deserve nothing from it. Google does provde the opt out option either by contacting them, or by simply using the robots.txt.

      --
      Don't waste time... procrastinate now!
    2. Re:Not as clear cut as it sounds by Anonymous Coward · · Score: 0

      I don't know... Google does display a few sentences of context. It may be that a few sentences are all those complaining organizations provided in the first place.

      (It's amazing how little information these news organizations actually give out now. Probably because joe-public just doesn't have the attention span.)

    3. Re:Not as clear cut as it sounds by BerislavLopac · · Score: 1

      It's all perfectly clear when you consider the whole point of Web. Web was originally designed for linking the published articles. Forbidding someone to link to your page is like forbidding people to tell each other about an article they read in a paper, or even from borrowing them the paper.

    4. Re:Not as clear cut as it sounds by Anonymous Coward · · Score: 0

      HI,

      > It does not display a cached version.

      It did in this case. Not only that, it did so after the original was only available after payment. *THAT* is what the court case was about but very few people here seem to realize that.

      Google was effectively giving away copyrighted content for free rather than just linking to it.

      *YOU* try telling RIAA that you would stop giving away copyrighted material if they'd only ask you.

      And as for those who say: let google stop linking to them and they'll die: This particular newspaper does not care about google. Their websites are there for their readers. Their business models revolve around selling ink-on-paper advertising, they can never get as much ad revenue from putting banners on web pages.

      Google needs newspapers to make money, newspapers do not need google to make money.

  11. Willfully stupid by hublan · · Score: 4, Insightful
    From the article:
    "Since search engine operators rely on robotic 'spiders' to manage their automated processes, publishers' Web sites need to start speaking a language which the operators can teach their robots to understand," according to a document seen by Reuters that outlines the publishers' plans.

    "What is required is a standardized way of describing the permissions which apply to a Web site or Web page so that it can be decoded by a dumb machine without the help of an expensive lawyer."


    You mean like robots.txt?

    This sounds like willful ignorance. All the search engines mention it as the method to avoid having particular content indexed. They might not read RFCs but a quick peek at the help pages on the search engines in question would've answered this (and squashed the lawsuit) in no time.

    --
    My spoon is too big.
    1. Re:Willfully stupid by mjtaylor24601 · · Score: 1

      I think the whole business about permissioning is a red herring. They have no real interest in actually getting themselves delisted from search engines. That would destroy their business as no one would be able to find their precious copyrighted articles.

      If all they wanted was to not be indexed they would have just used robots.txt and been done with it. Rather this smells to me like a cheap attempt to squeeze some money out of Google.

      They want to be listed in Google because it gets them traffic. But wouldn't it be great if they could also get in on the profits Google is making by providing that listing service? From the news paper's perspective that's a win-win scenario.

      --
      I wish I were as sure of anything as some people are of everything
    2. Re:Willfully stupid by pipingguy · · Score: 1

      But wouldn't it be great if they could also get in on the profits Google is making by providing that listing service?

      Wait - are you implying that greedy businessmen want a cut of something for essentially no effort? What are you, a communist or something?

    3. Re:Willfully stupid by Anonymous Coward · · Score: 0

      Exactly! And the most ironic part of this is the fact that if you couldn't search their site using Google or any other search engine, then they'd never get any traffic in the first place!

      On the net you only "exist" if people can find your site! Google is doing them a favor. In fact, I bet if Google just up and dropped all the complainers from their indexing, they'd then sue and claim Google was trying to ruin their businesses!!

      These people must have stolen the RIAA's playbook, because they're obviously showing the same level of self destructive stupidity.

    4. Re:Willfully stupid by mjtaylor24601 · · Score: 1

      "What are you, a communist or something?"

      You're right. I'm sorry, I don't know what came over me. I will immediately report to the nearest Walmart(TM) customer service center for "re-education".

      --
      I wish I were as sure of anything as some people are of everything
  12. I agree by khallow · · Score: 2, Interesting

    Instead, it'd be the content provider paying the search engine. I can't imagine a scenario where the webpage is so valuable that the economics would work this way. Further, I don't understand their concern about indexing content. It's not hard at all to block or steer search engines. It strikes me that these publishing companies are either ignorant of the value provided by external search engines and/or delusional about the value of content that isn't indexed by a popular search engine.

    1. Re:I agree by paeanblack · · Score: 1

      I can't imagine a scenario where the webpage is so valuable that the economics would work this way.

      Anything sufficiently popular and time-sensitive

      nyse
      nasdaq
      ebay
      craigslist

    2. Re:I agree by khallow · · Score: 1

      No, I don't see those as being popular enough that a search engine would pay to link to them. The stock exchanges distribute their information to many sites while most of what's on ebay and craiglists list is valuable only to a small number of people and only if those people know about it. Ie, it's still more valuable to the content provider to be listed on a search engine rather than the other way around.

  13. Hey! I got a better idea by iminplaya · · Score: 5, Funny

    Let's just shut down the net. Damn thing has been nothing but trouble since the beginning. We probably should outlaw all communications that don't provide more income for the content "owners". That means no more printing, writing, singing, painting, talking...anything. If we don't want to give all our money to these damn people, we should shut the hell up, right?

    And put in your earplugs
    put on your eyeshades
    you know where to put the cork...

    Oops, there goes another violation.

    --
    What?
    1. Re:Hey! I got a better idea by Anonymous Coward · · Score: 1, Interesting

      I agree. The Net was an interesting experiment, but it's just about over now. But, there were a few ideas to be learned.

      I suggest someone make an Internet Version 2. Now that we have software patents and EULAs and interminably long copyrights, patent/copyright/trademark the *&$%^ out of it. Then, license it to anyone and everyone on the sole condition that they agree to not let a lawyer anywhere near it. In order to run a web server, you have to agree not to sue anyone over content you post on it. In order to run a web browser, the EULA requires that you forego the right to sue anyone over any content you see with it. If you're a telecom company that wants to buy a router, you have to agree not to block ports or artificially slow your competitor's traffic. If you want to make software that uses Internet Version 2 functions, you have to agree to forego software patents or license them to everybody. In short, let's build a new, better internet - without the lawyers.

      Can it be done?

    2. Re:Hey! I got a better idea by iminplaya · · Score: 1
      --
      What?
    3. Re:Hey! I got a better idea by kfg · · Score: 1

      And put in your earplugs

      Brought to you by Bose(tm)

      put on your eyeshades

      Brought to you by Paramount Studios(tm)

      you know where to put the cork...

      Brought to you by Kaopectate(tm)

      KFG

  14. Robot.txt is a machine readable permissions model by mdfst13 · · Score: 4, Insightful

    "What is required is a standardized way of describing the permissions which apply to a Web site or Web page so that it can be decoded by a dumb machine without the help of an expensive lawyer."

    They already have this. It's called the robot.txt file. You can use it to tell search bots not to index you. This just seems to be a richer permissions model, that includes things like caching and excerpting options.

    In the longer term, I agree that this hurts content providers more than Google. Overall, it makes the search index less useful. However, it makes the content unfindable. Content that uses this will simply be replaced by content that does not.

    Why would Google pay to provide better search results for content? It would make more sense for them to pay for the content direct so that they could have an exclusive. Or for content to pay to appear in the search results, like with Yahoo.

  15. Is it, though? by Anonymous Coward · · Score: 1, Interesting

    But is it really "dumb"? I don't have any doubt that these media outfits have very talented economists, financialists, and lawyers working for them. These are people who can accurately predict what will happen if the media companies were to take this course of action. They know how consumers will respond, and they know how it will affect their company's bottom line.

    So while it may seem "dumb" to you, I think that many manyears of analysis have gone into this situation, performed by very bright individuals with a variety of backgrounds. And collectively, they have realized that this may very well be the most effective and profitable course of action for their company to take.

    1. Re:Is it, though? by tomhudson · · Score: 4, Insightful

      "hese media outfits have very talented economists, financialists, and lawyers working for them. These are people who can accurately predict what will happen if the media companies were to take this course of action. They know how consumers will respond, and they know how it will affect their company's bottom line."

      I hope you're just trolling. Most analysts in any field aren't worth shit when it comes to making predictions. That's why there are so many product failures every year, and why for every winner in the stock market, there's at least one loser.

      Media people are among the most clueless. Take a look at how many movies bomb, at how many magazines die every year, how many tv shows don't go beyond the first season, how many newspapers are having to cope with declining readership

      http://www.naa.org/marketscope/pdfs/Sunday_Nationa l_Top50_1998-2005.pdf Sorry, its one of those darned pdfs.

      Sample stats:

      1998 - 135,000,000 adult population, 92,000,000 readers
      2005 - 150,000,000 adult population, 89,000,000 readers.

      So, while the potential market has grown more than 10%, their readership has declined 4%.

    2. Re:Is it, though? by Trailwalker · · Score: 1
      These are people who can accurately predict what will happen if the media companies were to take this course of action

      Same fellows who predicted the precipitous decline of the daily newspaper?

      With advice like that, they can stop the presses now.
    3. Re:Is it, though? by Anonymous Coward · · Score: 0

      Holy shit, I've seen people pull conjectures from their asses before but this takes the cake. I work for a media conglomerate and they have even less of a clue than you. 1) we have no economists (economists?) 2) 'financialists' concentrate on cutting costs though we call them accounting 3) lawyers.... wtf do lawyers have to do with this? Your post would be no less nonsensical to claim our team of media astronauts ands neurosurgeons thought this a brilliant plan.

    4. Re:Is it, though? by Mr.+Underbridge · · Score: 3, Interesting

      But is it really "dumb"? I don't have any doubt that these media outfits have very talented economists, financialists, and lawyers working for them. These are people who can accurately predict what will happen if the media companies were to take this course of action. They know how consumers will respond, and they know how it will affect their company's bottom line.

      The question, though, is whether those smart people are actually allowed to make the final decision. This is the newspaper indstry we're talking about. The same industry that is *still* making you start an account and sign in to track what you read. This pisses a lot of people (like me) off, who end up not coming back to the site. Not only that, 90% of that information can be tracked by simply logging IP. So they turn away advertising revenue because of a completely antiquated practice.

      So no, it's not surprising that companies like that would fail to figure out that search engines are FREE FUCKING ADVERTISING.

      Go check out some of the recent articles on Techdirt, this is one of the author's favorite pet peeves. The upshot is that the newspaper industry has its collective head up its ass and completely fails to understand this whole internet thing. The recent developments in Belgium and France, where newspapers have sued google to avoid being cached, demonstrate this principle in action.

      If I'm google, I tell them go ahead - your funeral.

    5. Re:Is it, though? by edumacator · · Score: 1

      I don't have any doubt that these media outfits have very talented economists, financialists, and lawyers working for them.

      I remember when Coca Cola changed their formula too. That worked out really well...

    6. Re:Is it, though? by Anonymous Coward · · Score: 0

      And don't forget about the "old" net and specificaly Hotmail. Media such as newspapers wanted Hotmail to pay them to have links on Hotmail's site. Hotmail told them to go suck eggs and that they would pay Hotmail to link to their sites. The general standard of advertising and the associated revenue was created. The Media people were very wrong and very blind.

    7. Re:Is it, though? by misterhypno · · Score: 1

      It never ceases to amaze me that people who ridicule psychics and science fiction will rely on the predictions of financial analysts and economists.

      Lee Darrow, C.H.

    8. Re:Is it, though? by rm999 · · Score: 4, Insightful

      Perhaps his point was that 99% of the slashdot readers are judging this decision based off a 3 sentence summary and about 30 seconds of thought (if that), whereas educated people have been paid to put hours of thought into the decision, which may have some sort of long-term or tangential strategy. It's easy to judge the decision, but maybe there is more to what is going on than we know.

      At the same time, my first reaction is that this is retarded.

    9. Re:Is it, though? by abandonment · · Score: 1

      no kidding - this is the most naive assumption i've seen in a while.

      big corporations having a clue about anything to do with the internet? not likely.

    10. Re:Is it, though? by Treates2 · · Score: 1

      i personally thinks it dumb as ever, i hope this backfires in their face big time!

    11. Re:Is it, though? by Christopher+Cashell · · Score: 1

      Well said.

      --
      Topher
    12. Re:Is it, though? by tubapro12 · · Score: 1

      Wow where are my mod points when I need them; funniest thing I've read here in a long time.... "talented economists, financialists, and lawyers"? How do you think of this stuff...

    13. Re:Is it, though? by lonecrow · · Score: 1

      Yes but this has always been the case with subscription based sites. If I charge users a fee for access to my content then Google/Yahoo/MSN, etc would automatically be unable to access the content.

      Since the subscription TOS could specifically forbid reprinting of any portion of the content, search engines that *wanted* to index the site should be exepected to pay some form of licensing fee.

      The keyword here is *wanted*. Does any search engine really WANT to index your site? Not really, they simply want to be able to provide access to a larger sub-set of the internet then the other guys.

      So if a suitable large number of content sites hide their content from search engines behind registration or subscripiotn forms, then perhaps one of the underdog search engines might decide to try paying for access so they could boast about having a larger index to search.

      The only way I see this happening is if ad revenue dried up sufficiently so that you can make more money from the consumers of information then you can by consumers of eyeballs.

    14. Re:Is it, though? by networkBoy · · Score: 1

      On the bright side I'l make a fortune.
      Any PTC that does this will find a short sell by me the moment they do.
      -nB

      --
      whois gawk date unzip strip find touch finger mount join nice man top fsck grep eject more yes exit umount sleep dump
    15. Re:Is it, though? by julesh · · Score: 1

      Most analysts in any field aren't worth shit when it comes to making predictions. That's why [...] for every winner in the stock market, there's at least one loser.

      No, that's because the stock market is a zero-sum game. For somebody to make a profit on the stock market, somebody else must lose. Otherwise, where's the money coming from?

    16. Re:Is it, though? by tomhudson · · Score: 1

      The stock market as a whole is only a zero-sum game in a flat market with no new companies entering and no old companies leaving.

  16. Protective tarriffs vs. revenue tarriffs by davidwr · · Score: 1

    If a newspaper wants to make money, they'll set the "tax" low enough so most search engines will just pay the fee. They'll do this because they know at least one of their major competitors will do the same, especially those competitors who are ad-supported.

    If a newspaper wants to be delisted, they can charge a very high fee.

    It's like the 19th-century import duties in the USA. Small taxes on imports were a large part of Washington's tax base. However, to protect American producers, some items had huge taxes. Washington didn't make much money off of those taxes.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    1. Re:Protective tarriffs vs. revenue tarriffs by shmlco · · Score: 1

      Most search engines will NOT pay, as it then sets a precedent for everyone to make the same request. Having to pay EVERYONE would put them out of business.

      --
      Any sect, cult, or religion will legislate its creed into law if it acquires the political power to do so.
  17. The dying gasps of print publishing by grapeape · · Score: 1

    This is just the latest in an attempt to survive for the traditional newspapaper. Back when the web first started remember how many newpapers refused to be online at all or required registration hurdles to prevent "linking", after enough bad PR and dropping subscription levels, most reluctantly accepted the web and started to regain credability. I have a newspaper salesperson that comes to my door at least once a month, the last time he was here we argued about the value of the newspaper, he mentioned classified, i mentioned craigs list, he mentioned local news I mentioned kanascity.com, for every "exclusive" I could easily counter with 2-3 web alternatives that were not only more up to date but also allowed a certain level of interactivity. Print newspapers just cant compete.

    There has been a huge content shift with many newspapers mainly due to the readiness of up to the minute news online. Many papers now rely on their columnists and unique local features to survive, some have managed to flourish but most will never be as important to their respective cities as they once were, for a publisher that hurts. They all still want to maintain their mini-empires which frankly is impossible in the modern information age. Limiting their content will do nothing but limit the views to their content, further exasperating the very problem they feel they are facing.

    1. Re:The dying gasps of print publishing by extropic · · Score: 1

      He should have mentioned: "Reading it in the bathroom, bed, etc." "Bird cages" "Fish and Chips" "Moving day in the kitchen" "Packaging items sold on eBay" "Training the dog" "Reading the sports while she reads Lifestyle and junior reads the funnies"

    2. Re:The dying gasps of print publishing by Tankko · · Score: 1

      And who do you think provides all this "free" news you can find on the web? Print magazines and newspapers, that's who. Take them all away, and what do you have left? I bunch of bloggers that don't really do any investigative reporting. All those journalist that are over in Iraq, who pays them? Print media, that's who. So, in you brave new world, where print media goes away, who will provide the investigation? Who will spend months digging into stories and holding our leaders accountable?

      Look a couple levels deep and you'll see you should be supporting the print media, not calling for their demise.

  18. No, it's a great idea ! by Hawthorne01 · · Score: 1
    We have nothing but high hopes that this will increase our perceived value to our readers and boost our crediblity in teh news market, as well as continue the return the same value to our investors as our recent Times $elect service.

    - The Managing Staff Of The New York Titantic ^H^H^H^H^H^H mes

    --
    "Only two things are infinite, the universe and human stupidity, and I'm not sure about the former."
  19. That'd be great for earnings... not really. by HatchedEggs · · Score: 1

    Think about it, search engines make the internet go round. Well, not really.. we could in many ways survive without search engines, but it would be inefficient and problematic.

    Content owners that try to make somebody pay to search for their content are going to find that the desire to find that content "miraculously" dries up.

    Things might eventually change a bit in how pay sites are indexed so their content isn't made free to all, but as you'll find with the companies that got one leg up on Google this time, they will be the ones that end up suffering in the long run.

    Search Engines are your friends... they drive content to your site. The game is how to get the traffic to your site and make money on it once it gets there. Not trying to charge people to help bring you money.

    --
    Justin - Don't be afraid of my blog, it won't bite.
  20. This could cripple content owners who do this by ConfusedSelfHating · · Score: 4, Insightful

    There will always be smaller news outlets who want to get additional daily viewers. They want Google to direct people to their site. If the large news organizations want to opt out, there will always be someone to take their place.

    When you look at Google news, you see a brief summary of the news article and then when you click on it, you are directed to that website. The website will earn revenue from their advertising. If they have an attractive and useful website, people may go to their site directly. New unique users. Often I find that after I've read an article I found through a search, I will go to the homepage of the site (through the hacking known as modifiying the URL) and look at their other articles. Most websites would pay Google to have links to them, now some sites want to Google to pay them? Google will just ignore them and their competitors will prosper.

    Doesn't slashdot do something similar. Someone reads something interesting on the web and suddenly there's a link to it. I'm sure if some sites wanted to charge a fee to slashdot, they would promptly be ignored.

    The idea that comes to mind is revenue stream. Someone working for the news organizations came up with the thought "Google has lots of money, let's take it" and so it began.

    1. Re:This could cripple content owners who do this by westlake · · Score: 1
      There will always be smaller news outlets who want to get additional daily viewers. They want Google to direct people to their site. If the large news organizations want to opt out, there will always be someone to take their place.

      Do you have the faintest idea of what the cost of entry is here?

      Most cities count themselves lucky to have a single marginally competent daily newspaper. One TV station that rises above the "Eyewitness News" level. Where I live there is one regional upstate paper that is worth a damn.

    2. Re:This could cripple content owners who do this by ConfusedSelfHating · · Score: 1

      I admit that I was thinking on an international and national scale. But let's say a city with two papers that also have websites. One has a circulation of 70% and the other has a circulation of 30%. If the paper with a circulation of 70% demands royalties, it will be ignored and search results will bring up the website of the less popular paper. Even if it's of lower quality. If every news outlet of a region demands royalties, that region will be ignored. You will just need to bookmark the websites of your local news outlets when you find them.

      The only way around this, is for the news outlets to lobby for mandatory compensation within the law. I think the major news organizations may pursue this option.

    3. Re:This could cripple content owners who do this by westlake · · Score: 1
      Even if it's of lower quality. If every news outlet of a region demands royalties, that region will be ignored.

      A Canadian search engine that ignored the Globe and Mail, McClean's and the CBC would be next to useless. Searchers will simply move on the alternative search engine. If you index financial news, you won't be taken seriously unless you include the WSJ

    4. Re:This could cripple content owners who do this by arminw · · Score: 1

      ....The only way around this, is for the news outlets to lobby for mandatory compensation within the law.....

      What makes newspapers any different than other businesses? Why not pass a law that forces all phone companies to publish all businesses that have a phone in their yellow pages and pay each business for being listed? What makes a search engine different from the yellow pages? Are they not anything more than a world wide electronic yellow pages?

      --
      All theory is gray
  21. About robot.txt by HatchedEggs · · Score: 1, Redundant

    BTW, the Belgium newspapers, when asked about why they didn't just use robots.txt, stated that it should not be on their shoulders to have to keep others from misuing their copyrighted work.

    What this translates to is that not only are they too lazy to spend 5 minutes updating their site so that Google doesn't index it, but then they fail to understand the benefit that they obtain from Search engines. Which in reality is probably quite great.

    --
    Justin - Don't be afraid of my blog, it won't bite.
  22. Fair enough by Ajehals · · Score: 3, Insightful

    This would work fine - *if every content provider did it*. (when I say work fine I mean how the content providers would like it to work.

    i.e. Lets say The Guardian the Independent charged a royalty for indexing certain articles. and the Times didn't then when a person searches for something that would under normal circumstances return all 3 content providers articles (say you are searching on current news - or better an archived new story - say the search is for "Falklands War Newspaper Headlines" or something. Instead of getting all three papers returning a result you would get just the one from the times.

    Now assuming not everyone knows that certain papers charge search engines for permission to index their content, it will simply look like the Guardian and the Independent didn't report the Falklands War - or whatever you searched for.

    Repeatedly this may even turn customers against their traditional sales, especially with more and more people using multiple online papers and buying a paper copy. I mean if you start reading the Times on-line everyday as it is the only remaining fully indexed paper, are you more or less likely to buy it when you decide to get a real copy? I guess it would do wonders for international brand recognition too - I mean if you are not indexed for common searches who is going to know who you are enough to trust you for the occasional bit where you have allowed yourself to be indexed.

    Really this is all about the fact that search engines generate advertising revenue for themselves using others content, content providers are now looking and saying -

    "hey Google makes X million dollars by directing people to my site and advertising for my competitors, it indexes my content (goggle images / news etc..) so people aren't coming directly to me, maybe If i threaten the source of their content they will pay me and I can finally make some money from this inter web thing without having to actually charge people ourselves!"

    I guess this is an attempt to get at the revenue they assumed that they would get from selling content to their visitors directly through online subscriptions which didn't work. (unless you were a specialist or exclusive provider - such as companies providing financial information / stock prices / adult material etc..). It didn't work because others didn't charge, why pay for access to ITV news or CNN online (if they charged) when the BBC or some other organisation offered the same stories (with a different editorial slant..) for free?

    What they should be saying is how can I get a search engine to get as many people to my site as possible where I can then try and sell whatever services or exclusive content I want! after all the more page hits the more (theoretically at least) conversions.

    Anyway - let them try and charge a royalty - or enforce their rights regarding copyright and prevent thee search engines from making money by including their content in their search engines, it will only harm them.

    The internet really is a level playing field, anyone with a good site can get listed on a search engine and get hits - hopefully achieving whatever it is they are trying to do, why do some people want to change it so that it benefits them more? all that will happen is that it will break the way the internet works, or is perceived and damage their own web activities. Plus some content providers simply will never do this (probably at least) the BBC in the UK certainly would find it difficult, so too will other public service information providers (I assume) too so I guess there will always be at least one or two news site out there.

    I know I have focused on newspapers here (and that does appear to be the gist FTA) but providers of other content such as music, video, software etc. are in the same position. Problem is the internet using public like getting stuf for free, and probably wont pay for something if they cant have access to it for free for at least a while first.

    Ah well, (By the way I'm absolutely

    1. Re:Fair enough by pipingguy · · Score: 1

      Esoteric knowledge like robots.txt is not common within the population at large, so the goal is to raise "awareness" within your clearly-defined "understanding" of the issues. If you define, spark and control the discussion you can direct it any way you wish it to go. That's Manipulation 101 level.

      During a basic primer on HTML (and HTML is not *that* complicated at all) most people will go glassy-eyed and believe whatever the majority of "experts" say.

    2. Re:Fair enough by Ajehals · · Score: 1

      Agree completley - but the only people they are trying to convince of this are other content providers and then only ones that are sufficiently large to have any leverage - these are mostly media companies / companies with a large interweb presence and access to many large tubes who employ many tubeologists and imagineers, and therefore really *should* know better.

    3. Re:Fair enough by pipingguy · · Score: 1

      I am saddened by this new "tubes" analogy. If it was still termed 'piping' I might have made a lot of money by leasing my domain names. Oh, well, back to the drafting board for me. Cheers.

  23. Forget knee-jerk reactions... by Bender0x7D1 · · Score: 3, Interesting

    First, we must remember that not all web sites are found through Google. When was the last time you did a search for Amazon.com or BarnesAndNoble.com? Sure, it's nice to be listed but hardly deadly if they weren't - they already have the name recognition.

    Now, there is a legitimate downside to being listed on Google News - all of your competitor news sources are also listed - right next to you. If the New York Times runs a piece from the Associated Press, I can see that the Des Moines Register runs the same story, why go to the big name source? The NYT has spent decades and millions of dollars building their reputation and get listed next to other, less-known papers. It serves to dillute their name and reputation.

    For those of you convinced that you can get plenty of news from other places and that these print publications can adjust to new business models or die, are you crazy?!? One nice thing about having a huge newspaper is that they generally try to verify their stories, or at least avoid making things up. (I said generally...) When your paper owns buildings and huge printing presses and is sold at every newsstand your reputation means something. If you are a few people working out of a basement, then who cares? As long as you got people reading, you are happy. I like the idea of responsible journalism. It may be less than it was, but if I see it in the NYT I am inclinded to believe it. If it is in some tabloid, I am inclined to not believe it. In a strictly Internet world, how do you tell the difference?

    I hope that a good arrangement is made between the press and the search engines, but I don't think the survival of the press is based on them being indexed by Google.

    --
    Reading code is like reading the dictionary - you have to read half of it before you can go back and understand it.
    1. Re:Forget knee-jerk reactions... by topham · · Score: 2, Insightful


      I use Google News a lot. It makes it very easy to find a news article I would not find otherwise; I get annoyed when Google News shows a site which, when i click on the Article doesn't let me view it because I need to be registered. My solution? Follow the next link as it will likely not have the registration requirement.

      News sites are going to have to understand something, except for those sites I choose to go to on a daily basis the rest are secondary. I won't go to them unless there is a story of interest.

      News sites which require some fee to be indexed will drop by the wayside as the smaller sites become more available. I stopped going to Forbes a while back because there page caused Java runtime to load in the browser I was using, it slowed the system to a crawl and it was generally possible to read the article elsewhere.

      Except for a particular attachment someone may have to a specific site (be it Fox, CNN, Forbes, Toronto Star, whatever) all other articles are read on a whim. On the other hand, it is those articles which would create the opportunity for someone to see the site and realize it is worth a look on an on going basis.

      Somehow I think the smarter sites will realize the trick is to get people to stay on their site (by choice) once they get there, rather than charge an indexing service.

    2. Re:Forget knee-jerk reactions... by Dorceon · · Score: 1

      Not everyone is a Slashdot-level techie. I've heard of people for whom the Google search box has completely replaced the address bar. It's easier to avoid cybersquatters that way too.

      --
      What sound do people on rollercoasters make? Hint: it's not Xbox 360.
    3. Re:Forget knee-jerk reactions... by Klintus+Fang · · Score: 1

      When a big name news organization like NYT gets indexed site right next to some small-time news organization it only degrades the big time news organizations reputation if the stories have the same content and/or the same quality. And if that is the case, then a reader would be quite reasonable to conclude that the bigger news organizations reputation is over inflated. I can see how that might be something the bigger news organization may be threatended by, because it makes it more difficult for the bigger news organization to hide behind its reputation. I do not see how that is a problem for the user or for the integrity of news in general. If anything, it is good for the user and for the integrity of the news media because it keeps the bigger news organizations honest. If the bigger news organization is not able to provide content which is unique enough and compelling enough that it continues to stand out as superior when placed up against joe-blow's article on the same topic then all that means to me is that the bigger news organization's reputation isn't deserved. Now if the bigger news organization wants to be able to provide vanilla content to its dedicated users which it knows is no different than the vanilla content at Joe Blows site and doesn't want the fact that they do provied that kind of content to degrade the value of their stronger content: well, that's what I presume things like this robot.txt file are for. The bigger news organization can selectively prevent that type of content from being indexed so as not to tarnish the image they have built for themselves. Sounds like a solid and healthy system to me.

      --
      In a minute there is time For decisions and revisions which a minute will reverse. -T.S. Eliot
    4. Re:Forget knee-jerk reactions... by saikou · · Score: 2, Insightful

      I don't see how "verifying story" is applicable to, say, AP or Reuters newsfeeds. Those are pretty much blasted equally by small, medium and large newspapers as is (even though they need verification and oh boy, if you ever saw how they castrate content to make 10-sentence detail-less snippet out of interesting 10 paragraph story...). And for those news it does not really matter where you go, you read identical content (hence 50+ articles that start with exactly the same words). For those, the newspaper that will be smart enough to allow indexing and provide access, there will be a windfall of visitors (what they do with them is another matter, but at least they can try to recoup their bandwidth investments through ads). Heck, Reuters has its own web site, and I bet it'll be happy enough to allow indexing.
      For local news you pretty much have to go to small sites. The Washington Post for some strange reason does not cover news of, say, Hell, Michigan. So it goes back to local news provider. Which would like to have more visitors, not less.
      So... big media entities will keep out of the way of small entities. Users would be able to find pretty much the same content. Where's the down side? If the whole "don't index me, I want to charge for my content" thing leads to growth in small news provider niche, will you really object? Because even if you don't trust your local News 59 Hometown tv newscrew or Mournful Examiner newspaper, being able to read multiple reports on the same event beats one "trusted" source any day.

    5. Re:Forget knee-jerk reactions... by popsicle67 · · Score: 1

      Yup the NYT doesn't want anyone to find out they used the same wire stories to fill their space as the BFE Times(Bum-fucked Egypt for those of you in Rio Linda)

    6. Re:Forget knee-jerk reactions... by Zaphod2016 · · Score: 1

      One nice thing about having a huge newspaper is that they generally try to verify their stories, or at least avoid making things up.

      Clearly, you aren't familiar with the history of the New York Times.

    7. Re:Forget knee-jerk reactions... by remmelt · · Score: 1

      Now, there is a legitimate downside to being listed on Google News - all of your competitor news sources are also listed - right next to you.

      It's called competition. Remember? The American dream? Rags to riches? David fighting Goliath and winning? The big NYT should know better than to rely on direct copies of Reuters and AP articles. I am not a reader, but I can imagine it has an edge over the local rag. If it doesn't win in a straight head to head comparison, like Google is offering, then why is it better? Why should it win my dollar/euro?

      As for checking sources, local newspapers aren't three guys in a basement. And if they are, why shouldn't they check their sources? They would likely want to sell papers, and selling news without crap is the better business model (or at least, in a perfect world, sigh.) What's more, bigger newspapers are owned by bigger companies. I guess you can see where this is going. Political influence, some news is more important than other news, etc.

    8. Re:Forget knee-jerk reactions... by arminw · · Score: 1

      ....When was the last time you did a search for Amazon.com or BarnesAndNoble.com?.....

      Not a direct search of course, but I have searched for stuff I wanted to buy and their site was among the top to show that I could get it form them, among others. There are also sites for shopping comparisons which help users find things.

      --
      All theory is gray
    9. Re:Forget knee-jerk reactions... by Chops · · Score: 1
      For those of you convinced that you can get plenty of news from other places and that these print publications can adjust to new business models or die, are you crazy?!? One nice thing about having a huge newspaper is that they generally try to verify their stories, or at least avoid making things up. (I said generally...) When your paper owns buildings and huge printing presses and is sold at every newsstand your reputation means something. If you are a few people working out of a basement, then who cares? As long as you got people reading, you are happy. I like the idea of responsible journalism. It may be less than it was, but if I see it in the NYT I am inclinded to believe it. If it is in some tabloid, I am inclined to not believe it. In a strictly Internet world, how do you tell the difference?

      I think that if you turn this argument around a bit, you'll see the reason for a lot of the muddleheaded thinking that newspapers do when they start publishing on the internet.

      Big newspapers have squandered a lot of the reputation that they used to have. They've been subordinating more and more of their journalistic role, and instead serving as a mouthpiece for government and industry (especially their advertisers). That's nothing new (see also H.L. Mencken), but it's been getting worse as newspapers consolidate and come increasingly under the control of evil men and businesspeople instead of journalists.

      The newspapers are accustomed to trading on this accumulated capital of trustworthiness -- they're better than the National Enquirer, better than the cable news shows, better than magazines filled with celebrity gossip. People know that, the newspapers know it, and it affects how they conduct themselves and their business. On the internet, though, no one gives a damn. Newspaper web sites want strange things -- requiring registration, wanting people to pay for content, wanting search engines to pay for indexing them, or not to index them, or not to "deep link" them -- and assume that people will accede to their wishes, because they're in charge. And if they were right, it would make sense. Someone else mentioned specialized services like Lexis-Nexis and PACER, which the "readers" will pay for. There's also Nature and Salon, which both charge for access. Why can they get away with it, but the NYT and Washington Post can't?

      Because Salon and Nature really are better. They offer something you can't find on 100 other internet sites, and they do a good job for their readers instead of pandering to their advertisers and the upper management's buddies.

      This really seems to piss off the newspapers. "But we're better!", they say. "We own buildings, we're sold at the newsstand!" But on the internet, as you said, the NYT's content shows up right next to the Des Moines Register's identical content. It makes it a little more obvious that the whole thing is a house of cards; since we can't trust the newspapers not to report war-mongering lies about Iraq^HIran, why treat them any differently than Joe Schmoe's Blog of Rambling? The sooner they realize that, the sooner they'll be able to either start working on something that will actually make them more appealing (like, say, trustworthiness). That or just settle down into their role as happy typists serving up pageviews and stop trying to redesign the internet.
    10. Re:Forget knee-jerk reactions... by Dirtside · · Score: 1
      The NYT has spent decades and millions of dollars building their reputation and get listed next to other, less-known papers. It serves to dillute their name and reputation.

      No more than having the NYT sitting next to the Des Moines Register at a newsstand.
      --
      "Destroy science and religion. Science would re-emerge exactly the same; but not religion." - Penn Jillette, paraphrased
    11. Re:Forget knee-jerk reactions... by interval1066 · · Score: 1

      Bender0x7D1 wrote: > For those of you convinced that you can get plenty of
      > news from other places and that these print publications
      > can adjust to new business models or die, are you crazy?!?

      Huh? Like, the old print media has a choice? Or are you advocating the luddite approach?
      The times thay are a-changing, regardless of what the RIAA would have you believe.

      --
      Python: 'And then suddenly you have a language which says "we're all stuck with whatever the whiniest coder wants".'
  24. Please stop already! by db32 · · Score: 1

    There have been a dozen stories and lawsuits over this crap already. Why the hell hasn't robots.txt come out in court yet? I have a hard time believing the lawyers defending against this are so incompetent that thery wouldn't someone with a clue on the stand to explain that the system is already there and the people aren't using it. In fact a smart lawyer would counter sue because the system IS already there and they failed to use it and instead wasted the courts time. Imagine (diddly do diddly do slashdot analogy time) you sue the auto manufacturer for not including a safety harness in their vehicles because you got injured while not wearing your already installed seat belt.

    Or maybe there is something more to this than the typical slashdot "duh robots.txt" response...who knows...but I really would like a meaningful answer about if its something more...if not someone needs to make this shit stop! Maybe these places are using robots.txt and the search engines are ignoring it, or someone is using it wrong, or maybe we should get together and write a nice pretty page on robots.txt and submit it to all the news stations as a "new innovative" way to protect online content...maybe they will get it then...and then we can all laugh as all those sites fall off the net because no search engine can find em.

    --
    The only change I can believe in is what I find in my couch cushions.
    1. Re:Please stop already! by Chapter80 · · Score: 1
      Imagine (diddly do diddly do slashdot analogy time)...
      It took me a minute to figure out what the heck you meant by the above line. But then, after a chuckle, I read the rest of your message, awaiting the "Scooby-doo ending" where the mask gets pulled off, and *surprise*, it's the RIAA underneath, saying that they would have gotten away with it if not for you meddling slashdotters...
    2. Re:Please stop already! by Anonymous Coward · · Score: 0

      Because robots.txt is an opt-out mechanism, but copyright is not.

      There are many more users/redistributors then there are content makers. It would be infeasible at best and impossible at worst if you, as a content maker, had to go to each redistributor and explicitly opt-out of their service.

      Not all bots honor robots.txt, which is a voluntary file for both the site owner and the robot owner. Plus, there are more ways to get content from a site, such as the RSS feed, which is intended for personalized newsfeeds, not redistributors or commercial aggregators.

      This is not the same as the seatbelt argument, since you're looking at it from the side of the user, which would be the search engine in the original scenario, NOT the car maker, which would be the manufacturer. In fact, this argument actually supports the car maker/manufacturer: why should they be responsible for the user's choices? There are many more users than manufacturers, and it's impossible to meet the individual needs of all of them.

    3. Re:Please stop already! by db32 · · Score: 1

      I fail to see how this is anyone's problem but the content makers or distributers. Don't publish to a public area if you don't want the public to be able to get to it...pretty simple. Its not like the search engines are violating logins and whatnot to cache this stuff. Its out in the open.

      Further, the analogy was about how they are demanding this way to opt out of search engines and how vital it is they have this...when it already exists and they only have problems because they aren't already using the existing one.

      --
      The only change I can believe in is what I find in my couch cushions.
  25. implicit assumptions by grikdog · · Score: 1

    Isn't there an implicit assumption that indexing every conceivable shred of garbage on the net is a service? Isn't there a tacit understanding that anything useful, or interesting, or commercial will be herded behind tents and flogged by carnival barkers (thinking of Boing Boing or a score of others) for dimes at a time? Isn't there an immodest presumption that this activity shall be passed off as "scholarship" (such as requiring a disambiguation page at Wikipedia to disentangle Omar Khayyam, Persian poet, from Omar Khayyam, suicide bomber?) I have no objections to godless capitalism whatsoever, so long as it does not turn into Mordac, the Preventer of Information Technology. Let the shakedown ... er ... shakeout begin!

    --
    ``Tension, apprehension & dissension have begun!'' - Duffy Wyg&, in Alfred Bester's _The Demolished Man_
  26. Public domain by Antony-Kyre · · Score: 1

    Aren't websites not sing the robots exclusion essentially in the public domain?

    It would be totally unlike a music CD where it's not free to download, hence a site couldn't necessarily crawl and put it up there for everyone to see.

    Since the website was free for anyone to see in the first place, no harm done. Unless the site requires a subscription and if Noogling that bypasses it, there really isn't anything that can be done I think.

    1. Re:Public domain by Anonymous Coward · · Score: 0

      No. Western copyright laws grant copyright UNLESS (that is, if and only if) the copyright owner opts out and assigns ownership to the public domain before the copyright ends.

    2. Re:Public domain by Antony-Kyre · · Score: 1

      The site is essentially being tagged,not copied, in the search results, right? It's also being cached, but robot exclusion can stop search engines from doing that part.

    3. Re:Public domain by Tim+C · · Score: 1

      As the original respondent said, just because content is on the web doesn't mean that it's in the public domain. It's publicly accessible, but that's a very different thing to being in the public domain.

      Secondly, unless its changed since I last bothered with it, robots.txt can't allow indexing but prevent caching, and nor can it actually prevent anything. Robots.txt is a *request* to a user agent to not enter certain parts of a domain. User agents are perfectly at liberty to ignore the request, although doing so is obviously somewhat rude. Even if the user agent abides by the request, though, it'll mean that the excluded sections won't be indexed, not that they just won't be cached.

    4. Re:Public domain by Antony-Kyre · · Score: 1

      Maybe public domain is the wrong term to use.

      If the site is freely accessible to anyone, shouldn't it be considered "fair" for someone to index that site on a search engine?

      About the robots.txt exclusion thing, although it's not political law, it's almost good enough to use in common law, correct? Doesn't robots.txt indicate that the site does not want to be crawled?

  27. The Answer Would Be... by interval1066 · · Score: 1

    "Now won't the provider actually lose readers since their articles won't be locatable by search anymore?"

    Yes.

    --
    Python: 'And then suddenly you have a language which says "we're all stuck with whatever the whiniest coder wants".'
  28. Legislation-facilitated industry association by Anonymous Coward · · Score: 0

    How about Congress authorizes creation of the CCCA (Content Creators of America) as an "opt out" platform under which there is a basic royalty scheme for search engine to pay content creators when their items arise to a certain level in their displayed results?

    Allow content creators to "opt out".

    It's all about transforming a classic technology monopolist (unavoidable given technology facilitated increasing returns to scale) holding court over a decentralized competitive supply market, into a classic duopoly.

    As a matter of fact, the status quo is a significant disincentive to content creation. The duopoly model would be better.

    1. Re:Legislation-facilitated industry association by BlueStrat · · Score: 1

      "How about Congress authorizes creation of the CCCA (Content Creators of America)..."

      How about Congress authorizes creation of the CCCP (Coalition of Content Creators and Publishers)...

      There, fixed that for you. :P

      Cheers!

      Strat

      --
      Progressivism (aka US 'Liberalism'): Ideas so good they need a police/surveillance-state to enforce.
  29. Since when did the world work for Google? by mccalli · · Score: 0, Redundant

    All these points of view are predicated on the fact the content providers should be grateful to have their content placed in a search engine. Well, these people have explicitly said that they are not grateful, and that they don't want it to happen.

    Any 'content holder' that whines needs the same thing done to them with no option for reindexing without paying enough to bleed them white

    What sort of attitude is that? You see, that's exactly why people get fed up. A search engine could not exist as a commercial entity if there were nothing to search. Original content needs to be generated somewhere, and these people are saying that content is generate for the benefit of their site, not for Google's (or MSN or Yahoo et. al.). They are saying that the ad revenue for viewing headlines on the site should go to them, not to Google. That the terms of viewing the site should be set by themselves. That they own copyright where they say they do. And, since they originate the content, I agree with them.

    Cheers,
    Ian

    1. Re:Since when did the world work for Google? by kimvette · · Score: 3, Insightful

      If they disagree with how Google works, they should block googlebot, or at minimum, create a robots.txt

      --
      The Christian Right is Neither (Christian nor right). See: Matthew 23, Matthew 25, Ezekiel 16:48-50
    2. Re:Since when did the world work for Google? by mccalli · · Score: 0, Troll

      If they disagree with how Google works, they should block googlebot, or at minimum, create a robots.txt

      No, that's missing the point of what I said again. I said - since when did the world work for Google? I don't want to do extra work because someone is misusing my copyright, I want them to abide by the copyright in the first place.

      For just appearing in google.com's search index I have little sympathy for the sites' case. But look at Google News and tell me it isn't becoming a publisher. At the very least it needs to decide which articles should feature more prominently, whether by machine or not. I'm sticking by my normal privacy principles over this - opt in, not opt out.

      Cheers,
      Ian

    3. Re:Since when did the world work for Google? by sabernet · · Score: 2, Insightful

      Your point is moot as by publishing to a public internet site, you have opted in. Otherwise it would be a VPN or at the least a privileged site protected by a password.

      If you have a site on the www, it means it can be queried by ANYONE. Regardless of if you like it or not. To say otherwise would be to broadcast a message on FM radio and complain that someone heard it and spoke about it.

      There are ways around this: password protection and robots.txt.

      The world does not work for google, rather google works on the internet. If you don't want to put the extra effort in to secure it, then don't put it on the web to begin with or you lose all rights to complain.

      Would you sympathize for a bank having all their customer data on an insecure website but blaming it on people who visited the link when they "should have understood they shoudn't have"?

    4. Re:Since when did the world work for Google? by tsm_sf · · Score: 1

      Since you're not a professional sysadmin/webmaster/whathaveyou it's forgivable that you didn't know about the standard method for blocking search engines from indexing your site. It's not a hidden feature, it's not a hack, but it is a little obscure if you're outside the "art".

      The news service's webmaster has no such excuse. This isn't a matter of intellectual property vs. the "electronic commons", it's a matter of incompetence vs. greed.

      --
      Literalism isn't a form of humor, it's you being irritating.
    5. Re:Since when did the world work for Google? by arminw · · Score: 1

      .....Original content needs to be generated somewhere.....

      Content providers and search engines need each other. Anyone can create all sorts of cool content, but if it cannot be found, what good is it? Google is to the internet as the yellow pages to a phone book. A business has to PAY in order to be listed in the yellow pages. Here these businesses are complaining that they get listed for FREE. Free advertising almost always helps the bottom line of any business.

      --
      All theory is gray
    6. Re:Since when did the world work for Google? by mjtaylor24601 · · Score: 1

      "I don't want to do extra work because someone is misusing my copyright, I want them to abide by the copyright in the first place."

      IANAL so perhaps you can enlighten me as to what exactly Google is doing that is in violation of copyright law.

      If you post an article in a public place there's nothing I know of in copyright law that prevents anyone from walking by, reading the article, and telling other people what the article was about and how to find it.

      The worst thing Google is doing is listing a small excerpt from the article on their page, but isn't that covered by fair use?

      You say that you don't want to have to do extra work to opt out; well I look at the argument the other way around. You've posted something on the public Internet. The way the Internet works it's assumed that other people can link to and quote anything you put up. If there's nothing in law that prevents this why should Google have to go around to every single content provider and check with them to see if they want there stuff linked or not? The world may not work for Google, but neither does Google work for the world.

      --
      I wish I were as sure of anything as some people are of everything
    7. Re:Since when did the world work for Google? by Anonymous Coward · · Score: 0

      You do not have to publisher your content. You do not have to make it available publicly over the web. When you opt in to making your content available publicly over the web, you lose all legitimate right to whine about others looking at your content, indexing your content, evaluating your content, ridiculing your content, etc. So cut it out, troll.

    8. Re:Since when did the world work for Google? by Haeleth · · Score: 1

      I don't want to do extra work because someone is misusing my copyright

      Too bad. The vast majority of Internet content providers do want their sites indexed and cached by Google. Why should they have to do extra work, just to save you the minuscule effort of creating a tiny file to inform the world that you want your site to receive special and unusual treatment?

    9. Re:Since when did the world work for Google? by Anonymous Coward · · Score: 0

      If you perform publicly or publish your work in some other way (eg. by putting it on your publicly accessible webserver), you opt in to nothing but the exceptions which copyright law permits regardless of the way the user obtained your work. It doesn't matter if your site is public or for subscribers only: If a user reads your page, he can tell someone else *in his own words* what he read, he can cite short excerpts which are relevant in the context of his own work and he can point others to the source of the information. He is not allowed to (re)publish your content verbatim. By publishing your work on a publicly accessible webserver you do not put your work in the public domain. Copyright law still applies.

    10. Re:Since when did the world work for Google? by Anonymous Coward · · Score: 0

      Copyright law still applies.

      Last I checked, that law includes a fair use exception for quotation and citing, which is exactly what google does. You searched for "apple"? Here's a story with "apples" and a sentence or two from it about apples. You can get this story from this website here.

    11. Re:Since when did the world work for Google? by Anonymous Coward · · Score: 0

      Why should they have to do extra work

      Because it's the law. You need permission from the author before you are allowed to (re)publish someone else's work. As an author you do not have to explicitly forbid the republication of your works. That's the default under copyright law. (Indexing is OK but aggregation and caching, at least as practiced by the search engines, are not.)

    12. Re:Since when did the world work for Google? by Anonymous Coward · · Score: 0

      I'm not a lawyer but it's not as clear cut as that.

      1) Depending on local laws you may have to assert your copyright (let people know it's copyrighted) to prevent it defaulting into the public domain. On the web, not setting robots.txt to say 'don't index/cache me', is much the same - I doubt a japanese copyright statement on an english document would count, so why should they expect googlebot to recognise the difference between a 'Copyright MediaCorp 2000' and 'In 2000 MediaCorp released this into the public domain' and all the permutations thereof. In the UK, you don't have to assert, but you're on significantly dodgier ground if you don't.

      2) There's also the issue of reasonable expectations, basically, if you've got a website, both humans and machines will access it - by extension search engines will index and potentially cache and aggregate it.

      This is pretty similar to complaining about people linking to your site. (Which, in various countries, has got a few companies smacked around the head by a judge.)

      In the UK, copying certain types of work for the purpose of news reporting is fair dealing, so long as you credit. The EC has harmonized copyright laws, so I wouldn't be surprised if what Google were doing was legal.

    13. Re:Since when did the world work for Google? by Anonymous Coward · · Score: 0

      Hi,

      SO... if you disagree how the largest burglary gang in your neighborhood works you should paint your front door yellow with black stripes and pink dots to signify you don't want them to take your stuff and keep it for themselves or sell it on?

      You should not have to do something extra to exercise your legal rights. A robots.txt file is all good and well, but if there's too many of those, they'll just claim it didn't comply with their format specification.

    14. Re:Since when did the world work for Google? by Anonymous Coward · · Score: 0

      Depending on local laws you may have to assert your copyright

      Not if your country is a signee of the Berne convention. There needs to be a standard for machine readable information describing what you can do with content. The default is that you can't do much (for exceptions see copyright law). Robots.txt is not a copyright control measure. It's a way of telling robots which parts of a webserver namespace aren't suitable for bots. If robots.txt were meant to regulate copy rights, it would be a total failure because it approaches the problem from the wrong direction.

      reasonable expectations [...] index and potentially cache and aggregate it.

      I think it's reasonable to expect search engines to respect the law. The law says you can index and cite, but you cannot aggregate or copy (caching is not what search engines do, even if they call it that).

    15. Re:Since when did the world work for Google? by Pofy · · Score: 1

      >The worst thing Google is doing is listing a small
      >excerpt from the article on their page, but isn't
      >that covered by fair use?

      As far as I have seen, most of the time google has also made a copy and stored on its servers and in addition seems to feed it to anyone who wants it when someone clicks on "cached".

  30. Simple directions by Anonymous Coward · · Score: 0

    Draw gun. Aim at foot. Apply pressure to trigger. Reload and repeat as needed.

  31. lose readers? by Anonymous Coward · · Score: 0

    No. Regular readers will visit the site regardless of indexing by google news.
    Eventual readers will keep visiting whatever gets to be in the frontpage at the time they load it.

  32. Huh?? by www.sorehands.com · · Score: 4, Insightful

    Many companies with supposed "very talented economists, financialists, and lawyers working for them" have done things that failed. Look at Sony and their rootkits? In 1986 many "very talented economists, financialists, and lawyers" commented buying a PC software only company, Microsoft, would be a very bad investment. Many people said the same thing about a company that sells over priced coffee -- Star Bucks. A very talented manager at HP ridiculed Steve Wozniak when he designed a personal computer.

  33. Dear reuters, by Anonymous Coward · · Score: 0
    Is finding competent developers so hard?
    javascript:ArticlePaging('/news/articlenews.aspx', 'internetNews','2006-09-22T132105Z_01_L22732625_RT RUKOC_0_US-MEDIA-PUBLISHERS-SEARCH.xml','1','','', 'NewsArt-C1-ArticlePage1');
    Special links like this which specifically target the JS impaired need to be written using appendChild and the DOM, then a normal link placed inside noscript tags so that users with a clue don't have to copy and paste from your javascript. This simple approach is covered in HTML lesson 1 and greatly enhances accessibility and usability by allowing users to follow a link using a new browser tab or whichever method or assistive technology they prefer.

    Regards from the web (something which you obviously don't understand).
  34. Opt-in or Opt-out by houghi · · Score: 1

    Wether this is stupid to do or not should be entirely up to the copyright holder.

    I should not tell NOT to index my side, I should tell to DO index my site.
    Not opt-out, opt-in, just like anything else, if possible.

    In every other business opt-in is desired by all here, except when it concernes Google, because then it it handy for us.

    Nice double standard. :-(
    Go on, moderate me into oblovion, I have Karma to burn.

    --
    Don't fight for your country, if your country does not fight for you.
    1. Re:Opt-in or Opt-out by Anonymous Coward · · Score: 1, Insightful

      Thats frankly rediculous.

      By choosing to post something on a publicly accessible domain without a robots.txt file you HAVE chosen to opt-in. Much in the same way that walking down the street 'opts-in' to being seen by other people on the street. The structure of the internet was designed so that access to most domains was freely available. If you don't like how the internet operates you can choose not to use it. Or if you still want to use it you have numerous options to prevent your content from being indexed (robots.txt) or accessible (restricted access domain, login requirements, etc).

      Just like when you go shopping the business retains records of your purchase without asking your permission and it's a non issue. In some arrangements Opt-In makes sense and in others Opt-Out does. Provided the reasonable one is choosen and that one is always available (thus why spam doesn't qualify) it is perfectly reasonable. Just like it isn't a double standard to use a hammer to nail something instead of a wrench, using the proper tool (opt-in vs opt-out) in the proper situation is perfectly reasonable.

      Claiming that all Slashdotters are vigourous Opt-In believers and that any modding you get is because we don't like our hypocrisy being pointed out is wrong. If you get modded down its because you argument is faulty, poorly thought out, inflamatory, and stupid.

      Regards,
      -Dan

    2. Re:Opt-in or Opt-out by Millenniumman · · Score: 1

      Rediculous? A second diculous? Which was the first? At least you were here to undiculous his post.

      --
      Stupidity is like nuclear power, it can be used for good or evil. And you don't want to get any on you.
    3. Re:Opt-in or Opt-out by arminw · · Score: 1

      ...Wether this is stupid to do or not should be entirely up to the copyright holder......

      COPYright is not the same as INDEX right. A library may not COPY a book, but they may index it in their catalog so a user may find that book in the stacks. A librarian does not have to ask the publisher for permission to put the book's vital locating info into a catalog. Google does NOT copy a site, but only indexes it just the same as a library would a book so a user can find the site. Why should *any* site be able to prevent this indexing? Copyright is not involved, since there is no copying of the content. How is what Google is doing with web sites and different than what a librarian does with books?

      --
      All theory is gray
    4. Re:Opt-in or Opt-out by houghi · · Score: 1
      How is what Google is doing with web sites and different than what a librarian does with books?


      Google Cache. As if the library is handing out copies.
      --
      Don't fight for your country, if your country does not fight for you.
  35. Usage and abusage by matt+me · · Score: 1

    You suggest that Google should deal with anyone who threatens their profits by removing them from their index, essentially a death sentence for any online business. (Google has a 54% market share [Wikipedia], probably the more web-savvy half that consume the most) This is an apalling suggestion. I very much hope they don't do anything like this - but how could we tell? Business go to any lengths to beat their competitors, I'd wager Google receive hundreds of emails offering ridiculous values of currency in return for bumping up one site past another on pagerank. Thousands of sites will offer to do this for you, and needless to say if they do work, then it's by spamming.

    You can't assume Google will always act ethically. Power corrupts, absolute power corrupts absolutely. Scandal is inevitable, be it privacy, corruption or censorship. The way we use Google has eeroded the web's greatest quality, that of the hyperlink to render all sites equal. The hierachy of pagerank means sites beyond the first ten results are often ignored. This influence is dangerous.

    There's so much talk on Slashdot of Microsoft abusing their stolen monopoly. Yet we've handed Google one. People blindly swear allegiance to them, defending their more questionable actions that if another company perpretrated, they'd certainly condemn. Honestly, when did last use another search engine? When Google's broken, are you even able to find one?

    1. Re:Usage and abusage by Anonymous Coward · · Score: 0

      The way we use Google has eeroded the web's greatest quality, that of the hyperlink to render all sites equal. The hierachy of pagerank means sites beyond the first ten results are often ignored. This influence is dangerous.

      This is a fallacy. Search engine have rendered the web a usable place by providing entry points for requests. From these entry points, you still can go everywhere. Go and find the web site of the belgian newspaper that won the case againt Google. Don't use a search engine of course.

  36. Re:Robot.txt is a machine readable permissions mod by Anonymous Coward · · Score: 0

    "What is required is a standardized way of describing the permissions which apply to a Web site or Web page so that it can be decoded by a dumb machine without the help of an expensive lawyer."

    They already have this. It's called the robot.txt file. You can use it to tell search bots not to index you. This just seems to be a richer permissions model, that includes things like caching and excerpting options.


    You don't expect expensive lawyers to understand dumb machines, do you? It's much more profitable to make obfuscated law than obfuscated code.

  37. So's a court order. by Kadin2048 · · Score: 1

    They certainly can ignore robots.txt, but I don't think that any major search engine does; Google obeys both no-spider and no-cache restrictions, as does the Internet Archive.

    When you get right down to it, a court order is basically a request too, it just has some more weight behind it, if you happen to live in that court's jurisdiction.

    I think that a robots.txt file would be something like a "No Trespassing" sign; if you had one, and then you were cached or spidered and went to court, it would give you a big advantage because it would show that the search engine / database willfully ignored the standard request not to be included in their system.

    Anyway; you're right that any system can ignore robots.txt -- you can test this yourself if you want just by using curl. Last time I checked it had an optional flag to ignore it, and would further do lots of other fun things like insert random pauses between page requests, to make its robotic nature a little less obvious to the webserver. This in and of itself isn't illegal, but depending on how you used it, it might be.

    --
    "Ladies and gentlemen, my killbot features Lotus Notes and a machine gun. It is the finest available."
    1. Re:So's a court order. by Pharmboy · · Score: 1

      Last time I checked it had an optional flag to ignore it, and would further do lots of other fun things like insert random pauses between page requests

      Since your IP doesn't change, that isn't exactly hidding from detection. It IS, however, much nicer to a small server (T1 or less), rather than running curl or wget at full tilt and swamping it.

      I think your first point is the main point: A site should not be able to take action against a search engine if they are not using a robots.txt file that prohibits caching and indexing. It only takes two lines of text to make Google go away:

      User-agent: *
      Disallow: /

      --
      Tequila: It's not just for breakfast anymore!
  38. AOL mistake by Anonymous Coward · · Score: 0

    Don't make the same mistake as AOL did in the 90's.

  39. Payola by Anne+Thwacks · · Score: 2, Interesting
    Well the radio stations paid "payola" to play music didn't they?...

    on second thoughts...

    Perhaps the record companies and musicians union might ask the RIAA to "cease and desist"?

    SOmeone has lost the plot here. Must be me!

    --
    Sent from my ASR33 using ASCII
    1. Re:Payola by buffer-overflowed · · Score: 1

      No, the record companies paid the radio stations "payola" to play/promote certain music.

      It's illegal now(well, w/o saying airtime is paid for), so now they use third parties who bribe... err I mean *lobby*.. music directors who tell DJs what to play.

      --
      The key to the enjoyment of pop music is to replace any instance of "love" with "C.H.U.D."
  40. If it wasn't so funny you'd be driven to strangle by popsicle67 · · Score: 1

    Royalties to index a site for a search engine. This is the same chicken-shit thinking that causes cities to pass hotel room taxes. This era we live in where everybody has to make a buck on everybody elses back is the main reason life is so miserable these days. I would love it if search engines shut down for a week. Nobody goes anywhere on the net that they don't have the I.P.address for. Lets run the net like the old BBS days and see just how loud the little bitches squawk.No hits, No ad revenues, No nuthin, just a bunch of geeks gathering in well worn little niches in cyberspace and no commerce. We rule the internet. It is the way it is because we needed much of what it has become. If we want to stop this crap from happening we have to pile scorn upon dickheads and embarass them, shame them into being useful and harmless same as we need to do to our elected officials who do not listen, embarass and shame the bastards into quitting or submitting.

  41. Why stop there? by Zaphod2016 · · Score: 2, Insightful

    Ok, fine, content owners are entitled to royalties from Google.

    And when writing a story about me, or my company, I deserve royalties too. Sure, you might argue that publicity is valuable, but I say that without ME and my circumstances, these content owners would have nothing to write about.

    And, obviously, my dear old mum deserves royalties too. After all, without her genetic contributions, I couldn't exist, couldn't do anything news worthy, couldn't be the basis of a content owner's story.

    And lets not forget about Grandma. And great-grandma.

    And of course, I am writing this comment on a MacBook, so its only fair that Apple gets a piece of any slashdot ad revenues generated by people reading this.

    And, obviously, those interested in clicking on the slashdot ads are using Amazon's patented "click" technology, so they deserve a cut too.

    ...as does Jeff Bezos' mum and grandma.

  42. You're right by Anonymous Coward · · Score: 0

    If they want to shoot themselves in the foot, we have no place in stopping them.

  43. No Google news for french-speaking Belgium by tflash · · Score: 3, Interesting

    An organisation representing French and German speaking newspapers in Belgium has won a court order forcing Google to stop indexing these journals. They also forced Google to post the order on its homepage in belgium: http://www.google.be/ Here the address of these enlightened people: http://www.presscopyrights.be/ Lucky I speak Flemish and NEVER read these newspapers anyway. Nothing is lost, I assure you. Only a bunch of isolated people will get even more isolated since any news of them will totally fall into oblivion.

  44. Not sure why there's any outcry about this... by humble.fool · · Score: 1

    Sounds like they've discovered how robots.txt works.

    --
    Being anonymous is not cowardice.
  45. PAAA by abonstu · · Score: 1

    what the filthy bastards need is their own cartel - the Published Articles Association of America. they are never going to extort money from google when there are limitless deals to be struck with all the article providers of the world. at least with a solid bunch of the biggest news sites they may have some bargaining power with those theiving search engines types. much the same as mtv thieves from the RIAA by aggregating their video clips. damn i should get into the evil genius business.

  46. Sounds good in the board room by HangingChad · · Score: 1

    This is one of those ideas that sounds good in the board room and eventually reaches daylight because no one has the nads to stand up and say it's a really dumb idea that will ultimately be counter-productive. I run into the management group-think attitude all the time. And the dummer it is, the more likely there's some hard-headed, gung-ho upper-level manager determined to ram it through. As if being tough, determined and dogmatic magically transforms it into a better idea.

    Almost as dumb as charging content providers for faster delivery pipes. Only that stupid idea had a lot of high paid lobbyists behind it and government-funded studies that echo how great for consumers it would be. Perhaps the telcos are desperate to ram it through now just in case they lose their majority this fall.

    I don't know if anyone else sees this, but it seems lately I've run into more managers absolutely convinced of their own "rightness", even when common sense and good practice would dictate another course. There has always been some of that in corporate structures, but in the last five years it seems to have gotten much, much worse. Winning seems to be more important than being accurate.

    --
    That's our life, the big wheel of shit. - The Fat Man, Blue Tango Salvage
  47. Re:Robot.txt is a machine readable permissions mod by Anonymous Coward · · Score: 0

    This just seems to be a richer permissions model, that includes things like caching and excerpting options.

    At least the caching directive also exists: <meta name="robots" content="noarchive">

  48. this is beautiful by tehwebguy · · Score: 2, Interesting

    anyone who charges "royalties" to places like google news will learn how it really works very quickly.

    here's the formula i worked out for the way it works right now:
    (site advertisment click probability * click price * readers) + (subscription signup probability * subscription price * readers) = revenue

    this is how it will work if they charge royalties:
    (royalties per click * 0 + (site advertisment click probability * click price * 0 + (subscription signup probability * subscription price * 0) = revenue = 0

    --
    -- lol pwned
  49. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  50. Beginning of online content monopolies by JetScootr · · Score: 1

    Big $$$ online providers desperately want to create the monopolies they enjoy in city-wide newspapers, radio, tv advertising. Ultimately it comes down to this: Who gets the ad revenue? If the "yercity gazette" knows that ONLY its site will have the ability to present its own table of contents, guess where people in yercity have to go to see what's happening in town this weekend? Even bringing up the main page of the website will generate revenue, where a google listing doesn't (at least, not for the gazette's publishers). If the majority of the news services (i.e., 3 or more) lobby congress to enact a forced royalty, they kill two birds with one stone: The search engines ad revenue becomes the publisher's; and the small-time up-and-coming competitors are out of business, since the "cap" will be set high enough to be a significant barrier to entry.
    And then the web will suck just as bad as local radio, tv, and newspapers do.
    Other big $$$ bidniz benefits too - cuz now they'll have a bigger hammer to shut down websites that tell the TRUTH about their products and propaganda. And politicians will likewise benefit. WHo loses? Anyone without a billion bucks.

    --
    Pavlov wouldn't be so famous if he'd used a can opener instead of a bell.
  51. "shenanigans" = almost all traditional scholarship by tiltowait · · Score: 1

    A typical academic library spends at least six figures to get the (free) Google News equivalent for peer-reviewed journals -- which usually charge to have their contents indexed -- in the form of subscription research databases... many of which don't even provide the full text of articles.

    With the advent of Google Scholar and Microsoft Live Academic this may be changing (hopefully), but cases like this show its a constant tug of war between the profiteers and those that support the free distribution of information -- an old idea that would never get off the gound today.

  52. More Brainwaves over at the pub. industrry! by Mateo_LeFou · · Score: 1

    (These are notes I jotted down as fast as I could as I was listening in on one of their meetings) -Unsold books actually somewhat decorative... charge Barnes&Nob. a "decoration rental fee"? Interior design fee? -When content creators drive cars around, they're kinda expressing themselves... should charge oil companies money to put gas in our cars -Remember to think outside the box...

    --
    My turnips listen for the soft cry of your love
  53. the only way this could work... by The_Rook · · Score: 1

    the only way i could see the publisher's plan to work is if they get all (or at least all significant) content providers on to their program; essentially creating a content shortage for the search engines and increasing its value. then they can play the different search engine companies against each other.

    but if a few content providers 'cheat' - that is, make private side deals with one or more search engines, then the royalty system will very likley break down.

    one way search engines could break the content providers' monopoly on content would be to boycott the big players. deny them the links to customers that search engines currently provide for free. when a content provider's web site stops getting hits and their advertisers get angry, then they'd be more willing to deal on the search engines' terms.the question is, would we, the public, spank the search engines like google if google suddently decieded to boycott a content provider such as cnn.

    also remember, search engine companies also want content to be a little hard to get or cost a little money, the idea being that this would make it hard for new, possibly less well funded search engine companies to get a foothold in the market.

    --
    when religion is no longer the opiate of the masses, governments will resort to real opiates.
  54. Re:Symbiosis and the Tragedy of the Commons by jmorris42 · · Score: 1

    > Moral, as always: don't get greedy.

    You took the wrong lesson. The true moral is to BE greedy. Greed is about grabbing all the loot you can, but does not require being stupid about it. Doing something that will hurt your haul isn't greedy, it is stupid. Which is why enlightened self interest is the best way to go. When you dig down far enough almost everything immoral is also stupid.

    --
    Democrat delenda est
  55. Academic Journals already use 'Spam And Switch' by Anonymous Coward · · Score: 0

    When you search, Google finds and lists the text of the article.

    But when you follow the link, you get a different page which says 'Buy Article for $10'.

    Worst offenders are IEEE (Institute for Exorbitantly Expensive Engineers).

    Google for this: "aircraft site:ieee.org"

    You get this:

    [PDF] Nonlinear estimation of aircraft models for on-line control ...
    File Format: PDF/Adobe Acrobat
    "application to state and parameter estimation for aircraft. ... to aircraft parameter estimation"
    ieeexplore.ieee.org/iel5/7416/20151/00931241.pdf

    Now click on the link:

    Instead no article but page with this comes up:

    "IEEE Article Purchase Users
    Enter the username and password you received when you purchased the document. Once you access the document, you have 72 hours to download the Full Text PDF. Please complete the online Technical Support Form if you need assistance."

    So they show one thing for Google, and you something else. Google has shut down other web sites for this, but many Academic journals do it.

    What sucks about the IEEE is it's supposed to be a professional association. But they get articles and standards other people write, slap their copyright on it, and charge $$$. Many "Standards" once they ratify it (usually developed outside as open standards) suddenly become so expensive that only corporations can afford it.

    For other Academic Journals, same idea. They're run by companies. They only publish articles if the author agrees to give the journal the copyright. After that, the author isn't even allowed to distribute it through their web page.

    I think this deserves a thread in its own right.

  56. Let me get this clear. by kosmosik · · Score: 1

    So let me get this clear. Somebody is willing to charge for the ability to automagically (like using tools/algorithyms) read the content that is otherwise freely aviable?

    Like f.e. I have a website where I display something and I tell:

    1. You can use my website.
    2. You cannot run web crawlers over it.

    ???

    It does not make any sense at all. If you want your content to be paid and protected use well established facility like, you know, user authorization. Make the users login with their own well paid username/password to access content. This way no crawler will access it because it does not know the freaking password. Now if some legitimate users run crawlers (or it would seem like) on your site you can block them - it is your own content and you can block whoever you wish (just make sure it is in terms of usage).

    So basically somebody wants to get money. He wants his content to be public (if he doesn't he should lock it) but also he wants somebody to pay him for indexing of his content.

    Waaaayyy stupid.

    1. Re:Let me get this clear. by jkauzlar · · Score: 1

      I am posting a comment to slashdot. Either my IP is banned and this will not post, or it is unbanned, and it will post.

  57. Free isn't good enough for them... by phorm · · Score: 1

    They want to be able to make a buck off of it too.

    No, seriously, hope many free things are out there (google search indexing, GPL software, etc) that some jerk has to try and think of a way to break the system in order to get a free ride and make a profit? Seems like we're seeing more and more of that nowadays

    1. Re:Free isn't good enough for them... by Mr.+Underbridge · · Score: 1

      Oh, sure, I get that. But what they don't get is that they don't have the leverage to pull it off. They figure that the vaunted New York Times (for instance) has been around forever and Google is some plucky little startup that needs to learn some manners. They don't quite grasp that Google practically owns searching, that that without search, fewer people come to their site.

      Basically, they think, mistakenly, that they can dictate terms to Google, and that their news adds more value to Google than Google's free advertising adds to their papers. They couldn't be more wrong, and they're determined to learn the hard way.

  58. Can they? by phorm · · Score: 1

    Google can take your content and make pages containing ads. You can not take Google's content (RSS feeds, for instance) and make pages containing ads

    If you let them.... there are plenty of standards (robots.txt) or other methods to prevent your content being scraped. There are also plenty of sites that aren't indexed or at least not fully indexed by google.

  59. Google's Motto != "Do No Evil" by SeinJunkie · · Score: 1

    Google's informal corporate motto never was "Do no evil," rather it is "Don't be evil," (reference) which carries an entirely different set of implications with it. In the case of China, Google decided that to completely deprive the country of its information would be more evil than to voluntarily censor the government-forbidden sites, at least for now. I can't say that I agree with Google completely, either, but there's no need to misrepresent their stance via straw man.

  60. corporate and government corruption by falconwolf · · Score: 1

    The same is true of every other corporation in the planet, and is the reason why capitalism absolutely needs a strong central government: it is the only thing capable of keeping the coporations in line.

    Both corporations and governments can be corrupt, however because government has arms, when governments abuse their power they are more dangerous than corporations. The only way corporations can get as much power is through government. The only way to control both is with small not big government, and with a strong judiciary.

    This is also the reason why globalization will end in a disaster

    Globalization, which is a tool, is like any other tool. It can be used for good or bad. If it wasn't for globalization groups of people from different nations wouldn't be able to coordinate or work together. All of those demonstrations and protests whenever the World Bank, IMF, and WTO meet all happen because of globalization.

    Falcon
  61. Google's Usage and abusage by falconwolf · · Score: 1

    There's so much talk on Slashdot of Microsoft abusing their stolen monopoly. Yet we've handed Google one. People blindly swear allegiance to them, defending their more questionable actions that if another company perpretrated, they'd certainly condemn. Honestly, when did last use another search engine? When Google's broken, are you even able to find one?

    We don't all use Google all the tyme, as the stats from wiki you posted show. Sure I may use Google most of the tyme but I also use other SEs as well, like About, Alta Vista, Open Directory, and Mooter. About has good sections on Anthropology and Archeology as well as Photography, all of which I am interested in. Actually it was when I searched Google in these that I found them, Google returned them. I've found Alta Vista is good for science and technology, better than Google in some areas. And when Google doesn't give me what I'm looking for Mooter and the Open Directory sometimes will. I don't use Gmail either, instead I use Yahoo! Mail.

    Falcon
  62. They should pay search engines by Anonymous Coward · · Score: 0

    Google and other like search engines do drive traffic through indexing. They cant prove otherwise. Any loss of consumer interest in thier publication is a direct result in thier ability to produce good copy, content and stay up with the times. Nothing more, nothing less. They are just looking for someone to blame. However, another intersting areas that may possbily affected are any RSS feed services (other than Google, Yahoo etc..)which provide a headling and or mini synops of article. This is almost reminicent of what TimeWarner recently did: Got their panties all up in a bunch over YouTube and many others, posting their SNL music video spoofing "The Chronicles of Narnia". They threatened everybody under the sun, until they pulled their heads out of thier @#$%&s and realized that it drove traffic and interest. Go Figure!

  63. Google ought to take a page from Barnes and Noble! by scottsk · · Score: 1

    Barnes and Noble is a "search engine" - you go into their stores, search for books, and buy what you need. I don't remember why, but B+N started publishing their own classics and other books recently, bringing back high quality late-19th century translations to the shelves, and basically telling content providers (book publishers) that they wouldn't be messed with. Google ought to scan out of print books and newspapers, and put that info on a super-portal, and ignore newspapers, publishers, etc.

  64. getting a peice of the pie by falconwolf · · Score: 1

    These news sites are taking the point of view that not all publicity is good publicity. If they don't want their content to be aggregated into a section of another (and very popular) web site that they feel is encroaching on their business, then who are we to say that they shouldn't try to take action? If google decide to put ads up on Google News, then they'd be making money from others' content, why shouldn't they want and get a piece of that pie?

    Simple, if they don't want to be indexed all they need to do is to use a robots text file. Of course if not then they don't want someone finding them either. I have no pity for anyone who puts up a website and then complains when a search engine links to the sit. If they want to keep it private then either don't put it on the web or put it behind a login page. However nothing is stopping them from either putting ads on their own pages or from starting their own search engine.

    Falcon
  65. If a newspaper wants to be delisted, by falconwolf · · Score: 1

    If a newspaper wants to make money, they'll set the "tax" low enough so most search engines will just pay the fee. They'll do this because they know at least one of their major competitors will do the same, especially those competitors who are ad-supported.

    If a newspaper wants to make money then they want to be found. Charging search engines for listing their website is a good way not to be found. IF I were an SE and someone came along with a website and they said they wanted me to pay them for linking to their website I'd go to their competition and say "Hey, do you want free traffic to your website while your competition doesn't get any?

    Falcon
  66. He should have mentioned by falconwolf · · Score: 1

    "Reading it in the bathroom, bed, etc."

    And I'd say:

    "I have a printer".

    "Bird cages"

    "I have no birds."

    "Fish and Chips"

    "Good, I don't like Fish and Chips."

    "Training the dog"

    "I only have a wolf that lives in the woods."

    "Reading the sports while she reads Lifestyle and junior reads the funnies"

    "I don't read the sports, but even if I did I have three computers networked. And my news is more timely."

    Falcon
  67. Yes but... by bratwiz · · Score: 1



    Lunacy abounds.

    And on the Internet...

    Lunacy abounds abundantly.

    Want proof?

    RIAA

    MPAA

    Is there more to say?

  68. bye bye "content providers" by Anonymous Coward · · Score: 0

    bye bye those "content providers" who demand royalties for their content.

    Others will continue to publish and to be indexed. For the others, there's always paid advertisement.

    Google are correct in asserting that what Google News does is lawful, and whether you want to call it "publishing" or not is a semantic choice that doesn't change this clear fact. (OK, Belgium may be unusual, I don't know, but generally across the world, what Google News does is lawful.)

    As for 'google cache' of pages, well the publishers should get used to the idea of caches, the internet would not function without them, and google's service is useful and I doubt it results in people browsing google cache in preference over the original site.