Slashdot Mirror


Google May Limit Free News Access

You know how, if you want to read a paywalled newspaper article, you can just paste its title into Google News and get a free pass? Those days may be coming to an end. Reader Captian Spazzz writes: "It looks like Google may be bowing to pressure from folks like News Corp.'s Rupert Murdoch. What I don't understand is what prevents the websites themselves from enforcing some limit. Why make Google do it?" (Danny Sullivan explains how they could do that.) "Newspaper publishers will now be able to set a limit on the number of free news articles people can read through Google, the company has announced. The concession follows claims from some media companies that the search engine is profiting from online news pages. Publishers will join a First Click Free programme that will prevent web surfers from having unrestricted access. Users who click on more than five articles in a day may be routed to payment or registration pages."

27 of 236 comments (clear)

  1. I'll wait for the plugin by Threni · · Score: 3, Insightful

    Presumably there'll be a cookie to remove, or a BugMeNot account, or a way of creating/managing the 50 accounts needed to read as before.

  2. Frist Psot! by darthflo · · Score: 5, Interesting

    Most 'papers like Google and the visitors Google sends them; so the Google Bot and hits with a google.com Referer tend to get a free pass. Use this to your advantage:

    • Google the Article's URI, click the link and off you go (with a real Google referer).
    • If it's not indexed yet and you're using Opera: Go to any Google page, press Ctrl + U, change any one link's href to the article's URI, click "Save Changes", click the link and off you go (with a fake Google referer. This works for any fake referer, by the way).
    • If they're picky, they mightn't let hits from Google through but still allow the Google bot to index their pages. Change your User-Agent accordingly. In Firefox, go to about:config and change general.useragent.extra.firefox to Googlebot 2.1 and off you go (as Googlebot).
    • As a last resort, there's quite a few ad-blocking personal proxies out there. Most of them allow you to fake Referers or change User-Agents, for any browser.
    1. Re:Frist Psot! by b4upoo · · Score: 3, Insightful

      It seems to me that the people that advertise in newspapers would feel as though they were willing to pay more for ads if the newspapers would put the entire content online. Restricting access will turn around and bite the newspaper industry. The will rue th day they thought of restricting access.

    2. Re:Frist Psot! by kars · · Score: 5, Insightful

      Well, that's the other side of the coin; if I'm willing to pay for my news, will I finally be rid of all the ads? I think not.

      --
      Take life easy: one bit at a time.
    3. Re:Frist Psot! by asnare · · Score: 3, Informative

      Luckily, BBC News is run on the British TV Licence and can't - by power of it's charter - put adverts or start charging for anything.

      ... if you're in the UK. The BBC already show advertisements if you're viewing from outside the UK.

    4. Re:Frist Psot! by Trepidity · · Score: 4, Insightful

      The way cable tv has gone makes me suspect that paying will indeed just get you the same ads as before (or more!), but at a higher cost to you.

    5. Re:Frist Psot! by Darkman,+Walkin+Dude · · Score: 4, Insightful

      Indeed, why bother doing the acrobatics to work around it. I read BBC news, a few local newspapers, a couple of sites like slashdot and a few decent blogs to catch up on whats going on. If Murdoch wants to get people paying for what is free elsewhere, he'll discover how the internet routes around damage, at which point he'll either back up and try to find some other payment model, or he'll fold.

  3. or users behind a NAT by Anonymous Coward · · Score: 3, Interesting

    "can visit one article a day.."
    great thanks

    look, either get behind a paywall and disappear or dont!, the rest of us dont really care as we will just get our news from somewhere who doesnt put up walls and doesnt want the web looking like a version of TV

    thats why i like the web, its a level playing field and because of that it pisses off big business no end

  4. Meaningless concession by damburger · · Score: 5, Interesting

    People used to get their news by looking for a news brand like BBC or The Times, and reading stuff that was presented under that brand. Now a lot of people look for news under topics that interest them, and skip between news brands doing so. What google is offering to do will have little effect on such news browsers, who will have a choice of several competing free links under their topic of interest. People linking to interesting stories will simply copy and paste the content they wish to discuss.

    The print industry is dead and just doesn't know it yet.

    --
    If we can put a man on the moon, why can't we shoot people for Apollo-related non-sequiturs?
    1. Re:Meaningless concession by Trepidity · · Score: 4, Insightful

      This is to a large extent the result of AP and Reuters covering most stories "well enough". If AP or Reuters cover a story, thousands of papers, down to po-dunk local papers in the middle of nowhere, have sufficient coverage of the story for many people. So people rightfully don't care about the brand, because a large proportion of the content literally is the same across brands.

      Sure, the BBC, NY Times, WSJ, Economist, and a few others have original content. But in most cases, AP/Reuters cover a story well enough, so the demand for additional unique content is not nearly as high as traditional demand for a newspaper was--- when it might have been the only way for every only-sort-of-plugged-in people to get the news. Now you really have to care enough to know why you want a particular paper's extra content, and really care to be willing to pay for it.

      I'm not sure how dead the unique-content players are, though. The Economist is notably successful in selling its wares, and the WSJ hasn't been doing terribly either, despite Murdoch's whining.

  5. I for one welcome this by AmiMoJo · · Score: 4, Funny

    Anything which reduces the readership of Murdoch's media is a good thing.

    --
    const int one = 65536; (Silvermoon, Texture.cs)
    SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    1. Re:I for one welcome this by Rogerborg · · Score: 3, Funny

      Anything which reduces the readership of Murdoch's media is a good thing.

      My God, are you actually suggesting that we murder readers of Murdoch's media?

      If so, where do I sign up?

      --
      If you were blocking sigs, you wouldn't have to read this.
  6. What is going one here? by Matrix14 · · Score: 5, Interesting

    I'm still utterly baffled by what's going on here, and neither article seems to answer my questions. Since, in most cases, Google News only displays a snippet of the article (almost certainly fair use?) and then requires readers to click through to the actual web site of the news source to read the rest of the article, what is preventing those sites from implementing whatever access control scheme they feel like? (This should have nothing at all to do with robots.txt or ACAP which is about whether the *Google spider* can see the content, not whether users linking from Google can.) Am I missing some technical point?

    TFA says
    "Previously, each click from a user would be treated as free," Google senior business product manager Josh Cohen said in a blog post.

    So it sounds like (maybe?) the news sites have a policy that says that clickthroughs from Google don't have to be routed through their access control. Why? Is this something Google requires newspapers to do in order to do display links to them on Google News? This seems to be the best theory, but I didn't see anything anywhere that actually said that.

    So, in sum, is this a technical or a social/legal/contractual issue, and what, exactly, is it that is preventing these news sites from using their normal access control?

    1. Re:What is going one here? by Anonymous Coward · · Score: 5, Informative

      So it sounds like (maybe?) the news sites have a policy that says that clickthroughs from Google don't have to be routed through their access control. Why? Is this something Google requires newspapers to do in order to do display links to them on Google News?

      It's something Google requires any websites to do to be linked at all. If you present different information to Googlebot than to normal users and Google finds out about it, you get kicked out of the Google index. So you have to choose between:

      [a] Letting users see the story for free

      [b] Showing Google the same login screen as everyone else

      [c] Being kicked out of the Google index entirely

      It sounds like Murdoch and co have threatened to take path [b], and Google have made concessions.

    2. Re:What is going one here? by radtea · · Score: 3, Informative

      If you present different information to Googlebot than to normal users and Google finds out about it, you get kicked out of the Google index

      False. Springer, the academic publisher, has dozens of paywalled journals that routinely return hits on Google that lead to pages that have none of the search terms and whose contents are inaccessible. Nor is there any metadata in those pages that would justify the hit, and I'm damned sure their pagerank isn't due to having many other high quality pages pointing at their requests for $29.95 for PDF download. The only way this is happening is if the GoogleBot is seeing something that ordinary users can't.

      There is some non-obvious game being played here between Google and the newspapers, and I don't know what it is, but it doesn't smell good. This is "public policy theatre" we're watching here, which plays the same role as "security theatre": it distracts people from the real issues and makes them feel like their freedom is being taken away for a reason (yeah, ok, I'll take my tinfoil hat off now...)

      --
      Blasphemy is a human right. Blasphemophobia kills.
  7. Why make Google do it? by krou · · Score: 4, Interesting

    Easy. Google wants access to the data, and doesn't want to be shut out. Therefore, it's in their interest to implement something that appeases the Murdochs of the world. I don't quite think people understand just how much influence and clout Murdoch (and people like him) have in the world. More fundamentally, from Murdoch's point of view, if Google does it, then the changes can apply to all newspapers, including his competitors. If only Murdoch's news empire does it, then there is less chance of other newspapers following the trend. I suspect Murdoch does not want that many competitors offering free news, and actively wants to encourage the vast majority of newspapers out there to adopt a similar pay-per-view model, because that means that it's a fairly level playing field in terms of competition. So, if you get Google to do it, it encourages everyone else to follow along.

    This all reminds me of a nice little lesson from history when the thriving independent press were shut out a few hundred years ago because of spiralling costs. Advertising became the big funder of newspapers back then, and those that attracted the most funding were able to crush all competition. Independents simply couldn't compete with the rocketing costs of machinery, distribution etc. The market became a wonderful tool of censorship. I won't be surprised to see this having a similar effect ie. shutting down a lot of independents who rely on free news for commentary. Difficult to predict, but it's worth thinking about. I hope I'm wrong.

    Always knew that having an advertising company as the gatekeeper to knowledge on the internet was a bad idea.

    --
    'If Christ had tweeted the sermon on the mount, it might have lasted until nightfall.' - John Perry Barlow
  8. Re:Who needs an alternative by Evtim · · Score: 5, Interesting

    Who needs an alternative of BBC? They are simply the best out there. I for one am willing to pay their licence even though I do not live in the UK. Just broadcast me all their channels and I'll pay. I have not watched any other television in 9 years. I tried the local channels (Dutch) a few times and got sick by the ads. Can't stand them!

  9. Dont show me the news summaries then by secondhand_Buddah · · Score: 3, Insightful

    I think this is fine. But I suggest Google then allow me the option to remove articles that I cannot freely access.

    --
    Participatory Governance : The only feasible option for a real democracy, where everyone really does have a say.
  10. Here comes a troll or flamebait tag, but ... by ubrgeek · · Score: 3, Insightful

    Why is this a YRO story? In all seriousness, it's a "newspaper's rights online." They have every right to do with their content what they wish. If they suffer financially for their decisions, then it serves them right. But there's no inherent right to free access to the content they produce.

    --
    Bark less. Wag more.
  11. What really pisses me right off about paywalled... by Smegly · · Score: 5, Informative

    Google search, Google scholar etc always turns up paywalled articles outside of the news industry. In particular, research articles. On clicking through your are greeted by a screen to pay for the article, and the keywords that were searched for are not in the summary/abstract presented or even available to see. In effect Google has given me a "hit" on my search then led me to a place where not even the search terms are present... Google crawler has access to it but I do not.

    ieeecomputersociety.org, springerlink.com, sciencedirect.com (anything but direct)... the list goes on.

    Ok, you might say that they hold all the serious research papers - you might even be right, in some cases. I even understand that maybe just maybe, if I am really desperate, then I might actually want to search for paywalled articles and am prepared to pay the extra information access tax of $20-$40 a for every article. However what google is now doing is wasting their bandwidth and more importantly to me, completely wasting my time by including paywalled articles in top positions of all my search requests. Furthermore, Google does it by default.

    I have written to their support, posted on their forums -please Google - if you are listening - MAKE PAYWALLED SITES AN OPTION in my preferences and set it OFF by default. If you think about where it leads: the quality of the future of all our search requests is at stake. Now Google is planning to add News to this time wasting highly annoying practice - and I want to be opted out by default, I am begging you!

  12. Re:This is... by JasterBobaMereel · · Score: 3, Interesting

    Newspapers were once the only source of information

    Then came Radio and TV, and they because the source of in depth well researched information

    Then came the Internet, they could have a role as a known reliable source of information

    The problem is that the only role they have left is to be a reliable source of in depth news - and my experience is that they are not reliable, cover most stories in a very superficial way, do poor research (mostly from the internet, or direct from press statements) and are not very well written ....

    If they were a bit more processional then people would be willing to pay for their content, as it is people will just go elsewhere...

    --
    Puteulanus fenestra mortis
  13. Re:What really pisses me right off about paywalled by radtea · · Score: 5, Insightful

    I have written to their support, posted on their forums -please Google - if you are listening - MAKE PAYWALLED SITES AN OPTION in my preferences and set it OFF by default.

    YES, please. My god I hate this aspect of Google, which is an incredibly annoying time-suck. It's even worse for me because I have a uni account that gives me access to most of the paywalled research, but only when I'm on campus, so when I'm off-campus and I want to know something I just desperately want the option to turn off all that paywalled crap.

    This is by far the most hateful, stupid and annoying thing Google does, and in close to a decade of searches I have never once purchased article access from one of these pirates (academics don't get paid by journals for their manuscripts, and now that publishing costs have fallen to almost nothing due to Web delivery there is absolutely no excuse for the kind of rates academic publishers are charging. Open access journals are the future, and the sooner Google gets on board with the future, the better).

    --
    Blasphemy is a human right. Blasphemophobia kills.
  14. Re:What really pisses me right off about paywalled by Anonymous Coward · · Score: 4, Informative

    1) get Firefox
    2) get User Agent Switcher extension
    3) Set you user agent to googlebot's UA
    4) See what google sees

  15. Re:What really pisses me right off about paywalled by Smegly · · Score: 4, Informative

    A fee is NOT a tax and misusing words ala 1984 just makes your arguments less credible.

    No offense, but I suspect that your not aware of the issues involved. We have already payed for the vast majority of the research articles indirectly through taxation. Outside the US this is even more true. Considering this then yes, my statement is correct that the fee is nothing more than an extra tax on top of what we have already paid for. But it is besides the point anyway - we are supposed to be talking about News, and with news I don't need nor want paywalled sites in my searches be default - they are not giving me what I searched for so why should it be included in my search results, why is Google complacent and happy to keep wasting time, bandwidth of its users?

  16. Re:What really pisses me right off about paywalled by Smegly · · Score: 3, Insightful

    This does work in some cases (when the sites don't check IP addresses - most of the most popular ones do now) - but your work around does not help stop the steady debasement of search result quality as more and more companies outside of the research article industry setup these paywalled schemes. Do you really want the first two pages of your search results behind a paywall - even if you can work around the problem for some of them? What ticks me off is that you usually don't realize it is paywalled until after you have clicked through.

  17. Re:What really pisses me right off about paywalled by Smegly · · Score: 3, Funny

    Are you sure your university doesn't give you a login to use to access journals off-campus?

    and if they do, please post it to BugMeNot.

  18. Google hypocrisy. by TheLink · · Score: 4, Interesting

    > In effect Google has given me a "hit" on my search then led me to a place where not even the search terms are present... Google crawler has access to it but I do not.

    Google punished BMW.de for doing something similar to this before.

    http://news.cnet.com/Google-blacklists-BMW.de/2100-1024_3-6035412.html

    Quote: This is a violation of our Webmaster quality guidelines, specifically the principle of 'Don't deceive your users or present different content to search engines than you display to users,'" Cutts' blog said.

    Go figure.

    --