Slashdot Mirror


Amazon To Block Phorm Scans

clickclickdrone writes "The BBC are reporting that Amazon has said it will not allow online advertising system Phorm to scan its web pages to produce targeted ads. For most people this is a welcome step, especially after the European Commission said it was starting legal action against the UK earlier this week over its data protection laws in relation to Phorm's technology. Anyone who values their privacy should applaud this move by Amazon."

39 of 140 comments (clear)

  1. How do I opt my website out? by jonbryce · · Score: 4, Interesting

    It doesn't say anywhere how you opt your own website out of this.

    I suggest everyone does this, no-matter how small or insignificant your site it.

    1. Re:How do I opt my website out? by fuzzyfuzzyfungus · · Score: 3, Insightful

      SSL.

    2. Re:How do I opt my website out? by Pop69 · · Score: 4, Informative
      Perhaps RTFA would be an idea ? Novel one I know this being /.

      In a statement, Phorm said: "There is a process in place to allow publishers to contact Phorm and opt out of the system, but we do not comment on individual cases."

      This would seem to imply that unless you opt out you are in.

    3. Re:How do I opt my website out? by ebcdic · · Score: 5, Informative

      Phorm claims to look at robots.txt, but it's unclear what exactly they mean. See http://www2.bt.com/static/i/btretail/webwise/help.html#how-do-i-prevent-webwise-from-scanning-my-site

    4. Re:How do I opt my website out? by xaxa · · Score: 4, Informative

      I think you have to email them.
      http://www2.bt.com/static/i/btretail/webwise/help.html#how-do-i-prevent-webwise-from-scanning-my-site

      I've emailed them for my domains (they're very small and insignificant).

    5. Re:How do I opt my website out? by jonbryce · · Score: 2, Informative

      Phorm is only opt-in to the extent that you agree a contract with them to display Phorm ads on your site.

      It is opt-out as regards Phorm traking what your visitors get up to on your site.

    6. Re:How do I opt my website out? by Anonymous Coward · · Score: 5, Insightful

      Kind of useless really. Crawlers using robots.txt are supposed to uniquely identify themselves, so that you may block specific crawlers. Phorm doesn't do this - instead, it processes directives intended for Google, Yahoo, and all crawlers.

      Effectively, the only way to block Phorm with robots.txt would also block all search engines. That makes it effectively impossible to do, while still allowing them to claim that it can be done.

      Bastards.

      Anyway, if there were a way to block just Phorm using robots.txt, you can bet that as soon as a couple of major sites start doing it, Phorm will start ignoring it.

    7. Re:How do I opt my website out? by click2005 · · Score: 4, Informative

      Also, as part of the BT trials, they replaced adverts (from a number of charities) on webpages with their own adverts.

      Those sites/advertisers weren't given the chance to opt-out.

      --
      I am a free slashdotter. I will not be modded, blogged, DRM'd, patented, podcasted or RFID'd. My life is my own.
    8. Re:How do I opt my website out? by kramer · · Score: 4, Informative

      Reading carefully, they'll obey any robot.txt rule for "*", googlebot, or (yahoo) slurp. They apparently didn't feel it necessary to have their own robots.txt identifier so you can block just them.

    9. Re:How do I opt my website out? by fuzzyfuzzyfungus · · Score: 3, Insightful

      Because sleazy bastards like Phorm would never, ever think of just impersonating an assortment of other people's legitimate User-agent IDs...

    10. Re:How do I opt my website out? by blackest_k · · Score: 3, Informative

      Opting Out is a bit of a joke to these people it seems.

      While the privacy safeguards built into BT Webwise mean that sensitive or private content on websites is not compromised, the system also offers a number of mechanisms by which website owners can prevent pages being profiled if they wish. Website owners may implement any of the following methods:

                    1. HTTPS: No HTTPS traffic passes through the system or is profiled
                    2. Standard HTTP password-protection : Pages protected using standard HTTP password protection, as defined by RFC 1945, will not be profiled
                    3. robots.txt: The Webwise system will observe the rules that a website sets for major search engines using the robots.txt method. If the website's robots.txt file is set such that "*" (any robot) is not permitted to crawl it, then Webwise will not profile its pages.

              Alternatively, you may request specifically that your website is not scanned by Webwise. To request that your website not be scanned by Webwise, please email:
              website-exclusion{at}webwise.com.
                  [X]
      How are robots.txt files handled by Webwise?

              The Webwise system observes the rules that a website sets for the Googlebot, Slurp (Yahoo! agent) and "*" (any robot) user agents. Where a website's robots.txt file disallows any of these user agents, Webwise will not profile the relevant URL. As an example, the following robots.txt text will prevent profiling of all pages on a site:
              user-agent: * disallow: /

              The following example will restrict profiling of a directory named "images":
              user-agent: Slurp disallow: /images

              The system will request the robots.txt file from the root of the host e.g. www.domain.com/robots.txt. When requesting the robots.txt file, the system will follow up to 5 redirects. If no robots.txt file or an HTTP error is returned, if the returned file is not in single-byte ASCII (ISO-8859-x) format, or if the file size is greater than 50Kbytes, then the URL will be marked as allowed for profiling.

              Website owners should note the following aspects of the Webwise system's interpretation of robots.txt files:

                      * Malformed robots.txt files will result in the URL being disallowed for profiling.
                      * Any of the well-established line-termination tokens are interpreted as a newline, i.e. DOS, UNIX, old-style MacOS linefeeds. Multiple linefeeds are ignored.
                      * Web-encoded URLs are decoded and handled as normal.
                      * Variable capitalisation within the robots.txt file is converted to lower case and processed.
                      * The system does not support Google extensions to the robots.txt standard.

      So the options are https, or password protect your site, or use robots.txt to block google and yahoo from indexing your site or email them and ask to be opted out.
      option a and b inconvenience visitors, option c will reduce visitors since it means your site isnt getting indexed by the major search engines.
      option 4 seems the only practical way to get these jokers to desist.
      option d) no phorm in the robots text doesnt exist.

    11. Re:How do I opt my website out? by Richard_at_work · · Score: 4, Interesting

      BT owns a top level cert, so they can do a man in the middle attack without any error messages popping up on your end.

    12. Re:How do I opt my website out? by Canazza · · Score: 3, Interesting

      They've given us an 'all or nothing' ultimatum

      Block all Search Robots (and effectivly remove yourself from Google/Yahoo etc) or e-mail them and hope they put you on their no-go list (and as with many hidden services, there will be no easy way of telling if they have)

      We will obey the "*" from the robots.txt but we will disregard everything else.

      Just keep a look out on http://www.botsvsbrowsers.com/ and if you really want to block them do a user-agent Server-side script test and send them "FUCK YOU" Pages

      --
      It pays to be obvious, especially if you have a reputation for being subtle.
    13. Re:How do I opt my website out? by Timmmm · · Score: 2, Informative

      Actually it should be quite easy to work out. I expect that phorm does a man-in-the-middle attack and pretends to have the user agent of the web browser that has been tricked. All you need to do is ask some people who are using phorm to add "PhormIP" to their user agents.

      It's easy to see if you're using phorm because it does an HTTP redirect to webwise.net.

    14. Re:How do I opt my website out? by mikael · · Score: 2, Informative

      Phorm purchased slots to place adverts - when there was a match between what the user was reading and adverts available, the advert would be displayed. When there was not match, the charities advert would be displayed. They weren't stealing anyone's advertising space but they were still intercepting the communications of unsuspecting BT customers who had neither been informed or consented to taking part in the experiment.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    15. Re:How do I opt my website out? by Richard_at_work · · Score: 4, Informative

      If they have a top level certificate, they can generate all the domain certs they want on the fly - it would be no different at all to the cert you get from Verisign to run on your web server.

      This is why ISPs should never be allowed to own a top level cert.

    16. Re:How do I opt my website out? by Daimanta · · Score: 3, Interesting

      I guess we only need volunteers and we can intercept the right IPs and add them to the blocklist.

      --
      Knowledge is power. Knowledge shared is power lost.
    17. Re:How do I opt my website out? by Eil · · Score: 2, Interesting

      How would that work? BT might be a top-level CA but if I have an HTTPS-only site (say, https://www.example.com/ they still don't have my private key. Without that private key, they can't do anything to the data flowing between the web server and the end-user's browser without raising some flag or another.

      They could create their own certificate for www.example.com in order to fool the end-user's browser, but that would involve a very intelligent proxy and would be incredibly (almost painfully) illegal, even in Britain I'm sure.

  2. You're Starting at the Wrong End by eldavojohn · · Score: 4, Insightful

    Anyone who values their privacy should applaud this move by Amazon.

    Thank you for telling me how to think. I believe we are approaching this from the wrong end (why start with websites?).

    The article hints at two other points I would encourage Brits who care to be vocal about:

    Jim Killock, executive director of the Open Rights Group, said: We expect more sites to block Webwise in the near future and also ISPs to drop plans to snoop on web users.

    Write your ISPs. Threaten to change ISPs even if you're not able to. Let them know how this makes you feel.

    The European Commission has described the technology as an "interception" of user data and wants UK law to reflect more explicitly the need for consent from users in order for the service to be implemented.

    As always, contact your parliamentary representative and also EU representative and let them know how you feel about this.

    These would be much more effective options than asking each website that exists to request Phorm not scan their site.

    --
    My work here is dung.
    1. Re:You're Starting at the Wrong End by xaxa · · Score: 4, Informative

      To write to your UK and EU parliamentary representatives, go to http://www.writetothem.com/

  3. Not to nitpick ... by krou · · Score: 3, Insightful

    ... but they obviously didn't do it for privacy reasons. As a business, I can bet they weren't happy with the idea of something scanning their pages and then targeting adverts from possible competitors based on what users were looking at on Amazon.

    --
    'If Christ had tweeted the sermon on the mount, it might have lasted until nightfall.' - John Perry Barlow
  4. Re:Stay er... evil??? by fuzzyfuzzyfungus · · Score: 4, Informative

    I suspect we'll see a fair bit more of this. Not because the world is full of fuzzy defenders of privacy(it isn't); but because the world is full of nonfuzzy violators of privacy and Phorm is trying to muscle in on their action.

    One of Amazon's major selling points, beyond their good logistics, is their ability to use site analytics to make interest based recommendations to customers. Obviously, they have zero interest in letting Phorm piggyback on that, on their own site no less.

    I suspect that many other major web presences will be in a similar place. Phorm is potentially lucrative for the ISPs, but it is a nontrivial threat to larger site and ad-network operators. The small guys are more or less resigned to outsourcing analytics and ad placement, so it won't be as much of a change for them; but the big independents will not be pleased.

  5. Re:So in other words... by ji777 · · Score: 2, Insightful

    It's actually been a while since I last heard about phorm. I believe that the general issue had more to do with phorm intercepting pages on the ISP's side and re-writing them to insert material before re-serving them to you. Google ads, on the other hand (since you brought them up) is a widget added by the site owner's permission.

  6. Re:So in other words... by hansamurai · · Score: 4, Informative

    Except with Google ads, the people who actually own the website choose whether or not to serve them. Phorm ads are injected at the ISP level, completely ignoring whether the server wants the ads or not. Yes, they're still interest based, but they're evil for other reasons in my opinion.

  7. Re:So in other words... by ebcdic · · Score: 3, Informative

    Google doesn't do anything unless you use Google. Phorm gets the information from your ISP.

  8. Another reason for https by freelunch · · Score: 2, Insightful

    More sites should provide an option for https, like gmail does. Some still don't even provide it for authentication.

    Once upon a time there were wimpy CPUs, and https was a more significant computational burden. Now, not so much. Especially when compared to the resource requirements of most dynamic page generation systems.

  9. Re:So in other words... by Sockatume · · Score: 3, Informative

    You opt into Google's ad service by visiting a site using it, and can opt out by simply stopping them from creating the tracking cookies. You automatically opt into Phorm when you use the internet and can only opt out by setting a special "don't track me bro" cookie on each profile of each browser used by each device in your home. I think that's quite a distinction. Phorm assumes that any of your web activity is theirs to track unless you specifically tell them otherwise.

    --
    No kidding!!! What do you say at this point?
  10. Comment removed by account_deleted · · Score: 3, Informative

    Comment removed based on user account deletion

  11. Re:So in other words... by mrchaotica · · Score: 2, Insightful

    I believe that the general issue had more to do with phorm intercepting pages on the ISP's side and re-writing them to insert material before re-serving them to you.

    WTF?! Even ignoring all the privacy issues everyone else is talking about, isn't that still blatantly illegal? It's copyright infringement! By modifying the web page, Phorm is creating a derivative work, and that requires permission of the copyright holder.

    --

    "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

  12. Phraudsters by Blue+Stone · · Score: 5, Interesting

    Phorm are liars when it comes to robots.txt.

    They say they respect robots.txt but their scraper will only respect it if it also blocks google and yahoo. If it allows Google and Yahoo, they say it's fair game for Phorm. That's not respecting it at all.

    But what do you expect from the sort of people who would conduct illegal surveillance on people to test their spyware system and claim that letting opt opt out would have been impossible because it would have been too difficult for them to understand the complicated computery stuff they were doing.

    Phraudsters.

    --
    Corporation, n. An ingenious device for obtaining individual profit without individual responsibility. - Ambrose Bierce
  13. Re:Stay er... evil??? by fuzzyfuzzyfungus · · Score: 2, Informative

    Please correct me if I'm wrong; but my understanding was that Phorm's plan was to pay the ISPs for the privilege of spying on their customers and then buy ad space on various websites in order to run ads targeted on the basis of the spying.

    For a small site, then, having Phorm spy on your visitors via ISP, then having Phorm pay you to run ads, would not be considerably different than using a 3rd party analytics package, google analytics or similar, and then being paid to run ads from a third party ad network. Now, since, under Phorm, the ISP needs to be paid, the site operator would presumably see less money; but it would be a difference of degree rather than kind.

    If my understanding of Phorm is wrong(if, for instance, Phorm were tempted to go with the super-sleazy tactic that one sees occasionally, of colluding with the ISP to strip ads from 3rd party websites and insert their own), then the above is of course irrelevant.

  14. Re:But how exactly does it work? by Jane_Dozey · · Score: 3, Insightful

    Phorm wants to inject ads into web pages at the ISP level. They want them to be targeted so not only do they want to alter web content without the owners or receivers consent, they also want to take a look at all web traffic first (deep packet inspection) and keep a history so they can better target the ads. It's opt-out because otherwise no-one would even touch it.

    Now, I'm not going to even try to claim that I'm unbiased as living in the UK means that this monstrosity may well hit me but I think that's not an entirely inaccurate explanation. I really hope that the EC manages to step in and squash Phorm and maybe even slap BT with a giant fine.

    My website content has been written to look how I want it to look. I block many ads as a policy as I don't want crap clogging up my screen or distracting me. Now they want to bypass both my content layout in my website *and* throw ads at me even though I have zero interest in them. Asshats.

    --
    Silly rabbit
  15. What they don't tell you by Nicolas+MONNET · · Score: 4, Funny

    Is that if you opt-out of Phorm, you are automatically entered, for free, in a program called Phorm2. But don't worry, you can opt out. For your convenience, in that case, you will automatically be entered in our new business web marketing program, Phorm++. If you're not interested in Phorm++, no worries, you can very easily opt-out. In fact, it's so easy, we'll do you a favour and give you free, automatic access to PhormDeluxe. PhormDeluxe is completely optional. Just send us a certified letter to opt out.

    1. Re:What they don't tell you by wisty · · Score: 4, Funny

      Can we offer to deliver them complimentary building materials through their windows, with an opt out clause?

  16. I've emailed them too by Nicolas+MONNET · · Score: 3, Funny

    For real,

    To: website-exclusion@webwise.com

    Subject: Exclusion requested from your spyware system

    I hereby request that you remove the following domains that I own or may own in the near future from your WebWise / Phorm system:
    phorm-is-a-fraud.com
    webwise-is-big-brother.com
    bt-is-completely-retarded-for.allowing-this-phorm-nonsense-on-their-network.com
    webmasters-shouldnt-have-to-opt-out.com
    you-dont-respect-robots.txt-you-lying-scumbags.com

    Fuck you very much!

  17. Re:So in other words... by Heed00 · · Score: 2, Informative

    And don't forget the method by which they do their thing -- deep packet inspection. It's not the behavioural targeted ads that are the real problem with Phorm -- the real problem is that their DPI kit "gifted" to the ISP intercepts communication between two parties (the web surfer and the web page) without informed consent of both parties. In short, they spy on your web browsing in order to profile you.

    --
    Thought thinks itself.
  18. Re:But how exactly does it work? by threeturn · · Score: 3, Insightful
    Technical explanation in some detail

    Q Why is it an opt-out system?
    A Because they couldn't get away with providing no optionality control, so they went for the option which pushed as many users as possible to their system.

    Q When did I or Slashdot give implied consent to anyone to inspect the packets for reasons other than routing?
    A You didn't, but Phorm and the spineless UK government has decided you did.

    Q What data do they collect and what do they do with it?
    A Browsing habits to produce targeted advertising.

  19. The scary part by RalphSleigh · · Score: 3, Interesting
    They claim to manage the user opt out via a cookie, from reading the FAQ it appears this cookie is injected into every domain you visit

    As explained on the Customer Choice Process page, when a user opts into the BT Webwise service, a Webwise UID cookie, containing a unique random number is placed on the userâ(TM)s computer. This master cookie is held is the Webwise.net domain. When the user then visits other websites, the Webwise system stores a copy of the Webwise UID cookie within the browser in each the website domains visited by the user. The cookies are clearly labelled as belonging to Webwise as noted above and as a result can be easily identified as different to those cookies which may be placed by the website itself.

    Since it claims to need no client software, I must assume they do this by injecting extra cookie headers into all the HTTP responses sent to my browser....

    --
    Come as you are, do what you must, be who you will.
  20. Re:So in other words... by AlexBirch · · Score: 2, Funny

    But in all fairness to Phorm, their corporate motto is:
    Do only Evil.