Slashdot Mirror


Google Researchers Made An Algorithm To Delete Watermarks From Photos (venturebeat.com)

"Researchers at Google have found a vulnerability in the way watermarks are used by stock imagery sites like Adobe Stock that makes it possible to remove the opaque stamp used to protect copyright," writes Khari Johnson via VentureBeat. "The consistent nature in which the watermarks are placed on photos can be exploited using an algorithm trained to recognize and automatically remove watermarks." From the report: Changing the position or opacity of a watermark do not impact the algorithm's ability to remove watermarks from images with copyright protection. Randomization, the researchers say, is required to keep images from being stolen. In results presented at the Computer Vision and Pattern Recognition conference last month, subtle modifications to each watermark can make it harder to remove watermarks. With these warped watermarks, attempts to get rid of watermarks with an algorithm or photo editing software leaves noticeable marks, rendering an image useless. "As often done with vulnerabilities discovered in operating systems, applications or protocols, we want to disclose this vulnerability and propose solutions in order to help the photography and stock image communities adapt and better protect its copyrighted content and creations," research scientists Tali Dekel and Michael Rubenstein wrote in a blog post today. "From our experiments much of the world's stock imagery is currently susceptible to this circumvention." You can learn more about the different types of randomization that can be done to combat watermark removal and see more example images in Google's blog post. The full report and research is available via the project's GitHub page.

63 comments

  1. Stock photography is a plauge by Anonymous Coward · · Score: 0, Funny

    Please watermark them using an opaque white rectangle exactly the size of the image.

    1. Re:Stock photography is a plauge by Anonymous Coward · · Score: 0

      Sloppy spelling is also a plauge.

    2. Re:Stock photography is a plauge by Anonymous Coward · · Score: 0

      Not as sloppy as your mum.

    3. Re:Stock photography is a plauge by Anonymous Coward · · Score: 0

      Your mom has the plauge.

  2. DMCA notice inbound... by klingens · · Score: 1

    ...in 3, 2, 1.
    After all, DRM was circumvented and made public how to circumvent it. Or will Google be treated better than a normal Joe Random who happens to find a vulnerability in a commercial product?
    Bovi et Iovi, like always.

    1. Re:DMCA notice inbound... by Wootery · · Score: 2

      It's not DRM, it's attribution.

      DRM refers to technical measures to prevent unauthorised duplication and use. Removing watermarking isn't enabling the copyrighted work to be copied or used.

    2. Re:DMCA notice inbound... by omnichad · · Score: 1

      Removing watermarking isn't enabling the copyrighted work to be copied or used.

      That's exactly what it does. The watermark was to prevent practical use of the image. Sure, you can make a bit for bit copy of the hobbled version. It's the same as a trial edition of Photoshop that can be copied freely, but it becomes infringement once you use an activation crack.

    3. Re:DMCA notice inbound... by Wootery · · Score: 1

      That's an interesting interpretation. Would be fun to see it in court.

  3. Remove THEIR watermark by Anonymous Coward · · Score: 0

    They SUE YOU

  4. They miss the point by Anonymous Coward · · Score: 0

    The article misses the point of watermarking. Watermarking is not done to keep a professional user from using imagery. A professional knows better, knows about copyright, and doesn't want to risk to get into trouble for breaking it.

    The sole purpose of watermarks is to stop non-professionals -aka your digital illiterates like your grandma and nephew- from using such imagery accidentally.

    Also, the same watermarked images are usually found without watermark and within seconds, simply because someone on the web already used/bought/ and published it. Someone who really wants to pirate an image can already easy work around the watermark.

    So, to me it seems the author misses the whole point of watermarks. They are not protecting anything. They are only protecting unknowing persons against themselves. They will not stop an intentional pirate. They are not relevant to professionals.

    So what remains is a nice gimmick and someone justifying their own salary. And it's also nothing new as people/pirates have been removing watermarks from video content with increasing quality for decades.

    1. Re:They miss the point by jellomizer · · Score: 1

      There are so many times the "Professional user" will break copyright.
      Small companies without the money to pay for these big fees, to try to get a picture to make their presentation look a bit professional. Or used with a small audience, who really doesn't care. They will go as far as they think they can get away with it.

      --
      If something is so important that you feel the need to post it on the internet... It probably isn't that important.
    2. Re: They miss the point by Anonymous Coward · · Score: 0

      Yes... and they will use Google image search instead of Fotolia.

  5. Of course... by Anonymous Coward · · Score: 0

    I am shocked that this is "Google Research" worthy, as it should be obvious. If I would have known, I would have posted about this a decade ago.

    Interesting thing about removing copyright... sometimes the copyright watermark is the only thing that makes the image unique and copyrightable.
    Once you remove it, in some cases, there is no inherent copyright. Case in point: Digitized ancient manuscripts. These are public domain digital facsimiles. They are only copyrightable when you add something "unique" to them, like the copyright notice itself. (In the US of course, international copyright will be different).

    1. Re:Of course... by omnichad · · Score: 1

      These are public domain digital facsimiles. They are only copyrightable when you add something "unique" to them

      If the photographer didn't add anything unique, who would use this over the free public domain version? If you had more interesting lighting or camera angles, then it would be easy to prove the burden of copyright when your photo was chosen over a free alternative - and going to the effort of removing the watermark.

    2. Re:Of course... by bws111 · · Score: 1

      The 'unique' thing they add is not the copyright notice. It is cleaning up the image (adjust contrast, etc). That is copyrightable, because it is a creative work.

    3. Re:Of course... by Archangel+Michael · · Score: 1

      Does it become less copyrightable, when the entire process is done by an automated script on a computer?

      My suggestion is, anything that CAN be done with automation without any human interaction (or minimal) is by definition, non-creative. And if it was creative, the computer/program (Photoshop??) owns whatever copyright, not the human that pushed the button.

      Most clean up being done these days is simply auto adjustments made with computer programs.

      --
      Agent K: A *person* is smart. People are dumb, stupid, panicky animals, and you know it.
    4. Re:Of course... by omnichad · · Score: 1

      My suggestion is, anything that CAN be done with automation without any human interaction (or minimal) is by definition, non-creative.

      So since you can procedurally generate paintings of landscapes, no real paintings of landscapes can now be copyrighted?

    5. Re:Of course... by Archangel+Michael · · Score: 0

      Not exactly what I meant, but I understand. A mechanical reproduction is not creative. The creativity is in the programming.

      --
      Agent K: A *person* is smart. People are dumb, stupid, panicky animals, and you know it.
  6. BS this is the real challenge by avandesande · · Score: 4, Funny

    Remove the entire image leaving the watermark

    --
    love is just extroverted narcissism
    1. Re:BS this is the real challenge by EnsilZah · · Score: 1

      If you watch the video that's basically what it does.
      It goes through a bunch of images with the same type of watermark and isolates it, to be later used as a mask for the removal.

  7. Pro by Anonymous Coward · · Score: 0

    Wouldn't a pro just use photoshop to remove the adobe watermark?

    1. Re:Pro by Anonymous Coward · · Score: 1

      If the "watermark" is removeable, then it is too weak.

      Don't use techniques that watermark by overlaying shadows/highlights. That makes it possible to calculate the original pixel by subtracting out the watermark. Instead, just type "stock photo" or "copyright:me" across the image in a fat opaque font. Be sure to obliterate some fine detail - such as a face. It is now impossible to recreate the original.

      Lots of work in photoshop may still get rid of the text, but detail will be lost and the result won't be the original. If someone needs several days in photoshop, then reshooting may be cheaper anyway. and certainly more fun. Or just pay the copyright holder for a non-watermarked copy.

    2. Re:Pro by omnichad · · Score: 1

      It's not even nearly that simple. Even a semi-transparent white overlay with no shading of extremely difficult to remove if it passes over fine detail. The watermark effectively reduces the dynamic range of that part of the image - that has to be digitally reconstructed using the rest of the photo as context. I'm sure that's what they're doing and it's a pretty tough problem, especially if you don't have to provide the software work a mask off exactly which pixels contain the watermark.

    3. Re:Pro by rkordmaa · · Score: 1

      They rely on the watermark being constant, and apparently it usually is, average large number of photos and you can extract the watermark and just subtract it from all of them. Yeah, some dynamic range is lost, but evidently for most photos its not noticeable.

    4. Re:Pro by omnichad · · Score: 1

      Right - the averaging gives them a mask. That's one part. The second, they actually do reconstruct the dynamic range to a close approximation. There is some ambiguity involved as well. Once you overlay white on light colors, you can't tell how white it was underneath because you end up clipping past the value bounds.

      My main point is to refute the AC above me that you can't use Photoshop to remove these, even as a pro. This requires some serious computation.

    5. Re:Pro by Anonymous Coward · · Score: 0

      just type "stock photo" or "copyright:me" across the image in a fat opaque font.

      If you use an opaque font, it wouldn't be called watermarking (the word "water" implies some translucency).

  8. Sounds like protection money to me by holophrastic · · Score: 4, Insightful

    So, decades gone by, and I've never heard anyone complain about watermarks being ineffective. Google uses enormous resources to crack watermarking, and here's betting they invent watermark 2.0 next week.

    Here, pay me protection money, and I won't destroy your retail store.

    By the way, serial numbers can be filed off of guns and car parts too. The watermarks were never meant to be perfect -- in fact, it was always easy for a graphic artist to manually remove them -- about ten minutes. But it made obvious that you were crossing the line in doing so.

    1. Re:Sounds like protection money to me by GuB-42 · · Score: 1

      RTFA

      Google uses enormous resources to crack watermarking, and here's betting they invent watermark 2.0 next week.

      "watermark 2.0" is right in the paper. It is nothing more than a slight warping that anyone can implement.

      The watermarks were never meant to be perfect -- in fact, it was always easy for a graphic artist to manually remove them -- about ten minutes.

      There is a link to a video of an artist doing exactly this. But as they said, it's tedious.

    2. Re:Sounds like protection money to me by holophrastic · · Score: 1

      ...that anyone can implement? Like I said before, wait a week. I'll bet Google provides a "free" tool to watermark your images -- so you send every image you have to them, for free.

    3. Re:Sounds like protection money to me by squiggleslash · · Score: 1

      I think everyone knows they are limited in their effectiveness. The concept of watermarking as a major security system was addressed in the early 2000s when the music publishers started asking for help producing an audio equivalent. Their idea was they could kill piracy by, instead of encrypting music, placing watermarks on it instead that would be detected by operating systems, CD burners, etc, which would in turn refuse to copy that music.

      It failed for a couple of reasons, one of which was the logistical problems associated with getting hardware and OS makers to actually cripple their hardware that way. But the other was that it was too damned hard to produce a watermark that couldn't be easily removed.

      The idea has cropped up since, and I think it's even in limited use in one of the many DRMish schemes we see used everywhere on video, but nobody's relying on it because they know it's easy to remove.

      Which has left groups like Shutterstock, who place it on knowing it's easy to take off, but figuring it's awkward enough that most people will just pay money for a legal, unmarked, copy.

      --
      You are not alone. This is not normal. None of this is normal.
    4. Re:Sounds like protection money to me by Anonymous Coward · · Score: 0

      The trick being you can still see the changes in the structure of the metal of a firearm part where the serial was. To fully remove the serial number you need to grind off and indent your own series of letter/numbers over it. The FBI released a paper on recovering filed off serial numbers on weapons.

    5. Re:Sounds like protection money to me by Anonymous Coward · · Score: 0

      >By the way, serial numbers can be filed off of guns and car parts too.

      Not really. You can visually scuff the first nano-meters of the steel, rendering the numbers flat. But remember: those numbers were stamped into the steel- and stamped hard. Merely heat the metal up a bit and the numbers show right up. They glow. Very easy, very visible.

      So scuffing the numbers off only helps if someone is so near as to be staring closely at your item. And by that point, it's probably on an evidence table, and a useless characteristic. (though the shiny spot could offer 'street-cred' when you want to show off).

    6. Re:Sounds like protection money to me by holophrastic · · Score: 1

      ...and not a single one of those things has improved my life with my family. The credit that I give to them is that they've profited from all of it, a lot.

  9. Something Useful by eyepeepackets · · Score: 4, Interesting

    If Google wants to do something really useful as regards images, they can make a way for me to block or otherwise remove images with watermark from search results. These watermark images are a growing plague that pollutes image searching.

    --
    Everything in the Universe sucks: It's the law!
    1. Re:Something Useful by Anonymous Coward · · Score: 1, Insightful

      Yeah, Google... stop making my job of stealing someone else's IP more difficult! :)

    2. Re:Something Useful by cjmnews · · Score: 2

      If Google wants to do something really useful as regards images, they can make a way for me to block or otherwise remove images with watermark from search results. These watermark images are a growing plague that pollutes image searching.

      Just add -stockphoto and the other sites that have watermarks to your search criteria to ignore them.

      --
      You can lose something that is loose, so tighten the loose item so you don't lose it.
    3. Re:Something Useful by eyepeepackets · · Score: 2

      Thanks! I also found the licensing filter thingy under "tools" which helps as well.

      --
      Everything in the Universe sucks: It's the law!
    4. Re:Something Useful by Anonymous Coward · · Score: 0

      Just add -stockphoto and the other sites that have watermarks to your search criteria to ignore them.

      My current Google image search URL:

      https://www.google.com/search?tbm=isch&q=test+-site:123rf.com+-site:shutterstock.com+-site:dreamstime.com+-site:gettyimages.com+-site:gettyimages.co.uk+-site:alamy.com+-site:depositphotos.com

    5. Re:Something Useful by Cederic · · Score: 1

      Well, lets say I want to link to an image of a bridge here on Slashdot, so that someone can see a fine example of cantilever beams.

      I could link some shitty fucked up watermarked photo, or I could link to a picture someone's posted on their blog.

      At no point am I stealing anybody's IP

  10. hash by Tomahawk · · Score: 2

    I suppose adding a watermark containing or based on the hash of the original image would suffice to randomise it. How this is applied is open to any number of ways, such as adding a QR code, or a 2D barcode, or warping the watermark according to an algorithm based on the hash. That should be random enough to mess with the removal algorithm.

  11. Infringment by Big+Hairy+Ian · · Score: 1

    By removing the water mark you are effectively infringing the copyright

    --

    Build a Man a Fire, and He'll Be Warm for a Day. Set a Man on Fire, and He'll Be Warm for the Rest of His Life.

    1. Re:Infringment by Anonymous Coward · · Score: 0

      Not necessarily. If the image is a public domain work, as in a digital facsimile, the only thing that may add the uniqueness required to have a copyright is the copyright watermark itself.

    2. Re:Infringment by omnichad · · Score: 1

      Only if you distribute or publish it in same way afterward. Otherwise, you can look at it all you want

      That's separate from whether this will be considered anti-circumvention under the DMCA, which would make this as illegal in the US as DVD ripping software (when it bypasses CSS).

  12. Isn't it great by Anonymous Coward · · Score: 0

    How the only stuff Google makes that actually works is designed to screw people? They are a festering sore on the butt of technology. There's probably a cream, but it has been priced out of our reach.

  13. Wanted for Video by crow · · Score: 1

    I would love to have this technology for video. Anything to turn off those annoying network bugs while watching TV would be nice. Even if this can't be done in real time right now, having it in MythTV to clean up recordings would be really nice.

    At least they don't put the stupid bugs on the video on DVDs. (How long until they try that?)

    1. Re:Wanted for Video by omnichad · · Score: 1

      I don't mind those as much as the giant animated banner ads that some networks use after coming back from commercial - overlaid right on the content.

    2. Re:Wanted for Video by Anonymous Coward · · Score: 0

      This technology exists, google "Avisynth". I bet that if you combine OpenVC for logo detection with Avisynth batch processing you will be able to get this working. I've played with this a bit and the results are OK.

      For American TV it is be a bit more difficult. For example ABC uses a mix of local / national logos after each ad break, banners, twitter hashtags and other annoyances that make watching the channel pointless.

    3. Re:Wanted for Video by JohnFen · · Score: 1

      I would love to have this technology for video. Anything to turn off those annoying network bugs while watching TV would be nice.

      It was those graphics that essentially got me to stop watching commercial TV.

    4. Re:Wanted for Video by sexconker · · Score: 1

      Getting rid of the static, semi-transparent station logos is trivial. You just get a clean copy of the logo and position it on a new layer and find the difference.
      Plugins exist to do this.

      Unfortunately, it's not possible to cleanly get rid of the giant TV-MA or whatever rating at the top left, or the absurd promos for other shows that intrude on the show you're watching.

    5. Re:Wanted for Video by mccrew · · Score: 1

      It was those graphics that essentially got me to stop watching commercial TV.

      Oh, yeah? Well, I don't even own a television.

      --
      Hey, Windows users, there is no such thing as "forward" slash, there is only slash and backslash.
    6. Re:Wanted for Video by Anonymous Coward · · Score: 0

      Just the graphics?

      It was the lack on decent content and the ads that did it for me.

    7. Re:Wanted for Video by JohnFen · · Score: 1

      They were big factors too, of course.

      The problem with the graphical overlays, though, was that even when there was a show that I was so interested in that I was willing to put up with the commercials to see it, the overlays would completely ruin it. So there was no point in even trying.

      I guess it would be more accurate to call them the straw that broke the camel's back for me.

    8. Re:Wanted for Video by Anonymous Coward · · Score: 0

      Some cheese with that whine, sir?

  14. Can they adjust their algorithm by future+assassin · · Score: 1

    to filter out Pintrest image search spam?

    --
    by TheSpoom (715771) Uncaring Linux user here. I have nothing to add to this but please continue. *munches popcorn*
  15. Cat and mouse game by Tablizer · · Score: 1

    Watermark software will just have to become more involved to get around this, such as randomizing/distorting size and density of watermarks. Watermarks will become like Captcha's.

    1. Re:Cat and mouse game by rkordmaa · · Score: 1

      Pointless to randomize size and density, just fill the mask with noise and hey presto, good luck subtracting random noise from an image. Although, some neural network techniques are pretty good at repainting entire image or just parts of it.

  16. Thanks google! by Anonymous Coward · · Score: 0

    Now please invent something to automatically remove the tiny idiotic censor bars the japanese put on porn.

  17. LOL by sexconker · · Score: 1

    Welcome to the mid 90s, Google.

    I remember using plugins for VirtualDub that did the same thing with video.
    All you need to do is recreate a decent representation of the watermark, and the plugin simply subtracts it from the video.
    Bonus points if you dynamically handle opacity so you can handle fade in and fade out.

    This was done to remove semi-transparent station logos from the bottom right of TV broadcast recordings.

  18. As an artist by gillbates · · Score: 1

    As an artist, this really bothers me.

    As a software engineer, I've long known that watermarks can be removed by the diligent or the intentionally malicious. However, now that Google is doing it, those who infringe my works can now claim that the infringement is not intentional - which substantially reduces the penalties for copyright infringement, and increases the incentive to violate copyright.

    Google, it seems, has not considered the ethical implications of many of its recent decisions. Without the arts - movies, music, images, etc... - who, but geeks, would use a search engine?

    --
    The society for a thought-free internet welcomes you.
  19. Another approach by EnsilZah · · Score: 1

    Another method that I've... err.. come across:
    Since stock photographers try to maximize their exposure (pun not intended, but noted), the put up their images on a bunch of stock photo sites, each site has its own watermark, usually in a different location, so if you google image search the watermarked image, you can fill in the watermarked areas from those other images.

  20. How long before by Anonymous Coward · · Score: 0

    How long until this because a chat app and how long after that does Google kill it.

  21. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion