Slashdot Mirror


Google Unveils 'Gigapixel' Camera To Preserve and Archive Art (thestack.com)

An anonymous reader writes: The Google Institute has developed an ultra-high resolution gigapixel Art Camera which can automatically recompose images into single works of extraordinary detail. The first thousand images are released today, and include works by Rembrandt and Van Gogh. A gigapixel contains over one billion pixels, providing a level of detail unavailable even to the naked eye. The Art Camera has increased the number of available gigapixel art images from 200 to 1000 since 2011. The Art Camera consists of a robot camera that automatically takes hundreds of high resolution close-up photos of the details of an image, using laser and sonar technology to ensure that each image is in focus. Software is then used to take the hundreds of individual close-up pictures and combine them into one whole image. With this technology, one can view photos produced by classical artists from a computer or mobile device without needing to travel around the world to do so. These digital gigapixel images are intended to be available for viewing and studying for years. In the future, we may see Google use machine-learning algorithms to analyze influential classical painters and create new masterpieces.

43 of 71 comments (clear)

  1. Only for pirates by Overzeetop · · Score: 1

    Only people intending to pirate these works would need that kind of resolution. I expect Getty to file suit by Monday.

    --
    Is it just my observation, or are there way too many stupid people in the world?
    1. Re:Only for pirates by Anonymous Coward · · Score: 1

      https://en.wikipedia.org/wiki/Bridgeman_Art_Library_v._Corel_Corp.

    2. Re:Only for pirates by Sir+Holo · · Score: 1

      Only people intending to pirate these works would need that kind of resolution. I expect Getty to file suit by Monday.

      Great Artists of today study the details of the brushwork of past masters in excruciating detail.

      This is not for painting clones of famous pieces—That can already be done.

      This is for world-class artists top study, up-way-close and in-detail, the many layers of paint, or whatever, used to create classic works.

      You don't think Reubens got that realistic, translucent-looking skin by just swabbing on one layer of paint, do you?

    3. Re:Only for pirates by BuckaBooBob · · Score: 1

      Ahh yes.. they will also use the highest level of jpeg compression possible to get the file size down to about 100K and since it looks good on their phone they think its super then upload it calling it the most highest definition picture ever...

      --
      Who needs WiFi when we can have Packet Over Sheep! http://datacomm.org/PoS-InternetDraft.txt
  2. Nope. by kheldan · · Score: 1

    In the future, we may see Google use machine-learning algorithms to analyze influential classical painters and create new masterpieces.

    Nope, nope, and hell, no. At best they might create 'in the style of such-and-such classical artist', but they won't be 'masterpieces'. Google's hubris, arrogance, and lack of taste, apparently, know no bounds. AI fanbois can bite me.

    --
    Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
    1. Re:Nope. by kheldan · · Score: 1

      Since not a single one of you are anything more than Anonymous Cowards, I guess I need to comment on my own comment.

      The reason you don't 'get' art, is you're not emotionally available to it. Art is one of the most 'human' things that humans have ever invented, because the whole point of art, is to evoke an emotional response within the person viewing it. That being said, no two people are going to have exactly, precisely the same emotional response to a particular piece of art. Then there's people who Just Don't Get It, and maybe not for lack of trying on their part; they're just not available to it, emotionally, to be affected by it in any way, for whatever reason.

      That all being said: I don't get most art, either. But at least I understand the point of it, and can appreciate that aspect of it. Doesn't mean I think all art is trash and a ripoff, it just means I won't go out of my way for most of it. I'll even admit that perhaps more exposure to it and study of it would expand my understanding and appreciation for it.

      Oh and by the way: music is a form of art, too; if you really can honestly say that there has never been a piece of music of any genre whatsoever that never evoked some sort of emotional response in you, then perhaps you are, in fact, dead inside.

      --
      Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
    2. Re:Nope. by kheldan · · Score: 1

      Art is cultural

      Why does it have to be one or the other? Why can't it be both 'cultural' and 'emotional'? I disagree with your disagreement.

      --
      Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
    3. Re:Nope. by kheldan · · Score: 1

      because without a cultural reference most art is actually meaningless and completely unemotional

      Oh so you admit that it's BOTH 'cultural' and 'emotional'? Thanks for validating my point, have a nice day!

      --
      Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
  3. More like "gigapixel-panorama" camera... by Arkh89 · · Score: 1

    It is not a "real" gigapixel camera...
    (today's largest are about 250Mp)

    1. Re:More like "gigapixel-panorama" camera... by amRadioHed · · Score: 1

      It's a camera, and it produces gigapixel images of artworks. No, you can't take it out and take gigapixel snapshots, but no one claimed otherwise.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    2. Re:More like "gigapixel-panorama" camera... by Overzeetop · · Score: 1

      But it's no more a gigapixel camera than an iPhone. Well, a high end Android phone at least - iPhones don't have laser based focus detection.

      --
      Is it just my observation, or are there way too many stupid people in the world?
    3. Re:More like "gigapixel-panorama" camera... by Namarrgon · · Score: 1

      If your phone had a lens capable of optically zooming right into a tiny part of the artwork, and a motorised mount that could move it all over the whole work, and software that could match and stitch them all into a seamless larger image, sure.

      --
      Why would anyone engrave "Elbereth"?
  4. Re:Machine learning? by amRadioHed · · Score: 1

    Sure, as long as you can always redefine "Real AI" to mean whatever we haven't yet done.

    --
    We hope your rules and wisdom choke you / Now we are one in everlasting peace
  5. Re:Machine learning? by 110010001000 · · Score: 1

    Well since we don't have any AI at all yet you can comfortably say we haven't done anything.

  6. Re:a painting is not an image by amRadioHed · · Score: 1

    Sure, a painting isn't just an image. It has a texture, smell, and taste too. Most museums won't let you experience those however, so the image is pretty much what you're limited to either way.

    --
    We hope your rules and wisdom choke you / Now we are one in everlasting peace
  7. Re:Machine learning? by amRadioHed · · Score: 1

    Ok, have fun playing with your own special definition of AI that no one else uses.

    --
    We hope your rules and wisdom choke you / Now we are one in everlasting peace
  8. Re:Machine learning? by 110010001000 · · Score: 1

    Have fun playing with Siri and your Go "AI" programs...

  9. Re: Machine learning? by 110010001000 · · Score: 1

    Exactly. The only thing worse than a tech nutter is a space nutter who says we are going to start populating other solar systems "real soon".

  10. So you admit to the piracy and IP theft? by Overzeetop · · Score: 2

    So you agree - modern artists blatantly stealing the methods and means of other pioneering researchers in the visual arts who are likely not to receive a single cent of remuneration for their discoveries? I'll bet as a result of this rampant piracy and IP theft, not a single one of the old masters will have the money - or will - to create any more great works. And it will be the fault of the pirate corporation Google, leading and encouraging mass - illegal - appropriation of the IP of others for personal, professional, and financial gain. /s

    --
    Is it just my observation, or are there way too many stupid people in the world?
  11. Yet another mistake by caviare · · Score: 1

    A gigapixel is exactly one billion pixels, not "made of over one billion pixels". We should not let marketroids get away with this sort of crap.

    1. Re:Yet another mistake by wonkey_monkey · · Score: 1

      It's pretty common usage. A 5 megapixel camera belongs to the set of "megapixel" cameras.

      Anyway, the sensor in this thing has less than a billion pixels, so it is a bit of a lie, but for different reasons.

      --
      systemd is Roko's Basilisk.
    2. Re:Yet another mistake by cdrudge · · Score: 1

      But is that a base-2 billion or a base-10 billion?

  12. Stitching artifacts by ortholattice · · Score: 3, Interesting

    While the overall result is impressive, the "stitching" isn't perfect. On most pictures it's hard to tell since the brushstrokes have lower resolution than the photography. But on one picture in particular, called "O Livro (os Cem)" by Jac Leirner (1987), the stitching irregularities are easy to find. Type "O Livro" in the search box to find this image.

    Essentially this picture is a giant canvas of words in Portuguese. (I speak Portuguese, and it starts off as a bunch of rambling thoughts on money and love, degenerating into what to me makes no sense).

    Anyway, to pick an easy to locate spot where stitching apparently took place, find the line about 2/3 down that consists of a giant hexadecimal number (what the hell is that, anyway?). The line starts "D21D22C23..." Blow it up to maximum resolution. The first and second D, and the second 2, have alignment artifacts, and the lower portion of this starting string is slightly blurrier that the top portion. This even gives some insight into the algorithm, where you can see that it's desperately trying to align the top and bottom portions, even distorting or shifting some in-between parts to achieve the result.

    1. Re:Stitching artifacts by ortholattice · · Score: 1

      Studying the "hexadecimal" number some more, it doesn't have hex digits E and F. Instead, it seems that the artist took numbers from 1 to 99 and followed each of them with a letter from A to D, like the answers in a multiple-choice quiz. Then he took this long list and cut it into sections, some with the numbers increasing and some decreasing, and re-concatenated them. Beyond that, your guess is as good as mine.

    2. Re:Stitching artifacts by BadgerRush · · Score: 1

      Good catch, that particular work of art is extremely good to showcase the problems with their current stitching program. And, although examples of extremely egregious stitching error like the one you cited (on that weird number) are somewhat rare, more subtle errors can be found all around the piece. A quick look at the first few lines tell me that almost half of the words contain a subtle stitching error. For example here is a transcription of the beginning of the first line of text where I highlighted the letters containing stitching errors:

      > Estava escrito. Dinheiro me vale, dinheiro me leva. Para casa. Deilde de Souza quero casar com você ...

      So, although such an archival project is very interesting, it is far from fulfilling the promise of a substitute to the real thing when studying a work of art.

  13. Re:Use this with VR headsets by Namarrgon · · Score: 1

    Like how you can look at a specific item, then back out into a 360-degree view?

    --
    Why would anyone engrave "Elbereth"?
  14. Re:a painting is not an image by HornWumpus · · Score: 1
    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  15. why is this news by bloodhawk · · Score: 1

    Many companies have been stitching photos together to make a single larger high resolution photo for a long time and by the looks of it many of them do a better job as well.

  16. Re:a painting is not an image by Anonymous Coward · · Score: 1

    As well as a 3D scan, you should take colour samples at a whole range of frequencies (not just 3, as an RGB camera does). You also need to measure how opaque / translucent / transparent the paint is, the amount of specular vs diffuse reflection, etc. Again, at a whole range of frequencies. There is a LOT of data that needs to be collected.

  17. Re:Use this with VR headsets by K.+S.+Kyosuke · · Score: 1

    I'd argue that they actually need to combine this with hyperspectral imaging. Why? Just think of all the different pigments used. Could be interesting for serious art history research, even. (How many paintings have been spatially spectrographed, until today?)

    --
    Ezekiel 23:20
  18. Re:Why is this news by petermgreen · · Score: 1

    Machines with 64+GB of memory are still quite rare.

    16GB desktop (unregistered non-ecc ddr4) modules are now available at reasonable prices, so you should be able to do 64GB on a mainstream desktop platform and 128GB on a high end desktop platform now.

    I figure about £750 for the bits to build a computer with 64GB and about £1500 for the bits to build a computer with 128GB. Compared to the cost of pro camera equipment that is quite cheap.

    --
    note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
  19. Yep... by crazytrain86 · · Score: 1

    Bets for how long it is until this technology is used for porn, anyone?

  20. Capturing the Unicorn by necro81 · · Score: 2

    This brings back into my mind the photo-stitching work done by the Chudnovsky brothers about 15 years ago. Photo-stitching large mosaics has been around for a long time, but the work by these two mathematicians on the Unicorn Hunt tapestries rises to a much higher level.

    The tapestries has been hanging for a very long time. During a restoration they were taken down, soaked clean, and photographed on both sides. (The back side, being against the wall and with a fabric backing on it, had much more vivid color.) But the resulting images were completely un-stitchable by conventional techniques - nothing lined up! The tapestry, being a textile, had relaxed and subtly distorted by being laid horizontal and cleaned. The tapestry was not a static image, but rather a dynamic, breathing object. The Chudnovskys applied serious math and computing power to subtly distort each image in the mosaic, cross-referencing the front and back sides, in order to get the threads to line up.

    TL;DR. See this article for more details.

    This Google camera, I'm sure, has very sophisticated stitching algorithms. But in the end, it is probably assuming that it is capturing images of a static object. I wonder how it would handle a similar challenge.

  21. Even Steven by nospam007 · · Score: 1

    "a level of detail unavailable even to the naked eye."

    Even? You make that sound as if the 'naked eye' was the highest possible resolution one could get before.

  22. Gigapixel software question by thegarbz · · Score: 1

    Slightly off topic question for the Slashdot crowd:

    With the rise of large megapixel cameras and seemingly every photo editing program now including some form of panorama stitching function creating a gigapixel image is now getting trivial. How do you display such images? How do you present them on the PC? How do you present them online?

    I've had some success with using the Google Maps API and an open source tiling solution. However that has a serious problem in that it only works with JPEGs which have limited dimensions and thus unnecessarily prevents you from hitting that gigapixel barrier on the horizontal image.

    Does anyone have any suggestions, preferably open source for a way to display a gigapixel panorama online? I've seen one tool but the license cost was incredible.

    Likewise on the PC what are people using? Irfanview is quite painful loading images. Google Picasa viewer seems to be doing a good job but then magically crashes when you get to pictures of a certain size. Windows Picture viewer craps itself on Windows 7, and outright butchers the image on Windows 8-10 by rendering a high res picture and then not re-rendering when adjusting the zoom resulting in patches of horrible aliasing.

    What are people using for this?

    1. Re:Gigapixel software question by darkain · · Score: 1
  23. I think you've missed the point by JohnStock · · Score: 1

    "With this technology, one can view photos produced by classical artists from a computer or mobile device without needing to travel around the world to do so" Er...

  24. Re:Why is this news by tlhIngan · · Score: 1

    16GB desktop (unregistered non-ecc ddr4) modules are now available at reasonable prices, so you should be able to do 64GB on a mainstream desktop platform and 128GB on a high end desktop platform now.

    Not really.

    Skylake desktop CPUs (just coming out) support 64GB - older CPUs topped out at 32GB of RAM.

    128GB would require the use of Intel Xeon chips (server class), so it's not quite common yet. High end workstations with server CPUs may have the ability to take 128GB, but only the latest mainstream CPUs can take 64GB.

    Anyhow, you probably won't see that much art up there - as a condition for Google to scan it, the right to post it online is Google, and a lot of more famous art and museums don't particularly want that. So you're not likely going to see the Mona Lisa scanned like that - the Louvre would rather you look at it in person or at low res photos they authorize.

  25. Glass quality by darkain · · Score: 1

    Okay, really curious on this one. I've looked at a few of these now at fully zoomed in detail. WHY did they use a camera with cheaper glass to do such a high detail scan of these works of art? Zoomed in at 100%, the images are quite soft, similar to a budget or mid-teir DSLR lens. Basically, give a DSLR a few motors to move it around the painting, and it could do the same exact thing, only with sharper detail because of the higher quality glass available for them. Considering that their intent was visual image quality, it pretty much seems like their implementation was entirely constructed by people who don't fully understand optical properties of glass in relation to capturing photographs.

    And another note: They really need to get their laser based auto focus system corrected. There were a couple times I spotted portions of the image out of focus.

  26. Whose monitor? by alleycat0 · · Score: 1

    "one can view photos produced by classical artists from a computer or mobile device without needing to travel around the world to do so." On what monitor do you expect to see a perfect representation of the original colors? Certainly not your mobile device...

    --
    I am not a number - I am a free man!
  27. Re:Machine learning? by Coren22 · · Score: 1

    It's ok, we all know you are really Watson pissed that it isn't getting enough attention.

    --
    APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
  28. Re:Machine learning? by Coren22 · · Score: 1

    Intelligence is easy, Cortana, Siri, Watson, you could call all of those intelligent. Wisdom, that is difficult.

    --
    APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
  29. Re: Machine learning? by Coren22 · · Score: 1

    The only thing worse than those, is a nutter nutter. Someone so convinced of other people's shortcomings, that they are unable to get by their very massive shortcomings. Such as you.

    --
    APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?