Slashdot Mirror


Google Unveils 'Gigapixel' Camera To Preserve and Archive Art (thestack.com)

An anonymous reader writes: The Google Institute has developed an ultra-high resolution gigapixel Art Camera which can automatically recompose images into single works of extraordinary detail. The first thousand images are released today, and include works by Rembrandt and Van Gogh. A gigapixel contains over one billion pixels, providing a level of detail unavailable even to the naked eye. The Art Camera has increased the number of available gigapixel art images from 200 to 1000 since 2011. The Art Camera consists of a robot camera that automatically takes hundreds of high resolution close-up photos of the details of an image, using laser and sonar technology to ensure that each image is in focus. Software is then used to take the hundreds of individual close-up pictures and combine them into one whole image. With this technology, one can view photos produced by classical artists from a computer or mobile device without needing to travel around the world to do so. These digital gigapixel images are intended to be available for viewing and studying for years. In the future, we may see Google use machine-learning algorithms to analyze influential classical painters and create new masterpieces.

71 comments

  1. With a rotating AD placed at each corner by Anonymous Coward · · Score: 0

    for 15 seconds.

  2. Use this with VR headsets by Anonymous Coward · · Score: 0

    They need to combine that with the 360 pictures of churches that are available with the VR headsets like Oculus Rift. Imagine being able to zoom into a picture as well as see all the way around. It would be cool if the old moon landing and Mars rover pictures could be converted into 360 pictures.

    1. Re:Use this with VR headsets by Namarrgon · · Score: 1

      Like how you can look at a specific item, then back out into a 360-degree view?

      --
      Why would anyone engrave "Elbereth"?
    2. Re:Use this with VR headsets by K.+S.+Kyosuke · · Score: 1

      I'd argue that they actually need to combine this with hyperspectral imaging. Why? Just think of all the different pigments used. Could be interesting for serious art history research, even. (How many paintings have been spatially spectrographed, until today?)

      --
      Ezekiel 23:20
  3. Only for pirates by Overzeetop · · Score: 1

    Only people intending to pirate these works would need that kind of resolution. I expect Getty to file suit by Monday.

    --
    Is it just my observation, or are there way too many stupid people in the world?
    1. Re:Only for pirates by Anonymous Coward · · Score: 1

      https://en.wikipedia.org/wiki/Bridgeman_Art_Library_v._Corel_Corp.

    2. Re:Only for pirates by Sir+Holo · · Score: 1

      Only people intending to pirate these works would need that kind of resolution. I expect Getty to file suit by Monday.

      Great Artists of today study the details of the brushwork of past masters in excruciating detail.

      This is not for painting clones of famous pieces—That can already be done.

      This is for world-class artists top study, up-way-close and in-detail, the many layers of paint, or whatever, used to create classic works.

      You don't think Reubens got that realistic, translucent-looking skin by just swabbing on one layer of paint, do you?

    3. Re:Only for pirates by BuckaBooBob · · Score: 1

      Ahh yes.. they will also use the highest level of jpeg compression possible to get the file size down to about 100K and since it looks good on their phone they think its super then upload it calling it the most highest definition picture ever...

      --
      Who needs WiFi when we can have Packet Over Sheep! http://datacomm.org/PoS-InternetDraft.txt
    4. Re: Only for pirates by Anonymous Coward · · Score: 0

      No, only for Google.

  4. Machine learning? by 110010001000 · · Score: 0

    What is the deal with Slashdot and machine learning? Real AI ain't gonna happen no matter how much you want it.

    1. Re:Machine learning? by amRadioHed · · Score: 1

      Sure, as long as you can always redefine "Real AI" to mean whatever we haven't yet done.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    2. Re:Machine learning? by 110010001000 · · Score: 1

      Well since we don't have any AI at all yet you can comfortably say we haven't done anything.

    3. Re:Machine learning? by amRadioHed · · Score: 1

      Ok, have fun playing with your own special definition of AI that no one else uses.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    4. Re: Machine learning? by Anonymous Coward · · Score: 0

      Totally. Reminds me of nerds in the 90s who were sure that they would be able to fully exist in 'the virtual world' by the end of the decade. Beyond a certain point, optimism sounds suspiciously like a teenage fantasy.

    5. Re:Machine learning? by 110010001000 · · Score: 1

      Have fun playing with Siri and your Go "AI" programs...

    6. Re: Machine learning? by 110010001000 · · Score: 1

      Exactly. The only thing worse than a tech nutter is a space nutter who says we are going to start populating other solar systems "real soon".

    7. Re:Machine learning? by Anonymous Coward · · Score: 0

      Given some of the most common definitions in the community include things like Self Awareness or the ability to think and learn on their own I would say he is hardly on his own. There is no one definition of AI though, Over the years AI has become such a "cool" label that many areas in computing label anything that looks from an outward appearance to be human type behaviour as AI. We are decades away from coming even close to having Actual artificial INTELLIGENCE.

    8. Re:Machine learning? by Coren22 · · Score: 1

      It's ok, we all know you are really Watson pissed that it isn't getting enough attention.

      --
      APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
    9. Re:Machine learning? by Coren22 · · Score: 1

      Intelligence is easy, Cortana, Siri, Watson, you could call all of those intelligent. Wisdom, that is difficult.

      --
      APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
    10. Re: Machine learning? by Coren22 · · Score: 1

      The only thing worse than those, is a nutter nutter. Someone so convinced of other people's shortcomings, that they are unable to get by their very massive shortcomings. Such as you.

      --
      APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
  5. a painting is not an image by Anonymous Coward · · Score: 0

    To reduce a painting to an image and claim that by reproducing it on a screen one does not require to see the original is absolutely ridiculous.

    1. Re:a painting is not an image by amRadioHed · · Score: 1

      Sure, a painting isn't just an image. It has a texture, smell, and taste too. Most museums won't let you experience those however, so the image is pretty much what you're limited to either way.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    2. Re:a painting is not an image by Anonymous Coward · · Score: 0

      Sure, but if they add 3-d scanning to the data, then forgers could easily reproduce them down to the thickness of the paint in each stroke.
      Unless google ads a "scanned by google" watermark somehow.

    3. Re:a painting is not an image by HornWumpus · · Score: 1
      --
      John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    4. Re: a painting is not an image by Anonymous Coward · · Score: 0

      actually, a 3D scan would make it, next to a high resolution photo, virtually impossible to forge.

    5. Re:a painting is not an image by Anonymous Coward · · Score: 1

      As well as a 3D scan, you should take colour samples at a whole range of frequencies (not just 3, as an RGB camera does). You also need to measure how opaque / translucent / transparent the paint is, the amount of specular vs diffuse reflection, etc. Again, at a whole range of frequencies. There is a LOT of data that needs to be collected.

    6. Re: a painting is not an image by Anonymous Coward · · Score: 0

      and even with all that data, one can still not claim to have 'captured' the painting. A painting is a uniquely historical object, a symbolic memoir of the human experience at a particular time. The materials have withstood the test of time, beyond the mortality of it's creator. This is what makes a physical painting so valuable and fascinating. To share a deeply personal and subjective creation beyond the boundaries of our physical existence by seeing it in person. A painting is also what it means, an image is not.

  6. Nope. by kheldan · · Score: 1

    In the future, we may see Google use machine-learning algorithms to analyze influential classical painters and create new masterpieces.

    Nope, nope, and hell, no. At best they might create 'in the style of such-and-such classical artist', but they won't be 'masterpieces'. Google's hubris, arrogance, and lack of taste, apparently, know no bounds. AI fanbois can bite me.

    --
    Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
    1. Re:Nope. by Anonymous Coward · · Score: 0

      As an engineer, I think art is crap (not really... hear me out). But what is fascinating about art is the amount of work required and how it was done. An ancient clay pot or piece of bronze artwork looks terrible, but when you realize how much time a single person must have spent to create it, it's kind of wonderful. A note that something was transported across Europe means nothing... until you see that it was a giant 10m+ object moved by an American archeological team in the late 1930s, when travel must have been difficult.

      A new painting of a particular style will mean as little to me as the Mona Lisa... but I would have an appreciation for the algorithms that went into it. It would be a completely different type of appreciation compared to the work that went into the originals... but it would still be a type of masterpiece.

    2. Re:Nope. by Anonymous Coward · · Score: 0

      Agreed. I've wandered a few token art galleries in Europe and by and large found them remarkably dull. Endless paintings of bits of fruit, vases of flowers, dull landscapes, predictable portraits, and don't even get me started on the unavoidable "group of people with halos looking up all religiousy" works. The only real interest I found in such places was thinking about how say a vase or bronze would have been made with old tech, or how that guy might have painted the ceiling before OH&S.

      A new painting of a particular style will mean as little to me as the Mona Lisa... but I would have an appreciation for the algorithms that went into it. It would be a completely different type of appreciation compared to the work that went into the originals... but it would still be a type of masterpiece.

      IRL the Mona Lisa is a small, dark painting stuck on a wall in Paris and surrounded by jostling tourists and the occasional pick-pocket. With a google work "in the style of" at least the tech behind it would be interesting.

    3. Re: Nope. by Anonymous Coward · · Score: 0

      Agree. With all the liberal arts grads that frat company has, you'd think they'd have someone to tell them theyre not aadvanced enough at AI for that yet. Did they suddenly conquer emotion In AI yesterday? No.

    4. Re:Nope. by kheldan · · Score: 1

      Since not a single one of you are anything more than Anonymous Cowards, I guess I need to comment on my own comment.

      The reason you don't 'get' art, is you're not emotionally available to it. Art is one of the most 'human' things that humans have ever invented, because the whole point of art, is to evoke an emotional response within the person viewing it. That being said, no two people are going to have exactly, precisely the same emotional response to a particular piece of art. Then there's people who Just Don't Get It, and maybe not for lack of trying on their part; they're just not available to it, emotionally, to be affected by it in any way, for whatever reason.

      That all being said: I don't get most art, either. But at least I understand the point of it, and can appreciate that aspect of it. Doesn't mean I think all art is trash and a ripoff, it just means I won't go out of my way for most of it. I'll even admit that perhaps more exposure to it and study of it would expand my understanding and appreciation for it.

      Oh and by the way: music is a form of art, too; if you really can honestly say that there has never been a piece of music of any genre whatsoever that never evoked some sort of emotional response in you, then perhaps you are, in fact, dead inside.

      --
      Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
    5. Re:Nope. by Anonymous Coward · · Score: 0

      I disagree. Art is cultural. An Andy Warhol painting of a soup can will not evoke an emotional response from a member of an Amazonian tribe, or an ancient Greek -- how could it?

      You want to come back with music as the example, but modern western music is not the only way to setup sounds or notes or scales.

      However, if you know the background of the artist and the era and tools available, suddenly things become more meaningful. This is why people spend more time studying art history than science history.

    6. Re:Nope. by kheldan · · Score: 1

      Art is cultural

      Why does it have to be one or the other? Why can't it be both 'cultural' and 'emotional'? I disagree with your disagreement.

      --
      Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
    7. Re:Nope. by Anonymous Coward · · Score: 0

      because without a cultural reference most art is actually meaningless and completely unemotional. You definition is also a little off, Art is not just about invoking emotional responses, it can be to invoke intellectual responses as well.

    8. Re:Nope. by kheldan · · Score: 1

      because without a cultural reference most art is actually meaningless and completely unemotional

      Oh so you admit that it's BOTH 'cultural' and 'emotional'? Thanks for validating my point, have a nice day!

      --
      Are YOU using the TOOL, or is the TOOL using YOU? Think about it!
  7. More like "gigapixel-panorama" camera... by Arkh89 · · Score: 1

    It is not a "real" gigapixel camera...
    (today's largest are about 250Mp)

    1. Re:More like "gigapixel-panorama" camera... by amRadioHed · · Score: 1

      It's a camera, and it produces gigapixel images of artworks. No, you can't take it out and take gigapixel snapshots, but no one claimed otherwise.

      --
      We hope your rules and wisdom choke you / Now we are one in everlasting peace
    2. Re:More like "gigapixel-panorama" camera... by Overzeetop · · Score: 1

      But it's no more a gigapixel camera than an iPhone. Well, a high end Android phone at least - iPhones don't have laser based focus detection.

      --
      Is it just my observation, or are there way too many stupid people in the world?
    3. Re:More like "gigapixel-panorama" camera... by Anonymous Coward · · Score: 0

      I'm just waiting for the "googapixel" camera...

    4. Re:More like "gigapixel-panorama" camera... by Namarrgon · · Score: 1

      If your phone had a lens capable of optically zooming right into a tiny part of the artwork, and a motorised mount that could move it all over the whole work, and software that could match and stitch them all into a seamless larger image, sure.

      --
      Why would anyone engrave "Elbereth"?
  8. Exapixel camera by Anonymous Coward · · Score: 0

    How long before they use an STM for super duper resolution?

  9. But Copyright!!!! by Anonymous Coward · · Score: 0

    If they can get away with this, Rembrandt and van Gough won't have any incentive to make paintings!!!

  10. Why is this news by Anonymous Coward · · Score: 0

    There are already retail products that do this like gigapan: http://www.bhphotovideo.com/c/product/689699-REG/Giga_Pan_EPIC_PRO_EPIC_Pro_Robotic_Camera.html

    So what's new here???

    1. Re:Why is this news by Anonymous Coward · · Score: 0

      Near as I can tell, the only thing distinct from a gigapan is that Google's camera is (one would assume) mounted on an XY table rather than a PT head.

      The hardest thing about assembling a gigapixel or more image these days is finding a machine with sufficient RAM for Hugin to stitch it all at once. From experience, it uses nearly all of 32GB to stitch a 750MP output if you're at 16bit/channel. Machines with 64+GB of memory are still quite rare...

    2. Re:Why is this news by petermgreen · · Score: 1

      Machines with 64+GB of memory are still quite rare.

      16GB desktop (unregistered non-ecc ddr4) modules are now available at reasonable prices, so you should be able to do 64GB on a mainstream desktop platform and 128GB on a high end desktop platform now.

      I figure about £750 for the bits to build a computer with 64GB and about £1500 for the bits to build a computer with 128GB. Compared to the cost of pro camera equipment that is quite cheap.

      --
      note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    3. Re:Why is this news by tlhIngan · · Score: 1

      16GB desktop (unregistered non-ecc ddr4) modules are now available at reasonable prices, so you should be able to do 64GB on a mainstream desktop platform and 128GB on a high end desktop platform now.

      Not really.

      Skylake desktop CPUs (just coming out) support 64GB - older CPUs topped out at 32GB of RAM.

      128GB would require the use of Intel Xeon chips (server class), so it's not quite common yet. High end workstations with server CPUs may have the ability to take 128GB, but only the latest mainstream CPUs can take 64GB.

      Anyhow, you probably won't see that much art up there - as a condition for Google to scan it, the right to post it online is Google, and a lot of more famous art and museums don't particularly want that. So you're not likely going to see the Mona Lisa scanned like that - the Louvre would rather you look at it in person or at low res photos they authorize.

  11. So you admit to the piracy and IP theft? by Overzeetop · · Score: 2

    So you agree - modern artists blatantly stealing the methods and means of other pioneering researchers in the visual arts who are likely not to receive a single cent of remuneration for their discoveries? I'll bet as a result of this rampant piracy and IP theft, not a single one of the old masters will have the money - or will - to create any more great works. And it will be the fault of the pirate corporation Google, leading and encouraging mass - illegal - appropriation of the IP of others for personal, professional, and financial gain. /s

    --
    Is it just my observation, or are there way too many stupid people in the world?
    1. Re:So you admit to the piracy and IP theft? by Anonymous Coward · · Score: 0

      So you agree - modern artists blatantly stealing the methods and means of other pioneering researchers in the visual arts who are likely not to receive a single cent of remuneration for their discoveries? I'll bet as a result of this rampant piracy and IP theft, not a single one of the old masters will have the money - or will - to create any more great works. And it will be the fault of the pirate corporation Google, leading and encouraging mass - illegal - appropriation of the IP of others for personal, professional, and financial gain. /s

      Yeah, poor Vincent is poor because of Google - not all the people who visit galleries. Oh wait he's dead (you bastards!).

      Fact: Your time is worth money, your "ideas" and work are worth nothing. There's a difference between what people will pay and what something is worth.
      Clearly we're going to need a longer wall.

    2. Re: So you admit to the piracy and IP theft? by Anonymous Coward · · Score: 0

      Hmm, what makes one person's time worth more than another person's time. Ability to execute is certainly one part but a person's ideas are hardly valueless

  12. Yet another mistake by caviare · · Score: 1

    A gigapixel is exactly one billion pixels, not "made of over one billion pixels". We should not let marketroids get away with this sort of crap.

    1. Re:Yet another mistake by wonkey_monkey · · Score: 1

      It's pretty common usage. A 5 megapixel camera belongs to the set of "megapixel" cameras.

      Anyway, the sensor in this thing has less than a billion pixels, so it is a bit of a lie, but for different reasons.

      --
      systemd is Roko's Basilisk.
    2. Re:Yet another mistake by cdrudge · · Score: 1

      But is that a base-2 billion or a base-10 billion?

  13. Stitching artifacts by ortholattice · · Score: 3, Interesting

    While the overall result is impressive, the "stitching" isn't perfect. On most pictures it's hard to tell since the brushstrokes have lower resolution than the photography. But on one picture in particular, called "O Livro (os Cem)" by Jac Leirner (1987), the stitching irregularities are easy to find. Type "O Livro" in the search box to find this image.

    Essentially this picture is a giant canvas of words in Portuguese. (I speak Portuguese, and it starts off as a bunch of rambling thoughts on money and love, degenerating into what to me makes no sense).

    Anyway, to pick an easy to locate spot where stitching apparently took place, find the line about 2/3 down that consists of a giant hexadecimal number (what the hell is that, anyway?). The line starts "D21D22C23..." Blow it up to maximum resolution. The first and second D, and the second 2, have alignment artifacts, and the lower portion of this starting string is slightly blurrier that the top portion. This even gives some insight into the algorithm, where you can see that it's desperately trying to align the top and bottom portions, even distorting or shifting some in-between parts to achieve the result.

    1. Re:Stitching artifacts by ortholattice · · Score: 1

      Studying the "hexadecimal" number some more, it doesn't have hex digits E and F. Instead, it seems that the artist took numbers from 1 to 99 and followed each of them with a letter from A to D, like the answers in a multiple-choice quiz. Then he took this long list and cut it into sections, some with the numbers increasing and some decreasing, and re-concatenated them. Beyond that, your guess is as good as mine.

    2. Re:Stitching artifacts by Anonymous Coward · · Score: 0

      Mindless Hard core art types don't get hexadecimal pics at 11.

    3. Re:Stitching artifacts by BadgerRush · · Score: 1

      Good catch, that particular work of art is extremely good to showcase the problems with their current stitching program. And, although examples of extremely egregious stitching error like the one you cited (on that weird number) are somewhat rare, more subtle errors can be found all around the piece. A quick look at the first few lines tell me that almost half of the words contain a subtle stitching error. For example here is a transcription of the beginning of the first line of text where I highlighted the letters containing stitching errors:

      > Estava escrito. Dinheiro me vale, dinheiro me leva. Para casa. Deilde de Souza quero casar com você ...

      So, although such an archival project is very interesting, it is far from fulfilling the promise of a substitute to the real thing when studying a work of art.

    4. Re:Stitching artifacts by Anonymous Coward · · Score: 0

      don't you mean at 0xB

  14. scanner by Anonymous Coward · · Score: 0

    Congratulations Google. You've invented the scanner.

  15. How typical by Anonymous Coward · · Score: 0

    Soulless Hard core engineering types don't get art, pics at 11.

  16. NOT a gigapixel camera! by Anonymous Coward · · Score: 0

    It progressively scans the picture using something in the order of 10's of megapixels to create an entire image out of multiple images. Clearly the camera itself is not gigapixel.

  17. why is this news by bloodhawk · · Score: 1

    Many companies have been stitching photos together to make a single larger high resolution photo for a long time and by the looks of it many of them do a better job as well.

  18. Yep... by crazytrain86 · · Score: 1

    Bets for how long it is until this technology is used for porn, anyone?

  19. Capturing the Unicorn by necro81 · · Score: 2

    This brings back into my mind the photo-stitching work done by the Chudnovsky brothers about 15 years ago. Photo-stitching large mosaics has been around for a long time, but the work by these two mathematicians on the Unicorn Hunt tapestries rises to a much higher level.

    The tapestries has been hanging for a very long time. During a restoration they were taken down, soaked clean, and photographed on both sides. (The back side, being against the wall and with a fabric backing on it, had much more vivid color.) But the resulting images were completely un-stitchable by conventional techniques - nothing lined up! The tapestry, being a textile, had relaxed and subtly distorted by being laid horizontal and cleaned. The tapestry was not a static image, but rather a dynamic, breathing object. The Chudnovskys applied serious math and computing power to subtly distort each image in the mosaic, cross-referencing the front and back sides, in order to get the threads to line up.

    TL;DR. See this article for more details.

    This Google camera, I'm sure, has very sophisticated stitching algorithms. But in the end, it is probably assuming that it is capturing images of a static object. I wonder how it would handle a similar challenge.

  20. Even Steven by nospam007 · · Score: 1

    "a level of detail unavailable even to the naked eye."

    Even? You make that sound as if the 'naked eye' was the highest possible resolution one could get before.

  21. Gigapixel software question by thegarbz · · Score: 1

    Slightly off topic question for the Slashdot crowd:

    With the rise of large megapixel cameras and seemingly every photo editing program now including some form of panorama stitching function creating a gigapixel image is now getting trivial. How do you display such images? How do you present them on the PC? How do you present them online?

    I've had some success with using the Google Maps API and an open source tiling solution. However that has a serious problem in that it only works with JPEGs which have limited dimensions and thus unnecessarily prevents you from hitting that gigapixel barrier on the horizontal image.

    Does anyone have any suggestions, preferably open source for a way to display a gigapixel panorama online? I've seen one tool but the license cost was incredible.

    Likewise on the PC what are people using? Irfanview is quite painful loading images. Google Picasa viewer seems to be doing a good job but then magically crashes when you get to pictures of a certain size. Windows Picture viewer craps itself on Windows 7, and outright butchers the image on Windows 8-10 by rendering a high res picture and then not re-rendering when adjusting the zoom resulting in patches of horrible aliasing.

    What are people using for this?

    1. Re:Gigapixel software question by darkain · · Score: 1
  22. I think you've missed the point by JohnStock · · Score: 1

    "With this technology, one can view photos produced by classical artists from a computer or mobile device without needing to travel around the world to do so" Er...

  23. Great!!! by Anonymous Coward · · Score: 0

    so when drones are capturing pictures of me running around in my yard without a shirt on, they can now see my belly button lint too!

  24. Glass quality by darkain · · Score: 1

    Okay, really curious on this one. I've looked at a few of these now at fully zoomed in detail. WHY did they use a camera with cheaper glass to do such a high detail scan of these works of art? Zoomed in at 100%, the images are quite soft, similar to a budget or mid-teir DSLR lens. Basically, give a DSLR a few motors to move it around the painting, and it could do the same exact thing, only with sharper detail because of the higher quality glass available for them. Considering that their intent was visual image quality, it pretty much seems like their implementation was entirely constructed by people who don't fully understand optical properties of glass in relation to capturing photographs.

    And another note: They really need to get their laser based auto focus system corrected. There were a couple times I spotted portions of the image out of focus.

  25. Whose monitor? by alleycat0 · · Score: 1

    "one can view photos produced by classical artists from a computer or mobile device without needing to travel around the world to do so." On what monitor do you expect to see a perfect representation of the original colors? Certainly not your mobile device...

    --
    I am not a number - I am a free man!