Slashdot Mirror


Gigapixel Tapestries & Gigadecimal Pi

RobotWisdom writes "The new New Yorker magazine has posted two long non-technical articles about the Chudnovsky brothers and their homebrew supercomputers. One is a 1992 article about how they calculated pi to over two billion decimal places using a $70,000 cluster with 16 nodes. The other is a brandnew piece about how they spent months creating a seamless multi-gigabyte image of a fifteenth century tapestry for New York's Metropolitan Museum of Art. Tapestries are essentially pixel-art on a non-rigid (cloth) matrix, so the manual labor of photographing it inch by inch had introduced many tiny deformations in the images, which they had to mathematically iron out. Old lo-res pix of the tapestries are on the Met's site, pix of the brothers are in the world brain."

48 of 215 comments (clear)

  1. Gigabyte, gigapixel artwork? by Bradee-oh! · · Score: 4, Funny

    Link?

    :)

    --
    "This is Zombo Com, and welcome to you who have come to Zombo Com" - www.zombo.com
    1. Re:Gigabyte, gigapixel artwork? by TheRaven64 · · Score: 4, Interesting

      I know this is intended at a joke, but I saw a research project at Southampton University about 5 years ago that allowed multi-gigabyte images to be viewed over the Internet. Each image was split into small tiles, and lower resolution tiles were made of each segment. The entire image could be viewed at low resolution, and the user could then zoom in to the full resolution on any given area. The intended use for this system was high resolution scanned images of paintings in art galleries.

      --
      I am TheRaven on Soylent News
    2. Re:Gigabyte, gigapixel artwork? by p3d0 · · Score: 2, Informative

      Read it again. That is a link to pictures of the brothers.

      --
      Patrick Doyle
      I mod down every jackass who puts his moderation policy in his sig. Oh, wait a sec....
    3. Re:Gigabyte, gigapixel artwork? by Speare · · Score: 3, Informative

      I've used a Flash-based system called Zoomify to display higher resolution mosaics (up to 50 megapixels, myself). It works well, but since it's all based on jpegs, the tile deconstruction process can introduce more compression artifacts and a little bit of softening. It's worth the space and super-simple to install and use, in my experience.

      --
      [ .sig file not found ]
  2. If you're in New York by seringen · · Score: 5, Informative

    If you're in New York, you should definitely check out the Cloisters, where the Unicorn Tapestries are held. It's right at the Northern Tip of Manhattan. A number of my friends have gone to the Met and not seen it, thinking that it'd be there. The Cloisters is probably the most stunning collection of medieval art in America in a very beautiful setting, so you should definitely check it out!

    1. Re:If you're in New York by michaelaiello · · Score: 2, Informative

      If you do make it to NY, feel free to stop by Polytechnic University (6 metrotech in Brooklyn). The Chudnovsky brothers are here (on the 3rd floor) and are currently building a supercomputer for IBM. http://www.poly.edu/polypress/chudnovsky.cfm

  3. April fools by 0x461FAB0BD7D2 · · Score: 5, Funny

    Is this another April Fools article?

    David told me that they were working with I.B.M. to design what may be the world's most powerful supercomputer. The machine, code-named C64, is being built for a United States government agency.

    I mean, I loved my C64 too, but it's no supercomputer.

  4. The Cloisters at the Met by Speare · · Score: 5, Informative
    I was just at that museum to see the tapestries in question. I have a few high-resolution (multiple-image mosaic) photographs of the architectural elements on my Quick Pix Gallery. I also took and stitched images of almost every tapestry in the building, but have not posted them online at this time.

    It's a fascinating structure, with excellent pieces for close inspection. I encourage anyone within a couple hours drive of Manhattan to take the trip to see these in person. It's at the north end of Manhattan at Fort Tryon Park (there's also one high-resolution picture in my gallery from the park).

    --
    [ .sig file not found ]
    1. Re:The Cloisters at the Met by Sp1n3rGy · · Score: 2, Funny

      You sure this isn't quake3?

  5. The hardest technical problem... by Anonymous Coward · · Score: 5, Funny

    ...was breaking the tapestry's copy protection. Starting in the 14th century, nobility decreed all tapestries contain a pattern of knotting designed to prevent any scanning or printing of tapestries. By the end of the 14th century, all scanner and printer manufacturers had added this anti-tapestry copying technology into their products.

    1. Re:The hardest technical problem... by Sotogonesu · · Score: 4, Funny

      They just used a multi-threaded architecture.

  6. Why? by amanox · · Score: 2

    I can see why one would like to calcutate Pi as far as possoble, .. but tapestries ? Spending months on a multi-gigabyte picture of a tapestrie? Geez, and it's probably not even "correct" as they had to mathematicly correct some deformation or whatever errors. Seriously, what's the point? Are they doing this "just because we can", or is there some "higher goal"?

    1. Re:Why? by Speare · · Score: 4, Informative

      How about reconstruction and preservation? These tapestries are in terrible condition, compared to when they were completed in the 1400s. Any work that is done on them is done with magnifying glass, tweezers and a well-trained hand. Any reference works should be as clear and detailed as possible. They don't want it to erode any more than it already has, and they had no such detailed records of it in previous ages and conditions.

      --
      [ .sig file not found ]
    2. Re:Why? by jcupitt65 · · Score: 5, Interesting
      You can do very cool stuff with a good picture of the back of a tapestry.

      The colours in tapestries are usually vegetable dyes and they fade very badly with exposure to light. If you go around a museum, the tapestries almost always look dingy and you need to use a lot of imagination to try to picture how they might have originally looked.

      However the back of the tapestry has been kept in the dark and the colours there are still dazzling. So ... if you have a good picture of the front and the back and you can resample the back image to get it to line up with the front to within a knot size, you can use the back colour to "re-tint" the front image and get an excellent visualisation of how the tapestry might have appeared soon after it was woven (you need to take a bit of care with colour management too).

      A friend of mine did this as part of his PhD thesis. I can't find any of his images online (I guess there would be copyright problems), I'll see if I can dig some low-res ones up.

    3. Re:Why? by jcupitt65 · · Score: 4, Interesting

      Ah! Found it.

  7. Gigapixel pie? by aldeng · · Score: 2, Funny

    That's a lot of pie! Thanks, I'll be here all week.

  8. What were they thinking?? by datbox · · Score: 4, Funny

    One is a 1992 article about how they calculated pi to over two billion decimal places

    Hrmm.. They should've just rounded down? ;)

  9. Pi Accuracy by buckhead_buddy · · Score: 2, Interesting

    How do you ascertain that your 2 billion decimal places of pi are correct? After about 50 significant decimal places doesn't the accuracy get too small to test against reality? There are formulas for calculating pi but it would then seem that your "accuracy" in calculating pi just depends on which formula you chose and how big your power bill was that month. Is the act of calculating pi still a modern yardstick of computer accuracy or is this just what you need to do to get a feature in the New Yorker?

    1. Re:Pi Accuracy by mikeplokta · · Score: 4, Insightful

      Pi's definition is mathematical, not physical. No one really knows the exact ratio between the circumference of a circle and its diameter, but it definitely varies depending on how curved space-time is in the vicinity of the circle, and on the size of the circle.

      Pi is 4 x (1 - 1/3 + 1/5 - 1/7 + 1/9 + 1/11 ...). (Or the limit of that series as its length tends to infinity, for the mathematical formalists among you.) Your accuracy in computing pi depends on how many terms of the series you can calculate (actually, there are alternative formulations that converge much more rapidly, but are less easy to write down in ASCII.)

    2. Re:Pi Accuracy by mikeplokta · · Score: 2, Informative

      No, pi's value never changes. But the ratio of the circumference of a circle to its diameter, which is approximately pi (and only exactly in a flat space-time) varies. Consider a circle drawn on the surface of a balloon. For a small circle, the local balloon surface is nearly flat, and the ratio of the circumference to the diameter is nearly pi. But for a big circle, the circumference is much less than pi * diameter, as the diameter has to be measured around the curvature of the balloon.

    3. Re:Pi Accuracy by nb+caffeine · · Score: 2, Informative

      Thats not a circle, thats a disc that has been bent in some odd shape (somewhat like a bowl). That is a 3d object. a circle is 2d. Flat. No depth.

      --

      "Something's wrong with you...and I hope we never do meet again." - Deftones When Girls Telephone Boys
    4. Re:Pi Accuracy by Sparr0 · · Score: 2, Informative

      It is a circle in the 2-D coordinate system over the surface of the balloon. Just as a circle in 3-D space would be a bowl if you looked at in 4 dimensions in the vicinity of any significant space time curvature. consider a black hole. the circumference of the event horizon is easy to compute. the radius approaches infinity.

    5. Re:Pi Accuracy by mikeplokta · · Score: 2, Informative

      There's no such thing as flat in the real world. Space-time is curved.

  10. Re:Looks fine to me... by Anonymous Coward · · Score: 2, Insightful

    Why do we need anything more than the low-res picture that they already have? Going super-high-res simply magnifies the imperfections. Art isn't meant to be enjoyed with your face pressed up against it.

    This has got to be one of the most short sighted posting on /., EVER. Or a clever troll. Art wasn't meant to enjoy from 40 feet away either (well actually some art is, but not in this case). Just like with movies/photos/music, it's always better to have the highest quality original and you can always downgrade for mass copies. Imagine if something were to happen to the tapestry itself, without a very high quality scan, you'd be screwed.

  11. New Unit of Measurement by Cranston+Snord · · Score: 4, Funny

    David informed her that the brothers would need to obtain the complete set of raw data from the Leica camera. The next day, he went to the museum and collected, from Bridgers, two large blue Metropolitan Museum shopping bags stuffed with more than two hundred CDs, containing every number that the Leica had collected from the Unicorn tapestries. There were at least a hundred billion numbers in the shopping bags.

    Bags...and...bags...of numbers!

    --
    And now for something completely different...a man with three buttocks.
  12. Gotta wonder about "The New Yorker" readers ... by whitehatlurker · · Score: 4, Funny
    ... when the paper has to illustrate what a circle looks like when explaining 'pi'.

    "Here is a circle, with its diameter:"

    --
    .. paranoid crackpot leftover from the days of Amiga.
  13. several months?? by Anonymous Coward · · Score: 2, Interesting

    These guys are pretty inefficient or they wrote a bunch of software from scratch.

    This is basically a classic close range photogrammetry problem. In fact even easier than that, a tapestry is essentially a "flat" scene (think throwing a bunch of kitchen utensils in a pile on the floor and constructing a scene out of it which is more typical of this type of problem. Or photographing the inside of a chemical plant and reconstructing accurate blueprints).

    At work we can process 50GB worth of aerial mosaics per person per day using a specialization of a custom close range photogrammetry solution.

    These guys have a bundle adjustment which could be used to adequately solve the necessary equations for and instructions for recontructing the tapestry: http://www.ics.forth.gr/~lourakis/sba

    1. Re:several months?? by leoval · · Score: 5, Insightful


      I disagree with your analogy. Aerial mosaics have nothing to do with the work that the brothers had to accomplish.

      For instance, in aerial photagraphy the landscape being photagraphed changes very little if it changes at all (most of the changes are not even perceptible at the resolution of the cameras). Therefore reconstructing the full image is pretty much trivial (finding the overlapping sections is straightforward).

      In this case, and from TA, the images changed from frame to frame! because of several factors, temperature, humidity, light conditions etc. Also the paper cover that the photographers used also disturbed the fine threading in the images. So determining the overlapping sections between tiles could not be easyly automated, in fact from the article it seems that they were not even discernible with the naked eye.

      I thing that the time spent in that project was actually productive, and that in the process a bunch of original algorithms were created (I hope they are published in some place).

  14. Pi by MyLongNickName · · Score: 2, Interesting

    The unefulness of calculating pi to this number of digits is nill. After about thirty digits, you have the orbit of the earth calculated, with an accuracy equal to the size of an atom. Computing the circumference of a circle with diameter equal to size of known universe takes about fifty digits.

    The only interesting part of all this is the way that the algorithms (invented by Al Gore, hence the name) to calculate have become lossless in binary.

    Part of the issue I had when I was in grade school and crate my own pi generator using the 4 * (1 - 1/3 + 1/5 - 1/7....) algorithm, was the rounding error that creeped in. My TRS-80 model one would get the 3.141 part correctly, but depending on the implementation method, would round the rest in strange ways.

    Now, you can get an absolutely correct n binary digits of pi, and pick up where you left off. I've read over these algorithm proofs, and only get a headache :)

    --
    See my journal for slashdot ID's by year. Mine created in 2005. http://slashdot.org/journal/289875/slashdot-ids-by-year
    1. Re:Pi by leoval · · Score: 3, Informative

      I agree with you, I don't think that practical uses for the billionth digit of pi will be found in the near term. However exploring Pi is a good exercise for numbers theorists because it allows them to peer inside the irrational numbers and their properties. There is still a lot if uncharted territory in that area. One of the most sought after peculiaritis of an irrational number (Pi in particular) is to check if any kind of patterns can be discerned in the long list of decimal digits.

      Carl Sagan, dreamed long ago (through one of his characters) to find a "circle" pattern inside Pi (i.e another series of Pi inside).

      Who knows, perhaps something interesting will be found.

    2. Re:Pi by Ironsides · · Score: 2, Interesting

      The only interesting part of all this is the way that the algorithms (invented by Al Gore, hence the name)

      Not sure if this is meant to be a joke or not but...

      Algorithm, as it is used in mathematics means a systematic procedure to solve a problem. The word is derived from the name of the Persian mathematician, al-Khowarazmi (See algebra). The first use of the word I am aware of was by G W Liebniz in the late 1600.

      Source: http://www.pballew.net/arithme1.html
      Other Source: http://www.disc-conference.org/disc2000/mirror/kho rezmi/

      --
      Fly me to the moon Let me sing among those stars Let me see what spring is like On jupiter and mars
    3. Re:Pi by Hooptie · · Score: 2, Informative
      It is Sagan and it happens at the end of Contact (the book not the movie)

      Hooptie

      --
      "Heavens, it appears that my weewee has been stricken with rigor mortis!" -- Stewie Griffin
  15. Film by kinzillah · · Score: 4, Interesting

    rather than stich a bunch of digital photos, they should have simply photographed it with a very large format camera, and had the resulting negative drum scanned at 8000dpi. These folks do it that way, and if you take a look, the resolution is amazing.

    --
    Douglas P. Price
    1. Re:Film by myukew · · Score: 2, Insightful

      maybe they had no 8000dpi scanners back in a time when normal people could build one of the fastest supercomputers in the world and pay less than $80k

    2. Re:Film by BalloonMan · · Score: 2, Informative
      rather than stich a bunch of digital photos, they should have simply photographed it with a very large format camera, and had the resulting negative drum scanned at 8000dpi.
      Works great for landscapes at infinite focus, but not so great for up-close work. To avoid nasty spherical aberations, they would have to shoot the tapestry through a mega-telephoto lens from 100 yards away, but the walls of the museum would kinda get in the way. And it can't be just any large format camera, either. Scanning at 8000 dpi will reveal just how imperfect everything about your camera really is, unless you have it specially engineered for the task, which the Gigapxl folks have done.

      Putting the actual tapestry through a large drum-scanner would be the ideal solution, but I bet the museum was looking for a slightly gentler process. Seems like the photo-mosaic approach was a decent compromise.
  16. The middle ages weren't that simple by Anonymous Coward · · Score: 2, Interesting

    Everybody seems to think the middle ages were some kind of throw-back. Because Roman civilization was gone, people think that Europe had sunk back nearly to the stone age. In particular, they think that because the art is not photo-realistic that it must be primitive.

    This tapestry embodies a culture that we no longer understand. In fact, the makers of the tapestry may not have completely understood the references they were making. (Just as we don't. Think of all the figures of speech that you use and can't completely explain.) Understanding the meaning of the tapestry will take a much bigger supercomputer. (Eventually the answer will be 42.)

  17. Re:[A-Z][a-z]*sk[iy] brothers by Thud457 · · Score: 2, Funny

    Don't forget the Strugatsky brothers!

    --

    the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff

  18. Billion Places Of Pi by Pants75 · · Score: 3, Interesting
    Quick question...

    How do we *know* that pi is exactly the result of the formulas that these people use to calculate pi?

    I only ask because I assume that pi (as defined by the number of times the diameter of a circle can be wrapped around its circumference) might differ at some arbitary point into the calculation?

    How do we know that these calulations actually produce a number that matches reality?

    Pete

    1. Re:Billion Places Of Pi by poopdeville · · Score: 4, Informative

      Uh, pi is the limit of a convergent sequence. One can easily derive identities with which to calculate pi to any accuracy desired. A simple one is:

      pi^2 / 6 = Sum_{n=1}^{oo} 1/(n^2)

      It is straightforward to prove this identity. (Just take Fourier coefficients on the function f(x) = x on the interval -pi to pi).

      If you're looking for an experiment with 2 billion significant digits of accuracy, you're never going to find one. That's physically impossible, for several hundred reasons.

      --
      After all, I am strangely colored.
  19. Missed the real story... by Anonymous Coward · · Score: 4, Funny
    Meh.. you guys are missing the forest for the trees.

    Who cares whether they calculated Pi to n-billion digits? Who cares if they photographed the tapestries to the precision of an atom??

    The important question that needs to be answered is: how did they end up with wives who (a) work; (b) don't force these two nerds to work; and (c) let them buy all the toys they need? Where can I get a wife like this??

  20. Re:Why do you need to know Pi so accurately? by woodsrunner · · Score: 2, Informative

    Some people believe it holds insight into patterns. Thus if you could crack PI, you could crack the stockmarket, the bible, etc.

    See the movie:
    PI

    There are also several interesting books on the topic including The History of PI, by Peter Beckmann.

    The Life of Pi by Yann Martel, however, has nothing to do with the number.

  21. Obligatory... by Grendel+Drago · · Score: 2, Funny

    Frink: [drawing on a blackboard] Here is an ordinary square....
    Wiggum: Whoa, whoa - slow down, egghead!
    Frink: ... but suppose we extend the square beyond the two dimensions of our universe, along the hypothetical z-axis, there.
    Everyone: [gasps]
    Frink: This forms a three-dimensional object known as a "cube," or a "Frinkahedron" in honor of its discoverer, n'hey, n'hey.

    --
    Laws do not persuade just because they threaten. --Seneca
  22. With pi calculated with so many decimals... by Jugalator · · Score: 2, Interesting

    Has any numerical analysis been done to its decimals to find any particularly mathematically or esthetically "interesting" sequences? Anyone know any links to websites for that? The "monkeys banging on a typewriter" thing. :-)

    I mean, with an enormous amount of decimals calculated, you'd think there was some pretty cool sequences in there?

    --
    Beware: In C++, your friends can see your privates!
  23. wow... waste of processor cycles! by Adult+film+producer · · Score: 2, Insightful

    The first problem: They hired amateurs to photograph priceless artifacts. Though the description is short it does include some tip-offs, "skateboard wheels." Sounds like they hired some real flakes that couldn't control the environment they were photographing and they were using inexpensive equipment... I applaud the brothers for their work but it seems like a wasted effort because it could have been avoided if they had hired professionals to photograph the damn thing.

  24. Northern tip... by Doktor+Memory · · Score: 3, Funny

    Pfft. There's another mile (and change) of Manhattan north of the cloisters.

    Either that, or my apartment is actually in Yonkers and I should be paying a lot less rent.

    --

    News for Nerds. Stuff that Matters? Like hell.

  25. 70 billion? by PenguinX · · Score: 2, Funny

    That seems excessively irrational.

  26. Upon further reading... by cr0sh · · Score: 2, Interesting
    I read both New Yorker articles, and still, no pictures, nothing - googling and GIS searches seem to help not one bit. It isn't that I doubt the claims, I have no reason to doubt them. However, one would think there would be more than just a few pictures. It is madenning.

    I have watched the movie PI - and I know that in part it was based on these two. I think about the computer as depicted in that movie. I think about other people I have known and about myself. I have known people who have had "vast collections" of parts and computers, books and papers - scattered and ordered, on shelves, on the floor. I myself to an extent am that way (but I try to confine it to my workshop and my office - bits creep out now and then and I have to shoo them back). Some of those I have known, though - come closer to the Chudnovsky brothers than I do. Though they have, supposedly (given the lack of pictures), realized tools and such - I know of people who theorize tools, come up with gradiose plans, all the way up to almost the point of execution (bits of paper, writing, etc) - then do nothing with it, claiming the problem solved and moving on to the next. Such minds stagger me, because it indicates a certain level of laziness - but more so, because all the theory in the world will never prove whether the theory is realizable as fact. Many such theories that sounded like they would work fine actually broke down as they were realized in the real world - but later became workable as the real-world constructs were fiddled with, or as the real world advanced to allow for them. But how would one ever know without trying? It is frustrating to see this - to see the unrealized potential - to see the possibility of unrealized possible profit to be had from these ideas...

    True, that some of this is the need for thinkers and doers - after all, even Tesla's ideas needed Westinghouse to profit from them (and this is frustrating further still - why couldn't Tesla or the multitude of others then and now cash in on their hard work themselves - why must they all die virtually broke and alone?). It doesn't have to be this way - but something about how these individuals (and group minds?) work seem to preclude this as the "way it must be"...or something.

    Another note - the Cloisters wanted an ultra-high resolution image of the tapestry. I agree that for preservation reasons, it has to be exact. So I don't fault the Brothers for finding the small faults which would cause them much pain to reassemble the mosaic, and have to figure out a way around this - but this is an example of something else I have noticed in this class of brilliance - making mountains out of molehills. It seems that for any given task (no matter how simple it could be), these people insist on finding the most complex solutions possible to solve them. In the case of this tapestry - maybe that is the best thing (for future generations?). But even in everyday situations, it seems that simple solutions won't work for them - the solutions must be extremely complex, or it won't work. They also get terribly upset when you prove or show to them that a simple solution works equally as well and gets the job done faster (an example: a tight nut on a bolt needs to be loosened - these individuals will tend to go about needing complex tools or methods, theorizing forever on whiteboards on this or that angles and torque and whatnot, hours later with nothing accomplished - damnit all, just squirt a bit of wd-40 on it, stick a damn socket and wrench on the thing, add a pipe extension, and give it a bit of leverage and bust the bastard free).

    I will give the brothers this: they at least will build their own tools and realize things - though I will always find it madenning that the only "output" we ever seem to hear about these people, despite their genious, seems to only come from the pages of the New Yorker magazine. It seems like they are almost fiction...

    --
    Reason is the Path to God - Anon
  27. Generating Infinity.... by CmdrWaco · · Score: 2, Funny

    With this kind of processing power, a project of mine which I've always wanted to bring to birth, Infinity Generators, might be a reality.

    Take, if you will, a simple 640x480 image, with 256 colours. (It could be any image size and any number of colours, but this is just a standard image format). With it's 640x480 dimensions, there are a total of 307,200 pixels. If each pixel can have one of 256 colours, thats a total of 307,200^256 = 6e+1404 possible permutations of that image.

    Such a system as this could in theory calculate all these permutations in a reasonable timeframe.

    WHY?! you might cry.
    Here's why... if we calculated every possible permutation of that 640x480 image, we could have every picture of everything that ever existed. Most, granted, would be junk, but there would be a ton of interesting, and spooky images.

    Taken a little further, we could apply these generations to textual applications.
    For example, remember the classic Infinite Number of Monekys on an Infininte Number of Typewriters will eventually generate Shakespeare's plays.
    We could bring this into reality. Since textual documents are usually much smaller than images, we could do it faster with an Infinity Generator.
    Just imagine, not only the complete works of Shakespeare, but poems, plays, songs, books that have ever and never been written ... are brought into birth!
    Again, we could apply the generators to create MP3 files, Films, and anything...

    From Infinity, comes Creativity...

    --
    Vote devolution! http://www.devolution.co.uk