Slashdot Mirror


A RAW repository, The Internet Archive and OpenRAW

Stan writes "I just read this in the OpenRAW mailing list, OpenRAW plans to create a RAW repository, a final resting place for RAW file documentations of current and already abandoned digital cameras. The RAW repository will be hosted in the Internet Archive, which describes themselves as a digital archive of the Internet and other cultural artifacts. And they have all reasons to support OpenRAW, they currently photograph billions of book pages with cameras and store them in RAW format. Unfortunately the camera makers think different (which is not always a good thing)."

146 comments

  1. Which format again...? by Anonymous Coward · · Score: 4, Funny
    I just read this in the OpenRAW mailing list, OpenRAW plans to create a RAW repository, a final resting place for RAW file documentations of current and already abandoned digital cameras. The RAW repository will be hosted in the Internet Archive
    Sorry, you lost me there. Which format will this archive be covering?
    1. Re:Which format again...? by Now15 · · Score: 1

      Probably either NEF or CR2...

      --

      Computers are useless: they can only give you answers. -- Pablo Picasso
    2. Re:Which format again...? by Anonymous Coward · · Score: 0

      Doh!
      it's writen right there:
      in the Internet Archive
      so it is in this Internet file format

      your cableman Jorge

    3. Re:Which format again...? by Cryptnotic · · Score: 1

      Which format will this archive be covering?

      I realize you were making a joke, but RAW isn't a single format. It is a generic term for dozens of different formats, each of which depends on the make and model of digital cameras. Even if you take just Canon, you've got several formats including at least CRW, TIFF (with an extended section containing the raw data), and CR2. Each of these formats supports several camera models which may or may not need to be taken into account when decoding.

      --
      My other first post is car post.
  2. Digital == Loss of freedom by Dancin_Santa · · Score: 5, Insightful

    I'm not going to say I told you so, but I told you so. The minute you give up the physical artifact and rely on a digital representation of your data, you are at the risk of any company who wishes to exert some control over the format of that data. That's why all those RAW file formats for each camera are different from company to company. They gain the most benefit by locking you into a certain piece of software and forcing you along their upgrade path.

    If you stick with film, you are only limited in your ability to develop your own negatives. If you can do this, you will be able to continue with film for as long as you want. Scan the negs and save them in whatever format you want. It doesn't matter because the actual physical artifact is still in your possession.

    Not so with Digital.

    In many ways, digital is superior to film. However, when it comes to ownership of your data, you are far better off with film than you ever can be with digital.

    1. Re:Digital == Loss of freedom by kimba · · Score: 4, Interesting

      With my camera I shoot in RAW. By some process in history, today the RAW format for my specific camera is open - available not only for use in commercial products like Adobe, but in GPL'd software that will convert it for me and for while I have the source.

      Unless someone arrests me and confiscates all my software, as well as removes all this purportedly legal software from the market, what is the risk of using this camera?

    2. Re:Digital == Loss of freedom by phidipides · · Score: 5, Insightful

      They gain the most benefit by locking you into a certain piece of software and forcing you along their upgrade path.

      Just to nitpick a bit, most of the professional photographers I know use the various plugins to Photoshop to work with RAW images, so technically they aren't being forced into an upgrade path by the camera manufacturers. I personally use a Canon 10D, and the Canon software is so awful that I always use other tools to convert and manipulate the images.

      I fully agree with your point that it would be better if the camera manufacturers fully opened up their file formats, and I fail to see how keeping them closed provides them an actual competetive advantage. However, so long as there is no constraint against converting RAW images to another lossless format I'm not sure that this is a battle in which the camera companies can be accused of trying to pull a fast one on consumers; I think it's merely a case where they need to be educated about the further benefits of opening up their formats (ie open source developers can build free tools, etc).

    3. Re:Digital == Loss of freedom by Hast · · Score: 3, Insightful

      Oh you mean you'd rather use propriatary film with propriatary developer chemicals? There is nothing particularly "open" about that besides that the chemicals are available to buy in most photography stores. If they go out you will no longer be able to develop your old exposed film.

      Just to be clear, RAW is like the undeveloped exposed negative. After "developing" it to a TIFF16 or whatever format you want to have. You might think that RAW is equivalent to the undeveloped negative, but it really isn't.

      Besides, there is always DCRAW which allows you to "develop" your RAW files in an OSS fasion.

      Furthermore the reason RAW formats vary between makers is because it is raw data from the CCD/CMOS. So it's not strange at all that different manufacturers use different formats.

      I do agree with you though that we need open standards as far as RAW is concerned. I don't agree that the film world is any better though.

    4. Re:Digital == Loss of freedom by smithberry · · Score: 3, Insightful

      There is always some risk in machine readable data.
      In 20 or 30 years time you might have trouble getting hardware which reads your data and runs an OS which runs your software.
      Ok, you might be clued up enough to always copy backups to newer technology, but joe public is one day going to bring a CD out of his dad's attic and find he cannot even look at the photos on it.

    5. Re:Digital == Loss of freedom by aaronl · · Score: 2, Informative

      Actually... for the most part the formulas are publicly known for developers. You don't have to worry about acid fixes and rinse baths being proprietary. For most developers there are a number of companies that will make the chemical for you. Then you can just mix it yourself, or dilute it. I suppose you could make it yourself from scratch, but many of them use all sorts of evil to arrive at the final chemistry.

      Also, it isn't particuarly impossible to make your own film. Sure, getting the emulsion nice-nice isn't easy, but it's possible to do yourself.

      All that aside, you can develop most negatives from any vendor in the same chemistry. It's the C-41 process, and it makes industries like one-hour photofinishing possible. It also makes your life easier as an enthusiast.

      IOW, you don't have to worry about film being shut down because Kodak or whoever doesn't feel like manufacturing any more. It might be more difficult to get your favorite chems is all.

    6. Re:Digital == Loss of freedom by Eivind · · Score: 1
      You are wrong. The issue is not "digital vs analog", or "film vs harddisk", the issue is yourself knowing how to use the image, or have some arbitrary company control access to your images.

      With a film negative you're able to develop your own images as long as the required chemicals aren't a secret, and as long as it's allowed to sell them to you, and as long as you've got the required skills.

      With a image-file you're able to do the same thing as long as it's not a secret how to decode the image, as long as it's allowed to sell you photo-quality printers and as long as you've got the required skills.

      No difference between analog and digital here really.

      The difference only appears when you agree to store your digital images in a proprietary, secret file-format. You'd get the same problem with film if you agreed to take your pictures with a proprietary secret film-format from say Kodak that uses patented chemicals to develop and which thus can only be developed by a Kodak-lab.

      The solution is simple: insist on storing *your* information in formats where it's publicly known how to decode it. Store a copy of the instructions for decoding it in plain ascii next to the images themselves if you're feeling particularily paranoid. But it's not very likely the world will suddenly forget how to decode jpegs in the next 1000 years. (I'm /not/ saying jpegs will stay the dominant format for a thousand years!)

    7. Re:Digital == Loss of freedom by Lonewolf666 · · Score: 1

      However, so long as there is no constraint against converting RAW images to another lossless format I'm not sure that this is a battle in which the camera companies can be accused of trying to pull a fast one on consumers
      RAW format seems the best starting format for achieving best results in image manipulation (at least that was the message of an earlier /. discussion).
      So the following comparison would not be unreasonable in a review:
      -For cameras whose RAW format is publicly available, start image processing from RAW.
      -For cameras with undocumented RAW formats, convert to something like .bmp first and work from that.
      -Compare the results. If the cameras with undocumented RAW formats loses review points from the extra format conversion - tough luck.

      --
      C - the footgun of programming languages
    8. Re:Digital == Loss of freedom by Phanatic1a · · Score: 4, Insightful

      There is always some risk in machine readable data.

      There is always some risk, period. If I keep stacks of negatives in boxes in my house, then in 20 or 30 years time my house might catch fire and burn to the ground.

      Okay, *I* might be clued up enough to always keep my negatives in a fireproof safe, but Joe Public is one day going to use a penny as a fuse replacement and find that he can't look at the photos on all that celluloid ash.

    9. Re:Digital == Loss of freedom by eggz128 · · Score: 2, Insightful

      On the other hand, in the analogue world, in 20-30 years Joe Public pulls his prints and films down from the attic and finds they've been damaged due to damp etc.

      There's always some risk no matter what you do. Call it the 'shit happens' principle.

    10. Re:Digital == Loss of freedom by Eivind · · Score: 2, Insightful
      That is a risk you can't fix anyway, I mean even if you where using a film-based camera the authorities could still take your pictures and negatives away by force.

      If anything digital makes it easier to guard against that, because it makes it trivial to ensure mutliple, backups. If you're *really* paranoid you make you've got atleast 5 backups in 5 different jurisdictions.

    11. Re:Digital == Loss of freedom by Albigg · · Score: 1

      joe public is one day going to bring a CD out of his dad's attic and find he cannot even look at the photos on it

      Wouldn't it be nice if Joe's Dad used Smugmug/Flickr. I'm hoping that those guys will still be around in 20 years. I'm sure they'll have a disk array farm the size of Texas.

    12. Re:Digital == Loss of freedom by jacksonj04 · · Score: 1

      The thing with digital data is that if you have a good backup procedure (you should do anyway), it's safe. When you notice the format going out of fashion, pick up the latest lossless encryption format and it's a swift and easy move.

      The trick is to make the formats open (like this project is trying to), so that in 500 years when people dig out those antique nano-disks there will still be documentation for the format. With any luck if they get it right first time the format will still be the de facto standard. Plain text files anyone? WAV? They're not going anywhere as simple 'this bit is equal to that' files.

      --
      How many people can read hex if only you and dead people can read hex?
    13. Re:Digital == Loss of freedom by ajs318 · · Score: 1

      The chemical formulations of film and developer are published {and even if they weren't, would still be susceptible to mass spectrometry if not simpler analysis techniques}. If the companies making them go out of business, then the only thing preventing anybody from starting up making exact clones would be availability of equipment.

      What we really need is for it to be enshrined in law, in bold type if necessary, that a person is automatically privy to any secret embodied in any article they physically own, by sole virtue of the fact that they own the article embodying the secret. Well ..... it already is, I suppose; that's just simple common-law property rights. But you try getting a court to uphold your rights, especially in these times where juries consist of celebrity-obsessed morons utterly ignorant of the true meaning of freedom as long as the big corporations look as though they are giving something away and lawyers will tell you black is white for the appropriate fee.

      The problem is that back in the days when the US constitution was being written, nobody could ever have foreseen a time that it would be physically possible to make something that the owner couldn't scrutinise in the minutest detail. Like there is no mention of a right to privacy; because in those days before telephone taps, concealed cameras, tape recorders and suchlike, you could always just go off into the woods somewhere, poke the undergrowth with a stick to make sure nobody was listening, and have a private conversation.

      One of the reasons why this country did not adopt a written constitution was the fear that something important would be omitted, and not discovered until it was too late; or that some social or technological change would give rise to an issue which did not exist at the time of writing. At the time the US constitution was written, the UK was in the middle of IR1 ..... then WW1, WW2 and IR2 followed on in pretty quick succession. {Some might also say that if people know what their rights are, it makes it that much harder to take them away.}

      --
      Je fume. Tu fumes. Nous fûmes!
    14. Re:Digital == Loss of freedom by ChrisMaple · · Score: 1

      I'm not an expert in this field, but I think that making a color film of even barely acceptable quality would be an enormously difficult undertaking. Kodak, Fuji, et. al. have 100 years of research in their products and a lot of their product uses trade secrets. I would rather try to make my own digital camera.

      --
      Contribute to civilization: ari.aynrand.org/donate
    15. Re:Digital == Loss of freedom by BillX · · Score: 1

      Just to nitpick a bit, most of the professional photographers I know use the various plugins to Photoshop to work with RAW images

      So, they're not being forced to buy Photoshop?

      --
      Caveat Emptor is not a business model.
    16. Re:Digital == Loss of freedom by aaronl · · Score: 1

      You're completely correct. Doing B&W is much easier overall than color. I was just pointing out that while it's hard, it isn't by any means impossible to do these things. While their products used trade secrets, many of those have already been figured out. It's still outside the realm of what most people could, or would be willing, to do in their homes.

      On the other hand, making your own digital camera isn't nearly as hard as making your own color film. There's a lot less reasearch and trial & error involved, and all the parts are easily available.

    17. Re:Digital == Loss of freedom by theAtomicFireball · · Score: 2, Insightful

      What bullshit. The lengths that some people go to to "defend" film. If you like film, use it, but don't come up with these lame arguments, just say you like it and be done with it. I've NEVER lost a digital file since I went digital back in 1998. I keep my photo library on a computer and do periodic backups to DVD, which I store offsite. In my years of using film, I did lose negatives (only one copy of them, remember?) had many negatives that could only produce poor quality images because they got scratched, faded, creased, etc., or required a lot of work to get a good print. At many times, I didn't have room to set up my darkroom (and most people don't have one), so I had the negatives, but no way to make copies except to pay someone else - making me dependent on someone else, which is far worse IMHO than being dependent on a file format you don't own. I only periodically shoot in RAW, but I have an "official" converter that will turn it into any number of open formats, plus Photoshop supports the RAW format. If in some weird stroke of luck, both companies revoked my licenses to use that software, I'd convert them all to an open format. Otherwise, my images are JPEGs or TIFFs. I can do anything I want with them and there's absolutely no doubt that I own them. I can make unlimited copies with no image loss without a darkroom, make backup copies to store elsewhere, and print copies from pictures taken years ago at exactly the quality they were when I took them. How in the name of Dog is film "better" in terms of image ownership? And how did this lame argument get a +5 insightful?

    18. Re:Digital == Loss of freedom by Elwood+P+Dowd · · Score: 1
      The minute you give up the physical artifact and rely on a digital representation of your data, you are at the risk of any company who wishes to exert some control over the format of that data.
      As everyone else is pointing out, I also don't understand why you think physical devices are somehow better off in this regard. You leave no caveat for data standardization in either the physical or digital realm, and standardization is the only thing that gives you any such data security.

      It's not data, but look what these home canners got stuck with. Fortunately, their jar lids are standardized. Otherwise, they'd have been SOL.
      --

      There are no trails. There are no trees out here.
    19. Re:Digital == Loss of freedom by Anonymous Coward · · Score: 0

      how do you know that in 50 years we are not all going to be using some completely different kind of film that needs different chemicals to process it? Sure the chemical compounds may still be well known, but they are only as good as the specs to these RAW formats if you are unfamiliar with chemistry.

      And round and round we go...

    20. Re:Digital == Loss of freedom by fishbowl · · Score: 1

      Well, I'm still tickled shitless that I can make really detailed, breathtaking 24x36" prints. This is not something I could do AT ALL with 35mm film when I was into that. The new DSLRs are encroaching on the domain that was occupied by medium format.

      --
      -fb Everything not expressly forbidden is now mandatory.
    21. Re:Digital == Loss of freedom by WaltFrench · · Score: 1

      > ...I told you so. The minute you give up the physical
      > artifact and rely on a digital representation ...


      Tell me that Edison never patented the phonograph. Or the movie projector.

      Those very pre-digital devices encumbered the media with all sorts of restrictions; it's just that the patents expired. Before then: "Sure, that may be an image of you, on film stock that you purchased and developed. All well and good. You just don't have the right to show it to anybody else on a device that resembles ours."

      Especially on a forum dealing with intellectual property issues, let's be clear: you can try to Smash The System, you can try to amend it (e.g., 10-year copyrights or broader "fair use" rights) but when you try to pretend that it isn't pervasive througout the entire 21st century global economy, you're just wasting everybody's time.

      --
      "Inquiring Minds Want to Know!"
    22. Re:Digital == Loss of freedom by Anonymous Coward · · Score: 0

      That's why all those RAW file formats for each camera are different from company to company. They gain the most benefit by locking you into a certain piece of software and forcing you along their upgrade path.

      I thought it had more to do with the fact that very few manufacturers use the same detectors, meaning that the data that comes off of them is different in the first place.

      You're seeing a conspiracy where there is none.

      RAW is dead anyway. DNG is the future.

    23. Re:Digital == Loss of freedom by bbqpope · · Score: 1

      No no no..... There are tradeoffs. Sure there is no physical negative, but negatives are fickle beings within themselves. I shoot film and digital regularly. Some shoots aren't worth using film, and on another side of the coin, I think digital stinks for black and white. As far as ownership of data, if you don't like to have raw files, you can convert them, to a atandard like adobe's digital negative format, or shoot jpeg(if you like to be locked into lossy crappy files) Raw is different from company to company becasue the ccd or cmos ( or favian... etc) is different and the raw file is just the color gamut and luminosity recoded by the sensor, along with the data from the camer itself (shutter speed, f/stop, flash etc.) I know nikon has had a hitch in one of their recent formats, but it does not benifit the company to "own" your work andymore than it would benfit kodak or ilford to 'own' your negatives. Digital photography is not the end all solution for photos, and neither is film. they both have distict advantages. I still reach for a large format camera if I want a perfectly crisp image with lots of resolution, a 4x5 will out do a dslr hands down, but if I want a image fast without all the darkroom work, a digital is the way to go. This raw repository is a great idea, but I think it's silly to get all concerned with archivability. If your work is worth preserving, someone will. If you are shooting raw from a camera like a canon or a nikon, I am sure there will be utilities to open these files, hell even photoshops supports most of them. Especially when the average photographer's upgrade path is about 5 years or so.... or more, I have a camera that is as old as my grandma.

    24. Re:Digital == Loss of freedom by Hal9000_sn3 · · Score: 1
      how do you know that in 50 years we are not all going to be using some completely different kind of film that needs different chemicals to process it? Sure the chemical compounds may still be well known, but they are only as good as the specs to these RAW formats if you are unfamiliar with chemistry.


      Well, actually, regardless of what film type is being dealt with, one can always process as if you had black and white film, and will get negatives that can be used to make positive prints. And that is because no matter whether you are dealing with B/W, color, slide, motion picture, etcetera, you have silver halide that can be reduced differentially to metallic silver in an emulsion with a latent image waiting to be developed. No matter what dyes and filter layers are there, you can develop any film as if it were black and white negatives and you will get black and white negatives.

      Try it some time with any old film you have around, if you don't believe me. I have done this many times, especially with old exposed higher speed color film, that is going to have shifted color when processed normally.

    25. Re:Digital == Loss of freedom by Fred+Ferrigno · · Score: 1

      -For cameras whose RAW format is publicly available, start image processing from RAW.
      -For cameras with undocumented RAW formats, convert to something like .bmp first and work from that.


      Admittedly, I'm not a photographer or a graphic artist, but I'm a little confused as to how those are really any different. Chances are your image manipulation is done in Photoshop/GIMP/etc. If you use a Photoshop plugin, doesn't the plugin simply convert the RAW format internally? I assume Photoshop has some kind of standardized way of storing image data in memory so that it can be processed by the plugins and filters you want to use. The plugin's job* is to convert it to that format, which you might as well do outside of Photoshop.

      Short of using a format-specific tool, it doesn't seem like there's any sort of image manipulation that would really benefit from the RAW format, because they all do an internal conversion anyway.

      So someone, please educate me as to how a RAW plugin is any better than converting to lossless format first. It's not that I'm advocating that it isn't better, I just don't know.

    26. Re:Digital == Loss of freedom by aaronl · · Score: 1

      You cannot expect all people to be able to do all things. If the formula is known, the chemical can be reproduced. The problem with the RAW formats is that the format is not known, is unnecessarily obfuscated, or interoperability is unattainable because of copy restriction or some sort of infernal Federal laws.

      Today you don't know how the film works, or the digital camera, or the timing and fuel mix control systems of your car. This is perfectly fine, since how it works *is* known, and there are people that can make all of them. If not, you could learn how to take the information and use it to recreate these things.

    27. Re:Digital == Loss of freedom by Anonymous Coward · · Score: 0

      The C-41 and E-6 processing chemicals are pretty standardized, not to mention the b/w stuff, which you can mix yourself from ordinary, not-so-household chemicals. ;-)

      Kodachrome would be the exception...

      Oh, and we can always go back to large-format cameras, and prepare the glass plates ourself. Wet collodium photography, anyone?

  3. What's been said before by twoshortplanks · · Score: 3, Informative
    --
    -- Sorry, I can't think of anything funny to say here.
  4. RAW format by James_Duncan8181 · · Score: 4, Insightful
    The RAW format wars seem an odd competiton between camera manufacturers, who are actively hurting their presence in the professional space by making their imafes less useful for archive purposes and less interoperable for press agencies to sell. The thing that is particually noticible is that manufacturers are now being actively co-opted into sharing this information under NDA with MS to allow the hardware to work seamlessly with Longhorn. This mass move from open to propriatory standards (something MS will, of course, encourage) is meaning that the camera manufacturers are seeing their poduct become commoditised, and apparently feeling unable to compete on hardware quality alone.

    Thanks Canon, you just made me finally feel confident about buying Taiwanese.

    --
    "To any truly impartial person, it would be obvious that I am right."
    1. Re:RAW format by Uruk · · Score: 2, Insightful

      I think though that most people buy cameras for the functionality of the camera, rather than the image file format. Besides, a lot of the cameras that have strange formats come with ready-made software to convert that format into something reasonable, (even if such software doesn't run on minority OS's)

      They aren't hurting their presence in the professional space - those folks still are going to buy the camera for its camera features. That provides an opportunity to sneak in other stuff that the camera company thinks will distinguish it from other companies, including different file formats with extensions to do particular things.

      is meaning that the camera manufacturers are seeing their poduct become commoditised, and apparently feeling unable to compete on hardware quality alone

      If what you say there is true, you've identified the reason for the strange formats and differences between cameras; they are trying to differentiate themselves.

      --
      -- Truth goes out the door when rumor comes innuendo. -- Groucho Marx
    2. Re:RAW format by tgd · · Score: 1

      They're not having wars over the format. The issue is the data is *raw* -- its right off the sensor, with some header information.

      Every camera can't *by definition* have the same RAW format. Every camera has different electronics.

      Picking a common "RAW" format is no different that picking any other non-"RAW" image format. Might as well ask them all to just store uncompressed images as TIFF files or PNG with the additional metadata. But its not RAW at that point.

    3. Re:RAW format by DigicamGuy · · Score: 3, Insightful

      The thing that is particually noticible is that manufacturers are now being actively co-opted into sharing this information under NDA with MS to allow the hardware to work seamlessly with Longhorn.

      Actually, that's incorrect. The Longhorn interface is binary-only (no source code or format information is communicated to Microsoft or to the OS). Basically, the manufacturer (or third-party developer) writes a driver with an API that makes processed RGB data available to the OS. This is the same basic mode of operation as Canon and Nikon (and probably others) have implemented already in their free SDKs. Here's a brief interview with a Microsoft exec about the Longhorn interface and the shortly forthcoming "powertoy" RAW thumbnailer/viewer that's coming for XP. -- Not likely the level of detail /. people would want, but more than I've seen elsewhere, may help dispel some of the misconceptions.

      Of course, this means that the proprietary RAW formats remain entirely proprietary in the Longhorn era.

      For the record, I personally think that some level of open documentation of RAW formats makes a whole lot more sense than trying to come up with a common standard. A number of people (Adobe prominent among them, of course) have proposed Adobe DNG as a "universal" format. This sounds like a wonderful idea until you look at the assumptions underlying the format: It assumes a rectilinear pixel array, with a Bayer color filter array pattern (a checkerboard of RGB color filters on the pixels, with twice as many green pixels as red or blue). This is indeed the format used by the majority of cameras out there, but it completely misses innovations such as Foveon's full-RGB-in-every-pixel sensor, Fuji's hexagonal-pixel/diagonal-array "SuperCCD", and Fuji's latest "SR" sensors, which combine low- and high-sensitivity sensors in each pixel.

      While a "universal" RAW format would help with the issue of access to the underlying data, so would simple documentation of the structure of various proprietary RAW formats, and the latter wouldn't have the negative effect of stifling innovation in sensor technology.

    4. Re:RAW format by poot_rootbeer · · Score: 1


      RAW files were never intended for archival or interchange. The only reason they exist is to take the time and expense associated with "developing" the CCD output to a real image file format, and move it off of the camera and onto the workstation. A 2GHz desktop CPU is going to be much better at converting the data than whatever embedded microprocessor can fit into a camera form factor.

      I'm sure the AP's photographers take their shots in a raw format, but the images don't go out on the wire until they've been converted to JPEG (and had a good chunk of metadata embedded in them). Do as they do.

    5. Re:RAW format by fishbowl · · Score: 1

      "...actively hurting their presence in the professional space..."

      Uh huh. I'm sure that's exactly what they think, when they see all the photographers with their 1D's and their D2X's at every press event, or when you see all those Canon "L" lenses (white with the red stripe) at every sports event.

      The last message they are getting is that their presence in the professional space is in any sort of jeopardy!

      --
      -fb Everything not expressly forbidden is now mandatory.
    6. Re:RAW format by Anonymous Coward · · Score: 0

      The electronics don't differ *that* much, and even if they did, you could just add a different "class" or some such to the OpenRAW format.

      The point of RAW is not to do zero processing in the camera, but to have zero data-loss. Converting to TIFF or PNG loses data.

      Creating a standard "RAW" format, that can be read by a single program or library, is easy for cameras to output, and involves zero data loss from sensor to editing program, isn't impossible. They just have to want to do it, which (apparently) they haven't, yet.

  5. My Samsung saves JPG by jurt1235 · · Score: 1

    Which is apparently from quality point of view, not a good thing (however it has a high quality, low loss setting), but from an access point of view (and like what they do here: Photograph pages of books with it), is always works. No aging of formats or whatever.

    P.S. I am used of cancon just sending their software development manuals (at least in the past for their printers), apparently some attitude changed.

    --

    My wife's sketchblog Blob[p]: Gastrono-me
  6. why? by croddy · · Score: 1
    why is it referred to as RAW when it doesn't seem to stand for anything?

    why does the article link directly to some sort of blog?

    1. Re:why? by BabyDave · · Score: 2, Informative

      I think it refers to the camera's internal representation of the image (i.e. the "raw" data)

    2. Re:why? by Anonymous Coward · · Score: 1, Insightful
      why does the article link directly to some sort of blog?

      "Blogs" are the new informercial. Take something said somewhere else, post it on "your blog". Get a bunch of other accounts and link to it, and presto lots of page hits for your ads.

      Then of course, you can get it posted to slashdot (for free, I'm sure), and rake in the Rolandbucks.

      I wish google had a "blogs:no" option when searching.

    3. Re:why? by croddy · · Score: 2, Funny

      oh, they do. just add -me to your search terms :-)

    4. Re:why? by petermgreen · · Score: 4, Informative

      in this case (cameras) raw reffers to the fact its the raw unprocessed data from the CCD

      this has to be processed to convert it to a form that we would recognise as an image file. This can happen either on the camera or on a PC.

      However This conversion process may well not be fully reversable (due to rounding errors) and bloats the data considerablly (CCDs generally make a red green OR blue value at each location image files generally have red green AND blue at each location so turning CCD output into an image file always involves interpolation) so from an archivists point of view its best to keep the raw data unfortunately that raw data is often in a closed format.

      --
      note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    5. Re:why? by jaymz411 · · Score: 1

      here's the page that OpenRAW points to, to describe RAW:
      http://www.luminous-landscape.com/tutorials/unders tanding-series/u-raw-files.shtml

    6. Re:why? by croddy · · Score: 2, Interesting

      well, yes -- that page calls it "Raw" and "raw", which makes sense. I'm just confused about the "RAW" nomenclature.

    7. Re:why? by aussie_a · · Score: 1

      I tried that, but it didn't work

    8. Re:why? by 91degrees · · Score: 1

      Dunno. Either because people are so used to image formats being acronyms, or because filenames are usually stored in FAT's 8.3 format in capitals, with a filename along the lines of IMAGE001.RAW, which means it should probably be called ".RAW" format.

  7. Re:Can anyone say... by coopseruantalon · · Score: 1, Funny

    Hmm, and where would that be?

  8. Re:Can anyone say... by meringuoid · · Score: 4, Funny

    Somewhere in the world where the Americans aren't in control? Closest you're going to get is probably Iraq...

    --
    Real Daleks don't climb stairs - they level the building.
  9. How Open is the Repository? by Anonymous Coward · · Score: 4, Interesting

    This effort is being set up by a guy (Juergen Specht) who hosted a mailing list and then deleted it without notice when some of the posts offended him.

    See:
    http://www.vudeja.com/04/09/mailing-list

    http://www.esthet.org/blog/archives/001294.html

    http://www.wirefarm.com/archives/004186.html

    http://www.easterwood.org/hmmn/archives/001111.htm l

    http://openraw.org/about/

    Don't be surprised if this site just up and disappears one day, taking all of the data with it.

    1. Re:How Open is the Repository? by Spoing · · Score: 0
      Don't be surprised if this site just up and disappears one day, taking all of the data with it.

      Wow! Thanks for the heads up!

      --
      A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
    2. Re:How Open is the Repository? by Spoing · · Score: 1
      Someone posted what looks like a copy of your links to the comment page. The interesting thing? 6 votes when the average number of votes for other messages is 1 or 0. Assuming that the person who posted it voted themselves up, it looks like all the other votes are against this message;

      "My concern with OpenRAW is that Juergen Specht abused one stewardship -- the Japan Photography Mailing list -- by uniaterally deleting it. Who's to say he won't do it again?" (plus your links)

      I would have to bet that Juergen Specht is a very sensitive individual and doesn't like criticism.

      --
      A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
    3. Re:How Open is the Repository? by Spoing · · Score: 1
      Hey, he responded! The 6 votes used to be 2.5 stars. Now, it's 1 star. Those folks were right; what an @$$. Here's what he said;

      Thank you for your support! You could have used HTML to make the links work.

      But I ask you, what the bigger risk? That I delete the mailing list I created, maintain and finance or that Nikon, Canon or all the other camera makers stop supporting some older cameras, leaving you alone with your collection of abandoned RAW files, even you paid for the camera?

      And posted by Anonymous, that's so lame.

      --
      A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
    4. Re:How Open is the Repository? by Slashcrap · · Score: 1

      Don't be surprised if this site just up and disappears one day, taking all of the data with it.

      You're quite right - this is a very real risk.

      What we really need is some kind of tool for easily making copies of websites like this and all of the data & source code they contain.

      You know, a tool for getting complete copies of websites. Of course it would need a short and catchy name, maybe something like Wget would fit the bill.

      In fact, this is such an original and paradigm-shifting idea that I think I'm going to run off and patent it. I'm assuming from the comments that there's no prior art in this area.

    5. Re:How Open is the Repository? by Anonymous Coward · · Score: 0

      Yes, you can wget the site and now hopefully people will know to be careful of this guy.
      (But how often do you go and wget legitimate-looking sites?)

      Yes, people on the mailing list even had copies of the emails that were sent, but the posters only accounted for about half the members of the list.

      This guy acted vindictively and unnecessarily harsh and inconvenienced hundreds of people.
      I don't trust him.

    6. Re:How Open is the Repository? by Anonymous Coward · · Score: 0

      I wonder how long before he deletes that...

    7. Re:How Open is the Repository? by Slashcrap · · Score: 1

      This guy acted vindictively and unnecessarily harsh and inconvenienced hundreds of people.
      I don't trust him.


      I don't trust you either. Mainly because you are posting anonymously and seem to have suspiciously strong opinions about this guy.

      Without any evidence to the contrary or reason to trust you, I can't help wondering if the deleted mails weren't all ASCII art Goatse trolls posted by you.

      Sorry, but you appear to have an agenda and you're not prepared to put your name to the accusations. That's dangerously close to the definition of "troll" in my opinion.

    8. Re:How Open is the Repository? by Anonymous Coward · · Score: 0

      "I can't help wondering if the deleted mails weren't all ASCII art Goatse trolls posted by you."

      Anon's complaints are well documented and have credibility.

      As for being anonymous, what about you? It's not like I can look up your nym in a phonebook and give you a call.

      It looks like it is you that is trolling, FWIW!

    9. Re:How Open is the Repository? by Spoing · · Score: 1
      I wonder how long before he deletes that...

      So far, it's still there. Very strange things going on though such as the number of people voting (21) and the number of stars (1 out of 5). I'm suspicious.

      --
      A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
  10. What horseshit by loraksus · · Score: 3, Insightful

    The manufacturers are just opposed to working together to create some sort of standard.

    But can you blame them? Really, think about this for a second - people (scumbag fucks who should hang from lampposts, call them what you will) from Rambus sat in standards groups for years and then turned around and secretly patented the standard and then had the balls to demand royalties. You saw more or less the same bullshit with .gif and in hundreds of other similar cases in the last 20 or so years.
    I think it is (sort of) understandable that companies would be hesistant to work together to develop a standard way of doing something - especially in a cutthroat business such as photography.

    And by the way, using Canon is a fairly shitty example, Nikon is far worse when it comes to the RAW format (ok, its not really a format) bullshit that flows through the world of pro photography.

    That all said, this smacks more of the petty bickering that is involved in cameras more than than anything else (See Also, "Complete lack of lens interchangability" et al), but as always, we (or those who buy $600+ cameras) get fucked.

    Don't get me started on how "using the DMCA to "protect" the super complex almost but not quite encrypted raw format". I don't need a stroke at this age. . .

    --
    1q2w3e4r5t6y7u8i9o0pqawsedrftgthyjukilo;p'azsxdcfv gbhnjmk,l.;/
    1. Re:What horseshit by mukund · · Score: 2, Interesting

      The manufacturers are just opposed to working together to create some sort of standard.

      Adobe made an open format called digital negative... The camera manufacturers need to start adopting it.

      --
      Banu
    2. Re:What horseshit by Anonymous Coward · · Score: 0

      or Adobe can just drop support for their proprietry raw formats and ENFORCE the use of DNG. That will shake up the camera ODMs.

    3. Re:What horseshit by Hast · · Score: 2, Informative
      Unfortunately DNG doesn't go all the way and just moves the problem further down the line. From the OpenRAW FAQ:

      DNG also allows "private data" to be stored in the DNG file. This private data is only known to the camera company that wrote the private data. Third party software that reads and/or writes DNG files will ignore private data recorded by the camera. Only the software written by the camera maker will read the private data written to the DNG file by its camera. Some of this private data might be important or useful information needed by a RAW converter. Adobe's DNG format does not eliminate the problem of undocumented RAW files but transfers the problem into another "container", the DNG file. By allowing private (undocumented) data in the DNG file, DNG does not meet OpenRAW's goals.


      So in the end you end up with a similar situation. You can read the data but you don't know exactly how to treat it.
    4. Re:What horseshit by mukund · · Score: 1

      Many image-related open formats offer private data areas, including TIFF, EXIF, SVG (it's not a raster format, but still an example of a graphics format which is extensible with custom private data). Even a format with support for comments can be exploited to store private data. If you take the analogy of other open documentation such as CPU manuals, chipset documentation, etc. no company tells you *everything*. They give you enough to work with and keep many undocumented features hidden.

      The point here is that the RAW specification is completely closed. If DNG specifies enough "open fields" to reasonably express most of the currently proprietary information in RAW files without resorting to private data, then that's good enough.

      The private area is a necessary feature for extensibility. In the future, there may be things which a camera manufacturer would want to express which is not currently stated in the DNG specification. The private area is good for that while a new version of the standard comes out and specifies it.

      --
      Banu
    5. Re:What horseshit by Anonymous Coward · · Score: 0

      EXIF along with ICPA is METADATA.

      You can have extensibility and openness you know.

      I dont buy Cannon or Nikon for this reasons, they are lockin and their support unless you are a heavyweight is pathetic.

    6. Re:What horseshit by Anonymous Coward · · Score: 0

      By definition, there cannot be a standard RAW format. Since it is the RAW data from the CCD, it will be different for each CCD. Unless you reduce all CCD's to the lowest common denominator, which I doubt anyone wants.

      The debate is about manufacturers documenting their different RAW formats so others can write software to access them.

      I doubt the idea of Digital Negative will work, as it cannot encompass enhancements in the CCD's that are sure to come.

    7. Re:What horseshit by mukund · · Score: 1

      I know EXIF is a meta-data spec. I mentioned it as an image *related* file format. Btw, EXIF is not all metadata. It can embed a thumbnail which is JPEG-encoded raster image data.

      --
      Banu
    8. Re:What horseshit by loraksus · · Score: 1

      That assumes Adobe won't want a small 3% or so licensing fee for using it.

      I personally think we should be using a format that is braindead simple on the camera end. Forget having the camera decide that one pixel has this brightness or color, but do it yourself, on a computer - not in the camera.

      Each pixel (well, actually, we would want to use sub-pixels instead of viewing 3 sub-pixels (each with a different primary color) as a single pixel) would report that it received so much light while the picture was being taken. This "report" would simply be the number of electrons that have been created from light by the cmos sensor. Now (deep breath) I realize that counting electrons one by one is a bit of an iffy process (seeing that before march of this year we weren't able to actually count electrons one by one until some Swedes figured it out) however something a little more coarse can be used.

      Since the amount of time is constant across all pixels - and we know what "color" each sub-pixel is (via a map of the CCD / CMOS (actually, it would have to be CMOS I think) sensor on the computer), we can construct an image at virtually all exposure levels (yes, there would be an upper limit in most cases, nag nag), and selectively pick the exposure in sections of the image.

      Taking a picture inside a house facing a window? Who cares? Select the window area and specify to divide the values of that section by 2, or 4, or whatever is needed to change the exposure of the window to match the levels of the inside of the house.
      You don't really lose any data during this process - as in the vast majority of pictures, the image won't change much over the 1/250th of a second it takes to take it.

      It shouldn't matter which sub pixels you dispose of (because for most things,
      that only every second or third sub pixel (or 30th) is counted. All of a sudden, your "overexposed" section of the image is in balance with the rest of your photo.

      It would give people a lot more flexibility in selecting fstops, etc, because creating what amounts to a digital (virtual?) shutter that can be selectively applied to different parts of the image. This would also be the end of stuck pixels, as a little bit of logic could be used to filter out oddities such as one pixel reporting 7000 times more light than the average pixel. You could also do some neat things with the analysis of several photos to filter out noise, etc.

      Yeah, it will be a really big file size, but really, size doesn't really matter anymore if you're doing pro photography (oh no, not a 100mb image!)
      To work it out an 8mp camera = 24 mil subpixels, each reporting a 16 byte number (which is probably overkill by a wee bit if you consider the whole "number of particles in the universe" thing ;) the file doesn't turn out to be all that big (320mb or so)
      More of an extension of a bunch of stuff that is around today, not really anything groundbreakingly new...

      --
      1q2w3e4r5t6y7u8i9o0pqawsedrftgthyjukilo;p'azsxdcfv gbhnjmk,l.;/
    9. Re:What horseshit by Hast · · Score: 1

      It really depends on how the added data is stored there. If it is stored in a fasion which makes it possible for others to figure out what it means then that's one thing. If they put encrypted data there then that is another thing.

      There is also a risk that the camera manufacturers just dump all meta data into a "private" area for no real good reason. Apparently meta data is often obfuscated in RAW files, this includes things like white balance and such things. Hardly something that is very specific to the camera but they do it because they can or just because they can't be bothered to do it right.

      So the danger with DNG is that we move to a format where all the RAW files from cameras have to format .DNG but besides that not much changes from the current situation.

      Personally I think the most important thing is to make professional photographers aware of the situation. There was an article about the OpenRAW project on Luminous-Landscapes but it didn't cause much stir in the cummunities I look. (Eg fredmiranda.com which has a lot of good amateurs and pros.)

    10. Re:What horseshit by mukund · · Score: 1

      I completely agree with that. Photographers need to become more aware that their raw photographs are proprietary and there may come a time when they won't work with new software which drops support for old formats, and nothing else can help them as the format is closed.

      --
      Banu
  11. So does basically every camera by Jonathan · · Score: 4, Informative

    The point isn't that you can get a jpg out of your camera -- I haven't seen a digital camera that can't -- the problem is that the original, uncompressed data generally isn't in an open format.

    1. Re:So does basically every camera by Anonymous Coward · · Score: 0

      Actually, Sigma cameras only shoot RAW

  12. Please tell me this, this is critical.. by johansalk · · Score: 2, Interesting


    From Canon, as they refused to cooperate with openRAW and ended their letter with a slap in the face: "If our equipment or software does not meet your needs, you are entirely welcome to seek other suppliers".

    And this is *exactly* what I'll do from now on and for the foreseeble future; I will *not* entrust the future accessiblity of my visual data to such a company and its formats, and I will not render myself under their mercy given their manifest chauvinism. Does anyone know what suppliers are cooperating with openRAW? Those will get *all* my business.

    Thanks

    1. Re:Please tell me this, this is critical.. by CrackedButter · · Score: 1

      I don't know about openRAW but I use cameras which work with Adobes new open Digital Negative standard. Check out its FAQ sheet for cameras which support it. That fact that it is an open standard should be good enough.

    2. Re:Please tell me this, this is critical.. by Anonymous Coward · · Score: 0

      If our equipment or software does not meet your needs, you are entirely welcome to seek other suppliers.

      That's amazingly snarky for a company letter. Oh well, done and done, then.

    3. Re:Please tell me this, this is critical.. by Hast · · Score: 1

      It's open but parts of it are still closed. I made a comment about that in a differerent post.

    4. Re:Please tell me this, this is critical.. by Overzeetop · · Score: 1

      This is the result of having a good porduct and one which has a commanding brand name. Nikon does too, as does Apple.

      Basically, there point is that they feel they have a good product, and if you're not willing to trust them, go find somebody else to do business with. You $10,000 isn't really worth it to them to (potentially) provide proprietary data to their competitors.

      --
      Is it just my observation, or are there way too many stupid people in the world?
    5. Re:Please tell me this, this is critical.. by mei_mei_mei · · Score: 1

      Where can I get that FAQ? I've looked on Adobes site and all I can find is a list of camera's that CS2 can access Raw data from (including my 10D). I don't see the big deal about all this. How many people even use RAW mode, as opposed to JPEGS? And you get software with the camera (or can use photoshop) to get at the data, and it's not going to wear out is it?

    6. Re:Please tell me this, this is critical.. by Ubergrendle · · Score: 3, Interesting

      From Canon, as they refused to cooperate with openRAW and ended their letter with a slap in the face: "If our equipment or software does not meet your needs, you are entirely welcome to seek other suppliers".

      This is true, and unfortunately Canon can afford to take this position. In the DSLR market -- the *serious* digital photography market -- Canon has through various reports a 50-70% market share. Their only serious competitor is Nikon who controls anywhere from 30-50% depending upon who you listen to, and the rest make up a very small percentage. Kodak just announced a complete retirement from the DSLR market, Sigma cameras are doing horribly, and although Pentax and Minolta have decent offerings their market penetration is relatively weak. Canon can throw around threats since Nikon is WORSE in their disregard for RAW, actively encrypting (weakly) the white balance data. Nikon knows the encryption is a joke, but its enough to have legal teeth via the DCMA and thus Adobe won't translate it.

      Personally I'm more concerned with the retirement of RAW formats than the current vendor specificity. When you by a Canon EOS system or a Nikon F-mount you're buying into a closed, proprietary hardware system. Extending it to the software realm is crappy, but not surprising. Microsoft is best positioned to bust this wide open, and its in Adobe's best interests to open RAW or see the success of DNG. My guess is once the balance of power starts shifting heavily in favour of Canon or Nikon (towards virtual monopoly) the lesser company will open up their RAW format to be more accomodating.

      --
      John Maynard Keynes: "When the facts change, I change my mind. What do you do?"
    7. Re:Please tell me this, this is critical.. by Valar · · Score: 1

      This is a hold over from the normal DSLR market. Arguably, Pentax and Minolta have better lines, feature wise, but people who have tons of canon or nikkor lenses aren't really going to care. Luckily, I recently got into photography, stuck my fingers in my ears and sung 'lalalala' over the nikon vs. canon debate and went straight to a k1000.

    8. Re:Please tell me this, this is critical.. by Sch0pehauer · · Score: 1

      And this is *exactly* what I'll do from now on and for the foreseeble future; I will *not* entrust the future accessiblity of my visual data to such a company and its formats, and I will not render myself under their mercy given their manifest chauvinism. Does anyone know what suppliers are cooperating with openRAW? Those will get *all* my business.

      You can not just change the supplier, because everyone does the same thing and after a while you'll be obliged to return to Canon and ask them for pardon. That's why they don't care about saying you such things.

      A more effective way to push them into opening their RAW formats or adopting an open one is to take part to the Act Now! initiative.

      Personally I already mailed Canon representatives in the country where I live (BTW you can cut&copy my letter in French from my blog) to urge them into changing their format policy. Obviously it will not be enough, unless all major producers in all countries will be bombed with similar requests from their customers.

  13. Need for a broader approach? by archeopterix · · Score: 5, Insightful
    Hm... Everytime I read something similar to the article (that is about twice a week), I think that there should be a non-profit organisation to oppose taking away customer rights under the guise of "intellectual property".

    Something powerful enough to organise boycott that would cause *pain* to the offending company. Something that a congresscritter would be afraid to piss off. EFF comes close, except that it a) has a broader scope and b) sadly is not powerful enough.

    Too bad that the existing consumer organisations are focused on making money from their "consumer reports" and the general population doesn't care (the frog is half-boiled and still comfortable).

    1. Re:Need for a broader approach? by MartinG · · Score: 1

      EFF comes close, except that it a) has a broader scope and b) sadly is not powerful enough.

      They would become powerful enough if they received more donations.

      If you agree, show it not by replying and saying so, nor by modding me up, but by DONATING TODAY!

      --
      -- MartinG To mail me: echo kewyjlcxyzvjfxbqwh | tr bcefhjklqvwxyz .@adgimnoprstu
    2. Re:Need for a broader approach? by dnnrly · · Score: 1
      You could expand on this and say that each RAW format specification should be left in escrow. One of the conditions for public release could be that the format is no longer supported by any devices currently in mass production. Obviously this would work best for formats that are used in mass produced devices in the first place.
      Other conditions could be:
      • The company that owns the IP goes out of business.
      • The company decides to donate it to the community.
      • The format is succesfully reverse engineered.


      You could argue about this list until the cows come home but the point is to take some of the responsability away from those that have no interest in preserving the information.
    3. Re:Need for a broader approach? by Anonymous Coward · · Score: 0

      >Something powerful enough to organise boycott that would cause *pain* to the offending company.

      Oh... you say /.ing isn't enough?

    4. Re:Need for a broader approach? by fishbowl · · Score: 1


      "They would become powerful enough if they received more donations."

      Or would they merely become wasteful and/or corrupt?

      --
      -fb Everything not expressly forbidden is now mandatory.
  14. Gaaah! by Anonymous Coward · · Score: 0

    think different


    Damn it Jim! It's "think differently".

    Just one of those little annoyances like "To boldly go" and "Anytime. Any place. Anywhere." :)

    1. Re:Gaaah! by PsiPsiStar · · Score: 1

      What do you say to people when the advise you to think big?

      --

      ___
      It's the end of my comment as I know it and I feel fine.
  15. going canon fanboy in here but by william_w_bush · · Score: 2, Informative

    so far my experience with canon gear has only been positive. firstly, they released linux and osx drivers for an old inkjet i had, along with most of their current line, and a good number of their scanners. second, their cameras are amazing, and use normal sd and cf cards instead of the MS and XD that are becoming infuriatingly ubiquitous. Also, their printer lines tend to standardize on the same types of ink, with better quality than the hp's and terrible machines epson is putting out nowadays (my r300 photo printer ran low on lt yellow ink, so it won't print black and white and keeps nagging me in windows to order more ink).

    i suspect this is just canon usa marketing dicks playing bs politics for their own sake. so far theyve given out a lot better specs for most of their printers than most companies, and few printer mfg's will even bother to put out cups drivers for their lines.

    not releasing their RAW format seems amazingly petty, but sounds exactly like all those fat, middle-aged sales execs who thought it wasn't worth it developing open-sourced linux drivers, cause they could get more commision charging each customer for the drivers themselves. we released them anyway, but a lot of those types make VP and do stupid shit like this to try to throw their cock around.

    --
    The first rule of USENET is you do not talk about USENET.
    1. Re:going canon fanboy in here but by vidarh · · Score: 1

      One of the comments to the post about Canon specifically points out that they only released the printer specs after being put under pressure, though. It's not as if they were overly enthusiastic about it.

    2. Re:going canon fanboy in here but by william_w_bush · · Score: 1

      yes, and i'm sure the gimp-print people must be swearing up and down about canon's reluctance as they work hard to crank out epson and hp profiles.

      --
      The first rule of USENET is you do not talk about USENET.
    3. Re:going canon fanboy in here but by bhima · · Score: 1

      As a Apple user Canon has nearly convinced me to sell all of my canon stuff and go to Nikon, just because of the lack of a real SDK for there cameras. Then I tried to sign of for Nikon's SDK to compare them and found that they are have a contest of who can be the biggest asshole. Both companies ship a camera control program for Mac & Windows that I would say is like a demo in terms of quality and usefulness. So you know it's possible to control the camera from the USB port... but just try and get it done! There is only one way and it envolves using the current version of visual studio.

      --
      Nothing in the world is more dangerous than sincere ignorance and conscientious stupidity.
    4. Re:going canon fanboy in here but by Spoing · · Score: 1
      yes, and i'm sure the gimp-print people must be swearing up and down about canon's reluctance as they work hard to crank out epson and hp profiles.

      I'll take that as sarcasm. If not...please ignore the following comments.

      Both Epson and HP have provided drivers for printing under Unix-like systems. HP, specifically, has gone out of thier way to be helpful and contribute what they have to CUPS. The Gimp-print folks could use that at a minimum while contacting HP's reps for the CUPS drivers for more details if they want it.

      --
      A firewall can not protect you from yourself. Turn off what you do not need. Do not use the firewall to do your work.
  16. its not so much digital thats the issue... by petermgreen · · Score: 2, Insightful

    they could just use an unecumbered format like png

    BUT the advantage or "raw" is its the closest you can get to what actually came out of the cameras CCD. because of the way CCDs work this will be about a third the size of the resulting image (assuming they are uncompressed or compressed using a lossless algorithm that gets roughtly the same compression on both).

    --
    note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    1. Re:its not so much digital thats the issue... by mikael · · Score: 1

      The issue with the camera makers isn't the file format being used - it's the fact that the raw data would give their competitors an insight into how they postprocess the raw CCD/CMOS sensor data into a balanced color image acceptable for photography.

      Each CCD colour channel has it's own frequency response curve, which is more complex than a simple cubic or exponential curve. A considerable amount of calibration has to go into developing these equations for all light conditions.

      If a new competitor were able to have access to both the raw and processed image data, they would be able to deduce the conversion process.
      The raw data format may also include other factors like average light intensity, shutter speed, target distance, which are all taken into account.

      Any electronics company can make a camera case, license a lens system, flashbulb and memory card holder. It's the capabilities of the CCD that really justify the high price of a professional camera.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    2. Re:its not so much digital thats the issue... by bit01 · · Score: 1

      The usual "you must protect your 'valuable' intellectual property" canard that lawyers and others like to push to drum up their parasitic business, completely ignoring the fact that openness oftens make better business sense.

      In this case any company capable of competing in the market can trivially sniff the raw data coming off their competitor's chip with controlled lighting, a digital storage CRO and a little common sense.

      To claim that hiding the the storage format is anything more than anti-competitive market manipulation is itself manipulative.

      ---

      I'm not worried about the use of DRM. I'm worried about the abuse.

  17. Just keep... by troon · · Score: 2, Informative

    ...a copy of the dcraw source code.

    --
    Ydco co ,df C erb-y go. a Ekrpat t.fxrapev
    1. Re:Just keep... by RDW · · Score: 2, Informative

      The various manufacturer-specific Perl modules in the ExifTool package are also an excellent source of documentation for RAW file metadata. Reading this (rather well-commented) code can help make the more cryptic dcraw source much more comprehensible.

  18. Exactly - RAW is not an acronym by Anonymous Coward · · Score: 0

    It litterally means raw (as in uncooked or otherwise unprocessed).

    Like people refer to Apple Macs as MACS. It's just plain wrong and irritating.

  19. storing raw digital images is stupid by cahiha · · Score: 1

    We have nice lossy and lossless image compression formats. There is NO reason ever to bother with raw camera images for archival storage.

    Raw image may theoretically contain a tiny bit more information under some circumstances. But you have a cost/benefit tradeoff: store and manage terabytes of raw images indefinitely vs. just achieving the same quality by using higher quality imagers together with standard image formats. Both store the same amount of information in the long run, but the latter is the better economic tradeoff.

    1. Re:storing raw digital images is stupid by jgordon7 · · Score: 3, Insightful

      Most raw formats on modern cameras is compressed using a lossless format. Take Nikons nef format, a 6.1mp image in raw is only about 4-5 MB, if this was not compressed it would be closer to 10 MB.

      You can not tweak certain settings as easily once the image is convert to another format, even a lossless one like tiff. Best example is white balance.

    2. Re:storing raw digital images is stupid by dfghjk · · Score: 1

      Actually, NEF is a bad example because some versions (D100) implement lossy compression.

      White balance is just as easily adjusted in TIFF as it is in a RAW format as is most everything else. It's simply a matter of what tools are available. The only thing you lose is the opportunity to do the demosiac over again.

    3. Re:storing raw digital images is stupid by Anonymous Coward · · Score: 0

      You must be using the new math or something. An uncompressed 6mp imagine is going to use approximately 18MB for a raw image. That's not accounting for any extra data that particular raw format includes like white balance data.

    4. Re:storing raw digital images is stupid by fishbowl · · Score: 1


      "We have nice lossy and lossless image compression formats. There is NO reason ever to bother with raw camera images for archival storage."

      There is a reason, however, to want to perform the conversion, and that won't be easy to do with an inscrutable file format. TIFF and Lossless JPEG is fine, but getting there in the first place may be a problem. The white balance and colorspace stuff are not as esoteric as they are made out to be by people who don't use them. The WB controls on my Canon are indispensible now that I've started using them. I do realize there's a lot that can be done after the fact, but there's nothing quite as satisfying as getting an image perfect, straight from the camera.

      --
      -fb Everything not expressly forbidden is now mandatory.
    5. Re:storing raw digital images is stupid by Anonymous Coward · · Score: 0

      Atually it's the D70 that started with the lossy compression. The D100 does not do any lossy compression of the raw data.

    6. Re:storing raw digital images is stupid by Anonymous Coward · · Score: 0
      White balance is just as easily adjusted in TIFF as it is in a RAW format as is most everything else.
      Except for the rounding in the least-significant bits. That data is gone forever. So is the black level data.
    7. Re:storing raw digital images is stupid by Anonymous Coward · · Score: 0

      No. There are 6 million sensors on the CCD, some have a red filter, some a blue filter, and about half of them have a green filter, so there are going to be 6 million intensity values to store. They are probably using 12 bit for each value, so 10MB is a good estimate for the size of an uncompressed raw image. Not interpolating the "missing" RGB values does allow one to try to do a better job at this step than the camera would have done.

  20. Re:Can anyone say... by Anonymous Coward · · Score: 0

    No, really? You don't say?! My god, if you had never explained the joke, no one would have got it! Thank God you were around, Mr. Joke Guy!

    P.S: Just to save you the trouble, this post contains high amounts of sarcasm! No need to post again to point it out to everyone else.

  21. LOUD NOISES! by Vila,+Bob · · Score: 1

    It's funny how we always capitalize 'RAW' even though it's not an acronym. Despite knowing this, I myself can't stop from typing RAW when referring to it either.

    --
    Yes, *that* Bob Vila.
    1. Re:LOUD NOISES! by The+Cisco+Kid · · Score: 0

      Its also funny how /, often includes some sort of explanation of terms that most people know, but on this term, that I've never even heard of, they seem to have forgotten.

      WTF is 'RAW' ? I know what raw meat is. I know what a 'raw deal' might be. But neither of those seem likely in the context of this story.

  22. Storing RAW images is the SMART thing to do. by Anonymous Coward · · Score: 0

    By converting, for example, to JPEG and throwing the RAW away you are losing lots of creative post-processing control.

    Later you may want to re-process the picture with superior software (it does get better over time). Or perhaps you just needed to tweak the white balance. Or fiddle with the sharpening. Or the tone curve. That's why it's important to archive the RAW file.

  23. I don't get it by Anonymous Coward · · Score: 0

    Why not just convert the RAW files to an open format?

  24. Re:Can anyone say... by aussie_a · · Score: 1

    I hear Alpha Centauri is pretty safe. It use to be Mars was safe (and it's conveniently closeby), but unfortunately America has set it's eyes on it, so it won't be safe for much longer. I wouldn't bother with it.

  25. And in this corner... by Joe+Jarvis · · Score: 0

    Austin 3:16 says Internet Archive just kicked your ass!

  26. you need to know what you are doing by cahiha · · Score: 2, Informative

    By converting, for example, to JPEG and throwing the RAW away you are losing lots of creative post-processing control.

    Indeed, you are. That's because JPEG doesn't have the depth and gamut to represent digital images captured by modern cameras. If you use a more modern cooked, open format (e.g., TIFF, JPEG2000) at the right depth and at a lossless or high quality setting, then you lose nothing.

    Later you may want to re-process the picture with superior software (it does get better over time).

    And you can do that because the interpolation from raw to RGB is invertible given a tiny bit of metadata (metadata you would need to carry around with the raw image as well). If you are dealing with a four channel sensor, you can still store the data in a four channel TIFF. No need to store RAW.

    Or perhaps you just needed to tweak the white balance.

    You can do that in RGB.

    Or fiddle with the sharpening.

    For professional archival applications, you should turn off in-camera sharpening. That has nothing to do with whether you use raw storage.

    Or the tone curve.

    You can do that on the cooked image just as easily as on the raw.

    I think the whole confusion arises because people like you equate non-raw storage with JPEG. JPEG is a bad choice for high-quality archival storage, but formats like TIFF and JPEG2000 are fine.

  27. that's just stupid by cahiha · · Score: 1

    The need to archive large quantities of high-quality images captured with CCDs didn't arise only when photographers finally discovered digital--scientists have been doing this for decades.

    You do not need manufacturer-specific formats to do this. There are a bunch of formats you can use that store the data in a vendor-independent form and still let you recover the original data.

    The most important thing about such formats is that they need sufficient depth (16 bits per channel), they need a choice of lossless and high-quality lossy compression, and they need space for metadata to annotate them with the color space transformations and interpolation method that transformed the original image into the portable image.

    Even if none of the existing standard archival formats fit for these needs, it is far easier to define a new format than to try to keep track of zillions of proprietary raw formats.

  28. Canon and Nikon are quite good, actually. by ehack · · Score: 1

    Canon and Nikon have a Mac-like following in the photography field. Their buyers like them. In particular, support is incredibly good compared to computers.

    Edmund

    --
    This is not a signature.
  29. Camera Companies Really Don't Care... by Albigg · · Score: 1
    The number of consumers that shoot RAW is so low that it doesn't matter to them.

    Sure the pros use it, but they are already locked into a system so they just complain (or don't think long term).

    1. Re:Camera Companies Really Don't Care... by fishbowl · · Score: 1


      "The number of consumers that shoot RAW is so low that it doesn't matter to them."

      That's changing, with the increased popularity of cameras like the Canon EOS models, and also with the terriffic new ease of obtaining inexpensive, very high quality poster sized prints.

      There are a lot of people who were pretty serious about photography, took a hiatus, and are getting back into it now that it's easy. This is the first time in their lives that the sort of quality that was once the exclusive domain of medium- and large-format cameras, is accessible.

      And these people have no difficulty at all with the understanding that the RAW file is the digital equivalent of the film negative.

      --
      -fb Everything not expressly forbidden is now mandatory.
  30. i use JPEG... by Val314 · · Score: 1

    i know, lossy format, but its more then good enough for me and works in every software i've seen.
    (and my camera doesnt support RAW/Tiff or something else)

    Is the RAW format really that better (for someone who just want to make pictures)?
    If i'd do it professionally (and require the best quality), i'd use raw, but i dont see a reason why i should drop jpeg for raw.

    1. Re:i use JPEG... by OldeTimeGeek · · Score: 1
      For the vast majority of people taking pictures, JPEG is fine. The file size is relatively small, meaing that a lot of pictures can be stored on removable media, and the compression is pretty much unnoticeable.

      The problems come when you save the same image multiple times. Each time you save a JPEG image it's compressed a bit further, with a loss of more information. Eventually, you can be left with a fuzzy mess. It takes a couple of times for it to become noticeable, but it happens. For the vast majority of people this isn't a problem, but for photographers, it's huge.

      Also, the RAW format is a complete, uncompressed copy of what the CCD actually captured with none of the processing that a camera does when it creates a JPEG. All of the camera's settings are included as with the image as metadata rather than actually applied to the image, giving the photographer a chance to modify those settings when they process the image for reproduction.

  31. Summary of some key points: by Distan · · Score: 3, Informative

    What is this "RAW" format?

    RAW doesn't really refer to any single file format. RAW refers to pulling the unprocessed (raw) sensor data out of a digital camera. The actual layout of the bits varies from brand to brand, and often from model to model.

    Why do photographers want access to the raw data anyway?

    Many professional/prosumer photographers like to archive the version of their work that contains as much of the originally captured information as possible. In the professional film world, this meant processed slides (for consumers, this meant processed negatives). In the digital world, the RAW file contains all the data captured by the camera, before some data is lost by compression and other data is added through interpolation.

    Can't they just pull a lossless image out of the camera and be happy?

    No. The very act of converting the raw data into an image involves lossful processing of the data. Out of gamut color data is discarded, and CCD color data is interpolated to fill surrounding pixels.

    1. Re:Summary of some key points: by Anonymous Coward · · Score: 0
      What is this "RAW" format?

      RAW doesn't really refer to any single file format. RAW refers to pulling the unprocessed (raw) sensor data out of a digital camera. The actual layout of the bits varies from brand to brand, and often from model to model

      Slight nitpick: So-called RAW is not unprocessed data. The data from the analog sensor is processed by the A2D convertor before being written to the memory card in a digital format.

      Can't they just pull a lossless image out of the camera and be happy?

      No. The very act of converting the raw data into an image involves lossful processing of the data. Out of gamut color data is discarded, and CCD color data is interpolated to fill surrounding pixels.

      Agree here. Just look at the significant differences in the output of the various RAW converters: Adobe Camera RAW, Canon DPP, PhaseOne CaptureOne, Bibble, RawShooter Essentials, etc. There are differences easily visible.

  32. Erm... by RJabelman · · Score: 1

    Haven't you just described RAW? :)

  33. The difference is... by Anonymous Coward · · Score: 0

    That Juergen controlled the mailing list he took down. He doesn't control archive.org, so he can't affect this archive--that's kind of the whole point of hosting it there.

  34. In this context... by RJabelman · · Score: 1

    it's the data straight from the camera's sensor.

  35. There is no real alternative.. by shaanX · · Score: 2, Insightful

    when it comes to doing any sort of real editing JPG is *NOT* an option. I see people here that are obviously not photographers or have not used a digital slr camera saying just to use JPG. If you plan on doing little to no post processing sure use JPG but for true manipulation RAW is essential

  36. Ironic, isn't it? by magnus_1986 · · Score: 1

    "...Canon has been among the top 3 companies receiving US Patents for 13 consecutive years..."

    I just cannot believe that during this sensitive time concerning intellectual property and software patents, they are using THIS as a marketing statement.

    --
    My last sig was ridiculed
  37. Final resting place? by rice_burners_suck · · Score: 1
    OpenRAW plans to create a RAW repository, a final resting place for RAW file documentations of current and already abandoned digital cameras.

    A final resting place, eh? What is OpenRAW, a symlink to /dev/null?

    This article should probably say: A place for people to search for RAW file documentations, not a final resting place... Come on guys, be a bit more imaginative!

    RIP, RAW...

  38. Re:Digital != Sky Is Falling by PCM2 · · Score: 1
    That's why all those RAW file formats for each camera are different from company to company. They gain the most benefit by locking you into a certain piece of software and forcing you along their upgrade path.
    So shoot in JPEG. Seriously, I don't get the complaint here. If JPEG isn't good enough for you and RAW comes with some restrictions you find unpalatable and that prevent you from doing good work as a photographer, then it sounds like digital cameras aren't for you. Am I wrong? Why does everything have to be a draconian conspiracy theory? The camera companies want to close their RAW formats because they feel this is the best way to ensure themselves profits. If you can convince them that it would be more profitable in the long run to sell a camera with an open RAW file format, they'll do so. Obviously the demand isn't really there, except on forums like /. (And the caveat is, they'd open the file format but find another way to make a buck off you, because that's what companies do. Remember when you actually had to buy film and have it developed?)
    --
    Breakfast served all day!
  39. ok by Cryptnotic · · Score: 1

    The high end Minoltas are nice, but Minolta didn't even have a digital SLR until this year (is it even available yet?). I bought my first Canon digital SLR like 3 years ago and it was already a 3rd generation dSLR. A few years ago, for digital SLR's the choices were Nikon or Canon. That was it. Now, there's Pentax, Olympus, Minolta, Sigma, Kodak, and other stuff like the digital rangefinder by Epson (an interesting device, but not really mainstream).

    --
    My other first post is car post.
  40. What about DNG? by Untrusted · · Score: 1

    Adobe's DNG (Digital Negative) format seems to be to be a much better deal than OpenRaw. "Ah!", you think, "DNG is still the Man smacking us down".

    Not true. Adobe's published the spec and will let anybody use it for free. My money's on Adobe swaying the camera companies to support DNG. Free for you, free for me, free for everybody and support from a company that seems to get it.

    Here's more info on DNG: http://www.adobe.com/products/dng/main.html

  41. 10D? by tkrotchko · · Score: 1

    "I personally use a Canon 10D"

    What do you think of the 20D? It looks appealing. The new Rebel XT is tempting as well.

    --
    You were mistaken. Which is odd, since memory shouldn't be a problem for you
    1. Re:10D? by phidipides · · Score: 1

      What do you think of the 20D?

      I'd definitely like to own one -- more pixels, less image noise, turns on/wakes up faster, etc., etc. Of course, if money were no option I'd get the 1Ds Mark II and be shooting 16.6 million pixels. If money were no option.

      Still, the 10D and its 6.3 million pixels produces shots that are good enough for magazine publication, and I like it way more than the film cameras I've owned. In another ten years we'll probably all be shooting with cameras that capture 50 million pixels and the 10D will seem like a dinosaur, but for the moment it's helped me to shoot some of the best photos I've ever taken.