Slashdot Mirror


Digital Domesday Defies Doom

Hulver writes "The BBC Domesday project, originally completed in 1986 and under threat (as reported in this old slashdot story) has had its data recovered. The contents of the laserdiscs have been put on DVD, and new programs written so that PCs can access the data. Interestingly, most of the images and films were not recovered from the laserdiscs, but were instead re-digitised from the original analog films at a higher resolution than the laserdiscs contained. Full details of the recovered data are at the Public Record Office website."

39 of 176 comments (clear)

  1. Here come the "they mispelled Doomsday" posts! by Anonymous Coward · · Score: 5, Funny

    Let's see how quickly it happens.

    1. Re:Here come the "they mispelled Doomsday" posts! by inaeldi · · Score: 2, Informative

      But the book is a proper noun, so regardless of whether it's old english or not, that's still how it's spelled.

    2. Re:Here come the "they mispelled Doomsday" posts! by dirkx · · Score: 2, Interesting
      You may want to consult: http://www.domesdaybook.co.uk/ for the authoritative spelling. Which is indeed 'DomesDay'. For those who did not have history at school:
      The King wanted to know what he had, and who held it. The Commissioners therefore listed lands in dispute, for Domesday Book was not only a tax-assessment. To The Kings grandson, Bishop Henry of Winchester, its purpose was that every "man should know his right and not usurp another's"; and because it was the final authoritative register of rightful possession "the natives called it Domesday Book, by analogy from the Day of Judgement"; that was why it was carefully arranged by Counties, and by landowners within Counties, "numbered consecutively ... for easy reference".

      Also note that in england at that time domesday was a regular, repeating, day on when judicial decisions were announced which essentially could not be appealed. Just like the book could not. So one can argue of the christian judgement referenece is all that accurate and if it was not the other way round; the christian references was named after the every day scheduled judgement day in normal life.

      Perhaps.

      Dw

  2. Something else this reminds me of by Raul654 · · Score: 4, Interesting

    This article reminds me of something else I read - that the DOE is currently paying good money for people to help design a warning for Yucca Mountain (the giant nuclear storage facility out in Nevada). That one has to last as much as 100,000 years, albeight it has to store a lot less information (stay the F*** out). I wonder what kind of overlap there would be between the two?

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
    1. Re:Something else this reminds me of by Raul654 · · Score: 3, Informative

      Sorry about the reply to my own post, but the article refers to Francis Bacon's shrieking pope paintings. Here's a link.

      --


      To make laws that man cannot, and will not obey, serves to bring all law into contempt.
      --E.C. Stanton
    2. Re:Something else this reminds me of by cpt+kangarooski · · Score: 2, Insightful

      I'm kind of inclined to think that it's not possible. Instead we might be better off just concealing the site.

      I say this because I can't help but think of how many tombs have been robbed regardless of warnings to keep out. In fact, we usually think of it as stupid superstition and proceed headlong.

      That would be bad at Yucca of course, because for once the curse -- that people will get sick and die due to invisible forces -- is true.

      --
      -- This and all my posts are in the public domain. I am a lawyer. I am not your lawyer, and this is not legal advice.
    3. Re:Something else this reminds me of by Anonymous Coward · · Score: 2, Interesting

      Here's the funny thing though..

      Unless we go through World War III and end up as scattered tribes of man, this warning is useless.

      It's much more likely that we'll continue to progress, socially and technologically. In that case, the warning is moot - even if the United States falls, Yucca is common knowledge right now. It's doubtful everyone who's heard if it would be eliminated. It's also doubtful that all English speakers of the world will be eliminated. As such, a big giant, "STAY THE FUCK OUT! RADIOACTIVE BADNESS INSIDE!" sign would work fine.

      If, by some chance of Fate, the world is decimated, and we end up with scattered tribes who can't figure out English.. Then, no offense - who the hell cares? I'd say there's a bit more to worry about than Random Tribe X being wiped out due to their stupidity and penchant for glowing green rods.

      All in all, this is nothing more than politics ("Hey, Eco-nuts! We're being responsible!") and a waste of taxpayer's money. (See the above.)

    4. Re:Something else this reminds me of by burns210 · · Score: 4, Interesting

      " This article reminds me of something else I read - that the DOE is currently paying good money for people to help design a warning for Yucca Mountain (the giant nuclear storage facility out in Nevada). That one has to last as much as 100,000 years, albeight it has to store a lot less information (stay the F*** out)."

      The cool thing about that project is, they can't say "stay the f*** out" because in 100,000 years people won't be speaking english, or if they somehow did, it would have evolved so much that the warning wouldn't mean anything... This project has to use nonverbal, non-language based warnings, something that would scare you away....

      i am actually reminded of Planet of the Apes, with all the scarecrow looking guys were hangin to warn apes away from the forbidden land....

    5. Re:Something else this reminds me of by garyok · · Score: 4, Funny

      The best idea I heard of was to make the site inaccessible by covering it in a huge slab of black concrete. The concrete soaks up all the heat, becomes a big storage heater storing more and more heat over time and anybody that gets too close gets cooked.

      Of course, you'd hope that in the future people would be bright enough stay away from the place where the trees have tentacles and the squirrels shoot laser beams out their eyes.

      --
      One of the penalties for refusing to participate in politics is that you end up being governed by your inferiors - Plato
    6. Re:Something else this reminds me of by b-baggins · · Score: 2, Funny

      This has GOT to be a joke. You're asking this question using a computer connected to the internet? This can't be a serious question...

      --
      You can tell a great deal about the character of a man by observing those who hate him.
  3. Re:[ed. note: no it isn't] by usotsuki · · Score: 3, Informative

    Read your history and learn about the Domesday [sic] Book. It's not a mistake.

    YFI

    -uso.

    --
    Dreams, dreams, don't doubt dreams, dreaming children's dreaming dreams. Sailor Moon SS
  4. storage space by Graspee_Leemoor · · Score: 4, Insightful

    "Interestingly, most of the images and films were not recovered from the laserdiscs, but were instead re-digitised from the original analog films at a higher resolution than the laserdiscs contained. "

    This is why I have all my CDs stored as .flac, so I can be laughing in the distant future when everyone has crappy mp3s just because they wanted to save some space decades ago when 700 meg was a lot.

    graspee

  5. Your forget one thing though by Raul654 · · Score: 5, Informative

    Language drifts and changes. Pick up a copy Beowulf, circle AD 800. Chances are you won't understand a whole lot, it's written in old english. What with the great vowel shift, the meanings of most of those words have significantly changed. Now, instead of 1200 years, imagine what 100,000 years of language evolution would do to such a warning. That's why ANY warning they choose will probably be pictoral, not script.

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
    1. Re:Your forget one thing though by Raul654 · · Score: 4, Interesting

      Sorry for another reply to my own post, but here's a great resource for seeing how the language has changed over time. It has .wav readings of beowulf. The reason I keep citing beowulf (no, I don't have some computer-cluster fetish) is that it is basically the only surviving example of old-english, or so I was taught. If you listen to it, you can really see how in just 1200 years, the language has totally changed.

      --


      To make laws that man cannot, and will not obey, serves to bring all law into contempt.
      --E.C. Stanton
    2. Re:Your forget one thing though by IvyMike · · Score: 5, Insightful

      I wonder if widespread printing, audio, and video recording technology might have a long-term stabilizing effect on language.

    3. Re:Your forget one thing though by happystink · · Score: 4, Funny

      U think so? me 2. tru! LOL!

      --

      sig:
      See the "..for smart people" banners Wired runs here? Look elsewhere guys.

    4. Re:Your forget one thing though by WowTIP · · Score: 2, Insightful

      I'm not sure pictorial warnings would be any better. The guys in 102003 A.D. will probably think the gruesome images are irrational warnings of holy ground by the superstitious lowtech people of the 21 century. It's not like 20:th century people heeded warnings in pyramids and such before desacrating them.

      --

      --

      "I'm surfin the dead zone
      In the twilight, unknown"
  6. Land mines. Small ones. by vkg · · Score: 2, Insightful

    Seriously. I really think that a couple of hundred thousand mechanically activated (or perhaps solar so they come awake when they're dug up?) landmines are the answer.

    Yes, there'll be a few casualties, but by god what ever our pig ignorant descendents make of the situation, they'll be wary investigators. Death is a pretty fucking good keep out sign, and probably a lot less loss of life will result than if they carve their way inside and start wearing uranium as jewelery from the ancient gods...

  7. Uh? by The+Bungi · · Score: 5, Funny
    from the obsoletion-defeation dept.

    michael, you font of knowledge you. I wondered what the hell 'defeation' was so I Googled it. I must say I understand what Google is suggesting.

    1. Re:Uh? by bj8rn · · Score: 2, Funny

      This is language evolving right under your nose, and you make fun of it!?! It was people like you who killed Latin! Michael is a language pioneer!

      --
      Hell is not other people; it is yourself. - Ludwig Wittgenstein
  8. Quality by hackwrench · · Score: 4, Insightful

    ...re-digitised from the original analog films at a higher resolution than the laserdiscs contained.

    That's great as long as the film hasn't degraded to worse than the quality of the laserdisc images and the resolution is there to begin with.

    1. Re:Quality by gfody · · Score: 4, Informative

      from your statement it seems you think that just because data is not digital, it will degrade.

      it is actually the medium that degrades, data corruption is a side-effect. film is vulnerable to heat and light and laserdisc is vulnerable to scratching. the format of the data is irelevent.

      you should also realize that just the act of digitizing data is degrading it. the digital version will always be a subset of the analog version. really the only upside to digital is the ability to make exact copies.

      the only thing you can do is preserve the original in analog format the best you can, digitizing it once in a while whenever better digitizing technology is available.

      --

      bite my glorious golden ass.
    2. Re:Quality by shepd · · Score: 2, Informative

      >whereas IIRC the resolution of laserdisc is only somewhat better than VHS and not as good as DVD.

      Laserdisc stores infinite horizontal resolution, and carries a full NTSC (or PAL, or whatever you like) signal, which, if done properly, ensures most of the 525 (or 625) lines of resolution are on a disc without laser rot. According the the FAQ it's actually 420 lines, but since they are 100% wrong on the resolution of DVD (500 lines is NOT a standard NTSC DVD resolution and won't play back on a great number of players, PAL or NTSC, *ONLY* 480 is compatible, *NO* other vertical resolution is supposed to be playable), and they can't make up their minds about LD resolution (it also suggests 482 lines), I doubt it's validity on these measurements.

      Knowing now that laserdisc and DVD vertical resolutions are virtually identical, and knowing that laserdisc stores more horizontal information, we seem to see that laserdisc is superior. However, being an analog composite signal, it has the usual drawbacks, such as poor chroma separation, noise, and quality -- the effect of all depends highly on your equipment (modern comb filters are nearing perfection) and disc quality (laser rot, scratches, etc).

      But, balanced with the obvious MPEG artifacts found in crappily encoded DVDs, it can be a tossup. I'd probably take the DVD anyways, because there's a lot more tangible features it has over LD (portability and ubiquity being two big ones).

      --
      If you could be told what you can see or read, then it follows that you could be told what to say or think - BoC
    3. Re:Quality by shepd · · Score: 2, Informative

      >It is analogue. That does not make it infinite.

      Yes, it does make it infinite. In fact, that is the very DEFINITION of analog.

      analog: <electronics> (US: "analog") A description of a continuously
      variable signal or a circuit or device designed to handle such
      signals. The opposite is "discrete" or "digital".


      Continuously variable, of course, means infinite.

      If it were finite (like digital) you would be able to discern points if the image were blown up large enough. As you increase the size of a laserdisc image, you can clearly see each scanline, but you will not be able to discern any horizonal points if the source were analog, ever. It will simply become a smear, so there is simply no point giving LD a horizontal resolution -- doing so is a complete insult to the very idea of an analog signal. It would be like suggesting your skin has a "resolution" by counting the pores. It doesn't work.

      The fact is that with an analog signal, with better technology the signal can be improved to any point you like by improving the signal to noise ratio.

      In contrast, the definition of digital:

      <data> A description of data which is stored or transmitted
      as a sequence of discrete symbols from a finite set, most
      commonly this means binary data represented using electronic
      or electromagnetic signals.


      Which clearly specifies that digital is finite.

      A sufficiently advanced analog device will always be better than a digital one, but far harder to design, and normally more expensive to record, so digital is preferred for its simplicity.

      (Both definitions courtesy of The Free On-line Dictionary of Computing, © 1993-2003 Denis Howe)

      >According to:
      http://www.cs.tut.fi/~leopold/Ld/ResolutionCompari son/
      laserdiscs are 560x360 which is worse than DVD's.

      Actually, that's the letterbox resolution, which it specifies has the same amount of scanlines (vertical resolution) as DVDs. As I (and every EE in the world would also do so) have exlpained, because LD is analog, there is positively no point giving it a horizontal resolution. So, in fact, the quality of the picture, on a well designed, new (which they don't make, sadly) player can range from worse than DVD to better than DVD -- it's impossible to tell.

      Now, when DVD gets more scanlines than NTSC video, we can reconsider this. But until then, the formats are relatively equivalent, and on my ancient LD player, (an old Pioneer industrial model) the output, apart from the usual analog signal problems (sparklies, etc) introduced by the aged crappyness of this player, is the same as DVD for quality.

      --
      If you could be told what you can see or read, then it follows that you could be told what to say or think - BoC
  9. But where is it...? by mccalli · · Score: 4, Interesting
    I submitted the original Domesday story (the old one referred to), and I noticed this new bit of news yesterday.

    The first thing that struck me when I went over was...where's my copy? This was put together as an educational tool using public money, but now there's only one copy of it in Kew Gardens, London? Why can't I just download it? All the data's public domain anyway.

    As it happens, I don't live that far from Kew Gardens and so will probably go to see this. But what I'd really like to do is download the lot and use it as a referece tool at home. Or perhaps accessible online.

    Incidently, no word on the formats used to rescue it. It now has a Windows interface - good news, but what about people running other things? That's not a trite statement - they already came close to losing it once in just fifteen years, and in fifteen more years' time I'll guarantee you that it won't be XP on people's desktop. Need to have the formats available so that people can write their own interfaces to it.

    Cheers,
    Ian

    1. Re:But where is it...? by JamesO · · Score: 4, Informative

      I think (and this will go down really well here) that the problem is of licensing. The copyright clearance obtained for the original project didn't include republication rights, so they're not able to republish the content in a different form without contacting all the copyright holders. That would be
      expensive and timeconsuming, even if they could find all the information...

  10. The wonder of modern methods. by Anonymous Coward · · Score: 5, Insightful

    Domesday Book, vellum and ink, still readable after 900 years.

    Domesday Book II, Laser disks and computer files, in need of rescue after 17 years.

    Progress ?

    1. Re:The wonder of modern methods. by adri · · Score: 4, Insightful

      Doomsday 1 - text and possibly sketches.

      Doomsday 2 - text, sound, moving pictures, photographs, cross-linked statistics and from how its been described a very intense lookup system.

      Yup. Progress. Things have changed significantly in 17 years. I just hope people learn from these kinds of media mistakes.

  11. Great idea! by Raul654 · · Score: 4, Interesting

    I think you've hit on a really insightful idea. I'm reminded of a quote from Newsradio: "You can't take something off the Internet - it's like taking pee out of a pool."

    The guarenteed way of protecting data against time is to make lots and lots of copies. The internet is the perfect medium for that. So yes, why don't they put it on the internet?

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
  12. Re:EDITORS! by inaeldi · · Score: 2, Informative

    Check the link, it is "Domesday".

  13. If this system were off on a planet somewhere by matty · · Score: 3, Interesting

    ...in a perfect vacuum, and someone discovered it thousands (millions?) of years later, would it still work? (provided there was power for it, some type of solar, perhaps?)

    1. Re:If this system were off on a planet somewhere by Peyna · · Score: 2, Insightful

      More importantly, would it matter if it works?

      --
      What?
  14. M$ format = they'll have to do the same again by cabalamat2 · · Score: 4, Insightful

    The guarenteed way of protecting data against time is to make lots and lots of copies. The internet is the perfect medium for that. So yes, why don't they put it on the internet?

    Becasue they are stupid, probably.

    The ironic thing is that because they have decided to convert it to a proprietary Microsoft format, they will probably have to repeat the exercise in another 15 years. Bloody idiots.

    1. Re:M$ format = they'll have to do the same again by gilesjuk · · Score: 3, Insightful

      Which all goes to show that open source allows data and software to be rescued at lot easier. If a copy protection company goes bust and data on a disc can't be decrypted due to DMCA style laws then you're stuffed?

  15. Re:Why would you need to store as .flac... by Read+Icculus · · Score: 2, Insightful

    Backup. It's just like having the original .wav files, so if anything happens to the CD you have a perfect backup copy. You get all the benefits of it being digitized as well, you can play it in it's full audio glory on your computer/stereo, you can FTP or transfer the tracks in a format that is a clone of what is on the disc, but with a nice time-saving amount of compression. Also when the CD format dies out you have the digital file sitting around on your HD, which will no doubt be the way we store our media in the future. Your question is similar, (albeit with a few important differences), to asking "Why keep around the full rip of your DVDs? You already have the DVD. Why not just make a divx and leave it at that?" Quality is important, disk space is cheap, and there's nothing like a perfect backup when you are serious about archiving.

    --
    Anti-social? My code is just platform-specific.
  16. I made that... by ratbag · · Score: 2, Interesting

    well, I made some of the entry for the village of Wickenby, near Lincoln, with a childhood friend, Ann. We both had BBC computers at home so we sort of got co-opted into typing some stuff. As children of farmers we concentrated on that side of life in the area. Sweet innocent times...

    Rob.

  17. Static media is really no use by Moderation+abuser · · Score: 4, Insightful

    It's clear that any specific format will last for a while and then be obsoleted within a decade or so.

    Therefore transferring the information from format to format automatically as new and cheaper solutions arrive. This means a process and to simplify and reduce costs, some automatic tools to do the job.

    There are hierarchical storage management[1] solutions around which can do this for you, Tivoli do quite a good one, but, because we're talking long term, the software really also needs to be cross platform and open source.

    [1] http://itmanagement.webopedia.com/TERM/H/HSM.html

    --
    Government of the people, by corporate executives, for corporate profits.
  18. Another copy at "RetroBeep" at Bletchley Park? by LouisvilleDebugger · · Score: 3, Interesting

    RetroBeep, a retrocomputing museum at Bletchley Park (near Milton Keynes, close to London) has the VL-reader and a BBC micro. The proprietor (John Sinclair, whose son is also active at the site) discussed the Domesday project when I was there in May 2003. I'm not sure if there's a copy of it there, but they did have the hardware, and were trying to connect one device to the other.

  19. 15 years, try 15 minutes! by grundie · · Score: 2, Insightful

    I was at school when the Domesday project was being built, in fact my school was one the schools responsible for covering part of Carlisle in Cumbria.

    Our school bough one of the Domesday kits and on the first day all the teachers were bringing us through in to the library class by class to show it off. This was until one of the teachers dropped one of the discs and it shattered, bearing that in mind I am very surprised there are still discs in woking order after all this time.

    I would hope now that they will work on some of the other discs that used the Domesday hardware. I vividly remember a disc that featured an interacitve film. Basically the topic was about wathching a group of kids mucking around and every 2-3 minutes it would freeze and various options would appear over the characters, e.g "Simon calls Peter stupid". Depending on what you chose (using the track ball) the film would take a different path, either they would all go home happy or they would end up in some sort of trouble. Never mind the brainwashing apsects of the film (i.e. don't misbehave kids), the technology was trail blazing. This was in 1987! Years before DVD and even now I've seen very few interactive DVD films.

    Aparently there was over an hour of film and 4 possible endings to a 15 minute program on one of those discs. Whats more the system was very quick and totally foolproof.

    As an 11 year old obsessed with technology I was in awe of all this fancy equipment, Domesday wasn't just a great archiving project it also introduced some fancy technology which even today seems new fangled.

    What the BBC and their partners should have done is to add new material to the Domesday archive every 5 or so years. As well as the obvious enrichment of the archive, this would also mean there was a chance to update the technology in steps in order to keep track with data storage devlopements. Instead once it was finished it was forgotten about, meaning 15 years later when people realise the value of the project you have to get university's on board to make sense of the storage medium, data and software. That would have been a much better way to preserve the data.