Tape Disintegration Threatens Historical Records, But Chemistry Can Help (nautil.us)
An anonymous reader writes: Modern storage methods are designed with longevity in mind. But we haven't always had the scientific knowledge or the foresight to do so. From the late 60s to the late 80s, much of the world's cultural history was recorded on magnetic tapes. Several decades on, those tapes are disintegrating, and we're faced with the permanent loss of that data. "The Cultural Heritage Index estimates that there are 46 million magnetic tapes in museums and archives in the U.S. alone—and about 40 percent of them are of unknown quality. (The remaining 60 percent are known to be either already disintegrated or in good enough condition to be played.)" Fortunately, researchers have worked out a method to determine which copies are recoverable. They "combined a laptop-sized infrared spectrometer with an algorithm that uses multivariate statistics to pick up patterns of all the absorption peaks." Here's the abstract from their research paper. "As the tapes go through the breakdown reaction, the chemical changes give off tiny signals in the form of compounds, which can be seen with infrared light—and when the patterns of reactions are analyzed with the model, it can predict which tapes are playable."
Our young men have not died in vain, ...
The tapes have recorded their names.
What hubris! History has taught us that information is best preserved when backups are made, not when the original is designed to last for a long time.
But of course we're so technologically advanced that nothing would render our magical modern storage methods unreadable...
Freeze them all and wait until a 3d Printer can scan and reconstruct them at the atomic level...
Just try, if they're playable great. If not, then... what? Here's the paper on which something once was written but is now gone, what's the point of that?
Live today, because you never know what tomorrow brings
Did nobody just backup those tapes the moment CDs became widely available?
I ran into a related issue about 25 years ago.
I was working in a college media library, and there were several stacks (over 70 tapes in total) of 2" reel-to-reel video tape from the 1960s and 1970s - recordings off air from Public Television, mostly. Some of them were of local shows nobody even seemed to remember, and others were from live performances at the Dallas station or of live feeds from PBS. There was a live Alvin Ailey dance troupe local show from the late 1960s, if I recall correctly.
The problem was that they were recorded in a rare two-inch format - and only four machines that used it were ever even built (no, it wasn't 2" quadruplex, there were still lots of those at the time). I couldn't find a working machine, and the only one I could dig up was missing major parts (like the heads). So unless someone builds a new one from scratch just to read those tapes, all of that is going to disappear - if it hasn't already.
Thank god, I had some awesome BASIC skillz back then that I though were gone for good.
Is this like, 12" laptop sized or 17" laptop sized?
buh-bye.
Bullshit. Citation required. Modern storage methods are designed to be cheap.
A technical and logistical and financial project whose primary goal is longevity (in the multi-hundred-year sense) of that which it stores.
It should not be accomplished by individual media that are designed to last.
Rather it should use network redundancy cleverly and have protocols designed to ensure enough geographically distributed copies always exist.
It would have to carefully consider "readability, interpretability" assurances, such as very standard simple formats and protocols, and the methodology of storing the displaying / interpreting environment and code as well as the data. Emulated 1980s arcade games, now available and playable online, are good examples of this.
Sort of an Internet Archive on steroids. Crowdfunded?
Where are we going and why are we in a handbasket?
It sounds like chemistry is what got us into this problem to begin with.
Maybe we really don't need to retain all of this information.
I didn't remember it as being an Ampex, but it might have been the VR-8000. The timeline's about right.
I found a photo online, and that looks like the photo of the one from back then.
Maybe we really don't need to retain all of this information.
Probably not most of it - but you never know for certain.
What is missing these days is the concept of active archiving. The days of taking a book and putting it on a shelf as archiving are long gone. This was probably first noticeable then organizatyions started finding need to stockpile ancient computers as a way to retrieve old data from the large floppy discs and other old school data memory. But then we started getting to where this story pick up, with the coatings flaking off of tapes, whether sound data, or the discs.
And its a maddening issue, as there are ancient tapes that are actually on paper, but still sound good, and some that the coating is almost gone. As well there are issues with print trough, which has been a problem with old video tapes, as the tape sits nest to it's neighbors above and below it, teh magnetized parts can transfer a little bit, and the image can get a little fuzzy over time.
And we can't get complacent at all about CDs and DVDs I don't know if the young'uns remember at all about the great writable CD shortage era - this was when 1 CD cost around 11 dollars. And tehy were going bad quickly. I don't know if they were trying to reduce demand or if they were havienthat much difficulty making them, but it was difficult to get any for a while, and when you found one they were rationend out like WW2 tires.
Then ther ewere the CD devouring fungi that ate the data from the unsealed sides of the CD. Bottom line is you should hope you don't need data stored on CD's from the mid 90's.
So now if something is worth archiving, it needs to be in a form that you can continue to re-archive often.
People often bust NASA's chops whne tehy lose old data. I understand perfectly how this happens. re-archive old data, or hire a new accountant ot oversee where all of the pencils go, and the accountant wins every time, while the data slowly fades away.
The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
The Blu Ray version of M-Disk might be worth a look, as they're supposed to last for 1000 years. Also "backup" a spare drive that's capable of reading them.
If not I suggest printing all the data out on boxes of blue and white stripey paper.
Makes you wonder what would have happened to the Voyager's Golden Record which was from 70s. They would have possibly taken necessary precautions but can it survive the extreme radiations it would be exposed to in outer space?
Kept it 7 years, it's going in the dump next month, this is the final offer. Primarily NYT 1970-2000
Gently reply
> History has taught us that information is best preserved when backups are made, not when the original is designed to last for a long time.
I was thinking the exact opposite (and that maybe your case, too).
From present to past:
- Optical, magnetic, eletronic
- Magnetic
- Vinyl etchings
- Wax (Edison recordings)
- Metal (e.g. musicbox)
- Paper
- Leather (scrolls)
- Stone (Rosetta...)
- Paleolithic tools & statues
The earlier in time, the more durable are the recordings. And they don't rely on backups. The Voyager had a metal plate, which kinda imitates the stone thing...
The simple, obvious solution is to convince deadheads that these tapes contain live recordings of the Grateful Dead on them. They will find a way not only to extract and digitize this information (if necessary) they will also track its lineage, archive it and spread it so that many backups exist.
I make a bold prediction that 100% will be either good or bad.
One technique for saving shedding magnetic tape is to bake it in the oven and a relatively low temp (don't have my notes handy, so I can't remember the spec). Did it for audio and VHS plenty of times.
Modern storage methods are designed with longevity in mind.
Are you sure about that?
A HDD is good for maybe 5-10 years, but USB-sticks, unpowered SSDs and writable optical media may become unreadable after as little as a year. Unless you keep several redundant copies and verify and re-copy regularly, you are going to lose that data. The one readily-available exception is, surprisingly, archival-grade _tape_.
This basically shows that the story writers have really no clue what they are talking about.
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
This is kind of obvious thing that further you look in the past, more durable recordings you OBSERVE. There might have been a lot of non-durable paleolithic 'books' - but we will never know. And if somebody looks at our stuff in 1000 years, they will say - these guys knew how to preserve data, they made all these engravings on memorials and metal plates on benches, while we have everything recorded in supervolatile quantum displacement substrate.
Or, what is more probable, they will just smash our stuff with clubs while chanting sacred verses from whatever version of holy book will win in race to dumb human progress in next hundred years.
"The remaining 60 percent are known to be either already disintegrated or in good enough condition to be played.)"
Do they mean "NOT in good enough condition to be played"?
I want them alive. No disintegrations!
The DC100A tapes of my Hewlett Packard 85A from 1982 are still intact, but as soon as you try to read them, the head scrapes off the magnetic coating from the plastic film. After that I am left with transparent tape and brown powder. I have tried the baking instructions http://www.josephson.com/bake_tape.html to re-activate the binding but that did not help for me and I am still stuck with the Sticky Shed Syndrome https://en.wikipedia.org/wiki/Sticky-shed_syndrome
Would it be possible to read a tape without the head touching the tape? Maybe a very sensitive head?
https://en.wikipedia.org/wiki/...
Yeah, because no one makes durable storage, it just isn't a thing...
APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
You mean that all that stuff between the 60s and the 80s, like bell-bottom pants and mullets, will be lost forever? The only important question is how can we speed up the process of tape disintegration?
"Apk doesn't think DNS servers are worth running & believes Microsoft Active Directory can run w/out DNS." - by Coren22 (1625475) on Tuesday October 27, 2015
Where'd I say it? Show us. I say AD needs internal DNS far back as 2007 http://forums.tweaktown.com/wi...
See "To warn users who have ActiveDirectory/AD LAN-WAN setups to NOT use external DNS servers" there on OpenDNS free (I use it) + AD in my security guide.
+ Migrate hosts across a LAN (admin/scripts not GPO)-> http://slashdot.org/comments.p...
---
I'm RIGHT on admin priv + hosts (WFP/SFP)!
"figured out why privilege escalation's a bad thing?" - by Coren22 on Tuesday September 22, 2015
How else can I programmatically update hosts itself?
---
"it requires elevation to write hosts" - by Coren22 (1625475) on Wednesday September 23, 2015
Hypocrite later admits it!
Even MalwareBytes AntiMalware (best one) DEMANDS it or it can't do a job fully like many security tools!
---
"Needing admin privileges every time a program updates is poor design" - by Coren22 (1625475) on Tuesday November 10, 2015
Stupid, mine doesn't to get new data. Only hosts itself updates need it vs WFP/SFP. Users set it too. It's not programmatic impersonation.
---
"90's technology to fight modern war" - by Coren22 (1625475) on Tuesday November 10, 2015
Ozymandias/Watchmen per a namesake:
"I resolved to apply antiquities teachings" (hosts) "to our world today & began my path to conquest - Conquest not of men but of the evils that beset them: Fossil Fuels (antispyware), Oil (antivir), Nuclear Power (addons) are like a drug & you gentlemen along w/ foreign interests are the pushers"
It works Aryeh Goretsky NOD32/ESET said hosts = good security-> http://it.slashdot.org/comment...
Oliver Day (Symantec) too-> http://www.securityfocus.com/c...
MalwareBytes' hpHosts' Admin hosts+recommends APK Hosts File Engine 9.0++ SR-2 32/64-bit-> http://hosts-file.net/?s=Downl...
APK
P.S.=> Con't. in #2/5... apk
"Virus scanners/Adblock software don't need admin priv to update" - by Coren22 (1625475) on Tuesday November 10, 2015 @04:14PM (#50904323)
Neither does my program. AV does to remove threats - Adblock addons = Vastly INFERIOR in abilities + efficiency vs. hosts as I proved & no one proved me wrong to date!
---
"your software does" - by Coren22 (1625475) on Tuesday November 10, 2015 @04:14PM (#50904323)
No, hosts do due to WFP/SFP - Intake update of new hosts data doesn't!
---
"won't reveal your source code" - by Coren22 (1625475) on Tuesday November 10, 2015 @04:14PM (#50904323)
I don't owe you it. I don't give away work to be stolen by others so it's misused like GOOGLE CHROME http://it.slashdot.org/story/1...
---
"What's stopping you from pointing my bank's web site at your private server?" - by Coren22 (1625475) on Tuesday November 10, 2015 @04:14PM (#50904323)
I don't keep a server. Security guru (not - you create no ware for security & your forensics skills = non-existent): Put it in a VM, trace it using process monitor + wireshark to prove it (don't need code)!
---
"the possibility of being caught, which would be pretty hard to catch w/ such a large hosts file, as no one can go through it manually." - by Coren22 (1625475) on Tuesday November 10, 2015 @04:14PM (#50904323)
I place hardcoded fav sites @ top of hosts for speed & reliabilty - you'd spot it easily & bulk of hosts is sorted blocked known bad threats.
---
"What are you going to do when Windows gets rid of the hosts file completely?" - by Coren22 (1625475) on Tuesday November 10, 2015 @04:14PM (#50904323)
Hasn't happened..
---
"They have already taken steps to make it useless in Windows 10." - by Coren22 (1625475) on Tuesday November 10, 2015 @04:14PM (#50904323)
It works there!
Telemetry tracking (Killing 10 by itself) Win10 = Win8: A flop - who're you fooling other than yourself?
APK
P.S.=> Con't. in #3/5... apk
"I guess we should avoid your crap, it looks like it is marked as malware. Good luck getting that removed." - by Coren22 (1625475) on Monday November 02, 2015 @03:52PM (#50850445)
62 sources of good repute show + /. users say otherwise:
Proven safe by 57 antivirus programs in its 64-bit model https://www.virustotal.com/en/...
+
Same for the 32-bit model https://www.virustotal.com/en/...
&
Per VirScan its installer too -> http://f.virscan.org/APKHostsF...
---
MalwareBytes' hpHosts Admin (MalwareBytes employee) hosts & recommends it -> http://hosts-file.net/?s=Downl... & MalwareBytes = BEST antivirus per this VERY recent testing of them all http://www.av-test.org/en/news... /.'ers say my work is good too:
"his hosts program is actually pretty good" - by xenotransplant (4179011) on Monday August 10, 2015 @03:34PM (#50287195)
"I like your host file system." - by Karmashock (2415832) on Wednesday September 09, 2015 @03:57PM (#50489401)
"APK is kinda right... I've given up on JS based adblocking and gone to blackholing in /etc/hosts, just like it was back in the 90s. The computational load has gotten intolerable for any ad-blocking using JS. I've tried his hosts file generating software. It works." - by bmo (77928) on Thursday October 15, 2015 @11:30AM (#50736071)
"his hosts tool is actually useful for those cases in which one does indeed want to locally block stuff outright while consuming minimum system resources" by alexgieg (948359) on Friday September 25, 2015 @09:57AM (#50596461)
---
You tried using Computer Associates another antivirus I turned over on false positives (1/8 over time) & they were caught in ACCOUNTING SCANDALS FRAUD http://www.bing.com/search?q=c...
Reputable source (not): They had to sell off their PC security suite too (crap also) LOWERING the 'threat level' on THAT program (not my hosts file engine) TO ZERO!
* YOU ARE WRONG ON EVERY ACCOUNT NOTED!
APK
P.S.=> To be continued in part #4/5... apk
Coren22 'eats his words' vs. me 2x yet again:
"introduces risk you are relying on a 3rd party to update a hosts file potentially opening you up to MITM attacks" - by Coren22 (1625475) on Tuesday November 17, 2015
How can my program do it?
Only things it puts in as non-blocking IP addy to hostnames is ones users give it as their favs to speed up @ the TOP of hosts REVERSE DNS VERIFIED!
(For more speed, & reliability + security - in RAM as 1st resolver queried = faster & more secure vs. remote DNS w/ all its security issues in Kaminsky flaw, DNSChanger malware IP stack settings, routers bushwhacked in DNS settings, rogue DNS, Open DNS servers abused by malware. It aids in reliability vs. redirects).
YOU'D SPOT IT INSTANTLY AS THEY ARE @ TOP OF CUSTOM HOSTS & can easily edit anything you want out of it!
(Rest = known bad sites from 10 reputable security community sites for blocking - the MAJORITY of what's in my hosts files!)
---
"maybe one day you can get a score 5 comment" - by Coren22 (1625475) on Tuesday November 17, 2015
See subject & ~ 12 +5 upmods making you "eat your words" vs. me (1st one: You tried using what I post there against me to FAIL):
+5 'modded up' posts by "yours truly" (11):
http://news.slashdot.org/comme...
http://tech.slashdot.org/comme...
http://news.slashdot.org/comme...
http://science.slashdot.org/co...
http://tech.slashdot.org/comme...
http://hardware.slashdot.org/c...
http://news.slashdot.org/comme...
http://news.slashdot.org/comme...
http://hardware.slashdot.org/c...
http://yro.slashdot.org/commen...
http://yro.slashdot.org/commen...
"You believe you are getting the better of me" - by Coren22 (1625475) on Tuesday November 17, 2015
YOU GOT THE BEST OF YOURSELF in tech fails & lies about me. Your immature signatures about me SCREAM you're butthurt! You did it to yourself.
APK
P.S.=> Con't. in #5/5... apk
"defame me saying things he knows aren't true - by Coren22 (1625475) on Wednesday November 04, 2015
Hypocrite You're projecting & your signatures do the rest.
"the feeling of icky his software - by Coren22 (1625475) on Wednesday November 04, 2015
I show /.'ers say differently by quoted testimonials - Show us you've done better: YOU can't!
"maybe someone will think they are true - by Coren22 (1625475) on Wednesday November 04, 2015
Quotes of you = true - & You can't keep your word + projecting what YOU do (AD/DNS lie).
"I don't have time for the Troll APK, and refuse to respond anymore to a post signed APK" - by Coren22 (1625475) on Tuesday November 03, 2015
I protect users speeding them up, helping reliability, & security + anonymity online w/ more ability & efficiency than ANY 1 solution doing more w/ less - do you? No.
"I should change my signature again to rile him up more." - by Coren22 (1625475) on Tuesday November 03, 2015
Childish sigs = all you've got!
"I refuted his assertions - by Coren22 (1625475) on Wednesday November 04, 2015
&
"You claim I have never proved you wrong...a flat out lie." - by Coren22 on Monday November 16, 2015
&
"I proved you wrong on numerous occasions" - by Coren22 on Monday November 16, 2015
Where & on what tech? "Cat got your tongue"??
"written in shitty Delphi, "How to secure Windows" docs I could have written in my sleep when I was 20" - by Coren22 on Monday November 16, 2016
You're 30++ & haven't done either!
Show you've done MORE vs.a small partial list of mine & better, + earlier:
http://slashdot.org/comments.p...
THEN talk vs. TALKING OUT YOUR ASS!
CIS Tool took fixes from me http://slashdot.org/comments.p... which you doubted & my layered security guides got me paid http://pcpitstop.com/news/winn... MILLIONS use.
APK
P.S.=>
"I never admit you were right" - by Coren22 (1625475) on Tuesday November 10, 2015
You PROVED I AM... apk
No. History has taught us that if you want it to last you have to etch it in stone.
"Tape Disintegration Threatens Historical Records... From the late 60s to the late 80s, much of the world's cultural history was recorded on magnetic tapes." Good heavens! Are the historical records of the early Star Trek episodes in danger?