2008, The Year of Solid State Storage
An anonymous reader writes "At CES, SSD drives were a plenty on the show floor. "Some companies said we could see 250GB SSD units by the end of this year, while others predicted it could take up to a couple of years for them to become mainstream. None of the companies promised mainstream adoption, but they promised a bright future and we are inclined to believe them. High capacity drives are going to be expensive due to their very nature of early technology and gradual adoption rate."
High capacity drives are going to be expensive due to their very nature of early technology and gradual adoption rate.
I think they have that backwards. Lets try High capacity drives are going to have a gradual adpotion rate due to their very nature of being expensive due to their being early technology
There, that's better.
I'd have one now ("be an early adpopter") if they weren't so bloddy expensive.
I work for the Department of Redundancy Department.
Oh well everything that old is new again I guess.
I used a RAM drive on my Amgia way back when. Yes I know that they are how using flash but it does seem very familiar.
I wonder when we might see a hybrid flash-ram drive? A big bunch of ram for high speed and flash for permanent storage. Just use a super cap for a power backup and have it copy the ram to flash on power down. A little bit pricey but if you need the speed you need the speed.
See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
HDD still have a ways to go. In particular, the flash storage will be used for desktops, laptops and the core of servers. The real data will still reside on HDD for a long time to come because of cost / MB. What will happen is that HDD will learn to really park and lower their energy needs, most likely due to dropping in size. Tape has been used for eons for back-up, but I think that HDD will overtake that role as their prices will be forced to go way down.
I prefer the "u" in honour as it seems to be missing these days.
The sales guy at the Apple store told me that there was a persistent rumor of a solid state laptop coming in the next few weeks...
Boot camp + solid state = me finally replacing the old powerbook!!
"If you think you have things under control, you're not going fast enough." --Mario Andretti
I was talking to a gentleman from (big name hard drive company) about their plans for hybrid and/or solid state drives. Essentially he told me that solid state was still limited by price and sequential reading. So it may be advantageous to put some things on flash like OS files that require a lot of random seeks, but for sequential reading of things like media files, traditional hard drive tech won't die just yet . . .I apologize for being too lazy to back this stuff up with numbers, what can I say, I'm a true slahsdotter.
If you are about to mod me down, keep in mind that this post was most likely sarcastic.
I don't think so, tapes will still have many uses. They are very reliable for backups more than I would trust a hard drive. They also have the ability to be taken to off site locations like all backups should be. Hard drives would make doing that a little more difficult, even with external Hard drives it would be more of a pain than having the media of a tape. I don't see the tape going away any time soon.
Maybe in 09... not 08... unless we get chipsets that can supply greater throughput, the chipset will become the bottleneck - therefore, the only reason to have one of these is in a laptop or desktop... and thats for people for whom price is no object.
In the enterprise sector... forget about it... Even SATA drives are becoming ideal for storage solutions, and a simple raid-5 will max out the cap of a raid controller's bus.
So in other words... I don't see it.
That's hardly the situation at all. For massive magnetic data storage, tape is still very valid. You're just not going to find 500GB HDD's with such low failure rates in 10-packs for $1000 like you can get tapes at today. And tape can drop in price much more easily than HDD's will.
I'd give it a good 10-15 years before our massive tape storage units disappear from the datacenters.
I thought this was the year of the Linux desktop.
As I understand it, the problem with using HDDs for backup, at least archival backup, has more to do with longevity than anything else. An LTO tape has a shelf life of 30 years. HDDs don't.
Is there any hope of retrofitting old existing boxes with these drives or are they all going to come with newer (eg: SATA) interfaces?
I have a few older servers which will be too expensive to completely replace, but it would be nice to have solid state drives in
Until that time is years, instead of weeks, I don't see myself preferring more expensive, or even equal cost SSD, over rotating media drives.
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
...and I have known at least two women who seem to enjoy being tied up in magnetic tape. Not only is it 'good memory' but it seems to have an effect on my hard drive systems as well.
Allow me:
Initial Poster: These drives will not last! Solid state drives have limited read/write cycles.
Response: Dude! You are such a n00b. Newer versions of SSD have wear leveling to correct this problem!
Another responder: I am getting a kick out of these replies. We service 10,000 SSDs at our company and they only last 4 months.
Response: You suck!
I actually see the solid state drives replacing tape (if the cost goes down). They would be smaller then tape, and the life-span would be as good. You could technically have a SSD loader, working like the current tape loaders, and the only thing needed would be a good connector that can take several thousand insertions (like the SD connector). SSD would be more reliable then tape because of the reduced mechanical parts.
SSD's would have all the advantages of tape (portable, easy to load, etc) without the mechanical problems that tape has. Wow, I need to patent this now!
Looks like the big boys are getting into the game also: EMC in Major Storage Performance Breakthrough; First with Enterprise-Ready Solid State Flash Drive Technology Market-leading Symmetrix DMX Systems to Feature Newest Flash-based Technology for Unprecedented Performance and Energy Efficiency http://www.emc.com/about/news/press/us/2008/011408-1.htm They're claiming a 10X performance improvement, but at 30X the cost/MB. Given that a high-end DMX holds around 3000 drives, that a lot of flash memory! John
When I was a lad, just starting out at university, back when nobody uncool knew what an iPod was, the biggest you could get was something like a 15GB version for £250, and it was a hard drive because as a rule of thumb, you couldn't fit more anything of value on a flash player. I was browsing on play.com last night, and Creative are doing a 16GB all-Flash player for about £160. That in itself wasn't surprising, as 16GB isn't much these days, but thinking back, this was one memory technology completely replacing another in a particular application. Really, I could see SSDs completely replacing hard drives in certain consumer products at the rate this is going. Joe and Jane public's internet box doesn't really need more than 50GB, does it? It'll keep them storing 10-megapixel holiday snaps for years.
No kidding!!! What do you say at this point?
I was sure it's the year of the Linux desktop...
Here is the article, though it is limited to the high-end Symmetrix. http://www.infoworld.com/article/08/01/14/EMC-will-replace-disks-with-solid-state-drives_1.html I wonder if we could do the same thing with a few dozen thumb drives.
We are finally starting to move away from a long era of computers with moving parts. Since conventional hard drives will be gone within 10 years (my prediction), all that remains is the media player (CD, DVD, etc). Obviously, I am not taking fans into consideration since I don't consider it to be a part of a computer system like a processor is.
Hopefully computers will be completely free from moving parts in 10 years or so. Now that would make it interesting for laptop owners.
Full Tilt
Actually you can pick up 10 500GB SATA Seagate drives with 5 year warranties for $1300.
The price per GB will continue to fall, so magnetic storage will be more cost effective. Of course there are other advantages and disadvantages to both.
EMC just announced this this morning. They are going to start haveing soldi state drives in there DMX-4 storage arrays. "EMC plans to offer flash drives in 73 GB and 146 GB capacities for the Symmetrix DMX-4 platform beginning later in Q1 2008". http://www.pcworld.com/businesscenter/article/141323/emc_readies_solidstate_drives_to_replace_disk_storage.html
Linux is like a teepee. It has no windows, no gates, and there's an Apache inside.
The article talks about large solid state drives, but because of the price premium, I've been experimenting with smaller SSDs. In particular, I've been using an 8GB 266x CF card coupled with a CF->SATA adapter as the OS drive for my mythtv system for 5 months now with great success.
Not only is the flash drive completely silent, it is reasonably fast. Reads always benchmark at 40MB a second and writes benchmark at 34MB a second.
I've been a bit worried about the flash wearing out after repeated writes, but so far so good. Since my mythtv mysql installation is stored on it, as well as the normal system log files, I'm sure it sees quite a lot of action.
But to my point...
One common problem with systems such as mythtv that are under heavy IO stress is that during these moments of stress (lots of recordings going on at once) the whole operating system grinds to a halt or at least becomes sluggish waiting on some needed IO.
It was very common on my old mythtv setup where I used the extra space on the OS hard drives as extra storage space for mythtv recordings. I'm not experiencing any of that sluggishness with the new setup.
This has got me thinking that for my future desktop system, maybe instead of getting a raptor for the OS drive, and a large, slower hard drive for the rest of my stuff in order to minimize IO bottlenecks, I should swap out the raptor for a 16GB SSD for the OS drive. I'd end up with something that has almost no latency, good speed, silent, and it may be possibly just as reliable in that role.
What do you think?
Really? I would have thought that magnetic tapes were more prone to damage/errors. I have no experience with them, but I guess I automatically related them to VHS tapes or cassettes, both of which show signs of noise after being used X amount of times. That and the fact that a magnet next to it can really screw it up. Then again, same goes for HDD...
In the end, ppl will pick what is convenient Back-up is going to be moved to being a service. No doubt BIG business will continue to run tape drives. But the homes, and small businesses will move to service approach instead. And most are using hard drives with compression.
I prefer the "u" in honour as it seems to be missing these days.
As far as I know, hard drives encode data on the disk using simple binary waveforms. Communication systems are designed to use elaborate modulation schemes, and employ digital coding methods which make much more efficient use of the communication channel.
Hard drive makers could do something similar, like spreading the data over a number of physical bits on the disk (such as CDMA does.) Essentially, they would not be limited by the density of the data on the disk, but by the SNR (signal to noise ratio) of the magnetic medium, which I imagine is very high.
Taking this idea furthur, they could bifurcate their encoding methods into 2: a low latency one that retains the characteristics of existing drives, and a high-bandwidth-low-latency scheme which uses digital coding methods to spread each block of data over an entire cylinder for example, and has requires reading the whole cylinder to retrieve a single bit. This would be useful for storing video and large image data, which is retrieved linearly and usually buffered too, and does not require low-latency access the way normal files on a filesystem do.
Hybrid schemes are always better than simple implementations, if they provide a closer fit to reality.
Hasan
"Tape has been used for eons for back-up, but I think that HDD will overtake that role as their prices will be forced to go way down."
There may be another revolution in hard drive technology if they keep pushing new head designs, i.e. "non-mechanical" heads (i.e. light/lasers/etc), how feasible and cost effective this is, is up in the air.
Well, Im not sure about you but im my personal VHS and cassette players I never used a cleaning tape to maintain them. Using a cleaning tape on a monthly basis in tape drives seems to have great results. Also there is alot more ware and tare on a VHS or cassette player you are constantly pulling tapes in and out every couple of hours or so. With a tape drive backup its a daily type thing most likely which wouldn't put as much ware. Its all about maintaining them properly.
With respect to the "trust" issue: this is perception, not reality. Disk drive arrays of the type used for backup (virtual tape) have a reliability rating of 99.99% to 99.999% for uptime, and lose or corrupt data even less than that. The very best tape will approach 99.5% but only if it is not physically moved outside of a tape library--like it would, for example, it taken off site for disaster recovery purposes. The moment that humans start to handle it, bump it, get it dirty, etc, reliability drops below 99%, sometimes well below to the 95% level or so. So, very best case, disk is at least an order of magnitude more reliable than tape, and most often, several orders of magnitude.
full disclosure: I work for a company that sells virtual tape. Nevertheless, all the data is backed up by vendor neutral analysts like Gardner, and tape companies themselves.
Or looking at it from the other side - how long would a tape last as your swap media?
True, and I guess VCRs and tape decks aren't really made with longevity in mind (instead, use cheap parts to sell to the consumer for lower prices), and could cause some of these problems with VHS or cassette, whereas the entire purpose of a tape drive is to backup information, and longevity is the main factor in a purchase..
Yeah, certainly I'd pay double for storage for a reasonable 20-30 gig SSD. The seek times and lack of instant crashes out are great. For the speed and reliability, I'd replace my harddrive with a downright tiny drive just to run my OS. Their clicky cousins can store my massive amounts of non-critical data. I'm fine using magnetic drives I just don't want to use them for data I access all the fricking time.
I think we'll start seeing the drop off of magnetic drives well preceding the the overtake. We'll see people buying cheap 4 TB drives a couple years from now, but as is most basic users can't fill the 40 gigs. Why do they need more than a few gigs for a few dollars? If they have storage needs... that'll be your MM's job.
It is no longer uncommon to be uncommon.
I'm sure there are enough old hard drives floating around places that accept used computer equipment (Goodwill, Tech museums, collectors) that we should be able to do a quick survey.....provided someone can find a working RLL controller.
Layne
In (approx) 1992 I went to SID (society for information display) in Florida, and a keynote speaker said, roughly: "I have been coming here for 30 years, and I expect to hear, just like I heard 30 years ago and most years since, that within 10 years flat panels will overtake CRTs and make them redundant. Why has this not happened? Because CRT has continued to get cheaper and better quality, thus removing the opportunity for flat panel, because the goals keep moving" He also pointed out that we would get there (and we have) but that we should never underestimate where old technologies can go. In 1983 I put together a business plan for an outsourced proposal I was working on, and we put in £17K (thats $28k) to cover a 70 megabyte hard drive. Now I see one inch drives in iPods carrying multi gigs. I believe that we will see phased take up, ie where it is needed most (e.g. like the way airlines put in flat panels instead of CRTs to reduce weight), before the HDD manufacturers will curl up and leave the scene. Jerry
2008, the year of predictions
Digital video tape is approaching a tenth of a cent per gigabyte. Still going to be one to three orders of magnitude lower than flash. Moving disk will be in between.
And, of course, any technology with no moving parts is preferable-- mechanical parts have an annoying tendency to freeze up with vacuum thermal cycling.
How are the SSD makers getting around the limited write cycles of flash drives? Flash, even high endurance can actually wear out faster than HDDs with all of Windows' endless writing to the page file. A fluid bearing HDD can last a long time theoretically. One of the problems with those few people who have managed to get Windows (XP, not PE) to boot from a flash drive is that Windows will burn out a flash drive pretty quick with its endless page writes. Yes, you could turn off the page file, but that isn't how XP is supposed to work. Then again, neither is BSOD.
I understand that Linux pages too, but I'd imagine the average Linux nerd would implement a workaround.
Slashdot "libertarians": Small government for me, big government for those I disagree with. -1, I disagree with you
Nothing wrecks the future better than predicting it.
It's very much safer to predict the past, less ways to go wrong.
SATA was around for a long time, but it wasn't until I noticed that you could not order a system with IDE, or buy a hard drive at fry's that wasn't SATA that the transition really took off.
I suspect that same will be with SSDs. Consumer demand will bring down prices, but the true test is whether it becomes main stream or a replacement for SATA. The best technology is not what always gets adopted. Sometimes adoption has more to do with marketing.
When I see it at Fry's overtaking traditional disks, I will know it has happened. Before then, I wouldn't count on it.
Flexible bare-metal recovery for Linux/UNIX
..provided someone can find a working RLL controller. Another good point - not just for HDDs but will today's tape drive read a 30 year old tape? Do tape _drives_ last 30 years?The point of moving existing data is that the damage is done by writes. And long-term data has no writes performed to it. Therefore, for wear-leveling purposes, you would desirably wish to move the long-term data to a heavily written, but not yet failed, area of the flash, since it wouldn't be written again, freeing up the seldom-written, or even once-written, area for more use.
"It's the height of ridiculousness to say for those 9 lines you get hundreds of millions."
Hmm...a hard drive that uses a laser as a read/write head...interesting. I wonder what they will call it? Compact Disc, perhaps? Digital Versatile (or Video) Disc, maybe? Oooh, I know let's use a blue laser and call it Blu-Ray or maybe High Definition DVD.
How long before buffering reads into memory is considered archaic legacy support and something to be avoided?
-- 'The' Lord and Master Bitman On High, Master Of All
SSD is expensive right now. Is there any kind of DIY solution for battery-backed RAM out there? How about hacking one together?
I've been thinking about this workaround for quite a while, but I never see anything discussed about it. But why not mitigate activity on the SSD by having /var be a ramdrive? Once the system is stable, cron a backup (snapshot) to the SSD, along with writes for whenever the partition is unmounted. Ram is cheap enough that for typical applications, /var shouldn't be too large (unless you have large caches stored in /var, but that can be solved with symbolic links)
Dammit, I was going to declare 2008 the year of desktop Linux... guess I'll have to wait until 2009.
So what, I can get 10 LTO3 tapes (600GB average for our data) for $500. If we upgraded our drives to LTO4 I could get 10 LTO4 tapes (1.2TB average for our data) for $1300. Unless you use less than a handful of tapes a month tape beats HDD. Heck due to ongoing litigation I haven't recycled a tape since October 2006, using HDD for that would have cost an absolute fortune. There are markets for most technologies (otherwise why invent them) but I don't think HDD based backups are going to beat tape for many businesses anytime soon.
There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
832GB 2.5-inch SSD
1.6TB 3.5-inch SSD
source - ofpblog
Not only that when the tape is unloaded and sitting there in the library it consumes *ZERO* power. A couple of tape frames and you can easily exceed 1PB of storage for a fraction the price of hard drives and a vanishingly small percentage of the power. A good HSM later and you are cooking.
Not only that, what it would cost to reliably cable up all those drives I shudder to think. The nice man from IBM comes tomorrow to install another tape frame onto our library at work. We are then going to fit some LTO4 drives, load a bunch of tapes, and start shuffling it all off the LTO1 tapes currently in there. Once operation has been completed (there is a lot of data to move) and we remove all the LTO1 tapes we should have some 1.5PB of storage. Note there are of course two libraries for redundancy and disaster recovery.
Do that in spinning HDD, dream on mate.
Where's the news in this? I'll sell you one today if you want to pay for it.
OTOH, you probably would be able to patent it. Sigh.
In one year DVD and Blu-Ray burn media manufacturers will be having trouble. Once 1TB hard drives reach $100 dollars, you are basically at break even media cost wise with DVD+R media. Meaning you can just store all of your downloaded movies on a harddrive at the same cost as DVD media. In 2 years-ish, hard drives will be the clear winner, with 2TB drives approaching that $100 range possibly. While you have the chance of catastrpohic failure, if you really are using these things just for occasional read storage along with a docking solution you end up saving time and money and physical space (those 500 sleeve DVD holders add $0.10 to every disk you burn).
It will be nice in say 5 years when SSD tech reaches that same threshold, since catastrophic failure of those drives is presumably much less likely to occur.
http://blog.slaingod.com
What about copy-on-write file systems like ZFS that don't touch the data already on-disk, but only write to unused blocks?
ZFS is a bit of a more a general FS, unlike JFFS which tends to be in the niche of the embedded space.
I've put the old 1.8 HDD in a case and now i'm using it as storage, but once it dies i don't think i'll ever buy an HDD again.
Gus
Smart Talent was demoing 256GB at the show last week, and I just didn't get a photo of the demo system running it. But in saying that it'll be mainstream in X months or whatever is just a gamble. If we have another earthquake in Taiwan or one in Korea, RAM prices are going through the roof as all the factories are in Taiwan, and Samsung owns the flash memory market right now.
Aside from that, here are 145 photos from CES of stuff that I thought was worth shooting with my camera at the show: http://www.flickr.com/photos/barl0w/