Are SSD Accelerators Any Good?
MrSeb writes "When solid-state drives first broke into the consumer market, there were those who predicted the new storage format would supplant hard drives in a matter of years thanks to radically improved performance. In reality, the shift from hard drives (HDDs) to SSDs has thus far been confined to the upper end of the PC market. For cost-conscious buyers and OEMs, the higher performance they offer is still too expensive and the total capacity is insufficient. SSD cache drives have emerged as a means of addressing this situation. They are small, typically containing between 20-60GB of NAND flash and are paired with a standard hard drive. Once installed, drivers monitor which applications and files are accessed most often, then cache those files on the SSD. It can take the software 1-2 runs to start caching data, but once this process is complete, future access and boot times are significantly enhanced. This article compares the effect of SSD cache solutions — Intel Smart Response Technology, and Nvelo Dataplex — on the performance of a VelociRaptor, and a slow WD Caviar drive. The results are surprisingly positive."
For Linux users: http://bcache.evilpiepirate.org/
Lets you use any SSD as a cache in front of another filesystem.
Hybrid drives or mixed mode setups kinda suck ass now that actual ss drives are getting to a reasonable price/size.
SSD for os/programs.
Giant TB+ drive for storage and media files.
240GB SSDs are bouncing around 200. 2 bills for the boot SSD and your old drive gets the data partition and you are beating these hybrids on performance AND price.
To me it is not worth it to watch your os boot faster.
First of all, putting the OS on a disk by itself doesn't only mean that Windows runs faster - The OS reads and writes to its files on a near continuous basis. For years before SSDs, we've known that simply getting that activity segregated onto its own disk, away from "real" file activity, gives a decent performance boost across the board; moving it to an ultra-fast random-access media helps even more (and even if you don't care about boot time, how about "responsiveness"? Every time Windows needs to wait for some stupid little icon to load, you need to wait for Windows to wait for some stupid little icon to load).
Second, SSDs have gotten a lot bigger and a lot cheaper. You no longer need to decide between spending a fortune or segregating your apps out; a $60 SSD will hold the OS and every app you could ever possibly run, with plenty of room to spare. Yes, you'll still want that second big-slow-and-cheap HDD for general purpose storage, but you haven't needed to carefully weigh "on which disk should I install this program" for at least a year.
Flash ram is not a permanent solution and will die due to the limited number of writes.
And you think a drive with actual moving parts will live forever?
Make no mistake, SSDs have their flaws, and cost definitely still counts as one of them. But once you really use a system set up with SSD system / HDD data, you'll never even consider going back. And mere boot time has nothing to do with it.
There are a variety of different ongoing tests to look at how long drives actually last. Looking at a fairly standard older Intel 320 40GB drive, it went 190TB written before the MWI threshold was reached, and continued on until 685TB. That means it completely rewrote the drive 17500+ times.
No, it won't last forever. And it's not ideally suited for every single industry and use. But for the typical user, they are more likely to need a larger drive or otherwise upgrade then wear out the drive.
It seems that SSD accelerators can be hit/miss. If you take a look at http://www.theregister.co.uk/2012/07/12/velobit_demartek/ for example, some of these products don't seem to do anything - while some seem to actually work.
Like any young industry, it'll probably a while to shake out field until only a few decent contenders remain.
Nemilar http://www.techthrob.com - Visit Me!
> And you think a drive with actual moving parts will live forever?
Compared to how long SSDs have been in wide use, there are plenty of hard drives with "actual moving parts" that have lived forever.
However, the key thing is that you get some warning with a hard drive rather than it being sudden death.
Some SSD brands make Seagate seem reliable in comparison.
A Pirate and a Puritan look the same on a balance sheet.
It would be surprising if it weren't the case. We've been doing the same thing with memory for years. Our CPUs need memory that can perform in the realm of 100GB/sec or more with extremely low latency, but we can't deliver that with DRAM. So we cache. When you have multiple levels of proper caching you can get like 95%+ of the theoretical performance you'd get having all the RAM be the faster cache, but at a fraction of the price.
This is just that taken to HDDs. Doesn't scale quite as well but similar idea. Have some high speed SSD for cache and slower HDD for storage and you can get some pretty good performance.
I love Seagate's little H-HDDs for laptops. I have an SSD in my laptop, but only 256GB. Fine for apps, but I can't hold all my data on there (music, virtual instruments, etc). They are just too pricey to get all the storage I'd need. So I also have an H-HDD (laptop has two drive bays). It's performance is very good, quite above what you'd expect for a laptop drive, but was only $150 for 750GB instead of $900 for 600GB (the closest I can find in SSDs).
http://maxschireson.com/2011/04/21/debunking-ssd-lifespan-and-random-write-performance-concerns/ No idea how correct this is, but I bookmarked this over a year ago.
Perl Programmer for hire
SSD's were recently @ $1/Gig. That's when I upgraded everything.
I've seen them as low as 55-65c a gig now. Yeah... gotta love how
tech drops in price RIGHT AFTER you decide to adopt.
Buy a WHOLE SSD drive. Put all the programs you use daily on it.
120G ~ $70
That is all.
FWIW, except for bulk storage, I will NEVER buy a spinning HD again.
I experienced a RIDICULOUS speed up, going from a 7200rpm drive.
-AI
For me, it is far better to grasp the Universe as it really is than to persist in delusion
> In reality, the shift from hard drives (HDDs) to SSDs has thus far been confined to the upper end of the PC market.
Not entirely. I have the cheapest netbook I could find, and I replaced its hard drive with a cheap low-capacity SSD. I don't keep much big stuff on it so the capacity isn't a problem. In terms of performance and power usage and not having to worry about my data when I drop my computer, it's been entirely worth it.
...there are plenty of hard drives with "actual moving parts" that have lived forever.
Hmmm, been using 'puters since 1984 and still haven't found one that has a hard drive that, a) lived forever, or b) gave me a warning before it died a horrible death.
Seriously awful technology that is long overdue for an overhaul.
Under a simple OS like windows? yes, I added one to my work PC and it flies. I then got another for my mac book pro and it flips out causing problems. same goes for using it under linux. It seems that more advanced filesystems and OS's that do a lot of housekeeping to the drive will freak these drives out.
Luckily I was able to sell my second drive to a friend who could use it in his windows laptop.
Do not look at laser with remaining good eye.
This is exactly what has been going on in the enterprise storage space for a while. I only know much about two vendors, but they both have a solution like this. High end IBM storage has EasyTier, which while originally for the mix of FCAL/SAS to SATA, it works with SSD too, and in the latest revs all 3 tiers at the same time. NetApp used to have a PAM card which is now called... FlashCache? FlexCache? F-Something-Cache anyway, which is essentially an SSD drive on a PCI card.
Good to see the high end tech being applied to consumer level workloads.
----- - The beatings will continue until morale improves
The article doesnt mention any other software(mostly OS) requirements for the accelerators, which is a pretty big deal. Basically there are 2 ways to cache:
1. On the file level, which isnt very resource intensive(there aren't nearly as many files as blocks on a disk), but requires that the accelerator be able to read file system metadata(and of course be able to intercept OS calls) which severely restricts what kind of file system, and really even operating systems, you can use with the accelerator
or
2. Block-level caching. Much more generic, can really be used with any file system as the blocks, not any file system metadata, are the only thing that is used. However managing all that block information comes at a cost, either in main memory or more expensive hardware. For instance Flashcache requires about 500 megs of memory to manage a 300GB disk. Depending on your usage this may be acceptable(though is memory really that much cheaper than ssds nowadays?) but for most it isnt.
From the article I can assume that they only tested Windows, and that really limits its usefulness.
Monstar L
In reality, the shift from hard drives (HDDs) to SSDs has thus far been confined to the upper end of the PC market.
In reality, 100% of the smartphones, tablets, many/all? of the ultrabooks, and many notebooks now ship with SSDs. In a short time, virtually all laptops will ship with SSDs.
Disks will go the way of tapes. You'll be able to get them, but the practical uses will be few.
In reality, I imagine that more computers (yeah, I count smart phones and tablets) are now sold with SSDs than disks.
As to your actual question about accelerators - I have no idea. I went solid state a couple of years ago and won't be going back.
SSD prices have fallen quickly, while hard drives have gone up. If you don't need large amounts of storage it's better to just go SSD. But what if large amounts of storage are needed?
I would recommend buying an SSD, putting the OS and all applications on it, and then using a magnetic drive as the "users" volume. Any sanely laid out OS makes this very easy. The OS and Apps will load quickly, the large items (like video) will be stored on the cheaper, larger disk storage. No "hybrid" algorithm to worry about working. Two separate parts that can be upgraded independently. No OS support required. Perhaps some acceleration of some small data files will be missed, but the large ones would have never fit in the accelerated flash anyway.
I do think that file systems need to evolve in a new direction. ZFS is a preview in the right direction, but it would be nice to have a file system where you could add ram disk, or flash disk and tell it to be used as a "cache" for underlying disk, write through or write back. Easy to do in software. Plus better backup and replication support. I'd really like to configure my laptop with a 2TB spining disk, 256G super-fast SSD, and give 1G of RAM to the file system. Tell the file system to write everything through to magnetic, cache frequently used in SSD and RAM. When I'm on the hope network replicate the spinning disk to my NAS bit for bit. Perform incremental backups to my cloud backup service when connected to a fast enough network using compressed incremental to save space. Give me all that with ZFS's other features and it would be sysadmin filesystem nirvana...
i dont know about windows, but, wouldn't a more elegant way to accomplish this be paging? having a very large swap on the SSD portion and a very high swappiness value would sort of do what this intends to do, without such an end-run around the entire cache architecture of the OS
1MB/s will only take 30 years!
256GB
assume 20% over-provisioning
307.2GB * 3000 writes = 921,600GB
921,600 * 1024 = 943,718,400MB
943,718,400 / 3600(hours) / 24(days) / 365 (years) = 29.925years
With all programs opened, HD IO is closer to low 10s of KB/sec, not MB. Most of my IO is network traffic.
After a year of randomly benchmarking my SSD, having to reinstall Windows and 100GB of games a few times due to mistakes, it still is at 0% worn. At this relatively heavy usage rate, it will take more than 100 years to burn it out.
TFA at extremetech isn't that feature rich, nor embarking on a brand new frontier that none of us had ever been
TFA could have been made into ONE PAGE, but no, extremetech ain't gonna let us, the readers, enjoy it in one shot - we had to click through all the 5 pages
Please, Slashdot !
Next time you give us a link to a single TFA with multiple pages, please indicate it right upfront
Thank you !
Muchas Gracias, Señor Edward Snowden !
ZFS already supports flash devices for caches. For read caching (L2 ARC), you can create striped cache volumes. You get better speed that way, and if one of the devices fails, ZFS knows it and just goes straight to the main storage volume (the one being cached). Meanwhile, the other drive continues. For write caching (ZIL), since the data is "worth" more, you can create a mirror of flash devices. The benefit of the ZIL is realized even if the cache is small, but unfortunately SSD write speed can be worse than writing to regular drives (see below about SLC drives).
The best theoretical configuration would be, at a minimum:
- two small (and fast) SLC devices, mirrored and used for write caching
- two large(r) MLC devices, striped and used for read caching
- a redundant array of inexpensive drives (someone should come up with a catchy term for that), of huge capacity but otherwise slow (5400 rpm)
In place of the SLC drives, there are even more expensive (but higher performing) options, such as a bank of volatile RAM with a battery backup, and an SSD that the RAM contents get copied to in case of a power loss. These exist, and really work. The theory of a pyramid of caching; with "slower and cheaper" at the base and "faster and pricier" towards the top really has been shown to work.
ZFS can do all of this right now, and continuing a little off topic... can also do compressed incremental volume snapshots sent into the cloud :)
Yeah, I do a lot of work with ZFS. All of this stuff really works.
Dude, that is the 5,000 hour bug.
Update the firmware.
http://bit.ly/O1Fvzj
http://hothardware.com/News/Crucial-Acknowledges-Weird-5000-Hour-M4-SSD-Bug-Promises-Firmware-Fix-in-MidJanuary/
http://www.crucial.com/support/firmware.aspx
SSD aren't just for high end systems. Out of my 300 or so past customers, approx 3 filled their hard drives to over 60GB total. I built several Kingston HyperX 90Gb and OCZ Agility 4 128GB drives without problems and they were all $500-600 final cost. I use an H77MA-G43 from MSI + 4GB Gskill 1333-CL7 memory and i3-2100 or 4GB 1333-CL9 and a Pentium B940-960. Put it in a decent $30-40 case, use an Antec VP450 or Basiq or other respectable but medium end PSU, and wait for a sale on Win7 64-bit OEM copies for $80 instead of $100 and you've got yourself an unbeatable, 7 year anticipated lifetime machine. Here's the kicker.
I have an i5 (sandy) ridiculous gaming computer with a GTS450, 8GB of CL7 RAM, P67 chipset, and a pretty fast 7200 RPM 1TB Seagate main drive. It's custom built and would be around $1000 retail at my shop (at the time at least). It takes over a minute to log in and it takes forever to load games.
I also built a system I'm selling for $520 with a Pentium B950, 4GB of pretty standard RAM, and a Maplecrest 60GB SSD. It logs into Windows in 4 seconds. The glowing balls don't even touch while loading the Windows 7 logo.
SSDs are not for high end systems only! They're specifically exactly the opposite. They're the best way to make a really cheap budget PC seem extremely fast.
last year is years ago?
Indeed. The drive didn't even exist 'years ago'.
Someone below posted a similar bug with a different model of SSD. 'Update the firmware' seems to be a regular occurrence once you start using SSDs; so far I've never had to update the firmware on a hard drive.
Hybrid drives have been on the market for years. It seems to me your risk exposure is only increased by combining the two. You now have to worry about the perils of spinning platters, oxide eating flash write operations and new management technology gluing the systems together not widely deployed.
The last I checked about a year ago there were overwhelming negative comments related to reliability of hybrid drives. Even assuming all the bugs have since been worked out seems like such a fleeting and pointless stop-gap measure as to not be worthwhile.
I have enough memory that most applications load instantly from the operating system cache. 32GB of ddr is readily available for less than $200 ... nothing involving a SATA bus can be faster than the operating systems main memory disk cache.
Hopefully memristers or other technologies will pan out soon and we can be done with slow, power hungry access and inherently unreliable storage mediums once and for all.
Comment removed based on user account deletion
Comment removed based on user account deletion
When I got my new Z77 board last week, I managed to slice my 120gb SSD into two parts. 18gb for Intel's cache system, and rest for "Data" - aka Windows install.
I configured the SSD to cache my 2tb spinney a bit, and it generally worked as expected. Performance ranged from clean SSD speed some places, to in worst case old HDD speed.
In other words, worst-case scenario was same as not having cache, and best-case scenario made it look like a 2TB SSD at no extra cost :)
I've currently disabled it, since currently I'm re-installing my steam games (over 300 in total..), but will re-enable it when the data is a bit more static again.
So far I consider the experiment a huge success, even though it complicated the install somewhat (SSD cache can only be configured from Windows, and only if the SSD is not running the OS).
It's The Golden Rule: "He who has the gold makes the rules."
The cost benefit of SSD's barely makes sense - the makers got greedy and decided to tack absurd price premiums on their gear far in excess of their benefit. And they've stayed there.
If it requires O/S level drivers to implement the cache, then it's NFG.
SSD caching has promise, but it needs to be done in hardware, and be completely transparent to the O/S on top of it.
Absolute minimum latency for a fetch is 16ms on USB port
Where are you getting this number? I develop USB devices (Cypress FX2 Hi-Speed and a PIC for Full-Speed), and a USB Hi-Speed microframe is transmitted every 125 microseconds. When I initiate transfers, they almost always go out during the next microframe. I can and have sent two packets back and forth in a single millisecond, and that's without sending multiple packets per microframe (I believe I've seen up to 17 bulk packet transfers in one microframe before in a Cypress app note comparing bulk to isochronous).
The only USB devices I'm aware of with such poor latency are keyboards and mice, because they're generally low-speed devices.
Is this 16ms fetch latency some artifact of the OS? Because it's certainly not a limitation of the hardware and software, as I can personally attest to.
:(){