Seagate's Shingled Magnetic Recording Tech Boosts HDD Capacities to 5TB and Up
crookedvulture writes "Seagate has begun shipping hard drives based on a new technology dubbed Shingled Magnetic Recording. SMR, as it's called, preserves the perpendicular bit orientation of current HDDs but changes the way that tracks are organized. Instead of laying out the tracks individually, SMR stacks them on top of each other in a staggered fashion that resembles the shingles on a roof. Although this overlap enables higher bit densities, it comes with a penalty. Rewrites compromise the data on the following track, which must be read and rewritten, which in turn compromises the data on the following track, and so on. SMR distributes the layered tracks in narrow bands to mitigate the performance penalty associated with rewrites. The makeup of those bands will vary based on the drive's intended application. We should see the first examples of SMR next year, when Seagate intends to introduce a 5TB drive with 1.25TB per platter. Traditional hard drives top out at 4TB and 1TB per platter right now."
... for a significant reduction in speed?
No thanks.
Great warrior...hrmph! Wars not make one great.
rewriting data compromises data on the next track, which needs to be read/written, which compromises...
So you need to rewrite the whole damn 5TB disk?
"higher bit densities come with a penalty"
That sounds like an understatement.
A road map from WD has them putting 5tb drives on the market around ~nov-dec this year http://image.torrent-invites.com/view.php?filename=997wdred2013.jpg http://image.torrent-invites.com/view.php?filename=935wdgreen2013.jpg
People will just blame Windows for the sluggishness.
Sometimes I wonder if they already have the technology to make 50 or 100 tb drives and they are just trying to keep their profit margins up by incrementally increasing storage at a fixed rate every year.
I switched to SSD technology and I'm never going back. Yeah ok there are no 5TB drives yet. And 1TB is still insane. But 512GB is almost affordable, 256GB certainly is. If I need more storage, I'll just keep buying more. And eventually the price on the large drives will also come down. Sorry Seagate, the game is already over except for very specialized, very niche storage roles.
Seven puppies were harmed during the making of this post.
I can only imagine how long it would take to use a defrag program to degrag that drive. And dont get me started on using something like spin-rite to do a hard drive diagnosis where it needs to read and write to the heads many times trying to pull data off an iffy platter!
Yep, they've had it since 2004, when all twelve of the drive manufacturers agreed to just sit on it while Western Digital kicked their butt in the marketplace. Nine of them went out of business rather than reveal their secret.
I have to seriously question the retention reliability of a device that requires re-writing multiple tracks at one time.
The performance impact is obvious as well.
I think I'll avoid these like the plague until they're proven to be as reliable as older technology.
I do not fail; I succeed at finding out what does not work.
Except for some corner cases ? Given that Samsung also learned how to stack their NAND flash and CrossBar technology is almost there ? Traditional disks are almost dead at this point. Relatively high price of SSDs is the only thing that keeps them alive and price is going down fast. 4TB 3.5" SSD drives are already available and 2GB 2.5" drives are certainly possible (if SSD controllers are capable of handling such capacities). Any significant breakthrough in sold state storage technology (vNAND, CrossBar, anyone ?) makes SSD advantages only bigger and there seems to be a lot of room for improvement in this pretty much like in HDD technologies 15 years ago. My bet is that SSDs will take over traditional HDDs in all aspects (including price) in less than 5 yars.
A question: how can I find out the number of platters in a particular hard drive model? Seagate still lists areal density on its web site, but I was unable to find this information for WD. Naturally, Amazon and Newegg never tell you these things. So where can those of us who'd much rather have a single-platter drive find out which ones those are?
For some workloads these things will create nothing but problems. And all that for a 20% density increase? Sounds quite stupid to me.
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
You do not have to re-write multiple tracks each time.
Firmware adds the data at the end in an unwritten area and marks the old area "to be reclaimed" reclaiming can be done during downtime and is done safely.
Reclaiming works by reading the data for the other tracks in the shingled block and appending those at the end. Then, once that is verified properly copied, you mark that whole old block as free.
The only issue there is fragmentation. Need very smart firmware to do reclaiming without introducing fragmentation so reclaim probably best done by the OS. (ok, there is the other issue of overwrite not truly erasing data)
I have had drives from every manufacturer but one fail in warranty or just out of it, and I've had drives from all manufacturers last for years and years without issues.
All the hard drive companies have made some good drives and some bad ones.
(The one that never died prematurely on me was Micropolis. I had their server-grade drives.)
Given Seagate's track record with forays into fancy new hard disk technologies, let me be the first to say NO WAY IN HELL AM I GOING TO TRY THIS... until at least a second or third gen has the bugs worked out.
I was fool enough to try their terabyte drives with their nifty vertically-oriented bit techniques. Went through six brand new hard drives in one month. SIX! Two drives RMAed three times. Finally told Seagate that I'm not going to be their guinea pig anymore, and that I'm going to shelve the drives and to call me when they iron the bugs out. That was over 2 years ago and I haven't heard a peep.
In Soviet Russia, dot slashes YOU!
>Seagate has begun shipping hard drives based on a new technology dubbed Shingled Magnetic Recording....We should see the first examples of SMR next year, when Seagate intends to introduce a 5TB drive with 1.25TB per platter.
These two things don't match.
The read-modify-write penalty for overwriting existing data in-place is huge (even with attempts to minimize it with smart block mapping) and not worth the very minor increase in areal density. It's a bad sign that the storage industry was forced to adopt this because it means better encoding technologies are further off in the future than originally anticipated. Brick wall.
I'm glad to see that unlike some other well-known technical blogs, Slashdot has pushed aside new revelations about our Police State to pass along important product roll-out press releases from the biggest tech companies.
You are welcome on my lawn.
I have a 1.5TB drive that's been in service for nearly 5 years.
I usually retire drives not because of failures or disk errors but due to capacity. I've seen drives from 500G up to 4TB and hammered drives of all sizes.
Capacity doesn't really impact longevity.
A Pirate and a Puritan look the same on a balance sheet.
The read-modify-write penalty for overwriting existing data in-place is huge (even with attempts to minimize it with smart block mapping) and not worth the very minor increase in areal density. It's a bad sign that the storage industry was forced to adopt this because it means better encoding technologies are further off in the future than originally anticipated. Brick wall.
If it means that rotating media no longer has a write performance advantage over flash, then it is a very poor compromise indeed.
I buy several hundred drives a year and I've consistently had more problems with all non-Enterprise Western Digital product lines than with I had with Seagate, Hitachi or Samsung models. By rough order of preference, I found WD "Blue" drives least reliable, followed by WD Green, followed by Seagate Eco models, followed by WD Black. The most trouble free drives over the last five years or so? Samsung's F-series and Hitachi DeskStars. Goddammitsomuch.
-- I wanna decide who lives and who dies - Crow T. Robot, MST3K
If it means that rotating media no longer has a write performance advantage over flash, then it is a very poor compromise indeed.
What is this, 2008?
Rotating media hasnt been competitive in write performance for quite awhile now.
"His name was James Damore."
I usually retire drives (to the storage room) when they become full. By then they're obsolete anyway. Anybody know the shelf life of a hard drive? Should I run them like the air conditioner every so often?
“He’s not deformed, he’s just drunk!”
But if you edit a single point in the first layers of the hard drive, you have to re-write your entire hard drive down? What happens when the power goes out before you're done writing? Does it rewrite entire tracks or just the magnetic domains that are compromised? How does it even know certain tracks have valid data or will it require a proprietary driver to make it work?
Custom electronics and digital signage for your business: www.evcircuits.com
I may not want this because I see TV commercials all the time that say that I can get Shingles already if I've had the Chicken Pox. Supposedly there's a med that I can use to get rid of it or prevent it.
Harrison's Postulate - "For every action there is an equal and opposite criticism"
This is all well and good, but couldn't just one manufacturer afford to set aside one measly manufacturing line for making 5 1/4 inch Hard Drives again?
Here me out. Now that they are up to 1TB per platter with current tech on 3.5 inch drives just imagine what they could fit into a 5 1/4 inch drive now!!
I know I wouldn't be the only one willing to shell out bux for one of those, providing they used all that space intelligently: With Data Spaces that large it would pretty much be a requirement to include built in internal Mirroring RAID of some sort between the platters, or at least provide the option, for data integrity and protection and longevity of the unit.
I've been salivating over that dream for years now.
You mean like the bargain-bin SSDs that have almost 500MB/s of write performance.
What happens if you suddenly lose power?
bullshit on "done safely", instead of loss to a single file a power loss or unexpected interuption wil be devastating to the intergrity of an enormous amount of data.
4TB, I believe. AC's conspiracy theory is that all the drive companies have had 50TB drives they've been hiding. Since most of them have been driven out of the hard drive business, I guess they were so committed to the conspiracy that they'd rather fold than get rich selling huge drives.
Such is the logic of the left-wing nutjob conspiracy theorists. Damn the NSA for making them right about something. Even a broken clock is right twice a day.
Do not want and WILL NOT BUY EVAR.
It's way, way, way too much of a crippling performance and reliability hit for a laughably miserably tiny capacity gain. 25%? Are you kidding? I'll buy two 4's to get 8. I'll never buy a 5 to replace a 4. Maybe, just possibly, if it gave a 300% capacity gain I might possibly consider it for data where speed and reliability does not matter at all. Hmm, come to think of it, I guess that covers a big fat ZERO percent of my needs. So, no. Just no.
Never had a Micropolis SCSI 5.25" or 3.5" fail either. They were built to last forever. OTOH, I distinctly remember paying in the neighborhood of $2000 for 300's and then again for 1000's. That's MB, not GB, BTW.
I can't match your duration individually, but I have a huge failure-free aggregate duration of 2 and 3TB drives.
I have a total of 22 Samsung HD204UI 2TB 5400rpm (the last 4 were actually Seagate rebrands, but same design). Power-on hours 7574, 8090, 8098, 8592, 8609, 8690, 8691, 9330, 10,041, 10,105, 11,612, 11,612, 11,676, 11,676, 16,730, 17,270, 17276, 17,769, 17,769, 18663, 18663, 19650.
Also 7 Hitachi/Toshiba (another buyout) 3TB 7200rpm. POH 2133, 2761, 2766, 2925, 3533, 3598, the 7th one is not online to check at the moment, but not because of failure.
None of the 29 have any reassigned or failed sectors or any other indication of any problem to date, including SMART readouts. All of them have operated 24x7 for multiple periods of multiple months at a time. Purchases were spread over the last 7 years if memory serves.
OTOH I just recently had a 1TB WD current production RE4 Enterprise drive fail catastrophically after something like only 1000 hours.
I have had car air conditioners sit for periods of up to a YEAR without being turned on, and never had one fail yet. I had one car for 18 years and never once even started the engine from december through april of every year. The car including the AC still worked fine until rear ended and totaled in the 18th year. Another car sat from 1999 to this year in the driveway. Finally somebody bought it, and he says the AC still works fine. So much for that old wives' tale.
I don't think hard drives degrade in storage. I've had them sit for multiple years and then put them back into service without any problem. I have some SCSIs that haven't been run at all since the 90s that I might try just for fun and to see if those old files include anything good.
They made perfectly good 5.25" Hard Drives for quite a few years before they went with the 3.5" and now the 2.5" format. The size of the platters isn't really the problem at the lower data densities that drives had back then. When you move to higher densities and "smaller bits" on the media, the bigger platters tend to vary in exact placement a bit more, both due to the distance they could have from the spindle and the basic fact that almost all solid materials expand as they get warmer. This means that you can't get spindle speeds as high with big drives, or you have to invest in a lot of technology and materials to keep the whole thing stable. That would make the drives too expensive, resulting in a price/performance trade-off that put the bigfoots at the wrong side of the curve. Also, because you can't counter all of the effects completely, data density would still be lower on the bigger platters than on the small ones. You could by some really crappy hard drives in the era of the bigfoots, but their capacity got superseded by reliable 3.5" drives in less than 12 months at the same price point, so Quantum figured it was no use investing in the product line pretty fast after they introduced them.
I was promised a flying car. Where is my flying car?
I guess there was some significant trend of failures with Maxtor disks. People said that service departments could see statistically higher returns of Maxtor brand. I never saw the numbers though. I personally had one 40GB IDE Maxtor disk and it was rock solid, one of my best 3.5" HDDs.
So I guess HAMR is still in the labs.
You are ofcourse correct in that current methods of manufacturing is geared towards miniturization. But think outside the box for a minute, or rather, think INSIDE the box. Given the size available in a 5 1/4", you can easily fit say, 6-8 2,5" drives. Give a little room for some NAND chips and a raidcontroller, and you can actually have a pretty decent piece of storage tech available in a single 5 1/4" unit.
IMO, I think the reason for NOT doing this is the fact that the market for this type of technology is too small. Desktop sales are at an all time low, and tablets are all flash memory. External drives are usually 3,5", and laptops exclusively 2,5". High end servers and businesses are using SAN, which makes your identifiable market small servers and high end home PCs. The first is dying due to virtualization, and the second is probably not large enough to warrant a new development.
As your last paragraph pretty much points out, the technology just doesnt have sufficient lifespan to warrant production.
And given that same knowledge, that size will increase regardless of this new SMR technology, I predict this technology wont live long.....
--- To err is human... Am I more human than most ?
Many can now sustain 400MB/s+ for several GB, even when near capacity and in a used state, and with no compression.
armchair? no, I do data center devops in the real world
I heard the AC thing is about mushrooms growing in it, which could somehow contaminate you or whatever, so you had to run the AC once in a while (even in winter) just to vent the air out.
About HDDs there's a saying the bearing fluid can solidify, after about a decade. So maybe you need to spin archival HDDs once every three years or whatever abritrary time you choose.
Because "those evil business people are hiding the good stuff" is a left-wing belief. Not necessarily wing I guess, did you notice in the campaign Obama motivated the center-left by saying "corporations" every sixth word.
Right wing nutjobs believe entirely different nonsense.
If you don't want crap growing in there, always turn off the AC well before you're going to shut the car off, and leave the blower running until only warm air comes out. Just shutting the car off with the AC on, or one second after turning the AC off, is gonna make it smell like hell the next time you start the car due to stuff growing in the condensation.
Interesting story about oil solidifying or congealing. I'm not buying it until I observe it happen.