Slashdot Mirror


Mass Storage Leaves Microchips in the Dust

Roland Piquepaille writes "This article from Wired Magazine looks at storage with a new angle. 'Right now I am sitting in front of a whirring 60-gigabyte hard disk that cost less than $100. Do the math: If back then 10 megabytes cost $1,000, then 60 gigabytes would have cost x, where x = $6,000,000 and "back then" = 18 years ago. I'm sitting in front of $6,000,000 worth of mass storage, measured at mid-1980s prices. We have Moore's law for microprocessors. But who's coined a law for hard disks? In mass storage we have seen a 60,000-fold fall in price -- more than a dozen times the force of Moore's law.' DeLong also looks at a non-distant future when a $100 mass storage device will hold a full terabyte. He also thinks that with disk space becoming cheaper and cheaper, we'll be tempted to archive everything about ourselves, including pictures and videos. This is in fact the goal of the Gordon's Bell project, MyLifeBits. You can learn more about the MyLifeBits project by reading this NewsFactor Network article. Check this column for more details."

19 of 400 comments (clear)

  1. Price by larry2k · · Score: 5, Interesting
    If back then 10 megabytes cost $1,000, then 60 gigabytes would have cost x, where x = $6,000,000 and "back then" = 18 years ago

    No only the price, the size of the drives. 18 years ago a 40 Mb HD has the size of a toaster...

    --

    The package said "Windows XP or better. Pentium Class Processor or better"... So I got a Mac with OS X

  2. iPods for Example by tbmaddux · · Score: 4, Interesting
    Look at the iPod... it's been out for 27 months and its capacity is up to 30GB from 5GB, or 6x. That is, on average, a doubling in size every 9 months!

    In general the problem is that while capacities have lept up, the rate at which we can read/write to those drives has not kept pace. It's not so bad for the iPod in particular, but at some point it's going to be a real problem for desktops and laptops, assuming our appetite for capacity grows as the capacity does.

    --
    Can't you see that everyone is buying station wagons?
    1. Re:iPods for Example by theLOUDroom · · Score: 5, Insightful

      In general the problem is that while capacities have lept up, the rate at which we can read/write to those drives has not kept pace.

      No, not really. The sustained transfer rate of HDDs has been steadily improving. It's obvious if you think about it. The drive stays the same size. The density goes up. The disc spins at the same rate or faster. Therefore, more data goes by the heads per unit time. This means trasfer rate will also increase. Specifically, this means that the transfer rate will scale linearly with the density of the disk.

      What hasn't improved at the same rate as density is seek times. Seek times have always been the killer for mechanical storage mechanisms. They have to move something around and they have to obey Newton's laws.

      In order for seek times to improve at the same rate as the rest of the drive impoves, we would need improvements in materials science and motor design which far exceeded those that increased density.

      The other neat thing to think about is the spinning discs inside the HDD. Both those impovements I just mentioned might also allow you to spin the platters faster. This means that you could actually increase the transfer rate of your drive as well.

      The immediate problem I can see is that moving something back and forth doesn't scale as nicely as storage density. Here's an example:
      Say you've got something that you need to get from point A to B. Say you can do it in 1 microsecond. If you want to be able to do it in 1/2 microsecond, you need 4x more force. This means you need a motor with 4x more force, and a material that's 4x stiffer and 4x stronger.

      Even if materials science, and motor designs were improving at a rate comparable to "Moore's Law", seek times wouldn't. Some things just don't scale the way we would like them to. Batteries are a good example.

      Correction: You need a material that has 4x better strength to weight and stiffness to weight ratios.

      It's also worth considering that you have to burn 4x more energy to move something from A to B twice as fast. Power dissipation in CPUs scales linearly with clock speed.

      --
      Life is too short to proofread.
  3. Recording Everything? by Bob+Vila's+Hammer · · Score: 4, Funny

    I don't want to see Gordon Bell's "lifebits"

    --


    --"The perfect example of the man of action is the suicide." - William Carlos Williams
  4. Bloat will kill the increase in storage available by jgaynor · · Score: 4, Interesting

    Bloat will kill the increase in storage available - one way or the other. It'll be a 3gig version of word, or windows movie maker that will only save in raw, non-compressed video. Anything to drive the market. We've seen it with processor speeds, if HD prices keep dropping I'm sure well see it with storage as well.

    Come on, is XP is SO far ahead of NT 4 that it requires 4x the ram? Of course not. But what MS reccomends, PC manufacturers will have to yield to.

  5. Only a terabyte? by gricholson75 · · Score: 4, Interesting

    He's predicting only a tearbyte for a $100 in 2012. Right now desktop drives are about a dollar a GB. So, he's predicting about a 10 fold increase in the next 9 YEARS!!! What have we seen in the last 9 years, about 100 fold increase?

  6. for now by SHEENmaster · · Score: 4, Funny

    but wait until the RIAA starts charging in advance for piracy. They can do $15 for an album, or charge $15000 per song ammounting to $1,485,000 for a single recordable disc (99 possible tracks).

    --
    You can't judge a book by the way it wears its hair.
  7. It's freaky by Apreche · · Score: 4, Interesting

    An interesting feature of OpenNap is that it tells you exactly how many MB of files are out there for your downloading pleasure. I used to be blasted away at the large number. Sometimes I could get it up to 1 or 2 pedabytes.

    A terabyte is 1000 gigs. You can get a terabyte of storage today for $1000 dollars. One dollar per gig. It's insane. Soon it will be a dollar a terabyte. We wont need things like divx anymore. We'll be looking for ways to increase the quality of our recording devices so that the video, image and audio files will take up more space. Nothing else really requires a large amount of storage.

    The one limited is network speed. Sure, if I've got enough room for a collection of 2 gigabyte raw avi movies, that's great. But if I can't get enough speed to download them quickly it will suck.

    Storage aint worth crap if you dont' got enough stuff to fill it.

    Remember the days when DOS games would ask questions like this

    minimum install (if you're low on space)- 50MB
    standard install (reccommended)- 100MB
    big install (runs faster)- 250MB
    CRAZY INSTALL (no cd required!) - 500MB!!!

    those were the days...

    --
    The GeekNights podcast is going strong. Listen!
    1. Re:It's freaky by Rob+Parkhill · · Score: 5, Interesting

      The one limited is network speed. Sure, if I've got enough room for a collection of 2 gigabyte raw avi movies, that's great. But if I can't get enough speed to download them quickly it will suck.

      This has always bugged me... back in 1992, I had a 25MHz CPU, 8MB of RAM, a 660MB hard drive, 2.88MB floppies, and a 28.8 modem.

      In 2003, I have a 2.2HGz CPU (88 times faster), 1024MB of RAM (128 times more), a 120GB hard drive (180 times more), 700MB CD-RWs (243 times bigger) yet only a 1Mbit (on a really good day!) network connection (about 35 times faster, no matter what the cable company claims.) And that's as fast as it has been for about 5 years now.

      Where oh were is my 5Mbit cable modem? Heck, some poor bastards are still stuck using 56k modems...

      It seems that network connections ony get faster in big bursts. In 1997, I had a 56k modem. In 1998, I had a 1Mbit DSL line. Maybe in 2008, I'll get fibre to my house.

      --
      "Tomorrow's forecast: a few sprinkles of genius with a chance of doom!" - Stewie Griffin
  8. Re:Bloat will kill the increase in storage availab by tbmaddux · · Score: 4, Funny
    3gig version of word...
    No, no, no, NO.

    It will be a 3gig version of IIS, .Net, or whatever. The extra 2.9gigs are bundled data so you can buffer overrun yourself.

    --
    Can't you see that everyone is buying station wagons?
  9. Re:Wow! by The+Dobber · · Score: 5, Funny


    Moores Law for Microchips
    (doubles every 18 mnths)

    Porns Law For Storage?

  10. Re:yeah, but... by dAzED1 · · Score: 5, Insightful
    "microprocessors have gotten faster and faster. hard disks have not."

    Good lord! Are you serious??? You obviously never had to use debug to partition an esdi drive. You obviously have somehow missed the whole transition from 10Mb burst to 160Mb burst we've seen in the last few years. Scsi has, as well, gone from 8-bit with 5Mb transfer (scsi1) to 10Mb transfer @ 8bit or 20Mb transfer @ 16bit (scsi2), 40Mb transfer @ 16bit wide (scsi3) and now 80Mb transfer @ 16bit wide with ultra2. And while that's just what the *bus* can handle, I can promise you that the disks of today are far faster than the disks of even just a year ago.

    Ask yourself...what restricts data fransfer speed? Several things, really. Density is actually a factor, as its an engineerign feat to get the disks spinning fast, so the more bits go past the heads during a given time, the more can be put on/pulled off. Also, the ability to process that data, which - guess what, has significantly increased. Then there's the length of time a head needs to spend to actually get a bit to seat at a N/S, 0/1 - materials platters are made of are constantly being improved, so that's far better. Then theres the mamangement of the data itself, algorythms for where to write what, etc. Again, substantially improving, constantly. And all I've discussed was scsi - ide has improved (has quantity on its side) far more than scsi has the last few years, too.

    How in the WORLD could you say hard disks haven't gotten faster? Oh wait, I know how...because you are either being sarcastic, you're insane, or you simply have no idea what you're talking about. Did you just start using computers last week?

  11. Processors = reliable, hard drives != reliable by SuperBanana · · Score: 4, Interesting
    But who's coined a law for hard disks?

    Except that processors don't just give up the ship randomly(well, except in VERY rare circumstanecs)- drives do it all the time; it's almost expected. I don't give a crap about another 20GB or $20 off, I want a hard drive that won't turn itself into a paperweight after a year or two. If I'm going to own the drive for 5 years, what's another $20?

    SMART was an improvement, but most OS's(linux included) don't even recognize SMART info out of the box. Even if you've got the SMART utilities installed and the kernel modules etc, /var/log/messages is so noisy, I mostly ignore it- same for Win2k boxes, Event Manager is full of TONS of crap(thank god it has filtering, but still...) If SMART were to be useful, the HD would beep at you, or blink its LED, or the OS would annoy you with popup messages so you knew, "oh shit, I gotta back up my stuff to somewhere else, NOW!"

    I had an ancient 4GB Digital drive I got second-hand, in the early 90's; it was already several years old when I got my hands on it, so it was probably pre-90's. It weighed a ton, took up the full space of a 3.5" drive bay, and even had its own little suspension system. I abused that thing to hell and back, carrying it in bookbags, cooking it when the fan on the external case died...the whole nine yards. I think I low-level formatted it a dozen times(something you're not supposed to do often on SCSI drives, supposedly). It only finally gave up the ship around '99, when it spent a couple months cooking itself to death hooked up "temporarily" to a machine I forgot about.

    Meanwhile, I've lost two quantum drives(one laptop, one Ultra2 3.5") and my athlon's Maxtor drive is making funny noises every once in a while. None of them were more than 2, 3 years old TOPS. WTF? The excuse seems to be that consumers don't need the reliability corporate users 'demand'.

    Home users users have, at the very least, equal needs as business users, because while businesses need to keep going 24x7, they often have backups, clusters, RAID units, etc. Most home users don't have any of their data backed up, RAID is practically unheard of among the jane-and-bob computer users, and of course no clustering.

  12. Re:Faster than moore's law by nomel · · Score: 4, Informative

    By "process it all", he probably means being able to address the area on the disk (think extremes).

    By go over into negative integers, integers are an allocated space in memory that holds a number...if the number is bigger than the allocated space, what does it do!? 11111111 + 1 = 00000000 (keeping 8 bits of data). Look up signed integers. Since it's just binary...how can you represent a negative number? Well, you can't directly, you do it with little tricks that everyone agrees on. Look it up...you obviously need to.

  13. Latency is not really moving though by Oestergaard · · Score: 5, Interesting

    Drives today have 10.000 rpm or 15.000 rpm. Eight years ago the high end was 7200 rpm, 5400 before that...

    That's approximately a 2X performance increase per EIGHT YEARS. This is very very far from being impressive.

    Disk seek time is dominated (today) by rotational latency. The fastest disks have seek times around 4ms, and that is pretty much the rotational latency on a 15000 rpm disk.

    In order to improve disk performance (the seek time, not the throughput), disks need to spin faster. This does pose some interesting problems though...

    A normal 3.5" drive has a platter with approximately 48mm radius, giving roughly 0.3 meter circumference. At 15000rpm the speed of the circumference is 75.4m/s.

    Doing the math, this gives us a centripetal acceleration of v^2/r = 118435 m/s^2, or roughly 12085G. Sure as hell beats most drag racers out there (by more than a factor of 12000 ;)

    The fun part is, that a simple doubling of the rotational speed, will do really interesting things to the acceleration (note the v^2 thing above).

    A 30000rpm disk will have a centripetal acceleration of the circumference of approximately 48000G.

    A mass-element at the circumference weighing one gram, will have a "pull" corresponding to (F=m*a) 118kg - which again will be approximately half a tonne on the 30000rpm disk.

    You need to find a material that will weigh little, not deform under the given stress, and still have the necessary properties for use as a hard drive platter...

  14. Actually, performance gains for disk drives ... by Glonoinha · · Score: 4, Insightful

    Consider the IBM XT 4.77MHz with a factory default formatted 17 sector per track MFM hard drive with a 6:1 interleave. The peak throughput of this machine was roughly 87 kilobytes per second.

    Now consider the new SATA machines with measured (not calculated) throughputs of 87 megabytes per second.

    This is a 1,000x fold increase. For CPU processer throughput (speed) to keep up with this performance at the same rate, you would be able to buy a machine with a 4.77GHz CPU in it. Right now the fastest stock boxes are running what ... 3.06GHz, maybe a touch faster?

    CPUs have gotten faster. Hard drives have gotten faster faster.

    --
    Glonoinha the MebiByte Slayer
  15. Re:Bloat will kill the increase in storage availab by Teancom · · Score: 5, Insightful
    A library that saves you 3hrs on a project that takes a year is not good. A library that saves you 3 days on the same project... not good. a week, still not good. A month... now we are starting to consider using the existing library.


    While it's nice that you took the time to rant about how much better of a programmer that you are then everyone else (the whole "If I didn't code it, it's crap" attitude really shines through), I think your scale is a bit off.


    Lets say a library saves you a week. Now, lets say that like more people you use at least 4 libraries. Now, you've saved a month. A *month*, at which point you say you'll start to "consider" using external libraries. Well, I'm underpaid, but lets say you hired me to do this. By shaving a month off, you've saved over $3500 in my salary alone. And that's assuming that I (or anyone) could fully implement, *debug*, and "finish", a given complicated lib in 1 week. Great! Now, I quit, because I'm underpaid, and my replacement comes in. Now, I write good, well documented stuff, but it's not industry standard. So my replacement can't just sit down and pick up where I left off, but has to learn how *I* decided to implement libfoo. But it turns out that he's a lot like you, and thus 'he didn't write it, so it's crap'. And then *he* spends a month throwing away my stuff, and redoing it all. And on, and on, and on. There's a *reason* that things like Boost and Roguewave and Qt and Gtk and glib exist. And until you figure that out, you're doomed to be 1/10th as productive as you could be. Or, assuming that (as you claim) you've polished your libs to perfection and the productivity is there, I pity whomever has to take over your code. No, actually, I just pity you.

  16. The Math by bigattichouse · · Score: 4, Interesting

    Moores is the # of transistors/processing power every 18 mos... you're looking at price per byte.

    lets see what $100 gets you

    $100/meg = 1985 10 meg
    $50/meg = 1986.5 20 meg
    $25/meg = 1988 40 meg
    $12.5/meg = 1989.5 80 meg
    $6.25/meg = 1991 160 meg
    $3.13/meg = 1992.5 320 meg
    $1.56/meg = 1994 640 meg
    $0.78/meg = 1995.5 1.2 g
    $0.39/meg = 1997 2.4 g
    $0.19/meg = 1998.5 4.8 g
    $0.09/meg = 2000 9.6 g
    $0.04/meg = 2001.5 18.6g
    $0.02/meg = 2003 37.2g
    $0.01/meg = 2003.5 74.4g

    Looks like the curve is a bit faster than every 18 mo... I think 12 months might be a better approximation of storage/cost.

    --
    meh
  17. Re:Bloat will kill the increase in storage availab by Erwos · · Score: 4, Interesting

    "Basically if programmers still gave a damn like they did when writting code for C64's we wouldn't have alot of these issues. Nowdays they would rather churn out crap so long as it's better than some of the other crap they've seen."

    If you're trying to tell me we should go back to the days of non-portable assembly, I think I'm going to cry. Yes, people should write tighter code, but trying to make believe that we should write code just like in the "good old days" is ignoring years upon years of advancement in the field of computer science.

    And, also, look at what they were doing back in the days of the C64, and look at what they're doing now. You really do need more code to do more. Trying to tell me that they had 6kb executables with the C64 and then telling me our 6mb ones are bloated is ludicrous.

    -Erwos

    --
    Plausible conjecture should not be misrepresented as proof positive.