Slashdot Mirror


Vibration Killing Enterprise Disk Performance?

An anonymous reader writes "Is vibration killing disk performance? ZDnet reports on research that a carbon fiber anti-vibration rack increased random read performance by 56% to 246% and random write [performance] by 34% to 88%. Vibration is a known disk problem, but this is one of the few attempts to quantify its impact — which looks to be much greater than suspected."

35 of 159 comments (clear)

  1. Hmmm... by antifoidulus · · Score: 2, Funny

    So maybe sex in the server room IS a good idea! Not to mention all the puns you can make about racks.

    1. Re:Hmmm... by Anonymous Coward · · Score: 5, Funny

      Get off my Rack?

      In Soviet Russia, rack vibrates you?

      All your rack.....?

    2. Re:Hmmm... by thePowerOfGrayskull · · Score: 3, Informative

      A perfect example of why this type of joke flies right over the average /.er's head.

      So perfect, indeed...

  2. Old news is old by Anonymous Coward · · Score: 5, Informative

    Yes, already saw some crazed guy at Sun shout into an array of HDDs and it decreased performance.

    http://www.youtube.com/watch?v=tDacjrSCeq4

  3. Star Trek by robvangelder · · Score: 4, Funny

    Did anyone else think "how is Kirk going get out of this one"?

    1. Re:Star Trek by Bugamn · · Score: 3, Funny
  4. not surprising really by v1 · · Score: 5, Interesting

    It's a lot easier to interfere with a moving head arm than it is to mess one up that's locked on a track, so this isn't surprising in the least for vibration to affect reads that require numerous long seeks. I'm surprised it's not worse than they've found.

    Moving the head requires accelerated head stepping to top speed, stepping to close to the track, slowing down, stopping at the destination track, waiting for the head to settle, and reading an address block to find out where you managed to land. If you find you missed the track, you have to go through the whole seek process again. (usually only once more, those short adjustment hops are pretty reliable because they're lower speed) But that really hurts your single block read time.

    Add to that the fact that the "high performance" drives are making more risky higher speed track changes, which increase the odds of missing your target and make the operation more sensitive to vibration. I've written direct HDD io code before, and sure, you can up the step speed to get very nice seek time boosts, but then you start missing your track and start getting reseeks. Usually you go with the fastest that's acceptably reliable, and that puts you on the bleeding edge of having problems, where things like vibration can run you off the deep end of the bell curve.

    It wouldn't surprise me one bit if 50% of the "high performance drive" better speed is due to faster spindle speed, and the other half is faster (riskier) seek speed.

    --
    I work for the Department of Redundancy Department.
    1. Re:not surprising really by pspahn · · Score: 2, Insightful

      How difficult would it be to account for this vibration performance degradation in such a case?

      If you had some kind of vibration sensor that measured vibration levels, couldn't it then talk back to code telling it to slow down because there's too much vibration?

      --
      Someone flopped a steamer in the gene pool.
    2. Re:not surprising really by PopeRatzo · · Score: 4, Interesting

      For the computers in my music project studio, I've always used Scythe stabilizers for my hard drives, mostly to keep the sound down.

      But now that I think about it, the drives in my raid box are like 4 years old and not one has failed. I've thought about buying new drives to replace them, but as long as they're working and everything is backed up, I haven't bothered.

      I don't know if the stabilizers have had any effect on their longevity, but the little bit of care I take with vibration dampening when I build machines sure has resulted in some quiet machines.

      --
      You are welcome on my lawn.
    3. Re:not surprising really by v1 · · Score: 2, Informative

      should be possible to add a sensor (probably even on silicon) that can warn of higher vibration and slow the stepping, but I bet they don't do that right now.

      --
      I work for the Department of Redundancy Department.
    4. Re:not surprising really by Laser+Dan · · Score: 3, Informative

      Moving the head requires accelerated head stepping to top speed, stepping to close to the track

      I just want to point out that hard drives stopped using stepper motors decades ago. They've used voice coils since, which is basically an electromagnet and strong magnet which it deflects to various positions based on the field strength; in other words, it's continuous, not discrete like a stepper motor (though they can do microstepping as well). OK, so in a way, a voice coil is sort of like a stepper motor with only one phase, which is then microstepped...

      Well you are half right, but so is the GP.
      The GP's description is more accurate if you replace "stepping" with "accelerating".

      The head does not move to a position based on field strength (open loop control). It is free to move on low friction bearings, the applied field strength accelerates the head. Closed loop control is needed to make it stop at the correct position.

    5. Re:not surprising really by OffTheWallSoccer · · Score: 2, Informative

      The head does not move to a position based on field strength (open loop control). It is free to move on low friction bearings, the applied field strength accelerates the head. Closed loop control is needed to make it stop at the correct position.

      The servo firmware engineers I worked with went to great lengths to define and maintain (in real-time) the acceleration profiles for the actuator arm. The point is that the seek algorithm is fully closed loop.

      Originally they walked the fine line between all-out performance and reliability, but later they started slowing down the seeks (on 7200 RPM drives) to make them quieter.

    6. Re:not surprising really by textstring · · Score: 2, Informative

      The same techniques that silent PC nerds use to isolate their hard drive to keep it quiet would of course help reduce vibrations (I mean, that's the point). There is the thread detailing the techniques used to suspend/isolate HDD's at http://www.silentpcreview.com/forums/viewtopic.php?t=8240/.

    7. Re:not surprising really by adrenalinerush · · Score: 2, Informative

      I used to work in the HDD industry, and am very familiar with the seek algorithms used. Sorry, but your description of the move algorithm is completely wrong. Modern control implementations collect information about the actual output of the system (such as position) relative to the desired output (the target position) and act on it in real-time.

      Modern HDDs (as in, anytime in the last 15+ years) have 'servo tracks' written on the disk. These are radial spokes of distance information encoded on the disk. Today's drives may have as many as 500 or 1000 of these servo spokes. The head is able to read these as it seeks across the disk, so it knows where it is during the seek. There is no 'stopping, checking where you are and making an adjustment.' It's more along the lines of 'checking your position as you move, and adjusting the voice coil voltage to give the optimum velocity and acceleration to land in the right spot as quickly as possible.'

      There is an enormous amount of effort that goes into reducing the amount of vibration generated by the drives themselves, as well as minimizing the drives' sensitivity to external vibrations. However, there are specs for what the drives are able to handle, worst-case. By reducing the amount of vibrations they are subjected to, they will naturally perform better.

      Being Slashdot, we need a car analogy, right? Cars are made to deal with headwinds and still get acceptable gas mileage, but removing the headwind will increase a car's gas mileage.

  5. I saw the presentation... by georgewilliamherbert · · Score: 4, Informative

    ..at SustainIT 2010, Turner had a really good analysis. Still some gaps - figuring out what frequencies hurt the most, and how individual drive types respond to what, is necessary followon. How various vendors' drive units transfer vibration from the rack into the unit, into the drive carrier, into the drive. That sort of thing. Now that the phenomena is identified, a lot more to do on it.

    At the least, keep performance sensitive drives away from large sources of environmental vibration, such as your AC unit and so forth.

  6. Re:Anyone know why it affects SSD? by MarcoAtWork · · Score: 4, Informative

    the article does not say that it affects SSDs, but that it affects the SSD value proposition (aka, if you can spend little $$$ on carbon rack enclosures and get a significant seek performance increase, spending the large amount of $$$ to go full-ssd might not be as cost effective).

    --
    -- the cake is a lie
  7. Can't believe it by lalena · · Score: 3, Insightful
    From the article:

    that CS disk drives are more sensitive to the vibration from physically coupled adjacent disk drives.

    and

    The problem is that most civilians don’t understand the problem and are not willing to pay to solve it.

    Why should most people care about vibration caused by adjacent drives if most people only have one drive.

    The other issue from TFA is that I can't believe a different rack can cause 250% performance improvement, unless you really stacked the deck against steel racks - loose screws, hard drives not properly mounted...? I assume this means that current server racks see I/O rates that are only 40% of what is advertised by manufacturers. Are we expected to believe that no one has noticed this? What about multiple drives in a server. There is no rack separating those drives. This reads like marketing, not real research.
    http://www.greenplatformcorp.com/ is the site if you are interested and the "research" is several months old.

    1. Re:Can't believe it by georgewilliamherbert · · Score: 5, Interesting

      I've done some quick and dirty followups. Drive arrays on a concrete floor are much faster than those in a normal steel or aluminum rack with more drive arrays.

      This is real.

      You can demonstrate it with one drive array, a rack, and a solid floor. Put other equipment in the rack. Put the array in, test it. Stop testing, put it on the floor, start testing again. Put it back in the rack, test it again. The floor, test it again.

      There are some time delays involved as the drives adapt to higher and lower vibration environment - the mechanism here is the drive seems to be adopting a strategy of more error correction on reads and writes when it thinks the head's vibrating more. It will ramp that up and down as it figures out that the environment has changed.

    2. Re:Can't believe it by Burning1 · · Score: 2, Informative

      Why should most people care about vibration caused by adjacent drives if most people only have one drive.

      Some of the largest consumers of hard disks are enterprise companies with network attached storage, storage area networks, and RAID equipped servers.

      These companies have a very high density of hard disks, and spend a lot of money for high performance. It's not unheard of for such a company to purchase a huge array, not for capacity purposes, but for seek time and throughput.

      I'm sure they care.

    3. Re:Can't believe it by KahabutDieDrake · · Score: 4, Interesting

      Walk over to the nearest properly mounted rack array you have, and shake it. Does it move visibly? If so, problem identified. Most racks are built to hold things up. They aren't built with much structural integrity beyond what is absolutely needed. I've seldom seen a rack with any kind of proper cross bracing, and this makes them prone to vibration transfer. You make a valid point that this is presented as a "buy this product to improve your servers" kinda thing. However, the issues with vibrations have long been ignored, and maybe that needs to change.

      My personal anecdote is: Working for a small company dealing in terabytes of data (7 years ago), they got their first disk array. Previous to that, they were using desktops to store everything around the network. So, after months of pleading, they got me the disk array I wanted, and the failure rate was atrocious. Averaged to 1 disk per 90 days. The SAN we used sat on a flimsy filing cabinet right next to a high speed printer. Not touching, but close. After a while of trying to figure out the problem, I finally sold the bosses on the idea of turning one of the closets into a server room. I installed a rack, mounted it to the wall with dampeners, and installed the SAN into it. Along with 2 1au servers, and another brand new NAS. The failure rate plummeted. The original SAN so prone to killing disks worked it's ass off for 2 more years before any of the drives failed again. As far as I know it's only had 3 disks replaced in the 5 years since then. Seems reasonable to me to assume that vibration not only plays a role in performance, but in lifetime as well.

    4. Re:Can't believe it by Angst+Badger · · Score: 3, Informative

      unless you really stacked the deck against steel racks - loose screws, hard drives not properly mounted...?

      Depending on where exactly they are, loose screws might actually help you. Tight metal-to-metal connections are much better at transferring vibrations, especially the higher frequency ones, than looser connections, where some of the vibrational energy is converted into lower-frequency vibrations. Steel is insanely good at carrying vibrations over long distances, hence the old movie trick of listening to railroad tracks for a train in the distance, or tapping on pipes in Morse code to communicate your escape plans to the inmate several cells over. (At the risk of veering off-topic, neither of these tricks work nearly as well in real life as in the movies, but they do work. Well, at least the railroad tracks do. Since the MPAA hasn't found my gargantuan mp3 collection yet, I haven't had a chance to test prison telegraphy yet.)

      One thing that has always baffled me is why racks and computer cases are made of metal to begin with. There are, of course, certain areas where you need steel or aluminum for strength or carrying waste heat, but wood or plastic would do a much better job of damping vibrations. There's a reason audio speaker cabinets are made out of crappy, soft stuff like particle board: you don't want the cabinet to resonate, and particle board does a wonderfully poor job of transmitting vibrations, which is why it isn't used in guitars, where you want strong resonance. There are also a wide variety of synthetic rubbers like neoprene and sorbothane that do a good job of absorbing vibrations. Neoprene is cheap, and sorbothane, while more expensive, is still affordable and does such a good job of deadening vibration that it feels remarkably like meat. (I happen to have a square foot of it sitting on the counter next to me, waiting to be used in some vibration-damping experiments with my scooter, but having RTFA, I think I'll try using a little bit to replace the rubber pads on the bottom of my external drive enclosures.)

      --
      Proud member of the Weirdo-American community.
    5. Re:Can't believe it by drinkypoo · · Score: 2, Informative

      One thing that has always baffled me is why racks and computer cases are made of metal to begin with. There are, of course, certain areas where you need steel or aluminum for strength or carrying waste heat, but wood or plastic would do a much better job of damping vibrations.

      It's for RF protection in both directions. Those acrylic cases can cause problems with the PC, or with wacky noise in your stereo. I'd stick with metal, but float the drive cage, and float each drive in the cage.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  8. Re:Anyone know why it affects SSD? by InsertWittyNameHere · · Score: 3, Insightful
    I don't think it is. I always see "no vibration/movement issues" listed as a "pro" in all SSD vs HDD reviews. Plus SSDs don't have any moving parts.

    Is you comment based on this part of the article?

    SSD value. Flash SSDs have fast random read access. But disks can improve their performance by 50% through vibration damping, that changes value proposition for SSDs.

    I think the author is saying that if you can improve performance by 50% then there's less value in moving to SSDs that previously thought.

  9. good vibrations? by ncohafmuta · · Score: 2, Funny

    i guess the beach boys were wrong about those vibrations.

  10. This is what you get... by camperdave · · Score: 4, Interesting

    This is what you get when you drag a magnetic head across a surface. The sooner we get rid of mechanical storage the better. Solids are more robust, more energy efficient, quicker, denser, lighter. Cost and longevity issues are coming along. Yes, lets ditch the antiques already!

    --
    When our name is on the back of your car, we're behind you all the way!
  11. shouting at disks by Anonymous Coward · · Score: 4, Interesting

    So maybe sex in the server room IS a good idea! Not to mention all the puns you can make about racks.

    Also, don't shout at your disks since it increases latency, as the guys at Sun Storage learned:

    http://www.youtube.com/watch?v=tDacjrSCeq4

  12. Disks need alignment and balancing by NicknamesAreStupid · · Score: 2, Insightful

    Plus a lube job and, definitely, Window cleaning.

  13. Just in time, too by Weaselmancer · · Score: 3, Insightful

    This is news we needed 20 years ago. SSD is going to replace mechanical HD over the next couple of years making the whole vibration issue irrelevant.

    Ah well better late than never I guess.

    --
    Weaselmancer
    rediculous.
  14. This could be just a matter of resonance by melted · · Score: 3, Interesting

    The disks all spin at roughly the same frequency (250Hz for a 15K RPM drive), so you could get some interesting resonance patterns in that frequency band as well as in its harmonics and frequencies that you get when you subtract rotational vibration spectrum of one drive from another. You can even hear these effects if you run two 7200 RPM drives in your desktop in a quiet room (assuming you don't have a dozen fans in the case that some people like to have for some reason).

    The solutions is simple - dampen the drives to eliminate high frequency vibration transfer. Better yet, don't use screws to attach your drives at all. Use velcro.

  15. SSD by Ruvim · · Score: 3, Interesting

    It is going to matter only until price for SolidStateDisks becomes in line with what it should be

  16. Re:Anyone know why it affects SSD? by bertok · · Score: 3, Insightful

    the article does not say that it affects SSDs, but that it affects the SSD value proposition (aka, if you can spend little $$$ on carbon rack enclosures and get a significant seek performance increase, spending the large amount of $$$ to go full-ssd might not be as cost effective).

    My over one year old SSD drive can do ~6,000 under a database workload, the next-gen consumer SSD drives are reaching 60,000 random IOPS, and there are enterprise drives that can do over 150,000 IOPS with streaming speeds over a gigabyte per second.

    This is a little like saying that Hayes has released a new 56K modem that resists line noise 50% better than existing modems, which affects the value proposition of 1Gbps fibre.

    There's also no need to go "Full SSD". The newer virtualizing SAN arrays can migrate individual blocks of data between tiers of storage to place everything on the appropriate storage depending on the need for performance.

  17. Re:Females... by setagllib · · Score: 2, Funny

    Paging Dr. Freud...

    --
    Sam ty sig.
  18. My CDROM killed 2 hard drives by blue-slonopotam · · Score: 2, Interesting

    ..before I suspected something was not right and wrote a program continuously monitoring read speed. Then I started it, waited for the number to settle and put a disk into my CDROM. The reading speed decreased several times. After that I took the cdrom out, put it atop the case on a pile of foam rubber. That computer worked for 10 years more without any problems. The CDROM brand was Pioneer, if you care. HDDs were Maxtor and Western Digital. The story happen in 1997.

  19. Couple of comments from a storage guy... by HockeyPuck · · Score: 5, Interesting

    Note: I'm not a server guy, i'm not a LAMP guy, I'm not a OS guy nor a DBA. I deal with two objects in the datacenter, storage devices and switches that move packets (either FC or FICON) to storage devices.

    First when I heard the term 'enterprise disks' I figured they were talking not about the drives themselves, but rather of the highend EMC, IBM, HDS variety (HP/SUN don't count b/c they rebrand HDS). There's no dampening in those arrays, they're basically racks/cabinets on wheels with casters on them to lock them down. If I was reading from a raw disk, then I could definitely see how vibration would have an impact, but with Enterprise disk arrays, there's so much cache (in the array, not on the drive) and read-ahead algorithms in place that I could see how users wouldn't notice the difference. I'm not so sure that EMC/HDS/IBM would be willing to build their disk arrays out of carbon fiber. Especially with the price conscious consumers like myself that love nothing more than my yearly meeting with my storage vendor to discuss $/GB.

    I know of some companies that put their highend (Superdome/p690) servers on earthquake pads, which in the event of an earthquake the server can stay put while the floor shifts underneath.

    I've actually experienced this problem first hand. I used to work at one of the above mentioned storage companies and we manufactured a disk shelf that had 8 drives in the front and 8 in the back. There was a metal divider in both the front and back that separated the box into quadrants. We noticed one year that there was a significant drive loss in the field and upon further investigation, we noticed that one slot in particular had an abnormally high failure rate. So we flew to one such site that had these suspect drive shelves, and measured the vibration of each disk in their disk shelves (they had about 100) using a tool that look pretty much like an accelerometer at the end of a pencil. Turns out that the drive location that had the highest number of failures, was not abnormally vibrating, but that a drive 4 spots away was. It seems that if a the drive next to the divider had a "high vibrational drive" it would set up a standing wave which would eventually cause another drive, which was perfectly fine from a manufacturing standpoint to fail.

  20. Not surprising... by John+Pfeiffer · · Score: 2, Interesting

    Luckily, all my drives are mounted through silicone vibration isolators. Gotta love Antec case design! :D http://media.giantpachinkomachineofdoom.com/2007-02/blog/images/u1_array_supersize.jpg

    --

    Friend: "The NIC is misconfigured..." Me: "No prob, I'll just telnet in and fix it." *Silence*