Slashdot Mirror


HyperSCSI Examined

An anonymous reader writes "Eugenie Larson of byteandswitch.com has published a brief article that reviews the HyperSCSI protocol, which like iSCSI allows for an IP based san. The twist of HyperSCSI is that it's opensource, and runs over raw ethernet, avoiding the overhead of TCP/IP. The article has some comments from early adopters of HyperSCSI, as well as some comments from top vendors in the iSCSI industry."

179 comments

  1. That nasty TCP/IP overhead by Anonymous Coward · · Score: 0

    With all it's error correction and what not! Who needs that for data stoage?

    1. Re:That nasty TCP/IP overhead by Ifni · · Score: 4, Informative

      The article does and abysmal job of covering this, but the homepage for HyperSCSI has a nice PDF presentation that covers just this topic. In short, it goes something like this: The SCSI protocols already provide error checking The HyperSCSI layer adds flow control and retransmits Ethernet provides certain other checks So, in total, you have the same reliabilty of iSCSI and FibreChannel with less overhead (i.e. significant overlapping of the protocols in terms of error detection/correction).

      --

      Oh, was that my outside voice?

  2. Performance over TCP/IP? by borius · · Score: 2, Informative

    I read somewhere that it's like 5 times faster than SCSI over TCP/IP. Is it true? And how great is the sacrifice of not using TCP/IP? I mean, what doesn't support Ethernet these days?

    1. Re:Performance over TCP/IP? by Anonymous Coward · · Score: 0
      according to netcraft's latest survey, the performance over scsi (at 100 megabut) is about twice as good as over firewire (at 10 megabit).

      All numbers were from copying a 17 megabyte file on a G4 powermac that, by all rights, should have only taken minutes.

    2. Re:Performance over TCP/IP? by Anonymous Coward · · Score: 0

      Why did they use a G4 Power Mac? I would assume NetCraft, of all places, would know that *BSD is dying.

    3. Re:Performance over TCP/IP? by Anonymous Coward · · Score: 0

      When will somebody opensource the implementation of FAST TCP, i want my p2p clients to use FAST TCP, well chop chop get on with it. Get coding FAST TCP stacks for us masses.

  3. If it's raw ethernet, then it's not "IP based" by miguel_at_menino.com · · Score: 4, Insightful

    The summary says "IP based" then "without the overhead of TCP/IP" and then "raw ethernet".

    Which one?

    Can't be both IP based and raw ethernet at the same time.

    You don't expect us to RTFA do you?

    1. Re:If it's raw ethernet, then it's not "IP based" by 44BSD · · Score: 1

      I R'd TFA, and it doesn't say anything about IP-based SANs.

      It does, however, call the protocol a "beer can with an engine" (or some such colorful metaphor for 'kludge').

      I'm not a bit twiddler or an electrical engineer, but it looks to me like this is reinventing the wheel.

    2. Re:If it's raw ethernet, then it's not "IP based" by ProtonMotiveForce · · Score: 4, Informative

      TCP is a layer above IP. Hence, the two are not mutually exclusive.

      You can have "without the overhead of TCP/IP" and "IP based". All IP gets you is an address format and ARP type standards, it's not a lot of overhead.

    3. Re:If it's raw ethernet, then it's not "IP based" by Anonymous Coward · · Score: 0

      I see you didn't read the article either. First of all, the parent is right. It can't be both raw ethernet and IP based at the same time. In fact, it isn't. It's raw ethernet.

    4. Re:If it's raw ethernet, then it's not "IP based" by Epistax · · Score: 2, Interesting

      How about UDP? It's IP based, but doesn't have the overhead of TCP.

      For people who wouldn't know this kind of stuff, TCP does much to ensure that every packet arrives as it was sent. This adds overheard, but it's hardly ever seen by any end user because it's pretty universal. UDP has no error checking, so it isn't fit for anything where any particular packet matters. On the plus side, overhead is severely reduced. I imagine UDP is used for streaming audio and video, but I don't know.

    5. Re:If it's raw ethernet, then it's not "IP based" by Anonymous Coward · · Score: 0

      Well it can be both in this case. There are 2 modes to HyperSCSI. HS can run in a TCP/IP encapsulated mode (slower) that can be routed, to connect WANs together, and it can run in it's native raw Ethernet mode for local lans (much faster). The article failed to mention this, even though I told the author as much in our phone conversation (I'm Jesse Keating, but I don't have a /. account)

    6. Re:If it's raw ethernet, then it's not "IP based" by -tji · · Score: 2, Insightful

      Same thing.. UDP rides on top of IP.

    7. Re:If it's raw ethernet, then it's not "IP based" by Ifni · · Score: 2, Informative

      Not quite reinventing, just reengineering. To keep the analogy, it's like reformulating the rubber to provide better "grip" in racing tires - great for flat, dry tracks, but not great for inclement weather. In this case, they are redesigning TCP to remove all of the stuff that is unneccesary for this particular purpose:

      • sliding window sizes - block data transfer needs to start with large windows, not slowly "wind up" to them
      • error checking - this is done already by the SCSI protocol, and the Ethernet protocol as well

      But keep the stuff that IS needed:

      • Flow control
      • Retransmits for bad/lost packets

      This is a lot like using a GPU - the General Purpose CPU in your computer can do all of the same things, but having a processor that is streamlined for such a specific task is much more efficient.

      --

      Oh, was that my outside voice?

    8. Re:If it's raw ethernet, then it's not "IP based" by LostCluster · · Score: 2, Insightful

      Yes but "raw ethernet" is exclusive to mean you're not getting as far as IP... that's a physical first-layer protocol and that's it.

    9. Re:If it's raw ethernet, then it's not "IP based" by trippinonbsd · · Score: 1

      A big use of udp is in games, where you want to send out as much data as possible, and if you were to get a bad packet it has already happened and it doesnt need to be retransmited.

    10. Re:If it's raw ethernet, then it's not "IP based" by TheCrazyFinn · · Score: 2, Informative

      NO, Ethernet is also a layer 2 protocol. HyperSCSI runs as a layer 3 protocol over Ethernet's layer 2. Remember, Ethernet is both a layer 1 protocol (At the physical side) and a layer 2 protocol (Data Link).

      IP is Layer 3. HyperSCSI is Layer 3.

      --
      "You've got an invalid haircut" -Warren Zevon - Life'll Kill Ya
    11. Re:If it's raw ethernet, then it's not "IP based" by TheCrazyFinn · · Score: 3, Informative

      If you read the docs, you will note that they mention running over UDP/IP as a possible outgrowth. But they note as it's only really useful for Storage WANs (Since it does add some overhead), why not just use iSCSI. HyperSCSI is designed for Switched Networks, iSCSI is somewhat more flexible, if also somewhat slower.

      For what they want UDP offers nothing that straight ethernet frames don't. And UDP has more overhead.

      --
      "You've got an invalid haircut" -Warren Zevon - Life'll Kill Ya
    12. Re:If it's raw ethernet, then it's not "IP based" by Alien+Being · · Score: 4, Funny

      "NO"

      # # ###### ####
      # # # #
      # ##### ####
      # # #
      # # # #
      # ###### ####

      "HyperSCSI runs as a layer 3 protocol over Ethernet's layer 2."

      Okay, so where's the IP layer? Wait, wait, don't tell me... it's on the bongos, right?

      HyperSCSI runs on top of a raw datalink. IP doesn't enter into it.

    13. Re:If it's raw ethernet, then it's not "IP based" by Paul+Jakma · · Score: 1

      HyperSCSI can also run over IP (ie UDP presumably) according to their docs.

      --
      I use Friend/Foe + mod-point modifiers as a karma/reputation system.
    14. Re:If it's raw ethernet, then it's not "IP based" by TheCrazyFinn · · Score: 2, Informative

      IP is Layer 3. IP Rides the raw Datalink. IP is the same layer as HyperSCSI. Raw Datalink is layer 2.

      Ethernet is both a Layer 1 topology and a Layer 2 Datalink protocol. That's why you can push ethernet frames over dissimilar topologies (Like 100baseFX and LANE over ATM).

      OSI Layer 1 is Physical (Ethernet is here)
      OSI Layer 2 is Datalink (Ethernet is also here)
      OSI Layer 3 is Network (IP and HyperSCSI live here)
      OSI Layer 4 is Protocol (TCP, UDP and the SCSI side of HyperSCSI live here)

      --
      "You've got an invalid haircut" -Warren Zevon - Life'll Kill Ya
    15. Re:If it's raw ethernet, then it's not "IP based" by TheCrazyFinn · · Score: 1

      Yeah, but it does that by tunneling over TCP/IP (UDP based HyperSCSI doesn't appear to be implemented).
      It's pretty much tunneling Ethernet frames over TCP/IP.

      --
      "You've got an invalid haircut" -Warren Zevon - Life'll Kill Ya
    16. Re:If it's raw ethernet, then it's not "IP based" by Paul+Jakma · · Score: 1

      Its both apparently, ie can run both inside ethernet (HS/IP, frame type 0x889a and IP (HS/IP - udp port 5674). It apparently implements its own flow-control and optional authentication/encryption framework.

      RTFA? yes, perhaps you should have but instead you're moderated as insightful. (meta-mods?)

      --
      I use Friend/Foe + mod-point modifiers as a karma/reputation system.
    17. Re:If it's raw ethernet, then it's not "IP based" by Paul+Jakma · · Score: 1

      ooh interesting.. so the UDP version encapsulates ethernet header et al? How does that work then with the MAC addr? Why the hell does it even want to have the MAC addr's included in the HS/IP flavour? (of no use to the remote end).

      Its seems really strange for HS/IP to include the ethernet header and i get the impression from the PDF on their site that this isnt the case. Can you provide a reference?

      --
      I use Friend/Foe + mod-point modifiers as a karma/reputation system.
    18. Re:If it's raw ethernet, then it's not "IP based" by ProtonMotiveForce · · Score: 1

      I never said anything either way. I just said TCP/IP and IP are different beasts.

  4. ironic. by Anonymous Coward · · Score: 0

    "avoiding the overhead of TCP/IP"

    yet you can tunnel IP inside of it... adding a layer of overhead for IP.

  5. Bridge Board by Detritus · · Score: 3, Interesting

    I like the idea. Ethernet hardware is dirt cheap and fast. What it needs is a cheap IDE bridge board. That would let you put some IDE drives in an external enclosure and plug them into the local LAN.

    --
    Mea navis aericumbens anguillis abundat
    1. Re:Bridge Board by Anonymous Coward · · Score: 0

      Dirt cheap yes, but hardly fast.

      Unless you mean gigabit, but then it's not dirt cheap anymore, at least not the switches.

    2. Re:Bridge Board by Reece400 · · Score: 2, Insightful

      i've got tonnes of files that i'd like easy to access, speed is minimal,, it would still be far less that looking thorough my over 500 cd's for a doc file or game,, etc..

      Reece,

    3. Re:Bridge Board by Ifni · · Score: 1

      According to the homepage for HyperSCSI, it can support IDE (as well as USB and Fibre Channel) devices:


      To put this in "ordinary" terms, it can allow one to connect to and use SCSI and SCSI-based devices (like IDE, USB, Fibre Channel) over a network as if it was directly attached locally.
      --

      Oh, was that my outside voice?

    4. Re:Bridge Board by evilviper · · Score: 1
      Ethernet hardware is dirt cheap and fast.

      But no cheaper than anything else could be if it gained popularity.

      The big problem is the interrupts, and the processing power used. High speed transfers, and you need an incredibly fast computer to handle the storm of interrupts from your ethernet card. That's why (expensive) fibre channel is used, instead of (cheap) networking technologies.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    5. Re:Bridge Board by Sabalon · · Score: 1

      I believe his idea was to have an IDE drive with a power connector and an ethernet connector. That way you don't need another computer holding the drives running the hyperSCSI server.

    6. Re:Bridge Board by Anonymous Coward · · Score: 0

      SMC 8508T -- 8 10/100/1000 ports, full wire-speed (16Gpbs fabric), supports jumbo frames. $160.

  6. Re:why is there an article on this by larry+bagina · · Score: 3, Funny

    why is there an article on this, i mean linux wont support it for another 2 years lol obviously, it's so when linux does support it, legions of slashbots can complain about the duplicate stories!

    --
    Do you even lift?

    These aren't the 'roids you're looking for.

  7. favorite quotes by Thng · · Score: 1
    And that's not all. Since HyperSCSI was released as open-source software last year, it's free and licensed under the GNU General Public License (GPL). "It's not only free as in beer, but also free as in speech," says Jesse Keating.

    and

    "I would describe it as a beer can with a motor," says Andre Hedrick, president and CTO of iSCSI software vendor PyX Technologies Inc. [Ed. note: I need a beer!] "It will go really fast, but just hope there's not a problem, because there's nothing there to protect you."
    Mmmm.. beer can with motor.
    1. Re:favorite quotes by anti-NAT · · Score: 2, Interesting

      BTW, Andre Hedrick is one of the main IDE developers for Linux.

      I certainly appreciate his IDE efforts, but of course he is going to criticise the technology - his company is an iSCSI company!

      What, do they think he is going to say, "Gee, and all this time, I've thinking that iSCSI is the right thing to work on. I'm going to abandon iSCSI right now, and start playing with this HyperSCSI thing."

      --
      The Internet's nature is peer to peer - 20050301_cs_profs.pdf
    2. Re:favorite quotes by kfg · · Score: 1

      Fill the beer can with gasoline and you've got a Ferrari 312 F1.

      Hey, if it was good enough for Bandini it's good enough for me.

      KFG

    3. Re:favorite quotes by Anonymous Coward · · Score: 0

      Actually if HyperSCSI was a superior transport and was supported by a standards body and not a kludge, note kludge is a positive term for the most part, I would promote it. If you know who I am and how important standards are to me wrt to storage and protecting other people's data, your comments are out of context.

      HyperSCSI lacks the effective ECC everyone depends on and forgets about. This is part of the storage transport between the controller and the device. i/Hyper SCSI must met the basic requirements of reproducing the ECC as they are the effective transport aka the parallel copper ribbon. Disable the ECC between the controller and device and you will destroy and lose data.

      iSCSI has the means with Header(command) and Data(payload) Digests, and is in a class of ECC I have a comfort level and it passes all tests I used deploy the ATA/SATA transport in Linux (all of Linux).

      HyperSCSI does not have the data integrity check to validate the basics of classis DAS.

      Regards,

      Andre

      Proof it is me, you are a pinhead :-P

    4. Re:favorite quotes by Anonymous Coward · · Score: 0

      "Beer can with a motor", was a reference to a '71 Spitfire I tricked out with monster motor. When it reached cruising speeds of 120MPH, it suddenly hit me there was only tinfoil between me and the motor and less in the bonnet. Should anything have happened where control was lost, you would not have this charming quote from my youth. Unlike my Porsche 928 I totalled and walked away unscratch, the Spitfire would have eaten me for lunch.

      Maybe this would have been a good thing, said Martha Stewart.

      Regards,

      To lazy to login or get lost passward, Andre

  8. It does implement reliability by ryanmoffett · · Score: 4, Informative

    If you look go to the MCSA site and look at the HyperSCSI FAQ, it does implement reliability and flow control, just not in the same manner as TCP.

    The only technical negative side I can (at this time) is that because the implementation isn't over IP, you can't traverse a router. This usually isn't a problem but could cause some inflexibility in larger deployments.

    1. Re:It does implement reliability by Gerald · · Score: 1

      It'll cause problems in smaller environments too, if your goal is to replicate data offsite. The FAQ says that there might be a version that runs over UDP in the future. In the meantime you get to use bridging (yay!) if you want to move data to a different segment.

    2. Re:It does implement reliability by LostCluster · · Score: 1

      If you need a router, then clearly this protocol isn't for you and you should use iSCSI. The whole point of this is performance gain because in most SCSI setups, the parts are all right next to each other and can live on their own single-switch network...

    3. Re:It does implement reliability by jpc · · Score: 1

      last time I looked at it (a while back) none of ther performance figures were over gigabit. Or that recent. The question is can you run a tcp like protocol over ethernet that is more efficient than tcp (which is optimised by lots of kernel hackers)? nfs tried to run over udp, and on a modern os tcp gives much better performance than anything they came up with. ALthough there are interesting developments like the fact that gigabit optionally has flow control which could help if the protocol was aware of it (which I dont think hyperscsi is).

    4. Re:It does implement reliability by TheCrazyFinn · · Score: 1

      Well, since the SCSI protocol was duplicating alot of what TCP does (Error Correction especially), eliminating the duplication is a performance-booster.

      This isn't a replacement for NFS or CIFS/SMB, but for FC and iSCSI.

      --
      "You've got an invalid haircut" -Warren Zevon - Life'll Kill Ya
  9. an IP based san by Anonymous Coward · · Score: 0

    What is this?

  10. No error checking or recovery?? by twoslice · · Score: 2, Insightful
    While putting SCSI on raw Ethernet may speed up performance, there are also disadvantages associated with skirting TCP/IP, Smith says. "Without TCP/IP, it has no real error-recovery mechanism or guarantee that packets get delivered. It also appears to be quite limited in scaleability."

    And this is a technology breakthrough? I wouldn't want my data travelling down a wire with no error recovery no matter how small the error rate.

    --

    From excellent karma to terible karma with a single +5 funny post...
    1. Re:No error checking or recovery?? by ecalkin · · Score: 2, Informative

      remember that there are other ways to do error recovery besides with tcp. this system could detect errors by sending a crc of the total packet/sector sent and the receiving end would do the same crc. read-after-write would also detect bad stuff.

      eric

  11. Both of you are idiots, RTFA. by qtp · · Score: 2, Informative
    why is there an article on this, i mean linux wont support it for another 2 years lol

    and

    obviously, it's so when linux does support it, legions of slashbots can complain about the duplicate stories!

    From the article:
    the only HyperSCSI implementation available today is for Linux.


    --
    Read, L
  12. It's cute. but.... by nugatory · · Score: 2, Insightful

    Two big disadvantages:

    First, Ethernet can't be routed, so hyperSCSI isn't going to be nearly as flexible as iSCSI. This is the reason that just about everything that might want to be routed is usually carried over IP (and TCP and UDP and other stuff on top of IP). Straight ethernet is for stuff like ARP that really doesn't want to leave a network segment.

    Of course, one could reasonably do something hyperSCSI-like across IP, and still save the TCP overhead. (Consider that in a low-loss short-hop environment, NFS over UDP generally outperforms NFS over TCP). The problem here is that SCSI was never ever intended to run well over a lossy transport, and it doesn't. That seems a serious objection to running SCSI over both non-routable and non-reliable ethernet and routable but still non-reliable IP.

    C'mon, there's a reason why people use TCP....
    And why iSCSI chose TCP as the transport....

    1. Re:It's cute. but.... by Anonymous Coward · · Score: 0

      But what about VLANs? You could use them to route across a WAN if you wanted to...

    2. Re:It's cute. but.... by Anonymous Coward · · Score: 0

      HyperSCSI had a TCP/IP module to allow it to use TCP/IP when you need routing. It can run independant to the ethernet version of HyperSCSI.

    3. Re:It's cute. but.... by LostCluster · · Score: 1

      Yeah, this looks like the results of the kind of factory who lays off its QC department since they only find a problem with 1 out of every 200,000 units the place makes.

      Yeah, it's five-nines reliablity, for a factory that makes 1,000,000 units a day, those 5 mistakes a day are gonna add up...

    4. Re:It's cute. but.... by Paul+Jakma · · Score: 1

      HyperSCSI /can/ be routed as it /can/ run over IP. Presumably you'd still need to translate HS/ethernet to/from HS/IP if you have HS/ethernet devices. (unless devices could simultaneously speak both HS/ethernet and HS/IP - quite possible).

      Lossy transport: HS implements its own flow-control.

      The biggest concern i'd have is the lack of an integrity check. Most modern link layers do have their own their own integrity check, but usually pretty basic - they can miss errors. (see Linus' story on how his sources at uni kept getting mysterious bit flips due to the server disabling checksums).

      However, HyperSCSI apparently does have some provision for verifying integrity, as the docs mention there being a "hash check" of each window of data and the header contains a "digest" field. So if thats what it seems to be, a message digest of each window's data, then HS should be able to guarantee data integrity. (and as it can also do authentication, it should provide good bit of security too, depending on the message digest algo).

      So:

      IP capable? (hence routable) - tick
      Flow control (deal with packet loss)? - tick
      Data Integrity? - tick (probably)
      Authentication? - tick (optional)
      Free from overhead of TCP? - tick

      Sounds like HyperSCSI could be /very/ useful.

      --
      I use Friend/Foe + mod-point modifiers as a karma/reputation system.
  13. Reliability by Detritus · · Score: 1

    Vanilla Ethernet can be extremely reliable, without any additional layered protocols. I would be much more concerned about the reliability of the installation's AC power supply and distribution system.

    --
    Mea navis aericumbens anguillis abundat
    1. Re:Reliability by twoslice · · Score: 1

      I see you never had an Ethernet duplex mismatch or encountered a bad cable have you? It happens more often than you think...

      --

      From excellent karma to terible karma with a single +5 funny post...
    2. Re:Reliability by Detritus · · Score: 1
      How is that different than all of the many things that can screw up a SCSI or IDE setup?

      My experience is that a properly installed and tested Ethernet network is very reliable.

      --
      Mea navis aericumbens anguillis abundat
    3. Re:Reliability by tuomoks · · Score: 1

      Nightmare! Happens often too. Besides, answering to other posts, take a look on SCSI error correction, TCP has nothing compared to that, it only adds overhead. And yes, you can implement much more and clever error correction to UDP, that way you control ( mostly ) the optimal message size, out of order, etc. Useful especially in wireless, much less and shorter resends for lost packets. have a nice day.

  14. sweet by SHEENmaster · · Score: 1

    But I'd prefer to use it over gigabit ethernet, or at the very least a separate ethernet device than the one I use for me lan.

    Can multiple computers access the same drives through this?

    On another note, is it possible to network over traditional SCSI, by changing the SCSI card ID's to make them co-operate on the same chain? Does an implementation of this exist in Linux, *BSD, or Solaris?

    --
    You can't judge a book by the way it wears its hair.
    1. Re:sweet by MBCook · · Score: 1
      YES! Or something like that. I once found a site (I lost the link) that had made a little kernel driver to run IP over SCSI. It was for one of the 2.2 kernels, IIRC, and it would only work with some SCSI cards for some reason.

      All and all, a very interesting idea, even if it's not practicle (low number of devices on a SCSI bus, short cable length, etc). Maybe for a little mini-cluster of PC/104 boards if they had built in SCSI or something...

      OK, after a quick googleing, I've found this site. There are others too.

      --
      Comment forecast: Bits of genius surrounded by a sea of mediocrity.
    2. Re:sweet by djbckr · · Score: 1
      Can multiple computers access the same drives through this?

      I work for one of the first companies that is implementing Oracle RAC (2 and 4 node systems) over iSCSI to a Network Appliance.
      I gotta tell you, it works great.

      -djbkr

    3. Re:sweet by Anonymous Coward · · Score: 0

      Yes, multiple clients can access the same HyperSCSI server. The protocol would be pretty pointless if it didn't allow for this.

    4. Re:sweet by xenophrak · · Score: 1

      Yes. It's called multi-initiator SCSI. Suns (or any other SCSI or FC computer) use this when in a small cluster with a product like Veritas Cluster Server.

      Ultimately you get better performance and scalability with Fibre Channel, but cost is a factor.

      Here is a small document describing the practice:

      http://docs.sun.com/db/doc/816-2027/6m8dg246h?a=vi ew

      --
      Contrary to popular belief, life is not a bitch. It is far far worse.
  15. The proposed solution: by pr0ntab · · Score: 2, Insightful

    Use loose and fast HyperSCSI on your local segment where it's possible, and use a concentrator that translates into iSCSI over IPSEC for secure WAN connectivity.

    That way you only need to buy one TOE card per WAN edge. Those can get expensive!

    --
    Fuck Beta. Fuck Dice
  16. Re:Enough of those double standards! by ericman31 · · Score: 1

    SCSI is dead? For the home computer perhaps, but not in the data center. I have yet to see a serial ATA enclosure perform on anything like the level of enclosures using SCSI over FC. Why don't you go look around a large office environment or a data center and see how many storage devices are SCSI based. This stuff (iSCSI, HyperSCSI, Ultra320, etc.) are aimed at servers and storage networks, not your desktop PC.

    --
    In my universe I'm perfectly normal, it's not my fault you don't live in my universe.
  17. Single Vendor? by Anonymous Coward · · Score: 1, Funny

    This is great for folks that want to be locked into a single vendor without any path to get out

    Didn't the article state that HyperSCSI is GPL and runs on Linux? What the fuck is this guy talking about?

  18. Re:Enough of those double standards! by bersl2 · · Score: 2, Funny

    SCSI is dead

    Many people here disagree with you. I wish I had SCSI hardware... you troll... now you've hurt my feelings...

  19. The protocol implements in it's own way... by pr0ntab · · Score: 2, Interesting

    tuned for SCSI commands and data transfers. This is the particularly interesting part of the protocol. It assumes you're going to be doing bulk transfers, and lets both ends negotiate windows for performance (as opposed to using a sliding scheme).

    As I see it, the real problems:

    - SMP "experimentally" supported
    - client and server can't coexist on same box
    - client model is not decoupled enough from the server (a server going down can mean the client could crash)

    It appears the driver software needs some work properly implementing what seems to be a nifty protocol. And they want to port it to Solaris. I think they should get the locking and stability down first.

    --
    Fuck Beta. Fuck Dice
    1. Re:The protocol implements in it's own way... by Fermier+de+Pomme+de · · Score: 1
      And they want to port it to Solaris. I think they should get the locking and stability down first.

      Maybe that is why they are poring it to Solaris.

    2. Re:The protocol implements in it's own way... by Michael+Hunt · · Score: 1

      - SMP : If you mean on the server, who cares. most 'servers' are going to be embedded things much like a DEC HSG80 with a single task processor and a fuckton of disks. If you mean on the client, yeah, this is a problem. It should be fixed.
      - No client/server on the same box: Why the HELL would you want to do this? Most clients would have small local disks, if any, and mount most of their storage from a 'server' (possibly shared with other boxes using c.f. OpenGFS)
      - Server crashing can crash a client: Most FibreChannel deployments i've seen have this property as well. Same with SCSI. Unplug the cable going to your HD and see how long your system stays up.

  20. Gigabit Ethernet by Detritus · · Score: 1

    The NICs are cheap and the prices of the switches are dropping. I don't think it will be that long before gigabit Ethernet starts to push 100 Mbit Ethernet out of the market.

    --
    Mea navis aericumbens anguillis abundat
    1. Re:Gigabit Ethernet by Trolling4Dollars · · Score: 1
      I don't think it will be that long before gigabit Ethernet starts to push 100 Mbit Ethernet out of the market.

      ...and it won't be long before terabit ethernet is on the market to continue the revenue stream for our overlords.

  21. raw ethernet? by austad · · Score: 2, Insightful

    If it is truly raw ethernet, this means that you cannot route it. On most current networks, you probably wouldn't want to because of latency issues, but, on networks with 1 gig or 10 gig links, latency should not be a problem. So, if it does use raw ethernet, this is actually a limitation of it, not a benefit.

    --
    Need Free Juniper/NetScreen Support? JuniperForum
    1. Re:raw ethernet? by tuomoks · · Score: 1

      On data access latency is always a problem. Remember that the data ends to memory and the longer it is held the more latency there is for whole system even using DMA or whatever. Why do you think that mainframes with actually slower channels can deliver the amount of data they do - latencies are kep low.

  22. Re:Enough of those double standards! by drinkypoo · · Score: 4, Insightful

    More to the point, we have usb 2, serial ata, and firewire. Really all you should need is usb 1.1 and firewire in ever-increasing speeds, besides your display output. There's literally no need for anything else. Firewire can be operated in a synchronous fashion, after all. It supports lots of devices per adapter (63 or 127 depending on implementation) and comes in powered and unpowered as well as peer to peer or host-based forms, but nearly all devices will fall back to the lowest, slowest mode - which is capable of 400Mbps per second, or 50 Megabytes, clearly enough for all but the fastest hard drives, and nearly any other use to which you might put it. 800Mbps firewire is available today, and 1.6Gbps is uh, just over the horizon or something. They claim they'll do 3.2Gbps over fiber in the near future as well, but I'll just stick to developments just over the horizon, not way over it, here.

    Frankly what I want to see more than anything is native 1394 storage devices. 1394 is somewhat to scsi (it would kind of have to be, wouldn't it?) and is at least well documented. I want hard drives that have only power and 6 pin 1394 connections on them, pass through style. You could treat them basically like an external scsi chain not requiring termination, but inside your PC. Firewire to IDE bridges are not the answer, they just make things more complicated and firewire is supposed to make things less complicated, though I suppose they are a sort of interim solution.

    For the average user, if you could get native (and thus inexpensive) firewire solutions for everything, it would fulfill your needs much better and would make computer use much simpler. The only thing you need besides firewire and USB for every common peripheral is video output and possibly high speed networking, perhaps provided from a MII or similar connection, just as AUI was the standard at one time. Just, without the annoying box and cables. And let us not forget, a memory slot. I assume most people would also like to have wireless ethernet with an external antenna jack. For the rest of us, we would continue to run our however-shaped boxes with internal expansion, PCI-Express or what have you, and our cabling would be much simplified. Once again, 800Mbps is 100MBps, yes? Assuming you can only really sustain 50 or 60% of that with multiple devices competing for the bus, that's still fast enough for basically any two hard drives anyone is likely to have at home. So 800Mbps firewire is perfectly adequate to the task of connecting hard drives today. It's not that SATA isn't, it's that having less types of interface simplify a computer. If you're only going to have two interfaces, you will get more mileage out of USB2 and IEEE1394 than you will USB2 and SATA, even one of the bastardized forms of it like External SATA, if people will just make IEEE1394 devices.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  23. Re:Enough of those double standards! by Pervertus · · Score: 0

    I believe you could say exactly the same on Novell. "Yea, that thing is for serious users and not for your typical mother's girly who want to share a folder with her mom". And maybe what you said is right for now, but let's face it, SCSI is passe. You can't compare its big flat connector to the elegant Serial ATA wire.

    SCSI may try to continue living, but it got only one direction to go: history's garbage pail.

  24. Re:Enough of those double standards! by Pervertus · · Score: 1

    I've got SCSI hardware supplied with my CD-RW. And it didn't make me feel happier. Not at all.. my friend here bought an ATAPI burner and he's laughing all the way on me. "You sucker.. you paid so much more just to be able to say you got SCSI. And guess what? it's gonna die!".

  25. This isn't a problem with FC by anti-NAT · · Score: 2, Insightful

    Fiber Channel SANs aren't based on IP either, yet people manage to do off site replication with them.

    I don't know how far away you want to put your off-site backup, but Cisco have been selling a GBIC (Gigabit Interface Converter ? Too many FLAs for my head these days), which they've been calling 1000BaseZX, which will send an GigE signal around 90 Kilometers over single mode fibre.

    Even Full Duplex Fast Ethernet over multi-mode fibre will go 2 Kilometers.

    You can build some really big ethernet networks these days. I don't think the non-IP thing is all that much of an issue.

    Although the idea of using cheap commodity equipment like ethernet is to rationalise multiple networks down to a single IP network, there are also good reasons to using commodity ethernet to build a separate network for your storage, security being the main one. It probably wouldn't be too good to have CodeRed or other worms of its ilk infecting your storage network.

    --
    The Internet's nature is peer to peer - 20050301_cs_profs.pdf
    1. Re:This isn't a problem with FC by Anonymous Coward · · Score: 1, Interesting

      How does ZX meet DR (disaster recovery) requirements of 300 miles?
      How does FC operate in mixed vendors (Brocade w/ McData) ?
      SAN infected by virus, IPSEC mean anything to you?
      Data integrity checksum of the payload?

      First question ZX just does not get the job done.

      Second question, degraded mode and the customer is not told about the issues. They are generally are left uneducated about the issues/concerns.

      Will not explain the obvious in the third.

      Read the SPEC for iSCSI RFC for #4.

      Regards,

      Andre

      PS forgot/to lazy to login here

    2. Re:This isn't a problem with FC by Weissmohr · · Score: 1

      At my company we transport gigabit ethernet and HDTV over fibre (up to 20 GBE/100MB ethernet/RS422 or 40HDTV/SDI/SDH/SONET/whatnots per single mode fibre. Mix and match what you need). Longest link I've tested is 120km of fibre (in my office). :-)

  26. Re:Enough of those double standards! by ericman31 · · Score: 1

    SCSI may try to continue living, but it got only one direction to go: history's garbage pail.

    You do realize that the serious data center hasn't run the SCSI protocol on a SCSI cable for years, right? We run FC everywhere. Even for our internal disks on some servers (Sun Vx80 series). Serial ATA doesn't even come close to SCSI over FC. My Hitachi 9570V gives me 19.5 TB raw storage and more than 100,000 IOPS. Let's see serial ATA and USB2 do that.

    One more time, HyperSCSI, like FC and iSCSI is NOT for a desktop PC. It's for the data center. Although HyperSCSI provides some promise for extending centralized data storage to the desktop.

    --
    In my universe I'm perfectly normal, it's not my fault you don't live in my universe.
  27. UDP by Detritus · · Score: 1

    UDP is ideal for latency sensitive data, like real-time telemetry. It does require that you have excess bandwidth or control over who has access to the network if you want to avoid dropped packets.

    --
    Mea navis aericumbens anguillis abundat
  28. Re:Enough of those double standards! by Jeremy+Erwin · · Score: 4, Informative

    USB maximum cable length: 5m
    Serial ATA maximum cable length: 1m

    Fiber Channel maximum cable length: 10,000 m

  29. Ha! by twoslice · · Score: 1
    My experience is that a properly installed and tested Ethernet network is very reliable.

    An therein lies your problem. You just can't get around the human error factor. People incorrectly install equipment and configuration mistakes abound in a corporate environment.

    --

    From excellent karma to terible karma with a single +5 funny post...
    1. Re:Ha! by gburgyan · · Score: 1

      Amen brother! There's beena number of times that an ethernet cable has wiggled itself a bit too loose where I work. Yes, it was still "clicked" into place, but it wasn't making proper contact with the socket. Ethernet is a cable that was meant to be plugged in repeatedly, unlike SCSI or IDE or whatnot where you generally plug it in annd leave it -- or maybe even screw into place.

  30. NFS - history ignored by bourne · · Score: 5, Insightful

    The lessons of NFS are being ignored, and I'd expect HyperSCSI to die when it hits the same limitations.

    NFS started out UDP-based, and moved toward TCP with NFSv3. Why? Because having all that error correction done at the network layer made for a better product; TCP does all the work to insure packets aren't lost or out-of-order. UDP doesn't, and the NFS application layer had to handle it, making it slower, more painful, and a duplication of effort better spent elsewhere.

    The industry guys are almost right on this one. It isn't a beer can with a motor; it's a beer can with an M-80. Fun to watch when it works right, damn painful if you screw it up.

    1. Re:NFS - history ignored by nugatory · · Score: 5, Interesting

      That's a good point, and needs a bit more modding up.

      It's worth adding, however, that the hyperSCSI folks are trying to make a distinction between wider-area networks (which they call SWANs for Storage WAN) and local single-segment (since they aren't routing) networks, and arguing that iSCSI is right for the former and hyperSCSI, because it's faster/cheaper, for the latter.

      This view has parallels in the history of NFS over TCP versus NFS over UDP, because NFS/UDP is still hanging on in one niche: short-haul, high-speed, low-latency, few-hops, negligible-loss environments.

      It also has parallels with the bad old days when direct-attached storage interconnects were much faster than LANs, so one set of protocols (FCP, SCSI, ESDI, IDE, SIMD...)evolved on the short fat pipes used to connect computers to peripherals, and a completely different set of protocols (ethernet, TCP/IP, SDLP, ...) evolved for the long thin pipes used to connect computers to one another.
      Similarly, hyperSCSI is an argument that the two domains are different enough to justify different protocols. That seems to be arguing against a historical trend tht says that the short/fat and long/thin differences are vanishing; compare gigE and fibrechannel as _wires_ today.

      All of this just reinforces Bourne's general point about ignoring the history. It's pretty clear that NFS over TCP is where the world is going, and the only reason that there's an NFS over UDP hanging around is that's how all NFS used to be, so some still is. When we compare hyperSCSI to iSCSI over TCP, I can't find any reason not to just deploy iSCSI everywhere and be done with it.

  31. concurrent filesystem access by Anonymous Coward · · Score: 1, Interesting

    How do SANS based on such things as HyperSCSI handle cuoncurrent filesystem accesses by mutiple different machines, since the device at the other end is just acting as a disk, and the host has to maintain filesystem integrity?

    1. Re:concurrent filesystem access by dido · · Score: 2

      In short, it doesn't. That has to be done by the filesystem layer or application layer itself. A Fibre Channel-based SAN setup such as is common in enterprise deployments doesn't normally provide for this either (Fibre Channel zoning is an exception, but that's a feature not normally required by most setups). If you really want to do concurrent filesystem access by multiple machines, you need a distributed lock manager of some kind, similar to what you have in Oracle RAC's cluster filesystem, Sistina's Global Filesystem, or OpenGFS.

      --
      Qu'on me donne six lignes écrites de la main du plus honnête homme, j'y trouverai de quoi le faire pendre.
  32. Protocol/implementation confusion by Wesley+Felter · · Score: 1

    Saying that HyperSCSI is open source or HyperSCSI is under the GPL is pretty meaningless; those concepts don't apply to protocols. A HyperSCSI implementation is under the GPL, but so what? There are open source iSCSI implementations, too.

    1. Re:Protocol/implementation confusion by Anonymous Coward · · Score: 0

      and using the GPL will hinder adoption if it turns out to be desirable. No commercial effort would expose their proprietary firmware base to the GPL just to implement this protocol.

  33. Re:Enough of those double standards! by Anonymous Coward · · Score: 2, Informative

    SATA is killing SCSI. Yeah. Thats right, I just replaced my 30 drive dual channel ultra320 array with... what, 3 12 channel SATA-150 controllers?

    Come back and troll when SATA has doubled in speed, and when I can plug at least 15 drives into a card.

    Or hell, just stay out of the game, since Fibre Channel has 2Gbit/ps (250MB/ps, still faster than SATA, slower than ultra320) and 255 devices, with multiple host access over a SAN, which can be set up redundantly. And that ignores the point of this article, SCSI over normal networking equipment.

    So, to reiterate:
    SATA - Lower speed. Lower capacity (# drives). Single host access. (Lower drive warranties too.) Cheap.
    SCSI - Higher speed. Higher capacity (# drives). Multiple computer access via FC,iSCSI,HyperSCSI. (Longer drive warranties.) Expensive.

    So, for the home user, cheap is good.
    For the average financial institution which I'll estimate has roughly 1TB of information that needs to be available to everyone all of the time, well, they'll get what they pay for.

  34. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    omgomg! You made me a FOE! I can't believe it!!!!!!!!! Some people have no heart here. :~(((

    Forgive me while I go and cry my heart out..

  35. Re:Enough of those double standards! by ericman31 · · Score: 3, Interesting

    Fiber Channel maximum cable length: 10,000 m

    Add the appropriate routers and switches and you can easily go 90 km on dark fiber. Add some appropriate routers onto a fast network (T3, ATM, what have you) and you can go 500 km. With fast FC connected storage at each end. Of course, this sort of solution is used by data centers, not home users. But Fiber is the obvious solution to data storage problems. And there is enough mass in the server storage market now that prices are starting to come down. Of course, if you need fast, redundant, capable storage you won't blink at the cost.

    --
    In my universe I'm perfectly normal, it's not my fault you don't live in my universe.
  36. SATA is always much better by Anonymous Coward · · Score: 0

    Come back and troll when SATA has doubled in speed, and when I can plug at least 15 drives into a card.

    Hey, I plugged 15 SATA drives to my ass and had no problem with that at all. I don't know about you, but I ain't gonna try that with SCSI drives.

    1. Re:SATA is always much better by rizawbone · · Score: 1
      Hey, I plugged 15 SATA drives to my ass and had no problem with that at all. I don't know about you, but I ain't gonna try that with SCSI drives.

      Kind of funny you draw the line at 'SCSI drives' when it comes to plugging things into your ass.

      Was there a lot of trial and error in this decision?

    2. Re:SATA is always much better by Pervertus · · Score: 0

      Was there a lot of trial and error in this decision?

      Ofcourse there was. I needed reliable yet comfortable storage solution. I tried with USB drives first but they were too slow. I wouldn't dare trying IDE, SCSI or parallel drives, so the only solution left was SATA. And I am happy with it. Finally I've found a good place to store my shit around.

  37. You know it's coming soon... by WIAKywbfatw · · Score: 1

    HyperSCSI, huh?

    Well, let's just add that to SCSI, SCSI 2, Fast SCSI, Wide SCSI, Fast Wide SCSI, Narrow SCSI, Ultra SCSI (aka SCSI 3), Ultra-2 SCSI, Ultra-3 SCSI (Ultra-160 SCSI to some), Ultra-320 SCSI and iSCSI. (I'm sure I've missed something out.)

    So what's next for this party? UberSCSI? 1337SCSI? TheOneRingSCSI?

    --

    "Accept that some days you are the pigeon, and some days you are the statue." - David Brent, Wernham Hogg
    1. Re:You know it's coming soon... by pdbogen · · Score: 1

      TheOneRingSCSI?

      One protocol to rule them all
      One protocol to find them
      One protocol to bring them all
      And in the darkness to bind them.

      So it's a master-slave-model distributed filesystem with autosensing of new nodes, that automatically propogates changes to the master node and binds additions to automagically generated mount points.

      Neat.

    2. Re:You know it's coming soon... by Guppy06 · · Score: 1

      "TheOneRingSCSI?"

      Implemented on raw token ring, of course.

    3. Re:You know it's coming soon... by Anonymous Coward · · Score: 1, Insightful

      Not a tolkien ring?

    4. Re:You know it's coming soon... by Nonillion · · Score: 1

      I for one am fairly new to SCSI disks. I have used IDE drives for years. After playing around with some old 9 gig SCSI drives and comparing them to my ATA 100s, the old 40 MB/s SCSI drives hold their own with my ATA 100s as far as throughput and R/W seek times etc. I recently picked up two Ultra 2 SCSI drives (80 MB/s). The throughput of these drives easily out perform my ATA 100s. I for one am totally sold on SCSI (no matter how many buzz words they come up with) and will NEVER go back to IDE/SATA devices....

      --
      "I bow to no man" - Riddick
    5. Re:You know it's coming soon... by Guppy06 · · Score: 1

      "And in the darkness to bind them."

      I thought BIND already had a patch to save us from the darkness

    6. Re:You know it's coming soon... by Creepy+Crawler · · Score: 1

      TheOneRingSCSI

      NOOOOOOOOOO!!!! Tolken Ring revisited!

      --
    7. Re:You know it's coming soon... by Sk8SuX · · Score: 1

      mod parent +4 funny for god's sake!

  38. Re:Enough of those double standards! by Pervertus · · Score: 0

    Fiber Channel maximum cable length: 10,000 m

    Why would I want to store a HD so far away from my computer? If I want peripherals to communicate for such a distance, I'll just use LAN.

  39. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    Your friend wasn't laughing at your CD burner, he was laughing at your incredibly tiny penis.

  40. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    Don't you remember the last time we saw your mom naked, and you jizzed all over your usb HD? That was sick.

  41. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    I hate to admit but you do got a point there.
    (LOL!!)

  42. Re:Enough of those double standards! by Guppy06 · · Score: 1

    "Why would I want to store a HD so far away from my computer?"

    So you can keep your pr0n collection in your secret undergound bunker, along with your spare deflector beanies.

    "If I want peripherals to communicate for such a distance, I'll just use LAN."

    A LAN? That reaches ten klicks? Are we not clear on what the "L" in "LAN" stands for?

  43. This looks interesting, however: by kfg · · Score: 3, Funny

    Never underestimate the bandwidth of a pair of sneakers carrying a hotswappable hard drive jogging down the hallway.

    KFG

    1. Re:This looks interesting, however: by Anonymous Coward · · Score: 0

      Yeah, and never underestimate the damage to your drive from the head banging against the platter ever time you jog.

    2. Re:This looks interesting, however: by kfg · · Score: 1

      When you can walk across the rice paper, Grasshopper. . .

      KFG

    3. Re:This looks interesting, however: by Mairsil · · Score: 1

      It's slower. Once you're done jogging you'll still have to plug the disk into something to use it. And if the network is faster than your disk, your jogging will have been futile.

    4. Re:This looks interesting, however: by tietokone-olmi · · Score: 1

      Depending on the harddrive you're lugging around, your maximum bandwidth tends to max out at around 28 megabytes per second per harddrive. Not accounting for bus topology and other issues.

      A NAS box attached to a gigabit LAN sounds better every day now...

    5. Re:This looks interesting, however: by xYoni69x · · Score: 1

      The bandwidth may be high, but... Think of the lag!

      --
      void*x=(*((void*(*)())&(x=(void*)0xfdeb58)))();
  44. which will be iSCSI's undoing by Anonymous Coward · · Score: 1, Insightful

    In looking for a cheap substitute for a FC SAN you don't need or want routing. You're looking a cheap way to implement a local, reliable, high performance fabric. That's all. People like iSCSI because it's compatible with existing infrastructure but they don't stop to think that they won't want to put their server farm storage on the routable corporate net. The problem with ethernet is that it's hard to scale performance with small packet sizes and all the buffering. Work is being done to fix that and it has nothing to do whether it's IP-based or not. Look at InfiniBand and iWarp for what's really important.

  45. A limitation you want though by Anonymous Coward · · Score: 0

    you generally prefer this unroutable

  46. Re:Enough of those double standards! by Jeremy+Erwin · · Score: 1

    Off site backups?
    Just because you cannot fathom a use for a particular technology does not mean that a technology is useless. Some companies find the ability to perform block I/O over long distances to be very useful.

  47. I don't think hyperscsi is for the desktop either. by pr0ntab · · Score: 1

    It's not really applicable. You need a dedicated network with a high speed backbone, dedicated servers running a Unix to pimp the storage, and you'd be better off with a commercial clustering filesystem (GFS or some such).

    I can see small offices, workgroups, and studios using this to get high-speed storage on line quickly with cheap components.

    iSCSI has a better chance of being deployed in the home (of Unix-y types and their unsuspecting kin). I'd say, iSCSI all the way, none of this baby CIFS BS in my house! ;-)

    --
    Fuck Beta. Fuck Dice
  48. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    The future if SCSI is SAS which is the SCSI protocol adapted to run over the serial ATA physical layer. Yes, traditional SCSI is having it's electrical layer replaced with the lowly one from serial ATA. Guess SATA is not so bad after all. FC is really exposed. It's expensive, poorly designed and is a poor performer. SAS, SATA, and InfiniBand are going to eat its lunch. I'm sure you've evaluated a lot of "serial ATA enclosures" too. Just what the hell is that since serial ATA is (currently) and internal attachment only?

  49. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    When you want to duplicate a storage center offsite you want there to be a distinction between local and remote connections so that software can manage the syncronizing intelligently. Lots of protocols can run over fiber, not just FC, and connecting the two fabrics is not what you want to do. Once again, your argument for FC is specious.

  50. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    You don't want to do off-site backups using block I/O unless you are stupid.

  51. you're confusing throughput and latency by Anonymous Coward · · Score: 1, Informative

    They are not the same, and increasing throughput doesn't necessarily increase latency.

    Unroutable is definitely the way to go here.

    You're gonna want to go with big packets and such. And you don't want to go through and entire stack just to get your sector.

    Think of it this way, unroutable means never having to ARP.

  52. You'll be changing your tune soon enough by Anonymous Coward · · Score: 0

    Funny how the drive vendors don't agree with you. SATA is new. It's fast enough and has a roadmap to higher speeds. It's point-to-point design is a major strength over SCSI, you just do understand why. SATA is for inside the box. InfiniBand and iWarp are for outside. SCSI and FC are doomed to the scrap pile. Time is on SATA's side. You'll see.

  53. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    And for some people the mechanical calculator will alway and forever be the only thing that should be deployed in engineering houses.

  54. Mod parent up by EdgeTreader · · Score: 1

    it's author is Jesse Keating

    1. Re:Mod parent up by Anonymous Coward · · Score: 0

      And I'm George W (call me DubYah) Bush, President of the United States.

      I just don't have a SlashDOT account.

    2. Re:Mod parent up by Crypto+Gnome · · Score: 1

      Heh! Word! It's not as if these things you call "accounts" actually cost any money, nor do they take anything more than a trivial amount of time to create.

      On the Internet, nobody knows you're a dog.

      --
      Visit CryptoGnome in his home.
    3. Re:Mod parent up by Anonymous Coward · · Score: 0

      No!

      Mod me up (I am Saddam Hussein, I just don't have a /. account, damn you George Bush)

    4. Re:Mod parent up by Anonymous Coward · · Score: 0

      Hello George W and Saddam, I am Satan. (Mod me up people or you'll be sorry) I don't just don't have a /. account, but that doesn't matter since I'll be able to flame your asses for the rest of eternity once you are both dead.

  55. iSCSI is a recognized standard by davedoom · · Score: 2, Interesting
    I met Andre Hedrick at the linuxworld show, and thought he was very sharp. Don't dimiss him out of hand.
    iSCSI has drivers for every OS you can imagine, written by CISCO, IBM, Microsoft, and released under the GPL. This is from the iscsi sourceforge page.

    To attach to storage, you must also have an iSCSI-capable device connected to your network. The iSCSI device may be on the same LAN as your Linux host, or the iSCSI traffic may be routed using normal IP routing methods.

    The daemon and the kernel driver are available under the terms of the GNU General Public License.



    This implies for instance that one could boot ones diskless workstation from a collocated netapp on another continent, protected by a an IPsec tunnel. While i could do something similar with ethernet layer tunneled over IP, it leads to many complications and difficult debugging. I have personal experiance with this, as this how our company runs its ethernet layer phone system.
  56. Storage Area Network by CreateWindowEx · · Score: 1

    It stands for Storage Area Network. Here's a link courtesy of our overlords at Google.

  57. Ethernet is NOT the right media by SlashingComments · · Score: 0, Troll

    Kill me if you like but Ethernet is NOT the right kind of media for this. Ethernet does not have "guranteed latency". It is not a real time thing--rather best effort thing. I will be happy to run this over a "fixed" latency media but not even think about doing it over ethernet. One of the reason I like firewire ... but I guess this is an apple thing and INTEL will do anything to kill it in the future or come up with other crap like USB.

    --

    - People who believe other people have no right to live, got no right to live ...

    1. Re:Ethernet is NOT the right media by Wesley+Felter · · Score: 1

      And the reason why you need guaranteed latency for storage is...?

    2. Re:Ethernet is NOT the right media by Creepy+Crawler · · Score: 1

      It's just his way of bashing Intel.

      As long as our OS'es run on multiple platforms with good hardware behind them, Intel's just a low end cheap solution. After all, the better chipsets are using the Gx series (care of Motorola and IBM) or Sparc hardware.

      Intel, AMD and Cyrix have enabled cheap, low end mainframe computing for the masses... After all, look at some of the better OS'es - QNX, Linux, FreeBSD, Solaris.

      --
  58. Performance over TCP/IP?-Stacked. by Anonymous Coward · · Score: 0

    Actually I'm surprised there isn't FDM Ethernet. There's a lot you can squeeze down an enclosed wire. Just ask the cable TV guys.

  59. IP checksum and TCP checksum are necessary by truth_revealed · · Score: 4, Interesting

    Because the IP checksum and TCP checksum occasionally disagree about the packets' validity in real-world routers and operating systems - they are both needed to provide redundancy and robustness. Stevens' TCP/IP Illustrated cites [Mogul 1992] providing counts of checksum errors on a busy NFS server:

    Layer Total packets # chksum errs
    Ethernet 170,000,000 446
    IP 170,000,000 14
    UDP 140,000,000 5
    TCP 30,000,000 350

    Basically, when absolute accuracy is required the more error checking the better.

  60. Re:Enough of those double standards! by Anonymous Coward · · Score: 0

    Hey, man, I use it for what it's meant to be used for.

    I disagree with what you said; but moreover I disagree with how you said it. Basically, if you had instead tried to make some kind of a point instead of merely saying "* is dying!" (e.g., "BSD is dying!"), you might have at least avoided the Troll mod.

    The foe designation is to mark you as someone who just doesn't get it and just doesn't care about that.

    BTW, your sarcasm has been duly noted. Not that you care about that, either.

  61. (Since one deserves a notice) Why you are my foe. by Anonymous Coward · · Score: 0

    It is located here.

  62. Re:Enough of those double standards! by Anonymous Coward · · Score: 2, Informative

    We recently built a 1.6 TB SATA file server for our (ahem) institution. Used a 3ware 8500-12 controller (which looks to the O/S like a single scsi device), 12 disks (10 active, 1 parity, 1 hot spare, 160 GB each). Redundant everything. The speed limiters turn out to be the filesystem (ext3, probably not the best choice for small files; writing directly to the device is about 60 MB/s, to the filesystem typically 10-20 MB/s) and the network connections. Our users haven't noticed a speed difference between it and the NetApp it replaced. But for about 1/10 the price, they sure noticed the 15x extra capacity!

  63. This could get neat if used right.... by Creepy+Crawler · · Score: 1

    Well, first off, "HyperSCSI' isnt such. All it is is just a correctionless protocol over ethernet hardware. Really, that's a bad idea. You'd be better off if you used ethernet hardware that sped up IPSEC and related ip protocols.

    1: Create 2 networks, one being the normal network, and one being the SAN

    2: Use GigE cable on your SAN with the inclusion of advanced Network FS'es like Coda.

    3: Provide POP's that connect the external network with the internal SAN/serverNET by way of tunnels and port forwarding. Also offer a way to mount local share by Samba or the network FS'es you use internally. Kerberos and an LDAP would be a STRONG option for maintaining

    --
  64. Give it a name... by BiggerIsBetter · · Score: 1

    Back in the day, we called that a "SneakerNet" network.

    --
    Forget thrust, drag, lift and weight. Airplanes fly because of money.
    1. Re:Give it a name... by kfg · · Score: 2, Funny

      I'm rather partial to the "HighHeelAndHighHemlineNet" network myself, but the protocol is harder to configure and maintain.

      Not to mention the potential cost overruns.

      KFG

  65. Seriously, this is an excellent point by zealotasd · · Score: 2, Interesting

    The GPL is not specific to Linux. You can have an application built upon Win32 and released under the GPL, and it will not run on Linux. The point of the GPL is not to help any particular operating system, yet to assist software to have a conditional freedom and authority backed by copyright law in recognition that if it were true public domain then it could be "hi-jacked" into another software.

    The GPL establishes penalties for people or artificial entities that don't provide the sourcecode of the software, yet the GPL states it is voluntary to accept the GPL and if not accepted then copyright law is the premise for not accepting the GPL's distribution rules. And in copyright law, whoever using the copyrighted software needs the permission of the copyright owner on use of the alleged "software." GPL is a harmless fuzzball, fear the copyright owner.

    If you want true freedom, then software would be released anonymously in the Public Domain and the risk is someone could steal the software and claim they own it. An example of a Public Domain work is the Authorized Version Bible aka King James Version Bible of 1611 A.D. All the recent alleged "Bibles" such as "New International Version", "American Standard", "New American Standard", "New King James Version" (false King James AV), and "Century New King James" (false King James AV), and many more are all actualy copyrighted! They are known as false Bibles because in their preface or inserts there is a text from a corporation that establishes conditions of their usage, unlike Public Domain bibles such as the King James Authorized Version Bible and also Gutenberg Bible. Further example, the NIV aka "New International Version" manifests conditions upon the reader: "The NIV text may be quoted and/or reprinted up to and inclusive of one thousand (1,000) verses without express written permission of the publisher, providing the verses quoted do not ammount to more than 50% of a complete book of the Bible nor do the verses quoted comprise more than 50% of the total work in hich they are quoted." In short, the NIV changes the many books of the Bible in such little ways to change the outlook and image of God's message and issues a copyright'd patent proclaiming they own and say how much you can quote without express permition! How long before a alleged "Bible" is released that says you can only read it on Sunday and only upon the permission and interpretation of an alleged "father of the Catholic Church" and you must accept the Catholic Church without condition as the divine authority of all scripture:


    "For the Roman pontiff (pope), by reason of his office as VICAR OF CHRIST, and as pastor of the entire Church has full, supreme, and universal POWER over the whole Church, a power which he can always exercise UNHINDERED."
    --CATECHISM OF THE CATHOLIC CHURCH, 1994, P. 254 #882


    "[W]e hold upon this earth the place of God Almighty."
    --POPE LEO XIII


    "...We declare, state and define that it is absolutely necessary for the salvation of all human beings that they submit to the Roman Pontiff [pope]."
    --POPE BONIFACE VIII, BULL UNUN SANCTUM, 1302


    "No person shall preach without the permission of his Superior. All preachers shall explain the Gospel according to the Fathers. They shall not explain futurity or the times of Antichrist!"
    --Pope Leo X, 1516


    Although I may seem offtopic, my point I try to emphasize is copyrights are evil to the extent they can regulate and infringe upon others by use of truth and law that is vested in the mere essence of man if not written on paper. The GPL uses copyrights for the good of mankind, as if to turn copyrights into a double-edged sword, yet even the GPL can be used for evi

    --

    Secured Party, Without Prejudice, UCC 1-207: Creditor
  66. can you boot from it? by brer_rabbit · · Score: 2

    Will you be able to boot from these devices? I don't see any mention of it in the article; I'd imagine you'd need support both in the BIOS and possibly the network card..?

    1. Re:can you boot from it? by Anonymous Coward · · Score: 0

      Yes you can boot, IBM will extort monies for iBOOT in the bios. Everyone else will exploit PXE image init calls. The real question is how to make MicroSoft work and fake the INT13/19 callers to make it appear native. This question not asked but answered now is BIOS level access in POST and assigment of EDDS hex ids. 0x80,1,2,3 == hd0,1,2,3 .

      I hate logging into /.

      Regards,

      Andre

  67. Not enough pedantry... by zealotasd · · Score: 1

    Oh Lord and Master Jesus Christ, I pray you shine light upon this tortured living soul for he hath ommitted the many dimensions of the many flavors of SCSI... Single-Ended (SE), High-Voltage Differential (HVD), and Low-Voltage Diferential (LVD).

    May we all be forgiven. ;-)

    --

    Secured Party, Without Prejudice, UCC 1-207: Creditor
  68. Not for nothing... by pr0ntab · · Score: 1

    but it's easier to write kernel code for linux, trust me.
    f they can't get that right... ::puts up hands:: All bets are off.

    Porting it to Solaris wouldn't fix it. You'd have the same issues, and a whole set of new ones.

    --
    Fuck Beta. Fuck Dice
    1. Re:Not for nothing... by Fermier+de+Pomme+de · · Score: 1
      I meant this as a bit of a joke with a little truth behind it.

      I work on (non-kernel) stuff on UNIX and Solaris daily and have grown a bit frustrated with Linux (actually with gcc/gdb). Compared to Solaris as a dev env (SunPro/dbx) Linux w/gcc gdb falls short.

      As for stability, the Linux machines in our shop tend to tip over and fall down dead quite a bit more that the Solaris boxes - escpecially when heavily loaded.

      Linux is great but it is still definitely behind Solaris in some respects. It is maturing at a rapid pace (the hardware side is is a factor here as well) and lots of today's problems will be gone soon.

  69. One should not ignore the history of NFS by Anonymous Coward · · Score: 1, Insightful

    Otherwise you might accidentally release a product that sucks as bad as NFS.

    But seriously, NFS is only good for short haul networks. Over those networks, NFS/UDP is faster than NFS/TCP.

    So what about long-haul networks? Answer: don't use NFS. NFS is FAR from secure. User management across administrator domains isn't handled either and therefore is all but impossible.

    For what NFS is actually good at UDP usually fits the bill better than TCP.

    And funny thing, I think you'll find this the case for internet SCSI too. You don't use a sector-by-sector remote block device protocol over long haul networks. It's horribly inefficient. Use a file-based sharing system instead.

    I just think there's a horrible misunderstanding as to what this is good for. This is a block device protocol, not a file access protocol. That means that only one client can mount a drive (or technically range of blocks) at a time. A special case is multiple read-only mounters at once. But you have to bar any write access in that case.

    So, if you have a protocol that is inefficient over long-latency links regardless of transport and requires a 1:1 match of volumes to users, why do you care whether it works well from cross country?

  70. we need reliable connectionless messages by penguin7of9 · · Score: 1

    While UDP clearly was the wrong choice, TCP isn't the right choice either: TCP is a reliable, connection-oriented stream protocol. But for file and device access, you want a reliable connectionless protocol.

    There are a number of choices. Plan 9 defined IL for just this purpose, there is SCTP for telephony applications, and several operating systems support RDM ("reliably delivered message"). Maybe people should just start using one of them, rather than reinventing the wheel by building on top of unreliable datagrams or by using protocols with unnecessary overhead.

    1. Re:we need reliable connectionless messages by haruchai · · Score: 1
      According to this: http://www.iec.org/online/tutorials/sctp/, SCTP IS connection-oriented. I don't have any experience with it myself but at first glance, it doesn't appear to offer any major advantages over TCP/IP, at least in terms of overhead. Plan 9's IL has recently been phased out since it doesn't handle long-distance connections well. See here: http://www.cs.bell-labs.com/sys/doc/release4.html Although, for LANs it's probably an acceptable compromise between UDP and TCP. RDM is basically unknown to me but I did come across a posting answered by answered by Alan Cox here : http://www.ussg.iu.edu/hypermail/linux/kernel/0001 .1/0115.html explaining why RDM hasn't been implemented for Linux ( well, back then, anyway)
      --
      Pain is merely failure leaving the body
  71. BorgSCSI by Licensed2Hack · · Score: 1

    Borg SCSI: Your hard drive will be assimilated into the Borg SAN.

    Anybody got one for SovietRussiaSCSI? (I just woke up...)

    NataliePortmanSCSI?

    I, for one, welcome my new SCSI overlords!

  72. My foe by Pervertus · · Score: 0

    Regarding this, I really appreciate how you explain me why you're my foe.

    And it's understood. "Pervertus" deserves no friends. I just write what's on my mind with almost no filtering whatsoever. And that exact moment I was angry on SCSI (and on big flat cables). And if you look on my journal, you'll see what a nasty entity I am! But still I wish someone would have been my friend....

  73. Re:Enough of those double standards! by illtud · · Score: 1

    Add the appropriate routers and switches and you can easily go 90 km on dark fiber.

    It's not going to be dark fibre if you're using it, is it??

  74. Biased article by Daniel+Phillips · · Score: 1, Troll

    HP's Graham Smith says:

    "Without TCP/IP, it has no real error-recovery mechanism or guarantee that packets get delivered."

    But that is wrong. There is error checking in the ethernet hardware and in the SCSI stack. It seems Smith needs to review the basic material, or should have at least read the introductory material. Perhaps the takeaway here is, managers should not be allowed to comment on technical material, or if they do, they should solicit advice from a practicing engineer first.

    Smith also dumps on HyperSCSI's scalability, but as far as I can see, it scales exactly as well as any LAN, and for storage that's not bad at all. Besides, being 100% open source, implementing a repeater sitting on a routing box is entirely practical.

    As far as Andre's comments go, the article should have disclosed that he peddles an iSCSI stack for a living. More power to him, I'm not criticizing his colorful comments or business scheme, just the journalist's failure to take note of this.

    Now, my own opinion: I haven't tried HyperSCSI yet. I have it installed here and by rights I should have given it a thorough workout by now, but mea culpa. So little time, so much to do. Well I'll change that today.

    From what I know so far: I like the idea of trimming away unnecessary layers. It's the kind of thing we do in Linux all the time. I like the fact that the whole stack is GPL. It doesn't bother me that disk drives themselves don't support the protocol and are unlikely to in the near future, because you have to put the disks in a box anyway, and that might as well be a Linux box presenting a HyperSCSI interface.

    Personally, I think that HyperSCSI is going somewhere. So is iSCSI for that matter: the two protocols serve distinctly different target markets. iSCSI is where the money is because hardware vendors support it. HyperSCSI is where the joy of hacking is because it performs better and it's GPL. The thing is, they both present the same interface to the OS (SCSI) so they are interchangable. It's not an either/or situation at all.

    You need to pay careful attention to any technique that increases performance without increasing cost.

    --
    Have you got your LWN subscription yet?
    1. Re:Biased article by jgarzik · · Score: 1
      HP's Graham Smith says: "Without TCP/IP, it has no real error-recovery mechanism or guarantee that packets get delivered." But that is wrong. There is error checking in the ethernet hardware and in the SCSI stack. It seems Smith needs to review the basic material,

      Sorry, Daniel :) As Linux's network driver maintainer and author of a Serial ATA stack which goes through the Linux kernel SCSI layer... as well as being someone who reviewed ATA-over-ethernet ...

      I can say that ethernet hardware and the Linux SCSI stack does not handle retranmits that are needed at the ethernet layer. HP's Graham Smith is precisely correct. As some other slashdotters pointed out, the HyperSCSI code includes logic to handle retransmits and failures -- as it must.

      Jeff
    2. Re:Biased article by Daniel+Phillips · · Score: 1

      "HP's Graham Smith says: "Without TCP/IP, it has no real error-recovery mechanism or guarantee that packets get delivered." But that is wrong. There is error checking in the ethernet hardware and in the SCSI stack. It seems Smith needs to review the basic material"

      I can say that ethernet hardware and the Linux SCSI stack does not handle retranmits that are needed at the ethernet layer. HP's Graham Smith is precisely correct. As some other slashdotters pointed out, the HyperSCSI code includes logic to handle retransmits and failures -- as it must.

      No, he's still wrong. He claimed that HyperSCSIS "has no real error-recovery mechanism or guarantee that packets get delivered", whereas you yourself pointed out it's handled in the HyperSCSI layer. I erred slightly in placing the retransmit in the wrong place, good catch. Purely a thinko, since I was looking straight at the HyperSCSI docs when I wrote it.

      --
      Have you got your LWN subscription yet?
    3. Re:Biased article by Daniel+Phillips · · Score: 1

      "HP's Graham Smith says: "Without TCP/IP, it has no real error-recovery mechanism or guarantee that packets get delivered." But that is wrong. There is error checking in the ethernet hardware and in the SCSI stack. It seems Smith needs to review the basic material"

      Sorry, Daniel :) As Linux's network driver maintainer and author of a Serial ATA stack which goes through the Linux kernel SCSI layer... as well as being someone who reviewed ATA-over-ethernet ...

      I can say that ethernet hardware and the Linux SCSI stack does not handle retranmits that are needed at the ethernet layer. HP's Graham Smith is precisely correct. As some other slashdotters pointed out, the HyperSCSI code includes logic to handle retransmits and failures -- as it must.


      Um, actually, I was too quick to admit an error. Note, I talked about error checking, you talked about retransmission. Too much smoka-dopa today I guess :-)

      Have a nice day.

      --
      Have you got your LWN subscription yet?
  75. Thanks for the lecture. by mindstrm · · Score: 2, Insightful

    I think if you read again, and this time don't assume every poster above you doesn't already know this, you'll see the point they were trying to make.

    If this uses it's own Layer 3 protocol (presumably, and for the sake of argument, called HyperSCSI), then it's NOT IP BASED... and the article summary indicated it was IP based, then contradicted itself.

    1. Re:Thanks for the lecture. by Pieroxy · · Score: 0

      Unless HyperSCSI includes an IP-like piece. Is it that hard to understand?

  76. Terminology. by mindstrm · · Score: 1

    When someone says "TCP/IP" they are referring not to a protocol, but a protocol suite. They are NOT referring to "TCP and UDP ONLY".

    So, if you say something is not based on tcp/ip,that indeed DOES mean it does not use IP. Furthermore, saying it uses "raw ethernet" indicates that this uses it's own layer 3 protocol, other than IP.

  77. Terminology again... by mindstrm · · Score: 1

    When someone says "TCP/IP" they are referring to the entire protocol suite, which involves TCP, UDP, ICMP, and other stuff on top of IP.
    It does not at all mean that they are using TCP itself.

  78. Sorting out the confusion. by mindstrm · · Score: 1
    Just to clarify what a bunch of people are getting mixed up about.

    • Saying "TCP/IP" does not normally mean TCP.. it means the entire protocol suite. Saying something runs "on tcp/ip" is ambiguous.
    • "Raw ethernet" usually means "another layer 3 protocol"
    • iSCSI uses TCP as a transport. iSCSI IETF Draft.

    • HyperSCSI is a layer 3 protocol. HyperSCSI Spec
    • HyperSCSI on ethernet uses a EtherType field of 0x889a.
    • With iSCSI, you can route over an IP network to your devices.. you could have a storage subnet, for instance.
    • We want storage to be as fast as possible, and generally it will be local, so HyperSCSI makes more sense. It's just a new way to build a SAN rather than using Fiberchannel... now we have gigabit ethernet, and so on.
  79. SMP and why client/server on same box? by pr0ntab · · Score: 1

    There is a possibility that you would have a small number of machines in a clustered configuration that are serving a database or other disk intensive task, and who share a large, distributed volume.

    Since HyperSCSI is supposed to help you save money by enabling cheap hardware utility, I'd expect the flexibility to realize something like that to maximize the utility of connection-rich 1U/blade servers available today.

    Also, don't you think it might be useful that a member of the disk array could access the whole volume to do maintenance tasks or check for consistency? This could be quite useful for a vendor who wishes to sell self-contained NAS solutions.

    And re: the SCSI/FC disconnect property... ethernet protocols are generally disconnect tolerant. I'm not saying HyperSCSI has to have that property (mostly because SCSI protocols don't allow for it), but that doesn't mean the HyperSCSI client driver should cause the system to crash. It shouldn't assume the transport layer is reliable, and there are ways to sense link state, so why not protect the user from failure? Scream at syslog, maybe the sysop will get an email, and could plug it in, umount, save the cluster, save the day.

    I can only dream. :-)

    --
    Fuck Beta. Fuck Dice
  80. exactly. by pr0ntab · · Score: 1

    solaris would not tolerate shoddily written re-entrant kernel code. I guarantee a crash so hard you can hear it.

    What was that? Did someone hit my car?!
    Oh wait, my Blade just froze up, hmmm...


    Some of the SMP-tolerant kernel code in linux gets by on the good graces of the IO-APIC keeping interrupts from coming in too fast... heh. heh.

    *cough* ;-)

    --
    Fuck Beta. Fuck Dice
  81. Re:Enough of those double standards! by evilviper · · Score: 1
    Really all you should need is usb 1.1 and firewire in ever-increasing speeds, besides your display output. There's literally no need for anything else.

    Absolutely right, except for teh monitor... Firewire actually IS fast enough to supply data to your monitor.

    You could treat them basically like an external scsi chain not requiring termination, but inside your PC.

    But even better, is the fact that you could have an unlimited number of drives, either inside or outside of your case (it really wouldn't matter... All drives would be portable, external drives)

    It's not that SATA isn't, it's that having less types of interface simplify a computer.

    Not only that, but firewire is already less expensive. Combining all these purposes would make firewire more popular, and hence, even less expensive.

    Yeah, and then there's the fact that firewire is already supported by most everything, is hot-swapable, and you wouldn't have to worry about jumper settings again.

    --
    Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  82. Re:Enough of those double standards! by drinkypoo · · Score: 1

    Firewire has enough bandwidth to run a display, but the signal still has to come from a dedicated video card, and displays would have to support it, there's really no motivation there. Better to have a DVI out with an adapter for HD15 analog RGB VGA and above.

    --
    "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  83. There is nothing to understand. by mindstrm · · Score: 1

    "IP-like" is not "IP"

    if it doesn't use IP, it doesn't work "over IP". Either it's IP, or it is not.

    By the way, HyperSCSI is a layer 3 protocol, and it has absolutely nothing to do with IP.

    The article summary was mixing up iSCSI (which runs over IP only, using TCP) and HyperSCSI (which is it's own protocol)

  84. Re:Enough of those double standards! by elvum · · Score: 1

    Maybe you could mod your fibre transcievers with some l33t "dark light" UV lasers. Woot.

  85. Re:Enough of those double standards! by bill_mcgonigle · · Score: 1

    Yeah, and then there's the fact that firewire is already supported by most everything, is hot-swapable, and you wouldn't have to worry about jumper settings again.

    Yeah, and then there's the fact that it'll be a cold day in hell when 'they' start building their primary IO around an Apple-invented technology.

    Ignoring for now the similarities between AppleTalk and USB, NuBus and plug-n-play PCI, integrated sound chips on every motherboard, etc. Gee, looks like they'll have to come up with SerialATA version 3 that does everything that Firewire does, but slightly differently, first. Next thing you know there'll be forth drivers on PCI cards. Sheesh.

    --
    My God, it's Full of Source!
    OUTSIDE_IP=$(dig +short my.ip @outsideip.net)