Slashdot Mirror


Network Monitoring Appliance Looks Below 1 Microsecond

eweekhickins writes "Corvil has unveiled a new tool to help network managers cope with increasing pressure to improve performance. This appliance, from the Dublin-based company (with backing from Cisco), passively monitors traffic across networks in segments below 1 microsecond in length and correlates monitoring data with remote appliances and gives a complete picture of latency, jitter, packet loss and other phenomena that affect network and application performance. Corvil CEO Donal Byrne noted that 'If you can drop a millisecond [of latency] off, you're a hero.'"

78 comments

  1. Drop a millisecond by Anonymous Coward · · Score: 1, Interesting

    "If you can drop a millisecond [of latency] off, you're a hero."

    This is the kind of attitude that breeds the Scotty types (you know who you are). If you can cut 2 ms, then only cut 1 ms now and save the other for when you really need it. And when the company is going to spend thousands for analysis, then suddenly cut the last 1 ms.

    1. Re:Drop a millisecond by BSAtHome · · Score: 2, Interesting

      However, it might be more effective to make your application more tolerant to latency (and fix your TCP window first).

    2. Re:Drop a millisecond by molo · · Score: 3, Informative

      Some applications are natively sensitive to latency and jitter. Consider VOIP or teleconferencing, or algorithmic stock trading.

      -molo

      --
      Using your sig line to advertise for friends is lame.
    3. Re:Drop a millisecond by slashdotmsiriv · · Score: 1

      "If you can drop a millisecond [of latency] off, you're a Hero."

      Does this mean that a next step in human evolution is being able to measure time with microsecond accuracy?

    4. Re:Drop a millisecond by Architect_sasyr · · Score: 1

      I wouldn't believe it if I hadn't seen it for myself, but the users at my previous company could detect a 0.3 millisecond additional delay on a fibre line less than 100m long (they were whiny son's of bitches anyway). We took out the old Ethernet line out for some reason or another, and when we switched them over to this link there was instant complaints. They didn't even know we'd made the switch but still they cried.

      So I guess we've already evolved that far... the next step would have to be inbuilt dart barrels or something so the next time they come to whine.......

      Note: the delay appears to have been the switches at either end not working nicely with the new link medium

      --
      Me failed English...
      FreeBSD over Linux. If my comments seem odd, this may explain...
    5. Re:Drop a millisecond by Mr+Z · · Score: 1

      Note: the delay appears to have been the switches at either end not working nicely with the new link medium

      Was there any sort of increased packet loss? Also, was it merely an average increase of 0.3ms? If there were any sort of peaks in the latency, i.e. increased jitter, that could be much more noticeable than an average latency increase might suggest.

      If your signals travel the speed of light, the propagation delay from pt. A to pt. B (100m in your case) should be around .33us (microseconds). Propagation delay in, say, a coax cable is about twice that--signals move at about half the speed of light. Even if it was 1/10th the speed of light in your fibre line (unlikely as that may be), that's still only 3.3us.

      To see 0.3 milliseconds difference (300 microseconds), I'm guessing that the overall line behavior must not have been very nice and there was a fair bit of misbehavior going on.

      --Joe
    6. Re:Drop a millisecond by Architect_sasyr · · Score: 1

      Unfortunately (or thankfully as the case may be), my information is second hand, coming from the system administrator at the time rather than my own checks.

      There wasn't any packet loss that I am aware of, some pretty intensive (proprietary) UDP applications operating across the link (there was no TFTP style checks on this) and dropping a packet would have been noticed. Average latency was, (for example) 0.7ms and increased to 1.0ms... some fairly standard diagnostics such as a continuous ping showed no major changes in the network, no large peaks or odd lows, just an increase in average time... the data from other applications supported this.

      Can't say for sure what was the problem (see SysAdmin reference above), but a replacement of the hardware at both ends fixed whatever it was.

      --
      Me failed English...
      FreeBSD over Linux. If my comments seem odd, this may explain...
    7. Re:Drop a millisecond by Anonymous Coward · · Score: 0

      I will have to post this anonymously because I actually work on this from time to time.

      1. It is not the absolute precision in latency measurements which matters. What matters is measuring latency in a manner which provides an insight into the behaviour of the transaction chain. In nearly all cases this is the latency across a processing node which can be picked up by any dual input probe most of which actually have nanonsecond latency, not microsecond. It is simply a matter of walking the transaction chain with such a probe and making sense of the results.

      2. It is the same as in bed, it does not matter how big (or small in this case) your p***s is, what matters is if you know how to use it. The universities have stopped teaching proper probability theory to CS students. As a result 99.9% of the so called "CS graduates" from a USA or UK university look at the results from the probe and have no idea WTF do they mean as far as the dynamics of the underlying process. The worst part is that while the realtime traders themselves can make sense of this data in a jiffie, they are usually not allowed anywhere close to it. Classic example of IT inferiority complex resulting from the appalling quality of USA/UK education.

      Corvil makes a very good pitch into this environment. They are fully aware that there is a tremendous pressure onto the banking and hedge fund IT to deliver and that the majority of said IT has no math skills to do so. So they go and wave ms and shiny GUIs around. It is usually bought outright because its price is peanuts compared to realtime prop trading losses due to latency problems (I have seen figures on the order of 600000$ per millisecond of latency in one day for some markets).

      This article also says depths about the so called credit crunch. It looks like the banks have tightened up their wallets to the point where Corvil has to do Slashdot infomercials. Now that is a scary thought.

    8. Re:Drop a millisecond by Alarash · · Score: 1

      Some applications are natively sensitive to latency and jitter. Consider VOIP or teleconferencing, or algorithmic stock trading.
      Most VoIP codecs can work with a maximum of 30ms Jitter. You can't drop below 1ms because of the latency implied by the network equipments (just to go through their hardware takes a few milliseconds - not to mention stateful equipment such as firewalls or load balancers, etc.)

      Also, I wonder how they can passively measure latency or jitter - accurately, that is. Network Testing companies (such as Spirent, Ixxia or Agilent) do it in a much better way: you send a frame, and timestamp it. When it's received by the other side of the testing device, another timestamp is created. Then they compare the two timestamps and can accurately give you the one-way latency. When the two end-points are far away, you use two devices which you synchronize via GPS (down to the nanosecond precision). I don't see how you can measure latency (and, therefore, jitter) 100% passively.

    9. Re:Drop a millisecond by nilbud · · Score: 0

      That's why you're a consumer not a producer of such products.

      --
      never let a man put his dirty how-do-you-do into your bajingo
    10. Re:Drop a millisecond by amorsen · · Score: 2, Funny

      You can't drop below 1ms because of the latency implied by the network equipments (just to go through their hardware takes a few milliseconds - not to mention stateful equipment such as firewalls or load balancers, etc.)

      Here's a nickel, kid, go buy yourself a real firewall.

      --
      Finally! A year of moderation! Ready for 2019?
    11. Re:Drop a millisecond by Alarash · · Score: 1

      I read my post again and I wasn't clear. I didn't mean that one firewall created implied several millisecond of latency (although this can be true when you reach some critical load). But every device adds some latency, lower than 1ms, and since packets go through a whole lot of these equipments, in the end you can't really drop below a certain amount of latency.

  2. and again in layman's terms?? by Virgil+Tibbs · · Score: 1, Interesting

    Can anyone explain to me what the advantages of this actually is?
    sorry if I sound stupid. It seems like greak to me. I'm just used wireshark etc

    --
    www.tdobson.net #### Dare to Dream #### blog.tdobson.net
    1. Re:and again in layman's terms?? by Kazrath · · Score: 2

      I am definitly not a subject matter expert... however using wireshark to trace packets from a specific box to another with intentions of determining and fixing a network issue is much different than activly monitoring and storing all traffic going through your switches. Wireshark is "on-demand" while what they are talking about is "real-time".

      The breakthrough appears to be that it is the fastest of these type of devices available.

    2. Re:and again in layman's terms?? by evil+agent · · Score: 2, Funny

      sorry if I sound stupid. It seems like greak to me.

      That just about says it all...

      --
      End transmission.
    3. Re:and again in layman's terms?? by Virgil+Tibbs · · Score: 1

      Ah, sorry about the spelling in that post everyone!
      I managed to miss out more words, and make more spelling mistakes in that single post than I usually do in a week.
      I guess I need some more Coffee.

      --
      www.tdobson.net #### Dare to Dream #### blog.tdobson.net
    4. Re:and again in layman's terms?? by DigitalCH · · Score: 5, Informative

      The benefit depends on the person using it. Take an investment bank and an algorithmic trading system. Most of your money is made on volume, the faster you reply the more deals you get, the more volume you have, the more money you make. I've seen a lot of presentations at investment banks where every 5 milliseconds they shave off is $50+ million/year more money they make. Keep in mind that most of these companies have gotten to the point where they can do round trip for the whole trade transaction in 5 milliseconds or less. So each millisecond is like a 20% improvement.

    5. Re:and again in layman's terms?? by Virgil+Tibbs · · Score: 2, Funny

      I did of Course mean Greek.
      And that I was "used to" Wireshark.

      FYI, my Greek is much worse, than my first language, English. It is even worse than French and Russian, two other languages I can speak to varying proficiency.
      However, sir, I am very tired.
      At the end of a long day, it is not unusual to think in straight lines while typing nonsense.
      Moreover, thank you kindly sire, for asking God to help me;
      I needed some guidance to help me past morons like you.

      --
      www.tdobson.net #### Dare to Dream #### blog.tdobson.net
    6. Re:and again in layman's terms?? by Virgil+Tibbs · · Score: 1

      sir, that was a "low blow".
      Please see various other posts of mine, to see why that was uncalled for and unnecessary.

      --
      www.tdobson.net #### Dare to Dream #### blog.tdobson.net
    7. Re:and again in layman's terms?? by Anonymous Coward · · Score: 0

      sorry if I sound stupid. It seems like greak to me. I'm just used wireshark etc

      I love unintentionally funny people.
    8. Re:and again in layman's terms?? by XHIIHIIHX · · Score: 1

      If you "Greak" is as bad as your English
          ***

    9. Re:and again in layman's terms?? by thegrassyknowl · · Score: 2, Informative

      It seems quite simple. I took the following from the article:

      They timestamp the packet at some point in the network and when it arrives at the other side they timestamp it again to work out the trip time. Not really rocket science, but they seem to have come up with ways of measuring time pretty accurately at two different places and keeping the clocks in sync or working around clock drift in their measurements.

      The other part of their system is some algorithmic work that correlates packets and tries to work out a profile of the network to allow better tuning of networking parameters or even modifying applications to perform better.

      It's all very useful information to have if you're trying to milk the last bit of performace out of your network. It's useful for single customer applications, but I see ISPs using it to really tune the larger pipes between POPs so that things like VoIP work more efficiently even with lots of customers making and receiving calls in the presence of other traffic. It often isn't enough to say "send these types of packets out first", particularly if one user or application is generating a lot of them and other users are not; you can starve other users or applications of data.

      --
      I drink to make other people interesting!
    10. Re:and again in layman's terms?? by Anonymous Coward · · Score: 0

      I highly doubt network segments exist where RTT is counted in nanoseconds and apps benefit-money is better spent on trying to find a medium faster than light at this point:
      "passively monitors traffic across networks in segments below 1 microsecond in length "
      Shaving milli-seconds and even micro-seconds is digestable, but nanos???

  3. Oh goodie! by JK_the_Slacker · · Score: 0

    Now I can get those random stock tips in my email in less milliseconds! I will be rich one day, I will!

    --
    I'm waiting for a "-1 somepeoplejustshouldn'tgetmodprivileges" meta-moderation.
    1. Re:Oh goodie! by mccalli · · Score: 5, Informative

      Now I can get those random stock tips in my email in less milliseconds! I will be rich one day, I will!

      Milliseconds count. Maybe not to your stock tips, but trust me as someone who has spent about a decade in this kind of environment now - sub-millisecond latencies certainly count in automated trading between investment banks/hedge funds/whatever. To the point where people are prepared to pay fortunes to have their machines located physically closer to an exchange.

      For fun, check out arbitrage, and then ponder again why reducing latency might be important in a competitive environment. Think about highly liquid markets, such as spot foreign exchange.

      Cheers,
      Ian

    2. Re:Oh goodie! by Eivind · · Score: 1

      Yeah, sure. But that's zero-sum games. Having low latency here doesn't help at all. What helps is having lower latency than the *other* traders.

      If *everyone* improves their latency equally much, they're all back to square one.

      Which is typical of speculation (as opposed to investment) -- its fundamentally stupid playing a zero-sum game when positive-sum games are around.

  4. Still too laggy for FPS games. by Eevee1 · · Score: 1, Informative

    No offense guys, but unless you can make something that cuts the ping time in half, we won't be having any good FPS games against the Americans without increasing the ping from 60ms to 250ms or higher. 249ms won't cut it. It just won't.

    1. Re:Still too laggy for FPS games. by Drunkmunky · · Score: 1

      Damn you Americans and your low latency connections, I'm lucky to get under 300ms to most game servers (500+ for World of Warcraft) and I am on adsl with no interleaving.

    2. Re:Still too laggy for FPS games. by deftones_325 · · Score: 0

      World of Warcraft? Geez, with that kind of latency, you have time to go take a shit on your Star Trek toilet bowl ring, get back and still cast some super-secret magic on some other nerd.

      --
      "A gentleman never strikes a lady with his hat on." - Fred Allen
    3. Re:Still too laggy for FPS games. by Anonymous Coward · · Score: 0

      That sucks, I used to get around 300ms from Australia, but that was before the expansion, I quit then.

      Have you tried using stopcasting macros? For each spell you have, make a macro that does: /stopcasting /cast whateverspell

      Now don't press the button until you are within milliseconds of the last spell you cast finishing. The client will think it has cancelled the previous spell and is free to cast the next spell. The server will receive the /stopcasting AFTER the spell has actually finished, and the next spell can be cast without the delay. On a 2 second cast time with 500ms latency, you could potentially add 50% damage per second with this.

    4. Re:Still too laggy for FPS games. by dodobh · · Score: 1

      Just host your own server and make the Americans play against you.

      --
      I can throw myself at the ground, and miss.
  5. Re:comment not related by Anonymous Coward · · Score: 0

    Get back to /b/. Oh, wait - you can't.

  6. It burns! by Sta7ic · · Score: 1

    Argh, the buzzwording! It burns us! Make it stop!!

    More seriously though, the article might benefit from a little bit more context. As mentioned above, taking 1ms off network latency is meaningless across long connections, where you expect 40ms latency just from the routers, speed of light, etc. Taking 1ms off when microseconds count, when your latency is 5ms, within a system where automated transactions and big money are involved, then the situation is different.

    The readers do not recognize the requirements imposed by the environment implicitly!

  7. buffering ......... by khasim · · Score: 2, Interesting

    Milliseconds count. Maybe not to your stock tips, but trust me as someone who has spent about a decade in this kind of environment now - sub-millisecond latencies certainly count in automated trading between investment banks/hedge funds/whatever. To the point where people are prepared to pay fortunes to have their machines located physically closer to an exchange.

    A more logical reason would be to reduce the possible traffic issues.

    If I'm sitting on the network with a 100Mb/s connection straight to the server ... that's an entirely different scenario than sitting on the other side of the world hooked in through the Internet.

    First off, the chance of a dropped packet (and delay in re-transmitting) is a magnitude smaller when I'm on the network.

    So looking to shave a micro-second/milli-second off of a packet isn't that important or realistic. Humans do NOT make decisions that fast. You'd do better improving the speed of your code or throwing faster hardware at it.
    1. Re:buffering ......... by mccalli · · Score: 2, Interesting

      So looking to shave a micro-second/milli-second off of a packet isn't that important or realistic. Humans do NOT make decisions that fast. You'd do better improving the speed of your code or throwing faster hardware at it.

      Humans make decisions at a minimum of around 200ms I think - that's from memory, so I expect someone to be along and give the real figure soon. But I'm not speaking about humans, I'm speaking about algorithmic trading in a competitive environment. It truly is that significant to remove certainly a millisecond, and why stop there. Think about clustered pricing engines and similar, all trying to price as fast as possible to both a) capture business and b) avoid arbitrage. There definitely is a market for this level of network analysis. I'm on the code-side myself, so I agree that getting your code right is the most important. Throwing faster hardware at it helps however, depending on design, and in some circumstances you take all the speed you can get no matter which source it comes from.

      Not every financial system needs this level of performance, but there are a significant number that do.
      Cheers,
      Ian

    2. Re:buffering ......... by Passresv · · Score: 2, Insightful

      Hey Khasim. Can I say, I have to disagree. Analysing latency on large networks is incredibly important. There are often so many latency-inducing mechanisms between a packet leaving an application and arriving at the other end (misconfigured stacks, poor cabling, misconfigured routers and switches (#1 cause!), greedy applications, messy applications, multicast floods etc etc), that it is impossible to tell what the problem is. Modern networks are straining with latency problems that added bandwidth doesn't always solve. The problem is that if you have a large number of servers and clients and there's a problem - which codebase or hardware do you upgrade? You can't tell, because you don't know who's causing the problem. Only by analysing the network can you tell. As a developer, I use wireshark for this often to find out what the trouble is - asking other coders doesn't help - only when I look at the network I can pinpoint the problem - if you fail to configure your video service properly, a group of managers having a v-conference can blot out your network. But you won't know its happening because its off in building #5 somewhere - nowhere near your main servers.

    3. Re:buffering ......... by Kevin+Stevens · · Score: 1

      I used to work in Derivatives Market Making, specifically in their connectivity group. Latency is a *very* big deal. Arbitrage aside, essentially market making works like this- whoever has the best price gets the trade. For the sake of simplicity, lets assume everyone prices an option the same way all the time. Lets also assume that everyone can also price an option at the same exact speed. A new price tick comes in, forcing the options to all reprice at once. The guy who gets his quote out there first is going to capture whatever orders are out there at the new price, and thus capture the bid/ask spread.

      When I left, we were looking at sub 10ms and things like colocation to reduce it further, not anywhere near the microsecond level, but thats where things are headed.

  8. RIPE NCC Test Traffic services by jjgm · · Score: 3, Informative

    The RIPE NCC's Special Projects group have been offering sub-microsecond latency/jitter/analytical services to ISPs for years. Their data is invaluable and unique, since it measures latency, jitter and packetloss in a single direction (unlike ICMP Ping, which is a round-trip measurement over an asymmetric path) and goes back at least to 2000. The paper claims accuracy to 0.0006 ms, which was good for the time when the product was designed.

    Read about the project here and the paper on TTM [pdf] that was presented at the PAM2001 conference.

    (This isn't what Corvil do.)

  9. Time for token ring? by khasim · · Score: 2, Insightful

    Some applications are natively sensitive to latency and jitter. Consider VOIP or teleconferencing, or algorithmic stock trading.

    I guess that would depend upon where both points are. One has to be on your network. The other ... ?

    Now, with Ethernet, one machine can hog the switch (I'll guess that they aren't using hubs). What use is shaving a millisecond off the app if you're still vulnerable to someone else hogging the network at the moment that you're trying to complete your transaction?
    1. Re:Time for token ring? by morgan_greywolf · · Score: 2, Interesting

      Now, with Ethernet, one machine can hog the switch (I'll guess that they aren't using hubs). What use is shaving a millisecond off the app if you're still vulnerable to someone else hogging the network at the moment that you're trying to complete your transaction?


      That's what proper network segmenting is for. The guy that hogs the bandwidth usually has some business need to do so (but not always ;). Anyway, say the CAD guys do large file transfers multiple times a day. Well, you segment them off. That way they can't dominate the switch for that all-important transaction network, which would, of course, have its own segment different from the one where your office clients sit.
    2. Re:Time for token ring? by DarkShadeChaos · · Score: 1

      Or perhaps implement QoS and throw in VLANs for good measure?

      --
      The machine unmakes the man. Now that the machine is so perfect, the engineer is nobody. -Ralph Waldo Emerson
    3. Re:Time for token ring? by OnlineAlias · · Score: 1


      Actually, that is what QOS is for. Segmenting off everyone that wants to do some transfer makes for a fragmented unsummarized network with stretch VLANS all over god and country. Segmenting in little networks is fine...but a disaster in large ones.

    4. Re:Time for token ring? by smellotron · · Score: 2, Interesting

      Actually, that is what QOS is for. Segmenting off everyone that wants to do some transfer makes for a fragmented unsummarized network with stretch VLANS all over god and country. Segmenting in little networks is fine...but a disaster in large ones.

      You're missing where one of the parents commented about cases where speed matters. If you're doing algorithmic trading and you're using software QoS, and your competitor is using physical hardware segmentation, your competitor wins (all other things being equal).

    5. Re:Time for token ring? by Anonymous Coward · · Score: 2, Informative

      >Actually, that is what QOS is for. Segmenting off everyone that wants to do some transfer makes for a fragmented unsummarized network with stretch VLANS all over god and country. Segmenting in little networks is fine...but a disaster in large ones.

      All of which just basically proves how shitty collision-based networking is, especially as network size and speeds increase: You have to throw more and more hardware at it, to preserve performance.

      The only thing that switching and VLANs do, is attempt to rectify a fundamentally flawed physical network protocol by hiding its fundamental nature (switching) or reducing the size of the collision domain (VLANs).

      Because, when you get right down to it - it's still Ethernet, and so, is still basically CSMA/CA, though the switches, VLANs, etc., hide it for the most part.

      But, it raises its ugly head, when you start to scale the network, doesn't it? And, as you do, you have to throw more and more hardware at the problem.

      Token-based networks avoid that. BTW, Token-based doesn't necessarily mean Token Ring. I know, that's a concept that is difficult for many of you to grasp, because when you hear the word "Token", it's like a bell "ringing", and you salivate in response.

      Also, QoS is easier to implement on a token-passing network, by its nature.

    6. Re:Time for token ring? by Anonymous Coward · · Score: 0

      Now, with Ethernet, one machine can hog the switch (I'll guess that they aren't using hubs).


      This is a statement that tells me you know 0 about switches and ethernet.

      In a switched network there are no collisions, that's the issue the "switch" solved over shared media like hubs. All traffic gets through. In fact, switches can connect any port to any other port via the fabric and there's no contention for port to port communication. The 24 port Nortel 5520, for example, has a 160Gbps fabric in it. Even if all 24 (1Gbps) ports were saturated, no one could "hog the network".

      It's impossible for any one person to do this. It's like saying that one person could turn their water on, saturate a 6" municipal sewer pipe, and "hog the sewer". You can't saturate a 6" pipe with a 1/2" one.

      Your statement would be more accurate if you said "Now with internet connections, one machine can hog the internet connection.". It's not the switched infrastructure (or "Network") being "hogged".

      -AC
  10. Because you can buy faster hardware. by khasim · · Score: 1

    But I'm not speaking about humans, I'm speaking about algorithmic trading in a competitive environment.

    So get liquid nitrogen and overclock your processor.

    Speeding up the computer running the algorithm is more productive than trying to get your packet through 1 millisecond faster.

    Think about clustered pricing engines and similar, all trying to price as fast as possible to both a) capture business and b) avoid arbitrage.

    I understand that.

    I also understand that if you're LOSING because you're one millisecond slower than the competition (or the shift) then you're focusing on the wrong issue.

    #1. Re-write your code to be more efficient

    #2. Get a faster computer

    There definitely is a market for this level of network analysis.

    There is also a market for pet psychics. I'm fully supportive of people selling whatever they can get someone else to buy.

    I'm on the code-side myself, so I agree that getting your code right is the most important. Throwing faster hardware at it helps however, depending on design, and in some circumstances you take all the speed you can get no matter which source it comes from.

    My point is that if you're looking at spending money for a 1 millisecond gain, you've already lost sight of the goal.

    There are too many points where delays can happen and almost every one of them is out of your control.

    The only time they would not be a factor greater than 1 millisecond is when the process is running on the trading server itself and then the network would be completely removed anyway. And even that is a problem if the trading server has to communicate with any other server.

    What is the buffer capacity of the server's NIC?
    How long does it take to empty it?
    What was the guy just before you doing? Did he fill it?

    The same with the network switch.

    And that's not even counting a router or everything that can slow down your Internet connection.
    1. Re:Because you can buy faster hardware. by mccalli · · Score: 4, Informative

      What is the buffer capacity of the server's NIC?... How long does it take to empty it?... What was the guy just before you doing? Did he fill it?

      Sorry, but do you really think people don't do that level of analysis as well as trying to improve the network speed?

      My point is that if you're looking at spending money for a 1 millisecond gain, you've already lost sight of the goal.

      The goal in this kind of app is low latency - every millisecond counts. There are other goals of course, throughput, guaranteed maximums as well as low minimums...but in this case we were specifically discussing latency.

      And that's not even counting a router or everything that can slow down your Internet connection

      Internet connection? Who's talking about an internet connection? Dedicated leased lines direct to the exchange, internal transfer between machines...this kind of stuff isn't One Man And His PC sitting at home trying to day-trade. Yes there's variability, but even so engineering it out as much as possible is certainly an aim.

      All the levels of analysis you describe, from the algorithm right through to the NIC, are already being done. At some point they will be done better, because of a change in available tools. This appears to be one of those tools.

      Cheers,
      Ian

    2. Re:Because you can buy faster hardware. by doctorcisco · · Score: 5, Informative
      In a financial trading arbitrage environment, that millisecond would literally be worth millions of dollars. Yes, it matters that much. Some of the best and most expensive brains in the software and systems engineering world are paid a whole lot of money to try to gain that millisecond. At least one "dorm room to gazillionaire" story was built on just such an edge in the early 1990's. The resulting trading firm has $10 billion in net profits since 1998. Warning, there be flash here! http://www.citadelgroup.com/

      Do not assume that the people interested in this level of performance are idiots. There's always the possibility they know more about what they're doing than you do.

      doc

    3. Re:Because you can buy faster hardware. by Anonymous Coward · · Score: 0

      The benefit is in the feed of data from your provider. You're getting real-time data but there is always a delay in getting it. If you can reduce the delay you have a better chance of getting the price you want and executing the trade at the optimum time.

      Ian's right. In this environment the reduction in latency pays off big time.

    4. Re:Because you can buy faster hardware. by Anonymous Coward · · Score: 0

      Do not assume that the people interested in this level of performance are idiots. There's always the possibility they know more about what they're doing than you do.

      The hell you say! I'm a random idiot on Slashdot!

  11. no freeware, trial or demo = no thanks by Anonymous Coward · · Score: 0

    if we can't try it, my company won't buy it

    i guess they're too just important for us

    1. Re:no freeware, trial or demo = no thanks by Anonymous Coward · · Score: 1, Insightful

      Or you work for a shitty company (ie: small, unimportant, does nothing) that can't get demo units from other companies.

  12. MOD up parent by Anonymous Coward · · Score: 0

    subject says it all :)

  13. You'll never go faster than the speed of light by NSash · · Score: 3, Informative

    "There is an old network saying: Bandwidth problems can be cured with money. Latency problems are harder because the speed of light is fixed - you can't bribe God."

    A beam of light takes roughly 1/7 of a second to travel around the world. That means that if you're playing on a server on the other side of the world, your ping will always be at least 143 ms. That's a hard physical limit: the only way to decrease that time would be to drill a hole through the Earth, or move closer.

    1. Re:You'll never go faster than the speed of light by Eevee1 · · Score: 0

      "The speed of light was too slow, so we made it faster." - Farnsworth. Anyway, so no matter how hard these guys try, they'll never be able to get it under 143 ms if we're on the other side of the world?

    2. Re:You'll never go faster than the speed of light by Anonymous Coward · · Score: 0

      "That's a hard physical limit: the only way to decrease that time would be to drill a hole through the Earth, or move closer."

      Or gravitational lensing FTW!

    3. Re:You'll never go faster than the speed of light by The+Clockwork+Troll · · Score: 2, Funny

      That's why I only attend LAN parties in the vacuum of outer space.

      --

      There are no karma whores, only moderation johns
    4. Re:You'll never go faster than the speed of light by Anonymous Coward · · Score: 0

      Some of us don't need vacuum to suck at certain games.

    5. Re:You'll never go faster than the speed of light by Mikey1983 · · Score: 1

      A beam of light takes roughly 1/7 of a second to travel around the world. So the hard limit would be 1/14 to get a packet halfway around the planet (approx 71 ms) which actually is pretty fast!
      --
      Mike
    6. Re:You'll never go faster than the speed of light by petermgreen · · Score: 1

      and another 1/14 to get it back again making a total ping time of 1/7 of a second.

      and light in fiber moves slower than light in free space.

      Of course UK to USA isn't as much as halfway round the world.

      --
      note: i'm known as plugwash most places but i screwd up registering that here somehow in the past and now can't register
    7. Re:You'll never go faster than the speed of light by shentino · · Score: 1

      No, it would be more like 71.5

      Going half way around the world only takes 1/2 of 1/7, or 1/14th.

  14. Re:comment not related by Anonymous Coward · · Score: 0

    You forgot rule 1 & 2.

  15. Better living through physics... by Anonymous Coward · · Score: 1, Insightful

    Electrical impulses propogate much, _much_ slower than the speed of light when run through copper (and perhaps fiber optics since the light beam has to bounce around so much that the path is many times longer?), so your hard limit may be ~143 ms, but only if your signal went through vacuum all the way to the server and back.

    The real latency should be actually much higher due to switching or forwarding overhead and any monitoring that the NSA does. 300ms at least.

    1. Re:Better living through physics... by Agripa · · Score: 1

      Electrical impulses propogate much, _much_ slower than the speed of light when run through copper (and perhaps fiber optics since the light beam has to bounce around so much that the path is many times longer?)

      "Much much slower" is a pretty big exaggeration. Propagation velocity using a solid polyethylene dielectric is 66% and that is about as slow as it gets for electrical signals. Some glasses are as low as 50%. Store and forward ethernet switches at 100 Mbits/s have to add at least 150 microseconds per switch for 1500 byte packets which is about 22 kilometers at 50%. Cut through switching or a hub could lower this significantly of course.

      Long distance optical fiber links would use graded index fibers which do not have internal reflections as such. The varying dielectric constant across the cross section of the fiber keeps the photons traveling down the center.
  16. Uh by mikkelm · · Score: 1

    >Because, when you get right down to it - it's still Ethernet, and so, is still basically CSMA/CA, though the switches, VLANs, etc., hide it for the most part.

    When did wired Ethernet become CSMA/CA, and what decade are you in? Collision-based networking? The CD in CSMA/CD has been irrelevant after almost a decade of full-duplex microsegmentation, effectively rendering the MA point-to-point, rather than "multiple access", and throwing out the CS in favour of "empty your buffers as fast as you can".

    If you can segment and aggregate on a level equivalent to a High School senior fresh out of Net+, IP over Ethernet still makes more sense than most anything else.

    1. Re:Uh by morgan_greywolf · · Score: 1

      When did wired Ethernet become CSMA/CA, and what decade are you in? Collision-based networking? The CD in CSMA/CD has been irrelevant after almost a decade of full-duplex microsegmentation, effectively rendering the MA point-to-point, rather than "multiple access", and throwing out the CS in favour of "empty your buffers as fast as you can". Even your 'high school senior fresh out of Net+' knows that a broadcast storm will very effectively return your switched, full-duplex, microsegmented VLAN to a CSMA/CD network -- quickly. We have all kinds of fancy tools these days to hack Ethernet to do what we want, such as switches and bridges and routers and spanning tree protocol, and fast routing, etc., but in the end, it's still Ethernet. With a few simple hacks, I can force all of the ports on even the best Cisco switch equipment on a given VLAN open.

    2. Re:Uh by mikkelm · · Score: 1

      Broadcast storms can be avoided with even a modicum of proper planning. Of course you can hack it, but you can hack anything if you have the patience and skill. That does by no means constitute any fundamental failures of Ethernet.

    3. Re:Uh by morgan_greywolf · · Score: 1

      Broadcast storms can be avoided with even a modicum of proper planning All it takes is one badly behaving Windows client to create a broadcast storm. :)

      That does by no means constitute any fundamental failures of Ethernet. I'm not saying that Ethernet isn't the best technology available given the options. Its ubiquitousness is part of what makes it the best strategy, though. Realistically, Ethernet is an old technology and a fresh approach, given what we know today, could do much better technically. It has its flaws, and some of them are very fundamental. You're right in that you can hide these flaws through good network engineering and administration, both on the network end and on the systems end. But that's all it is -- hiding it. Someone who knows what they're doing can still crapflood your network and bring it down.

      What you're saying is akin to saying "well, sure, you can hack Windows with a few simple scripts, but that doesn't constitute any fundamental failure in the security of the operating system."
    4. Re:Uh by mikkelm · · Score: 1

      That's not what I'm saying at all.

      You can effectively stop broadcast storms at layer 2 with the right implementation, so what I'm saying is akin to saying "Well, sure, you can hack Windows with a few simple scripts, but that doesn't constitute any fundamental failure in the concept of operating systems."

      There are of course better things than vanilla Ethernet for regular IP networks, but Ethernet is still a very viable strategy if implemented correctly.

  17. bandwidth provisioning analysis appliance .. by rs232 · · Score: 0

    "For every packet [that the appliance records], we compute a signature and a time stamp"

    "When it exits on the other side of the WAN, we time-stamp it, and we can correlate the data across the whole network"

    Well, doh ... how about NMAP and Wireshark ...

    'Byrne said Corvil's customer base is "more than 10 but less than 100."'

    What ever happened to that perpetual motion outfit ..

    --
    davecb5620@gmail.com
  18. You can get faster than the speed of light.. by Anonymous Coward · · Score: 1, Funny

    ..you just make a Pre-Cabled Domestic Wormhole..

    To make your own wormhole:

    1. Put your network cables inside garden hoses first as wormholes can be moist environments
    2. Take two horizontal clothes washing machines and put them back to back (you can use tumble dryers but its a bit more dangerous - not wet enough)
    3. Open the door on each washing machine and take out any socks or coins
    4. Drill a hole through each drum and thread the garden hoses through
    5. Place a teaspoon of a uranium and a tablespoon of marzipan in each drum. Close tightly!
    6. Program each machine to a few seconds before the biggest spin cycle.
    7. Wait for each machine to spin up
    8. Pull the machines gently apart, you should see twinkling lights between them
    9. Don't be tempted to play with the twinkling lights as you'll die.
    10. Call UPS.
    11. Give them one of the machines.
    12. Tell the UPS guy not to touch the twinkling lights
    13. Wait for a few days for the machine to arrive.

    Propagation time: 4ms - guaranteed.