Slashdot Mirror


Network Testbed Emulab.net

gseidman writes: "Have you ever needed to simulate a network? Tired of old ns? Do you just hate dealing with hardware in general? Take a peek at Utah's Emulab.Net. They have over 300 PCs, some StrongARM devices, roughly 5 miles of cabling, a huge and expensive switch, and great software for setting up a virtual LAN. They also have a gallery showing the machine room in various stages of completion (did I mention five miles of cabling?)."

120 comments

  1. Gonna loose some Karma for this... by jeffy210 · · Score: 2, Funny

    ooooh... what about a Beo.... ah, forget it.

    --
    ------
    "And may your days be long upon the earth."
  2. Cost? by Anonymous Coward · · Score: 1, Interesting

    How much does it cost to have them do what they do for you?

  3. "God's" Design Is WAY Cooler! by ekrout · · Score: 0, Offtopic

    Every day, humans lose-and replace-200 billion red blood cells. Remarkably, our bodies manufacture 2 million replacement cells in a split second. A single red blood cell will make an incredible journey, traveling 100 miles through a vast network of 60,000 miles of veins, capillaries and arteries.

    --

    If you celebrate Xmas, befriend me (538
    1. Re:"God's" Design Is WAY Cooler! by Anonymous Coward · · Score: 0

      I clicked your sig... is something supposed to happen? I saw 100 windows pop open, but because I'm running XP, I just right-clicked the IE group on my taskbar and closed the whole group.

      If you seek to annoy, then you failed.

    2. Re:"God's" Design Is WAY Cooler! by ekrout · · Score: 1

      Wow, I don't know who you are, but that was a nice job of defending me, I guess. Your words are kind of cruel, but that jerk who doesn't like me based on a sentence or two that I wrote probably deserves it.

      --

      If you celebrate Xmas, befriend me (538
    3. Re:"God's" Design Is WAY Cooler! by NickisGod.com · · Score: 0, Troll

      Ha! I Beat the browser crasher, Mac IE rulez!

    4. Re:"God's" Design Is WAY Cooler! by BdosError · · Score: 1

      I defy you to find a router that's been running for 40 years.

      --
      Complexity is Easy. Simplicity is Hard.
  4. Cable Length! by Anonymous Coward · · Score: 0
    did I mention five miles of cabling

    Wow, did I mention my intestines are about 8.5 meters long and will be far more productive!!!

  5. This is very cool. by perdida · · Score: 3, Informative

    This is applied research, the type that may have direct and positive effects on improving security and efficiency in the immediate future.

    Unlike dark matter research, Mars colonization, and subatomic research, this stuff is the kind of thing that should attract wide funding from business. Immediate payoffs are likely.

    Basic research is fine, but I wish that the money poured into it would go towards immediate business applications. More available cash would make those venture capitalists a lot nicer and less demanding of unrealistic profits in an unrealistic period of time.

    1. Re:This is very cool. by fnordboy · · Score: 5, Insightful

      Basic research is fine, but I wish that the money poured into it would go towards immediate business applications.

      Now that's just silly. Basic research is incredibly important, and it is vital to the economic health of the country (and the world, for that matter) that money is spent on it. Where did the transistors that your nice new Intel chip is made up of come from? Basic research. How about lots of medical technology like MRI machines and x-rays? Basic research. And there are lots of indirect benefits to basic research as well. How about those snazzy digital cameras? The need for high-quality CCDs for astronomy (*cough* hubble *cough*) and for other research applications pushes that. Do you like the world wide web? Thank a bunch of physicists who put it together so they could share their data.

      The point of basic research isn't the small, immediate payoff - it's the hope that somewhere along the line, some scientist is going to come up with something that will revolutionize the world - just like the transistor! So I respectfully disagree with you - while it's important for companies to be concerned with their quarterly earnings reports, in the long term, basic research is most certainly worth the investment.

    2. Re:This is very cool. by LS · · Score: 2

      If businesses feel that they would gain from research, they can do it themselves. Look at IBM and Lucent. University research should no be based on short-term goals of funding, but instead on the researcher's interest coupled with the current direction of the science. I hope that the short-term thinking which placed the US economy and world environment in it's current state does not further infect the university and stain the ivory towers.

      LS

      --
      There is a fine line between being a cultivated citizen and being someone else's crop. - A. J. Patrick Liszkie
    3. Re:This is very cool. by Anonymous Coward · · Score: 0

      So you think that's cool, huh?

      You see, the whole massive computing power bit is just a front for what this really is: CmdrTaco's Super Secret Geek Fuck Compound. It's where he and the rest of the /. doodz go after a long day's lack of work, to bang some fresh ass.

      Yep, there's nothing better than kickin' back with a fresh bottle of Bawls while CmdrTaco's big ol' beef rearranges the innards of a cum loving bitch-boy geek. Well, maybe there's SOMETHING better... after all, what could be more fun than watching in delight as ol' Taco force feeds his granny a whole cartload of turd loaves. You know, hemp rope, Taco Pies, etc.

      That's actually the trick to gettin' some of the his granny's nasty crust-snatch... you wait until little Robby has filled her throat with his loving shit, and plug her craphole while she tries in vain to chew her tasty treat. Yeah, that's it...

      Awwww, shucks, you've probably already "been there, done that", so I'll stop dispensing tidbits from my big bag of CmdrTaco granny fucking HOWTO manuals now.

      HAND.

  6. Emulating the /. effect by Brento · · Score: 4, Funny

    It's already starting to slow down. Now would be a good chance to start dedicating some of those machines as backup web servers, eh?

    --
    What's your damage, Heather?
    1. Re:Emulating the /. effect by Slipped_Disk · · Score: 0

      I wonder if they do have a facility to emulate the /. effect. I didn't see anything in the projects list, although there was one project that I guess is close
      (although they concentrate on blocking the traffic surge rather than handling the load).

      --
      /~mikeg
    2. Re:Emulating the /. effect by Anonymous Coward · · Score: 0

      Looking much better now

    3. Re:Emulating the /. effect by yesthatguy · · Score: 1

      Maybe somebody can just start a distributed.net project that creates "friendly" DDoS attacks to test for things like that. A Sysadmin could just call up whatever company organizes it, and somehow verify his identity, then unleash a metric buttload of requests to his server...

      --
      Yes! That guy!
  7. This could be a nightmare by Quasar1999 · · Score: 3, Redundant

    5 miles of cables? I hope they labled them... :)

    --

    ---
    Programming is like sex... Make one mistake and support it the rest of your life.
    1. Re:This could be a nightmare by AlgUSF · · Score: 1

      I didn't see any labels on the cables. I guess they must have some database that stores the information.

      --


      I want my rights back. I was actually using them when our government stole them after 9/11.
    2. Re:This could be a nightmare by mac.newbold · · Score: 2, Informative
      5 miles of cables? I hope they labled them... :)

      Every wire (~1000 of them) on both ends, then the endpoints get recorded in a database.

      And anyone who moves a wire without properly documenting it gets shot! ;)

      Mac

      --
      Does the name Pavlov ring a bell?
    3. Re:This could be a nightmare by b1t+r0t · · Score: 2
      As a bit of perspective, I used up about 1/3 mile (most of two 1000 foot boxes) of cat-5 wiring up my house. (eight six-wire bundles of cat-5, plus 300 feet more of RG-6) They used up fifteen times that. Of course it's a little easier to label the ends when you're only pulling six at a time.

      Wow, there's nothing like a picture of a Cat-6500 switch full of ethernet. Except maybe a Cat-6500 full of gigabit fiber.

      --

      --
      "Open source is good." - Steve Jobs
      "Open source is evil." - Microsoft
    4. Re:This could be a nightmare by Anonymous Coward · · Score: 0

      I'll tell ya about a nightmare...

      You see, the whole massive computing power bit is just a front for what this really is: CmdrTaco's Super Secret Geek Fuck Compound. It's where he and the rest of the /. doodz go after a long day's lack of work, to bang some fresh ass.

      Yep, there's nothing better than kickin' back with a fresh bottle of Bawls while CmdrTaco's big ol' beef rearranges the innards of a cum loving bitch-boy geek. Well, maybe there's SOMETHING better... after all, what could be more fun than watching in delight as ol' Taco force feeds his granny a whole cartload of turd loaves. You know, hemp rope, Taco Pies, etc.

      That's actually the trick to gettin' some of the his granny's nasty crust-snatch... you wait until little Robby has filled her throat with his loving shit, and plug her craphole while she tries in vain to chew her tasty treat. Yeah, that's it...

      Awwww, shucks, you've probably already "been there, done that", so I'll stop dispensing tidbits from my big bag of CmdrTaco granny fucking HOWTO manuals now.

      HAND.

  8. 5 miles, big deal. by scott1853 · · Score: 2

    They probably didn't have a 2 ft. high crawl space that they had to run it through.

    1. Re:5 miles, big deal. by mac.newbold · · Score: 5, Informative

      I was one of the few 'lucky' people who had to run it, and no, we didn't run it thorough a 2ft high crawl space. It is even worse than that.

      In case you couldn't tell from the pics, this is all in self contained racks. The large majority of the wiring is in 9 standard-sized racks, or about 7ft tall * 3ft deep * 2 ft wide * 9 racks = 378 cubic feet for about 5 miles (25,000 ft) of cable plus all the PCs and switches.
      As a generous estimate, that leaves 100 cubic feet for cables and ventilation. That says the every cubic foot of open space is filled with an average of 250 linear feet.

      Needless to say, it was not fun.

      Mac

      --
      Does the name Pavlov ring a bell?
    2. Re:5 miles, big deal. by OWJones · · Score: 2
      Having worked with the Centurion cluster at UVa for a few years, I feel your pain. And this was before we added 10 such cabinets of rack-mounted PCs. :)

      -jdm

    3. Re:5 miles, big deal. by Dominic+Flandry · · Score: 1

      Hey Mac, glad to see you representin'... i was trying to do it myself, but don't know the details you do, since i got 'em all from you.

    4. Re:5 miles, big deal. by Anonymous Coward · · Score: 0

      I laid 5 files of turd goodness down your mom's throat this morning. Of course, that's nothing compared to the Good Taco:

      You see, the whole massive computing power bit is just a front for what this really is: CmdrTaco's Super Secret Geek Fuck Compound. It's where he and the rest of the /. doodz go after a long day's lack of work, to bang some fresh ass.

      Yep, there's nothing better than kickin' back with a fresh bottle of Bawls while CmdrTaco's big ol' beef rearranges the innards of a cum loving bitch-boy geek. Well, maybe there's SOMETHING better... after all, what could be more fun than watching in delight as ol' Taco force feeds his granny a whole cartload of turd loaves. You know, hemp rope, Taco Pies, etc.

      That's actually the trick to gettin' some of the his granny's nasty crust-snatch... you wait until little Robby has filled her throat with his loving shit, and plug her craphole while she tries in vain to chew her tasty treat. Yeah, that's it...

      Awwww, shucks, you've probably already "been there, done that", so I'll stop dispensing tidbits from my big bag of CmdrTaco granny fucking HOWTO manuals now.

      HAND.

    5. Re:5 miles, big deal. by Anonymous Coward · · Score: 0

      umm..That is a pretty awesome concept and opportunity you have there.
      Some of the resumes for students participating
      make me sick with envy.

  9. Simulation is never perfect by euroderf · · Score: 5, Insightful
    This is the difference between book learning and experience. Sure, you can 'test' a network under idealised simulated conditions, as one might 'test' a plane in a wind tunnel, but till the network is reality, and the secretary spills a cup of coffee on the router or the chief engineer urinates drunkenly on the packet switcher, you can't tell how your network will perform.


    What is it with the modern generation who think that simulations will improve their likely performance? It is all idiocy, when I was young we did things with a spanner and looked at das blinkenlights under real world conditions. This is so much nonsense, really, the sort of thing I'd expect to come out of our modern CS courses.


    Computing is just an offshoot of down-and-dirty engineering, and none of us should forget it. The day we forget the feel of the netowrk cards in our hands, the smell of the overheating cat5, is the day we lose control over the netowkrks of America, the day that our economy starts going backwards.

    1. Re:Simulation is never perfect by jachim69 · · Score: 1

      Perhaps you didn't read the pages where it says you can control every aspect of the simulated network right down to the hardware. Packet drop rates, latency, etc, etc, etc.

    2. Re:Simulation is never perfect by sharkey · · Score: 2, Offtopic

      ...chief engineer urinates drunkenly on the packet switcher...

      Yes, but what about urine acidity and volume?

      --

      --
      "Outlook not so good." That magic 8-ball knows everything! I'll ask about Exchange Server next.
    3. Re:Simulation is never perfect by John_Booty · · Score: 2

      "but till... the chief engineer urinates drunkenly on the packet switcher, you can't tell how your network will perform"

      If anyone needs help testing this condition out, I'm available.

      --

      OtakuBooty.com: Smart, funny, sexy nerds.
    4. Re:Simulation is never perfect by alexalexis · · Score: 1

      ... on the other hand, it's nice to be able to have an open testing network for software and hardware companies to use, without blowing the millions nessicary to build something of this scale. Large companies like Cisco and Microsoft (and universities like Stanford and MIT)undoubtedly have their own network simulation labs - this opens the door for smaller companies and universities.

      You're perfectly correct when you say simulation is never perfect. However, even basic approximations can really help point out weaknesses and strengths in any system, and in this case in particular, I don't think The Big Boys should be the only ones with access to these simulators.

      And, on a slightly more cynical note, remember that business people are very rarely engineers - even if it has no real world use, a simulation network like this will very likely get quite a bit of use from companies hoping to get some sort of advantage. At the very least, the students who run the show at emulab will have some pretty decent high-end networking experience behind them by the time they leave.

      All in all, I think it's a good thing.

    5. Re:Simulation is never perfect by bluGill · · Score: 2

      I partially agree, partially agree.

      Simulation isn't perfect, but it is a lot cheaper than full blown tests. If you solve all the problems in simulation that you can, then you have saved a ton of time any money over doing real world testing. Expirence in the real world will help you make the simulation better.

      Where I worked we once modified an old router to package FDDI packets over ethernet (note, we artificially slowed the sender), transmitted them to a sun IPX (a heavy duty machine for its time, though unbearablly obsolete today), ran some hardware simluation to send it through a fddi interface, through a custom routing board, through a backplane, to a ethernet board, and then took the packet to a different router, unpackaged it, and put it on a real network. We were accually able to do telnets through our hardware simulator, so long as we keep the packet count down to about 1 a minute and could deal with long latiancys. The result is we found a lot of bugs in simulation before hardware was built. Eventially this was the first switch on the market, beating Cisco to that mark by about a year. (Of course Cisco was still the go to network provider, and their switch could do more packets, but we beat them to market)

      A friend of mine works for a company that makes injection molds. the old expirenced engieers could sometimes get an acceptable mold after 3 prototypes, though 6 was considered normal for an expirenced engineer. They hired a new college grad a few years back who with simulation always gets a perfect mold on the first try. Not acceptable, perfect. With simulations he could watch hot spots, and make the changes to cool them and/or account for different contraction rates in the mold. Since a mold costs a lot of money to make, (but lasts a long time) this results in considerable costs savings for the company. The new engineer can also turn out more molds in a year because he doesn't have to analyise the failures and guess what went wrong, he knows.

      that said, I agree fully that simulation can't do everything. The new engineer above still sometimes turns out a mold that fails to work, but failure analysis improved the simulation next time. When we simulated our new router previously we still found a couple hardware bugs that didn't happen in simulation. for computer simulation we can't do stress testing without real hardware, but we already have solved most of the problems by that time.

    6. Re:Simulation is never perfect by _Yup_69 · · Score: 1

      I would dare to say you got it a bit backwards.

      To make a long story short, clueful simulations NEVER try to "emulate reality". And that for a very simple reason: You simply cannot, for the very reasons you list. So far, I cannot agree more.

      But where your story ends, starts the next cycle: After you get your hands dirty, after you sweat for reaching that !@#$% cable, you swear to the point it would make an boot camp sergeant blush,
      get pi$$ed out drunk while "just skimming through that !@#!$%^ IOS manual" THEN you're ready to really fubar reality (i.e. "do simulations", in academic terms). And, even more, make something out of it: Since you already know "what would fly, what not, and how" you have that grain of salt at hand. And, "based on simulation results", have a pretty educated guess how things will cheerfuly deviate from your well-thought simulated scenario in a real life environment.

      Again, as you so rightfully say, network simulations should _never_ be used for _learning_ reality. If you do that, you're in for very bitter lessons later on.

      But if you've "been there, done that", you really ready for it.And it will be so much worth.

      P.S. Excuse the lack of HTML tags and the pedagogical tone. It's too late and I'm posting this in a damn IE window. Talk about being in the position to preach about "being educated" ;)

    7. Re:Simulation is never perfect by Nightpaw · · Score: 1

      Yes, but what about urine acidity and volume?

      What, so people can hear him pissing and come running to stop him?

    8. Re:Simulation is never perfect by fishybell · · Score: 1

      As a programmer I am quite aware that in-house testing/simulations aren't perfect. Sometimes they're even ludicrous. But they do catch problems and bugs before the product is released. 'nuff said.

      --
      ><));>
    9. Re:Simulation is never perfect by Minupla · · Score: 2

      What is it with the modern generation who think that simulations will improve their likely performance? It is all idiocy, when I was young we did things with a spanner and looked at das blinkenlights under real world conditions. This is so much nonsense, really, the sort of thing I'd expect to come out of our modern CS courses.

      #include humor/sarcasm.h
      Ya, and what is it with those aerospace engineers who think they can simulate anything in a wind tunnel. I mean, come on, the only way to see what will happen in realworld conditions is to build a multimillion dollar airplane and see if it crashes. When will they learn?

      --
      On the whole, I find that I prefer Slashdot posts to twitter ones because I don't get limited to 140 chars before
  10. 5 Miles of sloppy cabling... by GLX · · Score: 5, Informative

    I don't know what brainchild designed the layout of those switches, but the fact that they went for the RJ-48 blades versus the Telco (RJ21X) blades in those switches shows sloppy planning. What if one of the blades in the middle goes out? They have to unplug 48 Cat-5 cables versus unscrewing 4 telco harmonicas and leaving the 48 ports untouched on a patch panel

    If you're going to put forth that kind of effort and money, why not do it right the first time?

    --
    Sig (appended to the end of comments you post, 120 chars)
    1. Re:5 Miles of sloppy cabling... by monkeydo · · Score: 2, Insightful

      Not only that, but they have 7 slots worth of 48 port 100Mb cards (33.6Gb) and 1 Gb uplink. That might be a little of a bottleneck if more than a few of the nodes are trying to pass upstream traffic.

      --
      Si vis pacem, para bellum
      The only thing more annoying than a Libertarian is an (un|mis)informed Libertarian
    2. Re:5 Miles of sloppy cabling... by yzquxnet · · Score: 1

      I saw that too. But, they may not require that amount of bandwidth. The systems behind the uplink may only generate small and sporatic data packets. It all depends on the application.

      Now, I'm not familiar with their systems or their uses but generally speaking there are client needs and server needs. Clients generally do not require fat pipes to the desktops. You can cram a lot of clients onto a single 100mb line and they will operate just fine. Server needs are a little different. Since all of the client requests are converging down to a few server systems the bandwidth needs are much more intensive. A nice fat gigabit line works very nice here.

    3. Re:5 Miles of sloppy cabling... by monkeydo · · Score: 1

      In a traditional network environment you are correct. Trunks and core links rarely are capable of carrying the full agregate bandwidth of the downstream links. However, This is supposed to be a system that lets you simulate the Internet and any to any conections and we're talking about a 3000% oversubscription (with no redundancy). You would think that they would make the hardware configuration as flexible as possible. Apparantly the boxes in there even emulate routers and switches. I don't know how they plan to do it, but it can't be realtime since the real Internet has many >100Mb links and the routers and switches have much higher packet fowarding rates than even the fastest server is capable of.

      --
      Si vis pacem, para bellum
      The only thing more annoying than a Libertarian is an (un|mis)informed Libertarian
    4. Re:5 Miles of sloppy cabling... by mac.newbold · · Score: 2, Informative
      There are several reasons we chose not to use the Telco connectors:
      1. Then we'd have to go to a patch panel, and then the ciscos, which greatly increases the number of wires and the time it takes to run them.
      2. The telco connectors aren't as dense enough to be worth it... 8 wires per cat5, 50 wires per telco, so we'd only consolidate 6 wires at a time.
      3. We eventually want to run gigabit over copper with these cat5e wires, and if we put them into telco connectors, we can't do that.
      Does that answer your question?

      Mac

      --
      Does the name Pavlov ring a bell?
    5. Re:5 Miles of sloppy cabling... by GLX · · Score: 2, Informative

      Not especially.... To answer in order:

      1) It increases the number of wires by 4 per 48. It however lessens the trouble involved if a module fails - apparently you've never had the joy of unplugging, keeping track of, and re-plugging in 48 Cat-5 cables in a hurry. It's not fun. An increase of time in the beginning far outweighs the risks of the increase of time in an outage. I can show you pictures of rats nests and tell you horror stories all day about this.

      2) The standard Cat-5e configuration still only uses 4 wires. The Telco panels are wired as such. For each Telco harmonica you get 12 ports - quite dense enough.

      3) There's nothing that says that gig won't be supported over telco, just like there's still no set-in-stone standard for gig over cat-5. Nothing even says that cat-5e is going to be required.

      --
      Sig (appended to the end of comments you post, 120 chars)
    6. Re:5 Miles of sloppy cabling... by mcowger · · Score: 1

      The only reason I can think of is that the switches they were given were donated. Granted I would rather use amphenols as well, as they are cleaner and look nicer too, but there is downside. If you get a bad cable (as we have where I work a coupe times), you have to pull down the whole set of 12 machines on that cable to replace it, rather than just unplug a single cable. Of course, your critique about a whole blade going bad still holds, but I have rarely had a whole blade go bad...usually just one port on that blade.

    7. Re:5 Miles of sloppy cabling... by mac.newbold · · Score: 2, Insightful
      1) It increases the number of wires by 4 per 48. It however lessens the trouble involved if a module fails - apparently you've never had the joy of unplugging, keeping track of, and re-plugging in 48 Cat-5 cables in a hurry. It's not fun. An increase of time in the beginning far outweighs the risks of the increase of time in an outage. I can show you pictures of rats nests and tell you horror stories all day about this.

      It increases the number of wires by 8 per 48 (see below), and yes, we've had module failures before, and I have moved 48 cat-5 cables in a hurry. These module failures are so rare that its not even worth the extra time at the beginning to try and make it easier.

      2) The standard Cat-5e configuration still only uses 4 wires. The Telco panels are wired as such. For each Telco harmonica you get 12 ports - quite dense enough.

      It uses 4 wires when running at 100Mbit, but like I mentioned before, when we go to gigabit over these cat5e cables, we'll need all 8, since the gigabit over copper products we're looking at use all 8 wires in the cable.

      3) There's nothing that says that gig won't be supported over telco, just like there's still no set-in-stone standard for gig over cat-5. Nothing even says that cat-5e is going to be required.

      Every product on the market that I've seen requires cat5e for its higher standards, and I've never seen a patch panel/telco combination that claims to be able to support the high requirements of gigabit over copper.

      Now maybe you would have done it differently, and that's fine. Our needs are different from yours, and our criteria for judgement of our options are probably quite different as well. What we chose to do has worked out very well for us, and we're very happy with the way that things are set up. If you're still not satisfied, perhaps we should just agree to disagree....

      Mac

      --
      Does the name Pavlov ring a bell?
  11. unforunately... by bungalow · · Score: 1

    Every machine is running XP. Requests for variants require filling out this form in triplicate

  12. oh well by psychalgia · · Score: 0, Redundant

    guess we know it works as well as the real thing -- its been /.ed...*sigh*

    --

    ________________________________________________

  13. Asimov by Scrameustache · · Score: 1

    I went and had a look at the pictures, it reminds me of the mental image I have of Asimov's Multivac city-sized super computer.
    Fun.

    --

    You can't take the sky from me...

    1. Re:Asimov by Anonymous Coward · · Score: 0

      There's also some Origin 2000's in the background of some of the pictures. Those are mighty big doorstops.

    2. Re:Asimov by Anonymous Coward · · Score: 0

      You should see it with the lights off. It looks even cooler!

  14. Amount of Cable by thetechweenie · · Score: 1

    Not to be a party pooper, but 5 miles of cable, really isn't that impressive. We ran 3 at the ISP I used to work for. Not to mention all the fiber running from the foxbox. 5 miles of round ide cables would really be cool...

    --


    Um, this is my sig.
  15. Agreed by clark625 · · Score: 3, Informative

    I totally agree with you. Simulation doesn't prove that things will be all peachy cream later on in the "real world".

    Then again, if a 1/100th scale model does a nose dive in the wind tunnel when they throw a little turbulence at it, you can bet the ranch that plane will be redesigned. Testing and modeling only show the existence or non-existence of very particular problems. We just usually hope that we can "test" out as many likely problems as possible.

    --
    Long, cute, or funny Sigs are just another form of over compensation, used by geeks, nerdz, etc.
    1. Re:Agreed by Anonymous Coward · · Score: 0

      I think this model has a lot of promise.
      I think though that you should throw in a test .edu class C infected with nimda for shits and giggles, to simulate "reality" for some of these
      real world people.

  16. Its good to see this. by Anton+Anatopopov · · Score: 1
    So much network design these days is done on an ad-hoc basis with disasterous results.

    This can only help network engineers to come up with scalable designs that work under various load scenarios.

  17. LOL by Anonymous Coward · · Score: 0

    was wondering if anyone else forsaw some of the nightmares this place holds

  18. Just how "virtual" can it be... by JesseL · · Score: 2

    if it uses 5 miles of cable? ;-)

    --
    "Prefiero morir de pie que vivir siempre arrodillado!"
  19. It's not just the testbed... by Anonymous Coward · · Score: 0

    The funny part is, it isn't just the network testbed room that is that cramped and packed with wiring. I'm not sure who designed the Merril Engineering building, but it wasn't an engineer!

  20. logN cable by K0R$+h4x0r+ru1z · · Score: 1

    It seems the cable is a bit excessive. Showy, looks professional. I work with Crays with the Navy, with a farm X1.7 that size underneath, never to be swamped with that much CAT5, much less in a test scenario. But we wish them the best (wonder if they test speed amongst those many meters of yellow. . .)

    1. Re:logN cable by Anonymous Coward · · Score: 1, Informative

      The reason for the cables is that every machine has 5 Ethernet ports.

  21. Random thoughts from a U student by Anonymous Coward · · Score: 0

    Another interesting tidbit:

    If i remember correctly, a couple years back a modified version of Doom with ultra-high player counts was used to study network testbed performance.

  22. spamming us /. ?? by jeffy124 · · Score: 0, Troll

    Infomercial Template:
    Have you ever needed to ____? Tired of the old ___? Do you just hate dealing with ___? Take a peek at ____. They have ___, ___, and ___. They also have ___, ___, and ___.

    I know /. is looking for new advertising sources and exploring new evasive ad techniques, but putting ads directly into articles is probably goin a bit too far

    --
    The One Rule Of Chess You'll Ever Need: Don't play someone who carries a kit in their bookbag.
    1. Re:spamming us /. ?? by Atilla · · Score: 2, Insightful

      Have You Ever Heard of Sarcasm?

      --
      --- sig moved for great justice.
  23. Only 5 miles? by yzquxnet · · Score: 3, Informative

    The post submitter makes 5 miles of cable seem like a lot. Well, it isn't. Even a small office complex can burn through 50,000 ft a cabling in short work. Running two data cables effectivly doubles your cable requirements. Depending on the situation the installer may even lay a third cable for voice. (What standard was that?) Anayways, 5 miles of cable is not a lot.

    1. Re:Only 5 miles? by Dominic+Flandry · · Score: 1

      Yes, but here the cables are mostly less than a couple meters long, because all the computers and such are in the same (small) room.

    2. Re:Only 5 miles? by monkeydo · · Score: 1

      People who's only experience is with academia frequently baffle at the marvels of the real world.
      Try taking a recent CCNA boot-camp gradute through even a small data center, "why would you need more than one router?"
      5 miles of cable could easily be used up just in a fiber loop around a small campus, and plenty of data centers have more servers. This project may be "cool" for its function, but the data center itself really isn't that special.

      --
      Si vis pacem, para bellum
      The only thing more annoying than a Libertarian is an (un|mis)informed Libertarian
    3. Re:Only 5 miles? by yzquxnet · · Score: 1

      Oh, patch cabling. That's not 'real' cabling. hehe. Okay, I'll give them a little.

    4. Re:Only 5 miles? by yzquxnet · · Score: 1

      Exactly, good point. If you imagine this network as just the data center portion and then add a client base behind it. Lets say a few floors of clients in the building, maybe some more floors in the office across the street, and then maybe another office in the next city. Now, wire them suckers up.

      I've seen a data center for Cargill Inc. in Minnesota. It was HUGE. Rows upon Rows of nothing but servers. The room was bigger than my highschools gymnasium. Then add a massive client base that was in the building. That's a wiring project.

  24. I work with Utah by OWJones · · Score: 2

    A group here at Duke has just started to collaborate with the Emulab people on a similar area of research. We're pretty excited, since we think our group has a lot to share with the Utah group. It's just kind of weird to load Slashdot and find your collaborators on the front page. Here I was thinking I'd take a break from research and read Slashdot, but noooooo .....

    And to respond to another poster, maybe if Emulab had Muse-like resource management of their web server, they could handle the web load. :) It would be nice if someone could work on merging the two, getting the two to leverage the best parts of both, work on .... uh, maybe I should get back to work before my advisor sees me posting on Slashdot. :)

    -jdm

    1. Re:I work with Utah by Anonymous Coward · · Score: 0

      [I'm one of the Testbed developers]

      Acutally, we're doing fine on our single FreeBSD web/database server. Just had to tweak some apache configuration. Wish we'd had some warning. :)

  25. 5 miles of cable by Anonymous Coward · · Score: 0

    There would be a huge amount of pride on owning a 300 based machine network. Right now, I am impressed with my personal 9 machines. Fun with beo. Anyway, just an offshoot, here is a nifty little network auralizer that some of you might be interested in...

  26. The more the merrier by Atilla · · Score: 1

    I guess a Q3 test is out of the question..

    but seriously, it's nice to see that schools get this kind of funding. Previously, only the heavyweights of the industry and the government could afford such projects.

    --
    --- sig moved for great justice.
    1. Re:The more the merrier by Anonymous Coward · · Score: 0

      No Q3, but we do have an experimenter that does research with a hacked up version of Doom.

  27. randomness by johnjones · · Score: 2

    yeah great

    much of the intresting things about networks has been done through live capture of a system and then sifting the data

    phone networks work well because they have had a long time trying things out and finding optermal solutions to random problems that come up in live networks (problems with GPRS networks where only seen once semi live)

    also you dont get the scanning and general attacks that do strange things to routers

    its like saying yep we have 1000 monkeys and typewriters but we need you to go through the data and compare it to the real world

    you might as well do it in the real world how expensive is a switch/hub and network cards ?

    silly but nice

    regards

    john jones

    1. Re:randomness by Anonymous Coward · · Score: 0
      phone networks work well because they have had a long time trying things out and finding optermal solutions to random problems that come up in live networks (problems with GPRS networks where only seen once semi live)

      Arguably, emulab is semi-live, so you do see many of those effects...

      also you dont get the scanning and general attacks that do strange things to routers

      Presumably they could make emulab do that, but you're probably not going to be using a PC as your router in any system you care much about anyway...

      you might as well do it in the real world how expensive is a switch/hub and network cards ?

      ... and the PCs, and the time to aquire them, hook them up, install OSs, configure them, etc etc etc... Doing your own when you can use theirs free would just be a waste of time and money. Even assuming you had your network set up, their software would you do the tests faster than you could on your own set of boxes.

    2. Re:randomness by Anonymous Coward · · Score: 0

      This is a really big switch/hub/NIC setup!

      Read the pages before posting.

  28. gasp! by _Mustang · · Score: 0, Offtopic

    the secretary spills a cup of coffee on the router or the chief engineer urinates drunkenly on the packet switcher, you can't tell how your network will perform.

    Damn, but I'm glad I don't do I.T support in your office!

    Of course- if those are common occurances around your neck of the woods, I expect hardware performance problems are the least of your worries..

  29. Just a bit surprised ? by pruneau · · Score: 3, Insightful
    Those guys just bought those 4 huge 6509C Cisco switches for big bucks.

    I assume that One is acting as the main router, and the other are using it. I assume also that the switches are interconnected with 2x1Gb/s fibers, probably full-duplex and load/sharing above the two links.

    What surprises me is that those switch fabric supports up to 256Gb/s bandwidth, but they are just connected with 2Gb/s links : talk about some bottlnecks here...

    But maybe I did not read enough documents ?

    Any comments from the builders of that lab ?

    --
    [Pruneau /\o^O/\ warranty void if this .sig is removed]
    1. Re:Just a bit surprised ? by Anonymous Coward · · Score: 0

      I'm one of the builders. We have some software that attacks the NP-hard problem of mapping an experimenter's desired topology onto our hardware (a graph problem.) It minimizes the number of cross-switch links. Thus, most experiments are run solely on one switch or the other, and the 2GB interconnect (you were right in your topology assumption) is rarely used. It's there in case someone runs an experiment bigger than 84 nodes (the number of nodes we can fit on one switch)

    2. Re:Just a bit surprised ? by pruneau · · Score: 1
      Well some remarks there.

      What do you means by "topology" ?.

      Because if that's about network topology, with only one switch acting as a router, you're pretty much limited to one single Vlan/(subnet ?) if you don't want to cross the 'switch boundary'... AFAIK, that's not much of a topologycal problem ;-)

      Or maybe some simulation of using your software showed that this was the typical test configuration, and that you will need routing just in 1/4 of your cases. I doubt it, though.

      Another thing : I'm part of the administration team running a cluster about the same size than yours (and certainly using less floor space !).

      Our architecture is the following : instead of having a small number of huge beasts, we have a network tree that is only three level deep, with computer/processor at the bottom layer, smaller switches having to handle only a reduced set of machines, and a core switch/router connected to everybody with 1Gb/s (full-duplex) at the top.

      Did you do some cost studies about network architecture, because I'm under the impression that our solution is less expensive and will at the same time assure a better bandwidth ditribution.

      But again, your objectives are probably different than ours, and it's just an impression.

      --
      [Pruneau /\o^O/\ warranty void if this .sig is removed]
  30. Notice the hardware config?!? by Geek+In+Training · · Score: 2, Informative

    Boy, I wonder if one of the projects they're planning to emaulate is "wide scale hardware failure." Look at their node configuration (hard drive boldfaced):

    128 new nodes:
    850Mhz P3
    512M ECC memoryold reliable BX chipset
    40G 7200rpm IDE disk (IBM Deskstar 60gxp)
    5 Intel Pro/100+ network interfaces
    2 on board
    1 on a single Intel card
    2 on a dual Intel card
    No video at all
    serial console


    This is the very same hard drive drive we drew and quartered here, and has gotten IBM a big fat lawsuit for rampant failures.

    So, I guess their error recovery is going to be tested to the limits very shortly, especially with the space/heat issues inherent in the installation exacerbating the engineering flaws in the 60GXPs. :)

    --
    SlashSigTheorem: Humorous, Political, Critical, Constructive- If you have a .sig, someone WILL complai
    1. Re:Notice the hardware config?!? by A+Commentor · · Score: 3, Informative

      Wrong... that was the 75GXPs. See the original article.

      I double checked a few posts, and they mentioned that the 60GXP was much more reliable.

      --

      Looking for any old 8-bit Heathkit/Zenith software/hardware - http://heathkit.garlanger.com

    2. Re:Notice the hardware config?!? by giberti · · Score: 1

      Even still, nice to have this much hardware at your disposal. Too bad they have such a low tech solution for to schedule time on it. Heck, probably take 2-3 days to roll out a full config to test what you wanted anyway.

      --

      AF-Design, web development.
    3. Re:Notice the hardware config?!? by Anonymous Coward · · Score: 0

      Actually, average experiment setup time is 3 minutes.

  31. I just LOVE... by Anonymous Coward · · Score: 0

    I just LOVE Euroderf's website, especially the "fash" session, where I learned to cut a turtleneck into thin strips and use them as an autoeroticism aide! Oh, and the "acid party" photos! If you haven't yet, check out Euroderf's website today!

  32. Simulation need not be perfect to be useful. by FallLine · · Score: 2

    While I agree with much of your sentiment, hardly being a fan of the Ivory Tower, if you take a look at some of the projects on the website, you'll see that many of them are things that are hard to simulate AT ALL in the real world. For instance, there are projects there to research methods of stopping DDos attacks. They can hardly start flooding a real WAN to test their software. While it is true that they can fall back to mathematical models, these are complex and can never hope to realistically simulate some of the non-deterministic elements nearly as well as a real WAN (or this network).

    That said, I also can't say that this network really has SUFFICIENT usefulness to justify its existence (after all, how many people need to test denial of service attacks and such?); we'll let the markets resolve that, eh?

  33. Sounds like hell to me... by Anonymous Coward · · Score: 0

    I worked at a school that was wired by morons. We had over 15 miles of cat 5 in the ceiling. Talk about an administration nightmare. One line goes dead, and everything is shafted. Every network drop in the building terminated directly in the central comms room. No hubs for labs, just 200 cat five lines heading back to fuck central.

  34. on a small scale, VMware = network emulator by fetta · · Score: 1

    If you have enough RAM, vmware can do a nifty job of emulating a network. Not much good for low level protocol debugging, but it is a handy tool for experimenting with routing protocols, replication (AD, Lotus, etc), file sharing, etc.

    Obviously, not in the same class as what's being talked about here, but something to keep in mind.

    --
    ** The opinions expressed here are my own, and do not reflect those of my employers - past, present, or future**
  35. Their stuff by lanner · · Score: 1


    This black faceplate 1U servers that you see are Intel SRM2K servers. I tested one out for production use about two months ago. They are a very cheap chassis -- cheap cost, and cheap quality. About the only good thing of them is that they allow for both a full size PCI card and a low profile PCI card -- one of the few 1U height systems that support more than one PCI card.

    The big switches that I see are either Cisco Catalyst 6009s or 6509s.

    Yellow cables are plain old Cat5. Orange cables are multimode fiber, for Gigabit Ethernet.

    That is about all that I can tell.

    1. Re:Their stuff by Anonymous Coward · · Score: 0

      You could read the 'Hardware' section of the FAQ to find out what you're really seeing.

  36. Nothing is ever good enough by kyras · · Score: 1

    I just love how most of the comments posted in reply to this story are all focused on how useless a simulator is. Sure, it isn't the real world, but it's not meant to be. You can "break" stuff in a simulator that you probably wouldn't want to (or can't afford to) break in the real world. And what about things that don't exist in the real world, but that this simulator could be made to, well, simulate? If you can't think of anything worthwhile to use a tool like this for, you probably shouldn't be allowed near it anyway. Or the real world, for that matter.

    --
    Tastes like burning! - Ralph Wiggum
  37. NARDS! by mchang · · Score: 1

    Did anyone else give a little Beavis 'n Butthead style chuckle when they read "... 160 edge nodes (Compaq DNARD Sharks)..."

    Nards. Heh... Nard Sharks... Hehh hehhh.

  38. 5 miles? pfft. by austad · · Score: 2

    In a 30,000 square foot office space, with only 50 employees, we have 42 miles of cat-6. 5 miles is only 25 spools of cable.

    The office was wired for 150 people, so we're not using even half the ports. And since this particular office is all tech people, everyone has at least 2 machines on their desk (I have 4).

    --
    Need Free Juniper/NetScreen Support? JuniperForum
  39. emulated networks by Anonymous Coward · · Score: 0

    I'm looking at emulating a multiple domain system as a training system for my company and found that mini linux kernels booted up in VMWare will do the trick. Looks like I've got few hundred feet of fake cable.

  40. Another cool hardware gallery... by Anonymous Coward · · Score: 0

    Take a peek at http://hardware.localhost.nl The site just opened, still gathering pictures...

  41. The Red Wheelbarrow by Anonymous Coward · · Score: 0

    so much depends
    upon

    a red wheel
    barrow

    glazed with rain
    water

    beside the white
    chickens