Slashdot Mirror


Managing Young Sys Admins At Oregon State Open Source Lab

mstansberry writes "Lance Albertson, architect and systems administrator at the Oregon State University Open Source Lab, uses a sys admin staff of 18-21-year-old undergrads to manage servers for some high-profile, open-source projects (Linux Master Kernel, Linux Foundation, Apache Software Foundation, and Drupal to name a few). In this Q&A, Albertson talks about the challenges of using young sys admins and the lab's plans to move from Cfengine to Puppet for systems management."

141 comments

  1. Props to them by Teufelhunde · · Score: 1

    As a 19 year old Computer Science major, I give major props to those kids for not crashing the server once a day.

  2. That's what you do in a university... by happy_place · · Score: 1

    Um... Don't all universities use students as sysadmins? I know this was nothing special at Utah state university. There were dozens of networks for varying departments and projects, and all of them administered at least at some level by university students.

    --
    http://www.beanleafpress.com
    1. Re:That's what you do in a university... by betterunixthanunix · · Score: 1

      Not really. Where I studied as an undergrad, there was a lot of paranoia about (undergrad) student sysadmins abusing their power, and so students were only allowed to assist faculty or full time IT staff. When I was asked to do some routine maintenance, I was told that they would not be giving me the root password because I could potentially use it to read other people's email, and that my assurances that I would never do such a thing made no difference.

      --
      Palm trees and 8
    2. Re:That's what you do in a university... by uncledrax · · Score: 1

      Um... Don't all universities use students as free/cheap labor?

      There fixed that for you.

      --
      ----- The internet has given everyone the ability to have their voice heard equally as loud.. even if they shouldn't be
    3. Re:That's what you do in a university... by jimbolauski · · Score: 1

      Most Universities will have a an old timer system admin and students that run the Hell desk, they are given Admin privileges to the computers but not the system.

      --
      Knowledge = Power
      P= W/t
      t=Money
      Money = Work/Knowledge so the less you know the more you make
    4. Re:That's what you do in a university... by Monkeedude1212 · · Score: 1

      Um... Don't all universities use students as sysadmins?.

      HA! No. The University around here only lets CS Graduates touch a server for about 2 weeks, after studying about it for a month. Everything is handled by its own CT&IS Faculty. As someone who has multiple friends at the university, I will speak for the students to say the system they have set up BLOWS. They will, on occaison, hire they're GRADUATES to do some contract work.

      Now, the Polytechnic that I went to, had us set up our own private networks, and administrate that. It was about as close to the real thing as I could get without actually being in the real mess, which was enough for me to learn the basics of what I needed to know. Looking back, it really depends on the class. Some kids were fresh out of highschool (like me) and played alot of Video games during class (not like me) so I would understand if they didn't want certain people administering the Web services of the campus.

      There was ONE student, who managed to hack into the firewall and allow World of Warcraft to run on his computer. He got Straight A's for a year and then Expelled. I sometimes wonder if he was able to get a job, saying "Yeah I was expelled from school because I knew their network better than they did"

    5. Re:That's what you do in a university... by BitZtream · · Score: 1

      There was ONE student, who managed to hack into the firewall and allow World of Warcraft to run on his computer. He got Straight A's for a year and then Expelled. I sometimes wonder if he was able to get a job, saying "Yeah I was expelled from school because I knew their network better than they did"

      No, no one gets hired when they say 'I found out that I could use httptunnel/sshtunnel to get WoW past their firewall so I could break the rules!'

      Because, you know, people love to hear about how you break the rules to play games, shows how great your work ethic is and how well you can do what your told.

      Its also not impressive in the least that you could get out of their network to play WoW. If I can make an outbound connection from a network to a random host on the Internet, then I can get any other network protocol out as well. The network is designed to keep bad guys out, and limit what most internal users do that they shouldn't, no network that allows random outbound connections is REALLY trying to stop you.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    6. Re:That's what you do in a university... by russotto · · Score: 1

      Most Universities will have a an old timer system admin and students that run the Hell desk, they are given Admin privileges to the computers but not the system.

      At my university, pretty much all the lab-dwelling geeks had root on everything they wanted... one way or another.

    7. Re:That's what you do in a university... by freedomlinux · · Score: 1

      Not at all. I am an IT student at RPI and they specifically prohibit hiring current students for the DotCIO. Students work in the software and hardware helpdesks, but never on the network.

      This makes sense because those networks include sensitive data, security networks, and building access authentication. It seems like a good way to cut costs, but it is a potential security risk.

    8. Re:That's what you do in a university... by querent23 · · Score: 1

      I was IT for a while at CU Boulder, and they didn't use students there. I'm actually a grad student at OSU now, and just alerted the local Linux Users Group to this article. Maybe they'll chime in.

  3. Re:Serious question. by Anonymous Coward · · Score: 1, Funny

    Because Greek mythology is reserved for server names, and everything else is copyrighted.

  4. I guess they're adminning the site for TFA. by Anonymous Coward · · Score: 0

    When I clicked on it, all I got was a black screen.

    Or, they're a bunch of Goth admins and are really into the whole black on black thing.

    NIN rocks!

  5. Especially if they are training developers by xzvf · · Score: 5, Interesting

    Most universities don't teach good system management. The CS departments are training developers and programmers. Since good SA's like stability and good developers like chaos the two normally don't mix. Does OSU have a SA degree program?

    1. Re:Especially if they are training developers by nine-times · · Score: 1

      Right. Actually, real-world situations of system administration often aren't very good learning environments. If you're hosting real-world stuff, the best advice is often "Don't touch this, and don't mess around with that." Not messing around with things is often how you achieve stability.

      Not to say that SAs don't mess around with things, but it's often not a really experimental situation when you're administering live servers. You're being careful and doing as little as possible. I suppose that, too, is a helpful skill that has to be learned.

    2. Re:Especially if they are training developers by Mad+Merlin · · Score: 1, Informative

      Most Universities don't teach any system administration. I don't know about you, but I picked it up hands on, by creating Game!.

    3. Re:Especially if they are training developers by jimbobborg · · Score: 3, Informative

      Really? I've had the OPPOSITE experience. I've had to fix more crap done by developers who thought they could do sysadmin work than I have dealing with other SAs.

    4. Re:Especially if they are training developers by lukas84 · · Score: 1

      "Never touch a running system" is what usually leads to the spectacular failures that make it into the press.

      If you know and understand something, patching and upgrading it is no big deal - but it helps you to stay familiar with whatever you're dealing with. Also, planned outages and planned upgrades ensure that everyone is familiar with the system and documentation stays current.

      Not touching your systems is a very, very bad practice.

    5. Re:Especially if they are training developers by Anonymous Coward · · Score: 0

      OSU does not have anything even close to resembling a SA degree program. We're all Computer Science majors, which means theory and programming!

    6. Re:Especially if they are training developers by i.r.id10t · · Score: 2, Informative

      A course titled "Unix Administration" is a 4000 level course offered as part of the CSE program at UF. What it covers I don't know (and won't for a few years) but there is at least *one* admin course taught at *one* university for comp sci/engineering folks...

      Looking forward to taking it too, since I teach a Linux Admin course here at the community college I work at...

      --
      Don't blame me, I voted for Kodos
    7. Re:Especially if they are training developers by lukas84 · · Score: 0, Flamebait

      Just like no university has classes on being a Janitor.

      I really don't see why someone with an university degree would want to work as a system administrator.

    8. Re:Especially if they are training developers by rhewt · · Score: 2, Insightful

      I would have to agree with your statement. As a soon-to-be graduate of Virginia Tech in Computer Science and Finance, the CS department's curriculum has about 2.5 years of programming before you even see any SA classes (of which cover a very limited area). It's almost as though the message is that one needs to be a good programmer (perhaps exposed programmer would be more appropriate) in order to be a good system administrator, which I don't believe is the case. I thoroughly enjoy net/sys administration and am a terrible programmer. It would certainly be nice to see these two coexist without one being such a prerequisite. It would also be nice for courses to prepare the students better for certifications, which hold a lot of weight in the corporate IT world.

    9. Re:Especially if they are training developers by Monkeedude1212 · · Score: 1

      Since good SA's like stability and good developers like chaos the two normally don't mix.

      So THAT'S how Warhammer 40K got started...

    10. Re:Especially if they are training developers by Anonymous Coward · · Score: 0

      It sounds like you weren't dealing with particularly good developers in the first place.

    11. Re:Especially if they are training developers by nine-times · · Score: 3, Interesting

      Planned upgrades are one thing. "I wonder what happens if I do this..." is another.

    12. Re:Especially if they are training developers by jimbobborg · · Score: 1

      No, they were excellent developers, just crappy SAs.

    13. Re:Especially if they are training developers by robbadler · · Score: 1

      One of my roommates at OSU was a CS major with a focus in IIS. He worked with the OSU OSL and LUG.

    14. Re:Especially if they are training developers by fuzzyfuzzyfungus · · Score: 4, Insightful

      The nasty trick is that, while not touching systems is very, very bad practice, being the first guy to touch something that hasn't been touched in a while is not a pleasant thing.

      In an ideal world, all systems get regular attention and everything hums along smoothly. In a less ideal world, people are distracted from what is working by what isn't working, and their knowledge gradually atrophies, until they no longer dare touch what is working for fear of making it join what isn't working. This is a thoroughly pathological situation; but, if you are stuck in it, Just Not Touching and hoping for the best is quite possibly more logical than biting the bullet and taking one for the team.

    15. Re:Especially if they are training developers by Anonymous Coward · · Score: 0

      Which is why god invented Test, Dev, and DRP servers, so you can try everything you need to with non-production equipment before deploying the solution to production. I don't do anything to production before trying it on 3 other environments.

    16. Re:Especially if they are training developers by Anonymous Coward · · Score: 1, Funny

      So we don't have to work side by side with fucktards like you.

    17. Re:Especially if they are training developers by suomynonAyletamitlU · · Score: 1

      How about we replace "chaos" with an equivalent word, "unstable".

      Developers are expecting the things they are working with to be malleable and assume they are suitable to be changed. They may easily leave a system in a state where it's easy to do something interesting later, with the understanding that if something goes wrong, it can and will be fixed.

      Then, since their job isn't to be a professional SA, they run off and do other things and completely forget about it for a while, and things degenerate. If they WERE professional SAs, they would notice them fairly quickly and keep trying new solutions until they came upon one that worked. Since they aren't, they just sort of hack together a workaday solution and then forget it again.

      I'm sure if they had the same skills but were hired as an SA and only did programming on the side, they would be half-assed programmers for a similar reason, if probably in different ways.

    18. Re:Especially if they are training developers by Anonymous Coward · · Score: 0

      Then clone the working system to a test lab with no outside network connection and poke the clone.

      If you can't clone a live production environment (I mean technically, with permission, an outage and all that) update your resume and find a new job, you don't want to be famous around town as the guy who was on watch when that important server died and took out 30 man years of work.

    19. Re:Especially if they are training developers by Icegryphon · · Score: 1

      ok, that needs to be modded funny.

    20. Re:Especially if they are training developers by Bandman · · Score: 1

      Were they excellent developers or excellent programmers? There's a difference, in my opinion.

      An excellent developer has a work ethic that would mesh nicely with an excellent sysadmin. That isn't necessarily the case with a programmer. You can be a wiz kid programmer, but not actually /develop/, you just write. Development is a much more in-depth process. You do things like document, you shepherd the code into maturity, and you manage it throughout its lifecycle. Again, that's a developer, not necessarily a programmer.

      Off the top of my head, I don't know of a division of sysadmins that can be the same. Maybe "enterprise admin", versus a non-enterprise admin. If your goal is to build systems with a maximum availability, to be fault tolerant, and you build an infrastructure, not just servers, then you're probably an enterprise admin. If you just "admin a linux box", that's not quite the same thing.

    21. Re:Especially if they are training developers by Bandman · · Score: 2, Insightful

      I've got to assume that you aren't a sysadmin, from your tone. At least, if you /are/ a sysadmin, you haven't really thought too much about it.

      Properly executed, systems administration is a far more difficult than the non-system admin (or even the casual sysadmin) realizes. Disaster and recovery planning, performance tuning, infrastructure design, these aren't small-brain tasks. There's a big difference between adding users and managing an infrastructure, and yet, sysadmins do both.

      Don't knock the profession just because your experiences with them have been less than ideal.

    22. Re:Especially if they are training developers by russotto · · Score: 4, Insightful

      An excellent developer has a work ethic that would mesh nicely with an excellent sysadmin.

      It's not the work ethic. It's temperment, the whole attitude towards things. As a developer, I'm very uncomfortable working on production systems, because there's a lot of walking-on-eggshells. If something goes wrong in the dev or QA environments, I can do a lot of "OK, try this... try this... try this", and if one of those things brings the environment down in flames, such is life. When I find the right combination it can be restored to the original broken state, then I can re-apply the thing I think worked, and if that works, I can then hand that off to ops to put on the production system with some confidence that it will work.

      If a production environment has some problem which has to be corrected "live", though, that's a very BAD way to try to fix it, for obvious reasons. Instead, a lot more passive analysis has to be done before trying anything, and more important than "will this fix the problem" is "will this bring the system down (worse than it is) or worse, destroy customer data". And since when a developer is called in to help with production there's probably a major problem, the developer usually has to deal with the ops folks and management breathing down his neck as well.

    23. Re:Especially if they are training developers by lukas84 · · Score: 1

      I am a sysadmin, if you're willing to call someone who works with Windows that.

      I like my job and i like what i do - but i have no illusions about it. Yes, there is lots of interesting stuff to do, but unless you work in a large corporation, people will still call you up if they can't fix a paper jam themselves.

    24. Re:Especially if they are training developers by BitZtream · · Score: 4, Insightful

      No, they weren't excellent developers.

      They may have been great code monkeys, but those are literally a dime a dozen if you don't mind importing from India.

      A GOOD developer is also a GOOD sysadmin.

      I've been doing both for ~15 years, in that time, I've met 2 good developers. The rest have are monkeys who write code, many of which who write well. Maybe in the next 15 to 30 years I'll meet a few more. With everything going networked now days, you have to be a good sysadmin to understand how to write software that admins can use.

      You don't write an apache webserver type application without being an admin, you just don't know what you are trying to hit. This isn't unique to developers writing for admins, its true for all development. If you don't know how to do and have experience doing what the software is supposed to be used for then its practically impossible for you to write software that doesn't suck. This is why there isn't a point of sale system on the planet that isn't asstastic. You'll be hard pressed to find a developer now days who actually had a job when they bothered to pay attention enough to know what good POS software needs to do.

      Interestingly enough, I've never met a CS student or recent grad who was even a good code monkey. After several bad experiences our company has developed a 'no CS grad' policy for developers. We'll take you after you have 5 years or more experience, but with less than that all you are is an arrogant asshole who thinks he deserves to get paid ridiculous amounts of money and you still spend a few years breaking them down into something useful. (Read: removing the arrogance of youth and learning that there is far more software AND administration than just writing code or installing Linux)

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    25. Re:Especially if they are training developers by Obfuscant · · Score: 1
      Does OSU have a SA degree program?

      From a quick scan of the program catalog, no. Not even SA courses.

      I know a few years ago they used to have what I expect would be an excellent SA course. I know the guy who taught it, and he was an excellent SA whose attitude towards the process was extremely infective. He had people setting up systems and mail servers and what not and tearing them down to see how they ran. The impression I got from him and others was that those who took the course loved it, but he and the course weren't highbrow enough for "computer science". He wasn't a PhD so he had to go...

      The main OSU computer stuff is all run by professional staff, as is our college's. One upside compared to "free" student labor is continuity. (I've been running my systems for 18 years -- grad students are here for 3-4 and then poof!)

      As far as "system admin" and "CS" at OSU, here's an anecdote that conveys my opinion. One prof here hired a CS MS student to write code to process his data. He would show me copies of his qaulifier exams and we'd chat about linked lists and all the typical CS kinds of things. Then one day he asks me "how do you rename a file"?

      Another look into the dark side of OSU EECS: http://eecs.oregonstate.edu/graduate/degreeprograms.html. Do act quickly so you don't miss the application deadline!

    26. Re:Especially if they are training developers by gchaix · · Score: 1

      Two OSL staff have created and taught a system admin course at OSU: http://cs312.osuosl.org/ The content is available under Creative Commons.

      We're actively working with the EECS faculty to incorporate both system administration and open source topics into the course offerings.

    27. Re:Especially if they are training developers by mysidia · · Score: 1

      Thats what test labs are for.

      Also, a good SA will know when "I wonder what happens if I do this...." is safe to try or not. There are no hard and fast rules.. sometimes an SA should be asking that question and considering applying it.

      Normally, only when troubleshooting an issue so business-impacting that it can't wait for a maintenance window to fix.

      Where "I wonder what happens if I do this..." is actually a knob the SA fully understands, and wonders if turning it off (or on) will help with the particular issue, which is probably caused by X, as indicated by the logfile....

    28. Re:Especially if they are training developers by ducomputergeek · · Score: 1

      It's always fun when we have interns from the local university CS dept and the first time they run into a systems problem in the real world, i.e. a router not properly configured or a firewall problem, and they spend hours trying to figure out what is wrong with their code.

      I come from the SA/SI world. The students always wonder why so much of our code is written in Perl as opposed to PHP, Python, Ruby, or whatever is the "cool" scripting language this year. And the reason is that a lot of it was stuff that I wrote 10 years ago. It worked then, especially log analysis stuff, and here it is 10 years later and guess what: it still works.

      --
      "The problem with socialism is eventually you run out of other people's money" - Thatcher.
    29. Re:Especially if they are training developers by mysidia · · Score: 1

      System administration changes as quickly as the computing technology changes, which is way too fast for curriculums to catch up..

      Many universities revise their curriculums once every 7 years or longer. For system administration, that's a disaster, it would be 2008 before they considered replacing the "Windows NT" class with a "Windows 2000 Server" class per the suggestions of some students (received a few years back).

      Many universities use a lot of old outdated computing hardware, and don't have labs with equipment similar to what enterprises use, and what will be in small businesses by the time they graduate.

      Many universities themselves don't have many competent sysadmins on staff, let alone instructors who are skilled in the craft.

      The admins who manage campus networks (if the uni. has a decent one) are way too busy to teach sysadmin classes, and probably not interested.

      As far as procedures and methods, that's different for every business.

      I don't see formal education as able to go beyond the basics.

      They ought to be able to teach basic information about common OSes, security, troubleshooting techniques, social aspects of computing.

      But honestly... they probably see System Administration as more like a trade such as 'Carpenter', 'Assembly line worker', 'Policeman', 'Truck driver', 'Construction worker', 'Janitor' than an academic pursuit such as 'Physics'

      Universities like to say they're educational institutions, not job training facilities :-)

    30. Re:Especially if they are training developers by nine-times · · Score: 1

      Also, a good SA will know when "I wonder what happens if I do this...." is safe to try or not.

      Oh, sure, I agree. But I was saying that it's often not a great learning environment specifically in that you shouldn't just poke around and say, "I wonder what happens if I do this..." I mean, if I were introducing someone with little or no sysadmin experience into a team, one of the first rules I would set is, "At least for the time being, don't poke around in any production systems unless you and I both know what you're doing."

      Thats what test labs are for.

      Yeah, but is that what we're talking about? Students poking around on test labs in development machines? Schools can always set up test labs for students to screw around with, but I was under the impression we were talking about students supporting live (and important) servers. In that case, one of the most important lessons that I think you can learn from real-life experience is, "This stuff is important and needs to be kept running without downtime. Don't experiment with these machines. Don't 'try things out' on this machine. This is the machine where, most of the time, you're only making changes that are well-controlled, planned, and necessary."

    31. Re:Especially if they are training developers by mysidia · · Score: 2, Interesting

      I think a better analogy might be professional diver, airplane pilot, or astronaut

      It's not a field where you can simply be educated on the subject, and become a practitioner that way, you need hands-on experience. A large amount of intense training is required to do it competently.

      And is also a risky business... if you're the DBA, and the enterprise database server breaks (hardware failure)... who will the fingers be pointing at for blame?

      What are people going to say to you, when you tell them... yeah.. our RAID array got hosed, due to 2 simultaneous disk failures. we gotta rebuild from backups, it's going to take 72 hours.

      And no business can be done until it finishes. Yeah... you don't want to be sysadmin at a time like that. Even if you tried to sell management before on a better disaster recovery plan. You're fortunate if they don't start wondering if you broke it in retaliation for them refusing to adopt your plan... and the scary thing is some (unprofessional/immature) sysadmins might do that sort of thing.

      It's a myth that people believe in "don't shoot the messenger".

      Large-scale sysadmin work is beyond the abilities of the average person. Both knowledge and skill are required. In many cases... programming skill; to an extent, all good sysadmins are programmers (scripters usually), but that doesn't mean all programmers are good sysadmins.

      Skill is developed over years of experience, it can't be taught beyond a certain extent.

      It's also a niche field. At the high end, there are not very many system administrators in the world, perhaps a few hundred thousand at most.

      At the low end, everyone and their brother, thinks they're a system administrator, with zero training, zero schooling, etc.

      You know how to plug a cable in? You have a CCNA? Great, you're hired.. network admin for a 5000 workstation network..

      So even if you do study for years, get lots of experience, become a really skilled system admin... you still have the lowest common denominator as competition, when it comes to employment.

      Anyways... I lost track of my point.. it's nothing like "Janitor"

      Almost all janitors basically do the same thing, it's not complicated at all, some skill might be required, but not much.

      Nothing that can't be picked up in a few days. The skills and knowledge required to be a janitor are common, and don't need to be taught -- just about every member of the public has them.

      The same is not true of a good sysadmin.

      I'll admit there are some exceptions, but there are a lot more janitors in the world than real system admins.

    32. Re:Especially if they are training developers by mysidia · · Score: 4, Insightful

      The ideal combination would be for them to administer live systems and test systems at the same time, e.g. have access to both.

      And utilize change control.

      Use test systems to experiment and learn. Make proposals to accomplish tasks/maintenance that need to be done to live systems (such as upgrades).

      On lab systems, they test/experiment with their proposed administration procedures/configuration changes. Before using them in the maintenance of live systems, they document what they plan to do step by step, and two other admins, a "partner", and a senior admin go over the procedure with them, question them about any apparent gaps, lookup any missing information needed, and take a copy of the procedure.

      Then at the planned time, the young admin will run the procedure exactly as documented.

      If they need help, or something (bad) should happen to them in the middle (e.g. they tripped over something, broke a leg, or broke their keyboard in the middle of maintenance), such that they can't complete the maintenance task, or get stuck, the other two admins both agree to be available to help and pick up if necessary.

    33. Re:Especially if they are training developers by Anonymous Coward · · Score: 0

      "The nasty trick is that, while not touching systems is very, very bad practice, being the first guy to touch something that hasn't been touched in a while is not a pleasant thing."

      I had to laugh before I cried at that line. my current job had a 8month down time between my predecessor and me. after 4 months I wrote up a hardware failure bingo card and gave it to my boss. first one to bingo had to buy the other person a beer.
      of course I won.

    34. Re:Especially if they are training developers by mysidia · · Score: 1

      What the fuck are you talking about? The best developers I've ever worked with were damn fine system administrators, and vice versa.

      That may be true that the very best developers were okay sysads. Most good developers aren't, except ones from a sysad background.

      There are still a lot of good developers who would be terrible system admins.

      And plenty of great sysadmins who would be terrible developers.

      The best sysadmins are the ones who have proper training as sysadmins, and a plentiful amount of relevant sysad experience for the specific job.

      Developing and System Administration are not the same, and emphasize different skill sets.

      Programming does not improve your knowledge of system administration; unless you actually do full time sysad work, you don't stay current and build the proper skills for a sysad job.

      You (hopefully) stay current and build skills suitable for a developer job.

      It is very difficult (but possible) to get and maintain both skill sets.

      Now I do see, many developers get the skills that would permit them to do some small-scale sysad work.

      Many happen to be geeky computer junkies, who have many computer systems of their own, running a variety of OSes, they play with for development purposes.

      Developers who write OSes or system administration tools are in a peculiarly good position to be system admins.

      However, a .NET programmer, is not likely to be a good UNIX sysad.

      They might, be, but there are critical other variables involved.

      The best developers often have special intellectual skills, that would facilitate them doing almost any IT job (if they read up on it), possibly even better than other sysads, at the important task of automating processes....

    35. Re:Especially if they are training developers by Bandman · · Score: 1

      Sure, I can't argue that. I've spent my career (almost 10 years) in small infrastructures, but I'm sick enough to like it. It can be frustrating at times, and it's often overwhelming, but I can't think of any other job that requires the breadth of knowledge of an IT Admin at a small company.

      The trick is to think of your small infrastructure as an enterprise infrastructure. Consider that you've got the same goals that they do: maximize uptime while minimizing costs. Sure, they've got a few orders of magnitude more budget than you do (if you've got a budget at all!), but that's part of the challenge.

      Implementing "best practices" as dictated by vendors is not feasible. We small shops can't afford that sort of thing, so we go with what we can do, which is frequently make it up as we go.

      That's one of the reasons I'm writing a series of books. The series is Small Infrastructure Administration, and it's going to cover (among other things) vendor-neutral best practices that can actually be implemented by people with small shops.

    36. Re:Especially if they are training developers by Bandman · · Score: 1

      I don't think it's work ethic, either. It's just the approach. A good developer, just like a good sysadmin, needs a holistic approach. You don't jump in and implement something without considering the effects of that change.

      I think we agree :-)

    37. Re:Especially if they are training developers by Almahtar · · Score: 1

      but, if you are stuck in it, Just Not Touching and hoping for the best is quite possibly more logical than biting the bullet and taking one for the team.

      Sounds like a typical Friday night for me.

    38. Re:Especially if they are training developers by msi · · Score: 1

      I hate the mod system. Why can't we have a undo option? I ment to make this post insightful

    39. Re:Especially if they are training developers by bdsesq · · Score: 1

      They really are two different skill sets.
      People who are developers CAN learn to be SA's and vice versa. However, in my experience they don't want to. They are developers because that is what interests them. Same for the SA's.

  6. Lesson 1 by tverbeek · · Score: 5, Insightful

    The main thing that people that age need to learn (both professionally and personally) is that Their Actions Have Consequences.

    --
    http://alternatives.rzero.com/
    1. Re:Lesson 1 by betterunixthanunix · · Score: 1

      Why not focus on the positive side of that instead? I would say the first lesson should be, "take pride in your work."

      --
      Palm trees and 8
    2. Re:Lesson 1 by Anonymous Coward · · Score: 0

      yeah and at that age "consequences" are 'delivered by storks'

    3. Re:Lesson 1 by NevarMore · · Score: 0, Troll

      You mean like reading and posting to slashdot in the middle of the workday?

    4. Re:Lesson 1 by Spit · · Score: 2, Insightful

      I'll agree, sysadmin is as much about process and discipline as it is tech knowhow.

      --
      POKE 36879,8
    5. Re:Lesson 1 by tverbeek · · Score: 1

      Because a clever 19-21-year-old is (generally) already plenty proud of what he knows how to do. So proud that he'll (random example) upgrade Apache from 1.3 to 2.0 as a treat for everybody as he leaves to go party at his friend's college for the weekend.

      --
      http://alternatives.rzero.com/
    6. Re:Lesson 1 by bzipitidoo · · Score: 3, Interesting

      I think patience and learning when to say "no" are big ones too.

      It's so tempting and easy to take shortcuts in system administration. "We don't need to waste time checking our backups" or, worse, "we don't need to backup" before doing major work is just the sort of time saving notion that can really haunt you if something goes wrong. Ugly when you need those backups and you discover the backup system you put into place in a similarly hasty fashion has some tiny little problem, maybe an incorrect flag on a command, and so the backups are no good. Can't spend all your time on paranoid checking either, of course. It's an art juggling these risks, deciding what is critical and what is not. There are never enough resources. If you have to make room in order to back up something, and it's going to take an hour or more to find things that can be deleted, clean out trash, compress directories that haven't been used recently, move files around, and so on, it's tempting to skip it, particularly if an impatient PHB is breathing down your neck, and other users are just waiting to pounce on that space the minute you free it up. Then there are the programmers who can't write anything that doesn't waste gobs of disk space and RAM. Someone notices when their code makes excessive use of the CPU, but a few megabytes of hard drive space flys under the radar. Some really think it isn't worth even a few minutes of their time to fix things like that, not when they're under the gun themselves to bang out more features as fast as possible.

      --
      Intellectual Property is a monopolistic, selfish, and defective concept. It is "tyranny over the mind of man"
    7. Re:Lesson 1 by Bandman · · Score: 2, Interesting

      I agree, as well. 90% of my time spent when teaching my junior admin is teaching him how to think like a sysadmin instead of a hobbyist.

    8. Re:Lesson 1 by camperdave · · Score: 1

      Ever hear of a coffee break?

      --
      When our name is on the back of your car, we're behind you all the way!
    9. Re:Lesson 1 by clarkn0va · · Score: 1

      I thought "you're actions have consequences" was a positive statement. Consider the alternative.

      --
      I am literally 3000 tokens away from the chaotic crossbow --Stephen
    10. Re:Lesson 1 by russ1337 · · Score: 2, Interesting

      I've seen single seat fighter jocks in that age range.... age has little to do with it. Training and attitude have lots to do with it.

  7. Amazing. by CannonballHead · · Score: 4, Insightful

    Young people with their heads on straight. Definitely newsworthy.

    I know the whole "you young'un, you can't manage a server to save your life!" feeling and all that, but really... is managing a server, even an important one, really that hard - when you have someone to go to when you have questions? A lot of lab administration seems to be finding problems before they become a real problem, which is time consuming.

    You may as well have a story about dental work done by *gasp* dental students and, lo and behold, they are actually doing a good job! Shocking. To think that young people could actually learn something. :)

    OTOH, it's interesting to read about the difficulties he brings up. They're pretty ... boring, IMO.

    It generally takes around six months for a student to feel comfortable with our environment.

    Like most jobs?

    Another challenge is the short turnaround with students, as we usually only have them for two to three years before they graduate. This creates a constant issue to ensure our documentation and training is honed.

    Two to three years, that's not too short, is it? And it's interesting that it's an "issue" to him to keep their documentation good/honed. I hope the graduates are learning that documentation is a BIG ISSUE in real jobs, for exactly that purpose: if something happens to you, the business can't just stop for 3 months while someone else tries to figure out what you did :)

    1. Re:Amazing. by betterunixthanunix · · Score: 2, Insightful

      "I hope the graduates are learning that documentation is a BIG ISSUE"

      Only in engineering programs. CS programs still retain a lot of their "math heritage," and there is very little push for the students to write good documentation; at best, documentation seems to be an afterthought.

      --
      Palm trees and 8
    2. Re:Amazing. by Monkeedude1212 · · Score: 1

      is managing a server, even an important one, really that hard - when you have someone to go to when you have questions?

      Thats exactly the position I'm in, and its the easiest part of the job I hold. If you know HOW to do things, the only thing left as part of the job is knowing WHAT to do.

      When an issue comes up, its just "Hey, this is whats going on. Whats the best course of action? We could..."

      And then he'll respond with "Yes, that sounds good" or "No, do this instead"

      And Bam, its a cakewalk.

    3. Re:Amazing. by CannonballHead · · Score: 1

      And knowing how to do something isn't toooo difficult with manuals, Google, and other people to ask.

      Knowing what to do appears to come with experience.

    4. Re:Amazing. by Anonymous Coward · · Score: 0

      I was one of the co-founders of the Open Source Lab with Scott Kveton and was involved in hiring Lance (I'm still one of the BOA members for the lab). One of our core "visions" for the lab was to create a place for younger developers and admins to be able to get top notch skills and jobs out of school. Because of that, our goal was not SOLELY to be the huge infrastructure host that the OSL is better known for, but to REALLY TRAIN YOUNG TECHNOLOGISTS.

      So as the first operations manager of the lab, I believed in the military axiom (thanks to Lt. Gen. Harold Moore): Power and loyalty go down, not up. We gave kids extraordinarily advanced jobs that a lot of companies don't give to far more experienced people. And the students almost universally took the responsibility seriously, and did better than I/we ever expected. Of course there were some controls and supervision. Lance and Corey Shields before him have done fantastic jobs of keeping things robust and secure while at the same time training young professionals to levels unheard of at that stage in similar career stages. To be smug and wankerish, it is one of the things I am most proud of. In fact, I have more pride in the students who all got great careers going because of the OSL than I am of the size and number of projects we host. I'm a little old fashioned I guess, but the OSL is at a UNIVERSITY.

      Jason McKerr/Anonymous coward

    5. Re:Amazing. by BitZtream · · Score: 1

      A lot of lab administration seems to be finding problems before they become a real problem, which is time consuming.

      Its also practically impossible for someone with no experience, which is why you don't let 'young'ns' do it.

      CS students are not SA students. You don't let a dentist perform open heart surgery, but of course most of them, unlike CS students, know better than to try it. I guess dentists are better educated or less arrogant than CS students.

      You want to let them manage a pseudo lab for training purposes fine. You don't however, if you have even half of half of a cluepon, let them manage a real network (or lab) that people need to use.

      You don't put your newbie admin hire at the company straight on the production servers doing massive system changes even with years of experience, why the hell would you let some college kid with no experience, no history on the subject, no knowledge of the subject, and absolutely no idea how much something that seems like a trivial unimportant change can wreak havoc.

      Admins of 20 years often have this problem as well, and most of them know better.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    6. Re:Amazing. by MonsterTrimble · · Score: 1

      Hear, Hear. I work as a mechanical / industrial engineer and at both my current job and previous one good legacy documentation did not exist when I arrived. All knowledge was tribal and therefore we all prayed that nobody got hit by a bus. I'm slowly getting things into a usable (for the next person) position but overcoming a decades worth of stuff is time consuming. At least I know the next person will be able to find stuff.

      --
      I call it 'The Aristocrats'
  8. Nope by autocracy · · Score: 4, Interesting

    The members of the CS department at my college actually petitioned to have me take over as their lab admin. The incumbent staff admin was notorious for breaking things and making it a chore to use the systems. Despite the complaints against him and requests specifically to hire me on, the department chair kept the incumbent.

    I found it all very amusing, especially since I'm not a CS student. I'm just well-known enough to the group. I'm also greatly amused by how often I get asked for help when I'm around there, specifically one case where a student was in a 390-something class. I replied, "We really don't know each other at all, and I'm not a CS student. What made you think I am a good person to ask?" He said he'd just seen me help with enough other people's problems... and so I gave him a hand too.

    Long-windedness aside, my university only uses students to provide, "Cean the viruses off your personal computer," services.

    --
    SIG: HUP
    1. Re:Nope by BitZtream · · Score: 2, Interesting

      The ignorance of your post is one good indication of why they didn't replace him with you.

      If you have a bunch of CS students petitioning to make you the admin, thats another good indication that you shouldn't be doing it. Part of this I know because I'll bet a months pay that the job description for the position doesn't include 'CS students must think your a swell guy and a good admin', which you seem to think IS part of it.

      An admins job isn't just 'make things easy on users'. There is a lot more that goes into it, which generally results in ignorant users getting mad at a good admin and wanting someone else. Making users happy is rarely part of the job description anywhere. Making it so users can get what they need accomplished is. Sometimes part of the requirements, especially at an educational facility is to specifically PREVENT users from doing things the easy way. You'll understand some of this more when you get older and realize that most of the education you get in college isn't what you hear in lectures or read in books.

      Your post smacks of a young, know it all with no experience and a lot less skill than you realize. Its great that you think the management at your school is stupid, I mean, they've only been doing it longer than you, you must obviously be better at it than them and know more than they do, I mean, thats why your going to their school rather than managing their school. You always want to learn from people who know less than you do.

      Just because you know how to use a computer, doesn't make you an admin. It doesn't make you aware of all the stuff that goes on behind the scenes in a large organization such as a university. You THINK you can do better when you really don't know what this person does across the board.

      CS students are most certainly always at odds with their admins. Its a bunch of arrogant socially inept kids with no real world experience who think they know everything there is to know about technology and that no one else has any idea how it works. To top it off, most CS students that come out suck ass at CS. I've hired from UNC, NCSU and Duke university for CS, obviously these aren't strong points here, however, our company now has a policy of not hiring anyone out of college with less than 5 years work experience. I'll take you off the street with a high school degree in a minute if you impress me, CS students on the other hand take far too long to knock the ignorance out of and get them to realize they don't actually know that much. This certainly isn't unique to CS, but it is more common there. The result is a bunch of CS people who think they should be able to do whatever they want, whenever they want without regards for anyone or anything else. Virus authors are less damaging to a network than a group of CS grads with root.

      Do you know every task those machines were intended to be capable of performing? Do you know the laws regarding security requirements for your state? Do you know what rules they have for vetting software to ensure its compatible? Have you ever actually been involved in the process of upgrading software across a campus? This isn't like when you run apt-get on the Ubuntu box in your basement. Its fine for you to dick around with your own machine and have it offline, but the majority of a sysadmins work should be done without the users EVER HAVING ANY IDEA that its happening.

      Its cute though, that you think that while you're still in school, you're more capable to know what to do than all the other people, which have been running a school for years. What I wouldn't give to go back to the time in my life where I knew more than everyone else. Ignorance was bliss. Those were good times. I guess when you have the cockiness knocked out of you in a few years after you rich the real world and fuck something up due to your arrogance that you may be better at it, my first half a million dollar mistake because I left a couple 0s off the end of a polling time did a good job putting me in my place, yours will probably do the same. It it doesn't, you won't be in the field long anyway so either way the damage will likely be contained. Theres a grad students get hired as interns.

      --
      Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    2. Re:Nope by Sir_Lewk · · Score: 4, Insightful

      And you wonder why people don't like your type...

      --
      "linux is just DOS with a UNIX like syntax" -- Galactic Dominator (944134)
    3. Re:Nope by Anonymous Coward · · Score: 0

      Wow, someone's a bit bitter today. Do you suck on lemons to practice that sour face we can read between the lines in your post, or did it come naturally from socially interacting with others?

    4. Re:Nope by Anonymous Coward · · Score: 0

      You are either having fun trolling, or else you yourself have more than bit of ignorance. I was the computer operator/programmer for my local school system when I was in high school (I worked directly for the only other person in the computer department, the Director of Data Processing for the school system). I worked 40 hours a week (every other week as part of a work-study program) while a senior in high school at a computer-based phototypesetting company as the operator of a PDP 11/60 which supported the International Engineering Department (about 30 employees). After attending college for one year, at age 18 I was working as the Associate System Manager for a startup computer company employing about 30 people where I was responsible for the management and operation of their VAX 11/780-based computer system, working with one other person (the System Manager). In all of these jobs I had serious responsibilities and I was quite competent at carrying them out. When I was 19 years old, I got a job with a major government consulting firm as an operator/programmer for their computer service center supporting a regional office with some 400 employees. By the time I graduated from college, I was the manager of the computer service center with responsibility for a large annual budget and five employees. Two years later, I was the manager/chief engineer for this same company's corporate data network, a position which I retained while the company grew from approximately 10,000 to over 30,000 staff.

      Based on my personal experience, I believe it is more than reasonable for someone of the age of the typical college undergraduate to be capable and responsible enough to be a systems administrator for a college computing center. Not *every* undergraduate has the maturity to do this, but certainly more than zero do.

    5. Re:Nope by Anonymous Coward · · Score: 0

      A bit harshly stated, but true in my opinion.

      Running apt-get on your uni server...and that probably in a segmented / sand boxed / fire walled / isolated in every way as much as possible student section of the network (if your uni admins have any sense and any desire to sleep at night...) is a far cry from running 24x7 systems that are LITERALLY mission and life critical (911, police, fire, flight, military, etc).

      Also, did I mention real world / life politics? That's been a hard one for me...but best practices says we should patch regularly...yeah but that breaks app xxx which we don't have money or desire to fix because that will upset so-and-so big shot.

    6. Re:Nope by Anonymous Coward · · Score: 0

      Oh dear. Another "Mordac, Preventer of Information Services" SA.

      Guess what? Being an SA isn't about being a dick to users. Really, it's not. Being an SA doesn't mean you automatically say no to every request, no matter how routine or standard, and have to be argued into doing your job.

      I've seen too many Uni sysadmins make life hard for students unnecessarily. The job really is about helping them get their tasks done. Not preventing them from doing it.

    7. Re:Nope by Calindae · · Score: 2, Insightful

      "...our company now has a policy of not hiring anyone out of college with less than 5 years work experience"

      Wow, good luck with that. So where are CS graduates supposed to get this 5 years of work experience if everyone hires like your company?

    8. Re:Nope by bill_mcgonigle · · Score: 1

      Despite the complaints against him and requests specifically to hire me on, the department chair kept the incumbent.

      Well then maybe the department chair will think twice next time before he stores those photos of himself quicksorting that trollup on the department fileserver.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    9. Re:Nope by Anonymous Coward · · Score: 0

      Academic Sysadmin is a different world from private or even government admin. The expectations are the same as those in a 'startup' private business while having the requirements of a public/financial institution.

      In the government/regulated institutions, the employees understand more readily that their privileges will be constrained by legal policy requirements. Public academics expect a nimble IT to deliver what is needed to research and collaboration without restraint. The IT staff have to juggle this demand with the public policy requirements while also being PERSONALLY responsible if the public policy requirements are not met..

    10. Re:Nope by ajlisows · · Score: 1

      I can understand your point that he probably does not have nearly as much knowledge as the incumbent admin, but that doesn't mean he couldn't do a better job. It is a computer lab, not the central Network facilities for the college. The computer lab person is pretty much there first to make sure people don't destroy the computers or do anything illegal and second to make sure to help the people in the lab. The guy currently in the position sounds like he doesn't really want to help the "lusers" so he locks everything down and browses the internet all day. The college kid apparently does want to help. That is half the battle in some of these situations. A position where you are helping people do (mostly) basic things with computers is going to benefit from a person with drive more than a person with experience.

    11. Re:Nope by Anonymous Coward · · Score: 0

      Holy smokes. As a sysadmin at a major U. your post makes me want to crawl in a hole.

    12. Re:Nope by CAIMLAS · · Score: 2, Interesting

      As someone who has approximately 5 years of experience, including 6 years of part-time and contractual small business network/system admin work and several years in small-medium hospital sysadmin work, let me just say that his attitude seems to be very, very prevalent.

      Granted, I may be getting lied to, but I've been told that I don't have any "big shop experience" even though I was one of three admins handling 250 Linux servers and several thousand workstations. This just happened to be a number larger than they had: this organization was simply in a different sector.

      My experience is that there are two lower level tiers of sysadmins: those which require 2 years of experience, for which anyone with over 3 years of experience is over-qualified for; and 5 years of experience, for which anyone with less than 6 or 7 years of experience is under qualified for. So if you want to do sysadmin work, you better reconsider your options, or hope to god you're able to hop jobs and/or avoid being laid off at the same place for a span of 4 years. Once you're unemployed, you're done.

      --
      ~/ssh slashdot.org ssh: connect to host slashdot.org port 22: too many beers
    13. Re:Nope by autocracy · · Score: 1

      Well, I don't intend to have a big back-and-forth on it, but I work professionally at a CPA firm. I'm entering my 5th year there. It is their policy that interns are near graduation, and staff have degrees. I was brought in at the end of my freshman year. In that time, I've become the resident expert on Unix related audits, designed and maintained several systems that deal with varying types of medical billing information for every hospital in my state, and I know most of the legal requirements of my state since I review compliance with them. I audited the state lottery three years running, and was lead on-site on the last year I did. I've got more stories and other companies behind that. COBIT, SOX, SAS 70, HIPAA... they're as much a part of my world as the shell is.

      I'm not trying to build a resume for you, and I think I've made enough point of the experience... five years defined there. When an entire department's technical students rally over replacing an admin, something is wrong. A month's pay doesn't have to dictate that the students even know I exist... but they ought to be able to rely on the lab machines to be operable, their files to be reliably stored, and their OS to carry the correct libraries for the assigned projects.

      My post isn't a novel, and it was never to convince you... or anybody else that I'm qualified. It was a short, informative, and successful response to its parent -- not all Universities do that (I think most don't), and here's my example. It's not ignorant, it just didn't have to be more than it was. To the effect of all that you said above, one of the greatest traits I think I have is that I know when I'm in over my head, and I'm acutely aware of when I'm pushing past where I've been.

      At the same time, so painfully, your post is that arrogant. You treat me as if I've stormed in saying, "This guy is doing it all wrong... what an idiot... I know SO much better." In fairness, my post does say he's not doing his job well, but it's not my voice... it's the collective carried complaints of an entire department of students who use those machines. I didn't charge in, and I never campaigned for it. I was asked if I would accept should they be able to convince the department, and I accepted. They were unable to do so, and my life goes on. Your own post, in three words that really matter: temper yourself some.

      --
      SIG: HUP
  9. Was that a short article or what? by gregarican · · Score: 1

    I actually broke down and RTFA. The interviewer must have been in the next stall over or on an elevator with the Oregon State employee. How many questions was that, like 4 or 5? Maybe one of the servers was getting ready to crash because one of the student admins was trying to install Windows...

    1. Re:Was that a short article or what? by Anonymous Coward · · Score: 0

      They would get fired if they got the disk within 100 feet of the datacentre.

  10. Good by OrangeMonkey11 · · Score: 2, Insightful

    Great that the university is giving these newbies a chance to get their feet wet before they venture into the real world. This type of opportunity is what i fine lacking while I was going to school and I had to search this type of opportunity out for myself.

    One of the biggest problem I find when you first enter into the IT field as a student is that there is a lack of on the job hands on training. Students really need to be expose to hands on materials more to reinforce what they've learned in text books and labs.

  11. 18-21 by Monkeedude1212 · · Score: 3, Interesting

    I am in the upper bounds of that range. I do Sysadmin stuff in our corporation, though not as much as the Chief IT Manager. I do the cabling, I set up the racks, I make sure the UPS are tested regularily. All the grunt work a Sysadmin would do. I help with decisions on new network policies, and dealing with security and updates. Network Topology is something I wish I had a say in, but don't. I will on occaison, be called in to reboot a server, or replace a bad drive.

    I had to learn the Help-Ticket system on the job, but really that was like a 5 minute breeze because most of it is common sense. (Ticket comes in, prioritize, assign, do)

    I'm glad to see that younger people are getting into these positions, since I think they help push forward newer technologies and methodologies. It'll sound like I'm tooting my own horn here (and Maybe I am just a little :P) but we've got a dozen boxes in our server room plugged into the rack so that people from other branches across Canada can Remote in to access certain software. It's a nightmare to look at, and it takes up alot of space. The IT Manager isn't fully familiar with Virtualization, though thats something I was taught in school less than 2 years ago. I'm sure you can see where this is going.

    All in all, the only thing holding back us young people from these positions is just experience. Almost any school you graduate from with a CS degree will teach you the fundamentals of system administration. However you can't exactly apply for that position with little to no experience (don't get me wrong, you CAN apply, but the guy who has 5+ years experience managing Windows Server 2003 is going to look a bit shinier).

    It's good to have a Looong project like this to show you DO have experience. I went and switched from a CS Degree to simply an Object Oriented Programming because it was shorter and I enjoyed programming more, but now that I'm out here working I wish I had that education. (I know right, how did I land a Sysadmin/Technician job as an OOP grad? Funny story, ask me later). Anyways, If I could show my boss "Here's the webserver that I set up and maintained" I think he'd be more lenient with letting me handle things I know how to handle. It's frustrating when he mentions a problem and you know a solution but he won't admit its a good idea because you're fresh. That's more a problem with my boss though, and probably isn't a good representation of every manager out there.

    1. Re:18-21 by Bandman · · Score: 1

      Sorry, why is parent modded as Troll? There's nothing trollish at all in there.

    2. Re:18-21 by Anonymous Coward · · Score: 0

      Almost any school you graduate from with a CS degree will teach you the fundamentals of system administration.

      Because of that. Any *good* school you graduate from with a CS degree will not have you take system admin classes.

  12. single point of failure? by SuperBanana · · Score: 1

    The Oregon State University Open Source Lab's data center hosts some of the Linux community's heaviest hitting projects including the Linux Master Kernel and the Linux Foundation. It is also the primary location for the Apache Software Foundation and Drupal, open source content management software. The lab, aka OSUOSL, also hosted the core infrastructure for Mozilla's Firefox project, and currently host's six of Google's servers.

    Uh- why is one organization the primary/master site for so many high-profile, critical open source projects?

    This is bad for a number of political, economic, security, and technical reasons. All it takes is one pissed off Dean or university president and you can be shut down overnight. It's happened to some famous researchers; one morning they came in and found all their equipment locked up in storage, their papers confiscated, and students/researchers/staff axed.

    1. Re:single point of failure? by phoenix0783 · · Score: 3, Informative

      They're a mirror.

    2. Re:single point of failure? by blofeld42 · · Score: 1

      Hosting Open Source is also a core competency to Oregon State. They made a rather clever decision to focus on the open source niche a few years back, and it's helped them bring in industry support and helped the student learning process, as shown by the article.

    3. Re:single point of failure? by riverat1 · · Score: 1

      I don't know if there's any relation but Linus Torvalds lives in the Portland area, about 60 miles north of the OSU campus.

    4. Re:single point of failure? by MostAwesomeDude · · Score: 3, Interesting

      We're a rather bright spot on the university's record; we are the largest open-source datacenter in the hemisphere, and that causes a lot of donations to come in. Take it from Ed: http://osuosl.org/sites/osuosl.org/files/ed_ray.png Nobody will shut us down.

      --
      ~ C.
    5. Re:single point of failure? by gchaix · · Score: 4, Interesting

      I work for the OSU OSL.

      Actually, we're more than a mirror. While mirroring is a major part of the services we provide, we also provide hosting for many projects' core infrastructure - Apache, Linux Foundation, Drupal, kernel.org, etc. Google is a major supporter of the OSL because we provide a place for projects whose needs have outgrown the more "off-the-shelf" structured hosting provided by Google Code or Sourceforge and need a more customizable environment.

      As to the single point of failure concern - I disagree for several reasons:

      • We are not funded by the university. The OSL's activities are funded almost entirely by donations (both personal and corporate) and agreements with the projects we host. While we are all university employees, our wages are not paid using university dollars. Also, as part of the administrative computing organization at the university (as opposed to part of an academic department), the OSL falls under the university's CIO instead of a dean or department. The financial independence and organizational structure provides us with a significant amount of autonomy and insulation from the vagaries of university politics.
      • OSU President Ed Ray has stated time and time again that the role of a land grant university in the 21st century is to provide leadership and assistance in information technology - much the same way the land grants provided support to agriculture and industry in past centuries. The OSL helps OSU fulfill that goal.
      • On the FOSS community side, the OSL provides a vendor-neutral environment. We're not tied to any one distribution or manufacturer - we work with Dell, HP, and IBM all equally. The same goes for SuSE, Ubuntu, Gentoo, Red Hat, etc. IIRC, our neutrality one of the reasons master.kernel.org and the Linux Foundation reside at the OSL. We (and the university) consider that neutrality a very valuable asset.

      It would take something more than a "pissed off dean" to summarily shut the OSL down.

      -Greg

    6. Re:single point of failure? by size1one · · Score: 2, Informative

      Linus isn't affiliated with the lab. He works for the Linux Foundation, formally the Open Source Development Lab. The Open Source Lab also host's the rest of Linux Foundation's infrastructure in addition to master.kernel.org

    7. Re:single point of failure? by riverat1 · · Score: 1

      Just a happy coincidence I guess :)

    8. Re:single point of failure? by argorg · · Score: 1

      You and your parent have an unwholesome idolation on "Ray." I had to follow your links and the (wholly fuck he's ugly!) PNG picture of him to find out who OSU (Oregon State University) and OSL (Open Source Lab) really are (ie., I did't read the article and didn't know Ohio/Oregion/Ontario/Oman/Ohwhogivesafuck could also be confused with Open in acronyms). You really must try to spell out somethings and, maybe, if repeatedly citing his Rayness, try to prove your robust viability without dependance on the Immanent Rayness of Ray, not actually saying, "we're viable; our Godhead Ray -- may he so ever preside -- has immutably said so."

  13. I don't get it by Anonymous Coward · · Score: 0

    When I was 18 I started at a Managed Hosting company that just recently went public as a Linux Sysadmin. I've had my hands on the insides of some very big web companies, and I've gone through the ups and downs. Such as the recent Dallas Outages or the infamous driver who knocked out our power a few years back. Along with being thrust into a Sysadmin position barely after getting out of high school (and college as I graduated at 17 before I did high school), I've also had to deal with corporate heads trying to make their imprints. These kids had it ***king easy, I've had to let guys cry on the phone because they didn't have any backups and their whole business was relying on that one thing on their server. I've learned infinitely more in this environment (no I'm not at work right now) than I would have if I had gone into my university lab as an admin.

  14. But age is only a number... by MrCrassic · · Score: 1

    I thought that being a good sysadmin, or a good tennis player, or a good anything depended on the experience and natural talent the person has, not his or her age. There are kids out there that can probably develop much, much better than many with years and years of experience in the field; hell, most of the hackers back in the day were kids themselves!

    I think that actually letting these folks do something of importance with their skills is more laudable, since most companies that hire undergrads or high school students can only afford to give them low-risk projects that may or may not contribute to their development of in-field experience.

  15. Open Source Lab? Big Deal! by Zorlon · · Score: 1

    It's not like it's the Accounting department or HR. I have my own open source lab in my home.

    --
    - Things are the way they are because they're coded that way -
    1. Re:Open Source Lab? Big Deal! by Anonymous Coward · · Score: 0

      Yeah, but your parents' basement doesn't count, since you can't sysadmin over your bowl of Froot Loops...

  16. Re:Serious question. by Kjella · · Score: 1

    The lack of a marketing and sales division, or indeed the need to have a "marketable" name at all. Plus a geeky need to overexplain with acronyms, backronyms, puns on other software (more | less anyone?) or other obscure references. And, but to a much lesser degree, no desire to fight other projects and particularly companies with lawyers over trademark disputes. Usually if it's a cool name it's already used, like for example Phoenix which became Firebird which eventually ended up as Firefox. If you don't care, call it Ekiga and noone will fight you over it ;)

    --
    Live today, because you never know what tomorrow brings
  17. I think I've been on the internet too long... by tool462 · · Score: 1

    18-21 year old undergrads

    Pics?

    1. Re:I think I've been on the internet too long... by Titoxd · · Score: 3, Funny

      They are server administrators, which means they probably look like the average slashdotter. Do you really want to see that?

    2. Re:I think I've been on the internet too long... by grigarr · · Score: 1

      If you really do want to see that... some digging will find you pics: http://osuosl.org/about/people :)

    3. Re:I think I've been on the internet too long... by zoloto · · Score: 1

      so you're saying the answer is no, right?

  18. Could These Sys Admins Be by Anonymous Coward · · Score: 0

    outsourced with several shell scripts?

    Yours In Ashgabat,
    Kilgore Trout

    1. Re:Could These Sys Admins Be by gmuslera · · Score: 1

      Thats for what are cfengine and Puppet. Most of what a sysadmin do that can be described as "several shell scripts" can be done by them. But you need sysadmins to do the initial configuration, the changes (unless you have a fixed system, everything evolves with time) and of course, the unexpected.

    2. Re:Could These Sys Admins Be by Jean-Luc+Picard · · Score: 1

      Not unless you have a shell script to make coffee

  19. Re:Serious question. by Anonymous Coward · · Score: 0

    But it's not that simple. If that were the case, we would have a bunch of more-or-less neutral names; these names are gayer than Richard Simmons.

  20. Sysadmins have good growth opportunity by omgwtfroflbbqwasd · · Score: 5, Insightful

    While entry-level programmers may make a slightly higher salary than a similar systems administrator, over time there's a lot more upward opportunity for the sysadmin. Systems Engineering and Systems Architecture - being the guy that ties the network, the server, and the apps together, is a very in-demand skill and is something programmers will never have the opportunity to become. Programmers only make the big bucks when they have other specialized knowledge that's specific to the apps they are developing, i.e. finance, GIS, physics, etc..

    I'm personally glad I made the decision 12 years ago to move into systems after earning my Comp. Sci. degree. I went from web app development for an ISP to Linux/Solaris/HPUX sysadmin, to Systems Architecure, to Info Security.

  21. Re:Serious question. by cyphercell · · Score: 1

    Even gayer than that would be "Dick Semens", hey I've got a new name for an OSS program!

    --
    Under the influence of Post-Cyberpunk Gonzo Journalism
  22. Heh, they aren't admins by BitZtream · · Score: 2, Insightful

    Sorry, there is no such thing as an 18-21 year old sys admin.

    There are plenty of kids pretending to be admins that are 18-21 years old, but just because someone gives you root, doesn't make you an admin anymore than installing mysql and creating a table makes you a DBA.

    Having root on a Linux box doesn't make you an admin, regardless of how ignorant you are of that fact.

    --
    Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
    1. Re:Heh, they aren't admins by gchaix · · Score: 5, Insightful

      I beg to differ. I've been a sysadmin for 15 years. The professionalism and quality of the work done by the students here at the OSL is quite often indistinguishable from many of the people I've worked with over the years. Many of the people working on our hosted projects can't tell whether they're working with our professional staff or student workers.

      We teach them to be sysadmins. They may not be sysadmins when they come to us, but they sure as hell are professional sysadmins when they leave.

  23. No Free lunch by Anonymous Coward · · Score: 0

    Free labor aint free

  24. How do you find a young sys admin?? by enryonaku · · Score: 1

    Are there people out of college who want to be sys admins? We are tying to hire a sys admin, but we either get people who are overqualified -- they would not want to do the job for a long time -- or we get people who are under-qualified -- front desk support types you cannot design and manage a whole network.

    On top of that, new grads don't usually have a lot of real world knowledge for sys admin work, though we would definitely relax this requirement for someone who is a problem solver and eager to do the job. (We haven't found this person yet, though)

    1. Re:How do you find a young sys admin?? by Luke+has+no+name · · Score: 1

      You probably aren't paying enough. $60,000 + medical and I'll move anywhere in the country for what you want.

      lukehasnoname AT gmail DOT com

    2. Re:How do you find a young sys admin?? by IMightB · · Score: 2, Insightful

      99.99 of sysadmin'ing comes from experience, which young ones do not have, or are in the process of learning (90% of the time due to necessity, being the low person on the totem). the experienced ones know enough to know that experience isn't cheap.

    3. Re:How do you find a young sys admin?? by gchaix · · Score: 3, Interesting

      99.99 of sysadmin'ing comes from experience

      Right ... which is why we here at the OSL give them the opportunity to gain that experience in a real-world production environment while providing the mentorship they need. It dovetails nicely with the theoretical knowledge they're getting in their CS classroom work.

    4. Re:How do you find a young sys admin?? by Anonymous Coward · · Score: 0

      I can give you 50K + medical if you are sharp. In Oregon. 70Win/15Mac/15Linux, Interested?

  25. Re:Serious question. by thatskinnyguy · · Score: 2, Funny

    I heard from one of the higher-ups that Gnome projects' names are more like an inside joke. "How can we make some of the best software out there and give them the most aweful names?"

    --
    The game.
  26. Mod parent up! by sgtrock · · Score: 1

    Man, I wish I hadn't already burned all my mod points today. Been there, done that, got the scars and war stories along with my BOFH T-shirt. :)

    1. Re:Mod parent up! by Anonymous Coward · · Score: 0

      Agreed and done. Glad I save a point or two until the end, generally.
      --
      Nilt

  27. Personal experience in all-student department by ZPWeeks · · Score: 2, Informative

    I'm in my fourth year working and studying at the Colorado State University College of Business. Student-facing systems are pretty much 100% run by students, who report to student managers, who report to the IT Director and a student committee representing students who pay the tech fees. It's worked remarkably well, and I've been in several roles throughout my tenure- Lab Technician, network engineer, sysadmin, security team lead, web developer.

    In terms of the department's effectiveness, I would say that students receive a great value and enthusiastic service from their colleagues. The risk of system failure is pretty low since we have decent turnover and a hierarchy of newbie and more experienced staff. (It also helps having a good balance of student employees in the technical disciplines and the business administration major.) Everybody starts out with very little experience, and gets direct access to systems they wouldn't otherwise be trusted with. We put heavy emphasis on documentation and formal training requirements, but a lot of stuff is "throwing us in the lake and learning how to swim." I was 18 when I got the security team lead position, and later that week a horrible false positive in $vendor's antivirus definitions rendered every workstation in the college useless. The real-world experience of emergency response and dealing with managing a team and staying accountable to others taught me so much.

    I value this kind of opportunity as something much more valuable than an internship, some entry-level jobs, or even my degree program. The job's flexibility with my school schedule and direct pertinence to my studies added several dollars worth of value to the decent student hourly rate.

  28. It's not trolling if it's true ;-) by Zero__Kelvin · · Score: 4, Insightful

    "The ignorance of your post is one good indication of why they didn't replace him with you."

    Well, I haven't seen someone display such blatant ignorance while calling someone with a clue ignorant for quite some time, so I guess I'll set the record straight ...

    "An admins job isn't just 'make things easy on users'. There is a lot more that goes into it, which generally results in ignorant users getting mad at a good admin and wanting someone else."

    That is an absurd thing to say, and the irony is that you claim to be a great sysadmin, but can't figure out that a good sysadmin doesn't have ignorant users (at least not for long.)

    "Making users happy is rarely part of the job description anywhere. Making it so users can get what they need accomplished is."

    And how do you plan to accomplish that while leaving them ignorant? You'd be surprised how much happier users are when you actually know how to do your job and educate the users so that they understand why something has to be done the way it does.

    "Its fine for you to dick around with your own machine and have it offline, but the majority of a sysadmins work should be done without the users EVER HAVING ANY IDEA that its happening."

    Are you fscking serious? Why the hell do you think they came up with /etc/motd ? (Message Of The Day for those who don't know and are following along.) If you are doing your job right then users know when backups happen. They know what new software you are installing, and when; you have visibility.

    "Its cute though, that you think that while you're still in school, you're more capable to know what to do than all the other people, which have been running a school for years."

    Maybe he has people similar to you setting the bar ;-)

    Non-disclaimer: I was a VAX/VMS system manager at the age of 22, having been professionally trained by DEC at their Burlington Training facility, and I have been involved in various aspects of technology from sysadmin, hardware and software development, SQA my entire adult life (I'm now "over the hill"). I have had to deal with idiots like the parent my whole life, and his/her/it's attitude is outdone only by phenomenal cluelessness.

    --
    Guns don't kill people; Physics kills people! - John Lithgow as Dick Solomon on Third Rock From The Sun
  29. Yes it is. by Toze · · Score: 3, Informative

    An admins job isn't just 'make things easy on users'.

    Yes it is. It is an admin's job to make things as easy as possible on the users over as long a period as possible. That is why backups are made; so the users don't have to redo all their work if there's a failure. That's why there's firewalls; so the users' machines don't get infected and their network isn't crippled. Without an admin, small organizations can chug along until something breaks (and they have to contract an admin to patch it), but life isn't easy. A full-time sysadmin for a company or a department has only one purpose; to make things easy on the users.

    --
    No OS on the planet can protect itself from a user with the admin password. - Yvan256
  30. So that explains by /dev/trash · · Score: 1

    Why the Drupal site is so dog ass slow at times.

  31. Yawn by Anonymous Coward · · Score: 0

    OSU's CS department has been using undergrad sysadmins for years, including research type projects.

  32. OSU corruption by NSN+A392-99-964-5927 · · Score: 0

    Deidre Waters is partly responsible for this and irc.freenode which servers run from OSU and stupid GENTOO devs who steal BSD code and port it to gentoo, if you do not like my comment then sue me. Open source offer! GPL and BSD licensed. Bytes just nibble a bit.... meow :)

    --
    All cows eat grass!
  33. We would outsource to India but... by NateTech · · Score: 1

    ... these undergrads work cheap! And we only have to zap them once with the tazer to get them to stop doing "rm -rf /".

    What's the point of this article? That young sysadmins can now be exploited by their school instead of their first employer?

    Oh, and what exactly are they training them so well for anyway? Their first job, they'll learn that there's never time nor budget allowed for doing things like setting up Puppet. They want to do that, they can cram it in during lunch and after-hours, and hope they don't get fired if they get it wrong, and zero praise (or even comprehension) if they get it right.

    The school's doing them a disservice. Throw them a pile of broken five year old servers, a "datacenter" diagram that looks mysteriously like their dorm closet, and a $10 Starbucks card with a little card that says, "Thank you so much for contributing to my mansion... ahem, er... our company mission this year... without a raise... ahem, without pay since you're an intern... and Happy Holidays from the CEO!" That'll do more to prepare them for the work world than managing big projects like... ooh, mirrors. (Bestill my beating heart. Mirrors! How high tech!)

    LOL!

    --
    +++OK ATH
  34. Lesson 2 by CAIMLAS · · Score: 1

    Lesson 2 is that it doesn't matter what your actions are, if someone doesn't like you and they've got power over your position, you're fucked.

    --
    ~/ssh slashdot.org ssh: connect to host slashdot.org port 22: too many beers
    1. Re:Lesson 2 by tverbeek · · Score: 1

      Well, yeah. I learned that one about 20 years later. Hopefully most college-age sysadmins-in-training have a while before this principle kicks them in the balls.

      --
      http://alternatives.rzero.com/