Slashdot Mirror
Measuring LAMP Competency?
An anonymous reader writes "Our company is getting ready to hire a number of programmers. While the majority of the prospective candidates do have good-looking resumes, we are looking to see if we can get some clear metrics in the assessment process. After a little research we have learned that there is a well-established PHP + MySQL training and certification process, and some of the candidates are already certified. There is also a candidate with a good portfolio, a lot of experience, and no certification. Most of the applicants also have some college/university science-related education. So our goal is to be able to somehow measure LAMP overall competency as well as basic computer science concepts such as BNF, data normalization, OOP, MVC, etc. How do Slashdot readers go about this kind of characterization?"
Get them to write a trivial app.
If it contains 'INSERT INTO table ('. $foo. ');'
Kill them.
Why BNF?
As someone who has run a dedicated server for seven years, I would never grant any unknown third party access to my server. Even as a guest with almost no permissions. That's just inviting trouble into your house. Give them code samples, answer questions, provide references, but keep the digital doors locked unless you don't value the data on the machine.
Unfortunately IT certification has nowhere near the requirements and rigor that doctor and engineer certification requires.
If IT certification were more than "pay $amount -> get cert" then I'd be all for giving them credence. But they aren't. Currently they just highlight the programmer or IT professional who wants to hide their incompetence with paper.
A good work ethic and honesty ...
is not hiring two persons to drop them few months later.
I've hired a couple programmers in the past and there is always one question I ask that I have found sorts out some of the better candidates. The question - "I've just requested you to do some task and you find you really haven't worked out that type of task in the past and aren't fully sure the best approach. What do you do?" The answer I'm looking for is basically they'll let me know that's a new area for them, but that they'll go out and find examples of that type of task and research it and find out how to make it happen. If they say anything along the lines of having me help them, or ask to go to a class, or anything along that line it will automatically set up red flags. And of course, just answering the question "correctly" doesn't automatically mean they are good at doing that, but you can dig deeper into how they'd research it, etc. I've been a programmer for over 25 years now and while there are certain core things that a computer can do and some it can't, the actual processing of it is what matters and it's nearly impossible for you to remember every little detail of every language and system, the real power is in knowing where to look to quickly get your answer. And as a final important talent, a person needs to be good at understanding and conversing specifications from someone that is not technical. Just my thoughts on what I've looked for....
as well as basic computer science concepts such as BNF, data normalization, OOP, MVC, etc.
Put 10 seasoned programmers in a room and, without access to references or preparation, ask them to write the BNF for some subset of a well-known language, normalise a database in stages up to 5th normal form, give a detailed description of OOP implementation in any language (not just "how is inheritance formed?" but "demonstrate polymorphic behaviour - suggest how it might have been implemented - describe its disadvantages" etc.) and ask them to fit some app description into MVC pattern.
You know what? Zero of them will succeed in all of your tasks. And, dear reader, if you claim that you will then you are lying.
You know why? Because testing like this doesn't reveal anything. I passed University with top grades throughout because I knew how to bone up for an exam and cough up the syllabus as requested, as well as having a moderately mathematical head. I can demonstrate prior performance and I can grasp new concepts. I can remind myself quickly of old concepts when given access to a reference.
But I don't have some magical savant-level ability to memorise everything I've ever done (and, experiments on savants suggest, if I did then I'd lack the skills to apply my elephantine knowledge to solving general commercial development problems). It's never hindered me. This sort of ability might be necessary if I were, say, a field intelligence agent(?), and not being able to concoct the right deception within a subsecond time interval might result in my death. Otherwise, it's just a dog and pony show.
"The COO has come to you, because no one else is available. The CEO is flipping out. There's a server on the network running some common variety of Linux. Transfer rates from it to any other machine are very slow, regardless of the protocol. i.e., http, ftp, rsync, samba are all slow. What do you do?"
OH GOD OH GOD... what wall jack is that server plugged into...what? Not labelled? CRAP! OK, I'll just PING it and look it up in the switch arp table and cross reference the MAC and the switch port... OH NO...THE RDP client on my Blackberry just crashed and I'm in the middle of the highway during rush hour... CRAP. OK, OK...calm down...make up something... OK, um tell the CEO that the server is under service lockdown and frozen due to the upcoming board meeting and potential buyout... yeah...that'll give me a couple of days leeway... whew!
Then, since I'm in the network group, I can just blame it on the server group since they never patch their servers anyway... that E1000 driver never did work properly on Linux, yeah yeah that's what I'll do...
Karma: Excellent. 15 moderator points expire sometime.
I was with you until the yelling part, an interview is a two way street. If I'm getting yelled at in an interview I can only imagine how bad it will be in the workplace.
On second thought, if that's actually how your office functions, then I guess it is honest and appropriate. I just wouldn't want to work there.
Agreed. Meeting a table thumping, yelling person in the interview would just cause me to stand up and say "I'm sorry, I'm looking for a position at a professional organisation". If this sort of situation is routine enough to require somebody to do well in it during an interview then I'd say there are some problems there.
In real situations this doesn't happen. At least in the places I've worked. There was an incident of massive negligence by the support team involving one of our biggest customers databases last year. Instead of someone in management hitting the table and yelling, everyone in the development team already knew it needed to be fixed and so we fixed it. A good team doesn't need yelling at.
It seems to me that the type of managers who yell and ask why are usually the ones in the positions who don't need to know. A good manager will be right there with the team putting forward ideas, not simply asking questions. If they're not going to be putting in ideas then they should get away from the problem and let people get on with it.
Go home and shave your giant head of smell with your bad self
Actually, I never had anyone walk out. Since it was presented as roleplay of a real world situation, and I'd explain the details of the situation calmly and clearly, it was evident that it was an extreme example.
What a competent interviewer would do is set up a VM with the problem they want diagnosed. That way, there wouldn't be any need to set up a fake "situation" where the "real fault" can be any number of things, including ones that don't match what you have established in your head.
Of course, if you can't handle an environment with occasional actual preparation for your job (e.g., interviewing), I wouldn't want you to work with me.
That's the last thing I'd ever want is a stressful situation to come up, and an employee walking out because it was "too hard".
Being "yelled at" by a superior is not a "stressful situation". It's unprofessional behavior. Being told politely and calmly that there is a problem that needs to be fixed quickly because the company is losing $X million per hour is a "stressful situation".
Egads - it's the whole "Root Cause Analysis" crap. A mile-long report filled with BS that means nothing to anyone else and and action plan of "how to prevent this from happening again" blah blah blah. I always felt those things should be triaged first to determine if the RCA was even under our control. But whatever.
I worked for a hospital in LA that rakes in far too much money than they should and they do those a lot. Usually they would pay the most expensive consultant to write one of those things up for it to only be ignored. They would have already vilified someone (responsible or not) and then just go through the motions.
As far as the interview - deal with it. If you can't stand a little heat stay out of the kitchen. I would probably just laugh at the guy slapping the table and then play along. I would say "Good. We have some spirit here. You there - table slapper. First thing I'll say is use some of that fire and gumption to get the reatrds with their neckties on too tight to get the f**k out of my way while I fix the problem - and be advised, every time you slap the table adds another 1 minute to my problem solving because you're being annoying, and another 10 dollar Starbucks card to feed my liquid crack habit."
And as someone who had to deal with a LAMP server I built on spare parts a few years ago I encountered just such a thing - ARP flux. I still don't understand a lot about it but was able to get it working. And don't knock Google. I don't pretend to have all the answers - never do. I am a jack of all trades, master of none. If all I am is all you got, you'd do well to either have coverage I can count on or a MiFi for me to have unfettered access to resources I've built over the year. Be smart. Leverage your people and their assets they know they can reach.
As to nobody being available and it filters all the way down to me to fix a critical server? Looks like that's the FIRST thing that goes into your RCA before you even THINK of rattling my cage, Mr. Manager. "Business Continuity Planning" - learn it and love it :-)
That said, I am now and always have been happy to roll up my sleeves and try something to help regardless of the circumstances. CIO, CEO, Line Manager or Mary in accounting who blushes at the comment of "I think your mouse has a dirty ball" :-)
One of my favorite things to ask is like what I read a while back on the site "Joelonsoftware". "Build me a house" and hand them a pen. If they just jump up and start writing a square - they lose. Ask questions. Probe a bit. "Who wants the house? Where? Underwater? In space? what's my requirements? I figure if you're asking ME to design a house we're pretty much open to anything."
Does the person have good troubleshooting skills? Are they well rounded? Common sense is not so common much anymore. What kind of things do they like to do as "stretch" things on their own time? I write hospital EDI interfaces for integration engines for a living and I very much enjoy it. It also means what I do touches many, many aspects of programming and system design to get things to work together. Part programmer, part analyst, part teacher, part hardware engineer, part tech support, part application setup, part network guy to help figure out VPN stuff. Being able to get iptrace running on AIX so I can grab a file for bringing in to Wireshark can be helpful too when the ass-hat on the vendor side says I'm sending him 2 of everything and I'm saying he's on crack.
So you wanna slap the table? I'll roll with it and we can laugh about it. I don't take any of that seriously. Be advised I might also stick my finger in your coffee and then taste it and say "Hmm.. A cream and sugar kind of fellow, eh? You should warm that up a bit." right in the middle of your mini flake-out. Someone did that to me years ago and I made the choice right then and there to laugh at that kind of thing. It was either that or I could have just kicked his ass. Of course he was much bigger than me so I was pretty sure I would have had to pack a lunch; since kicking his ass would have most likely been an all-day job. Lucky for both of us I was lazy.
Never have a philosophy which supports a lack of courage