Slashdot Mirror


Politics-Oriented Software Development

thelesserbean writes "Up at K5 there's a tongue-in-cheek look at the dirty world of software development's inside politics. Presented as a guide, it is actually full of useful advice and lessons learned the hard way. For instance, in the 'Ass-Covering' section, we read: 'The chief difficulty is reaching a satisfactory compromise between ass-covering and not appearing too negative. (...) The emails you sent will be used in evidence against you. Keep a professional tone: before sending any sensitive email take a moment to think how it would look at an industrial tribunal.'"

37 of 126 comments (clear)

  1. HAHAHAHAH by PedanticSpellingTrol · · Score: 3, Funny

    One of the very first posts for this story at kuro5in was "Oh man, I bet slashdot is going to pick this up".

  2. bad philosophy... by physicsphairy · · Score: 4, Funny
    before sending any sensitive email take a moment to think how it would look at an industrial tribunal.

    Now, if you're a sadist like me, that is probably *not* a good question to ask yourself. Or, at least, I can think of all sorts of stuff to write in my emails that would be friggin' hilarious to hear publicly recited by a no-smiles lawyer at an important tribunal.

  3. Education by feamsr00 · · Score: 5, Insightful

    You know, universities should pay more attention to real world scenarios like this. Maybe then there would be less effort on screwing with politics, and more on doing a good job. Oh well, just add this to the list of things fresh programers get slaped with right out of college.

    1. Re:Education by superpulpsicle · · Score: 2, Funny

      Yah as if management ever read the code. As long as the young guns act slave-ish for the first decade out of school, management will love them.

      I learned the hard way that telling management to get their own fucking coffee made me public enemy #1. Good developer vs bad developer only lie in between how well you handle firedrills and fetch coffee.

    2. Re:Education by bob65 · · Score: 2, Insightful

      Since when did universities become life training institutions? Universities exist for very specialized and niche reasons - if you want to take courses on software development politics, go start your own "life training school".

    3. Re:Education by khallow · · Score: 2, Insightful

      Actually, I get the impression that some universities teach their students just fine. Look at how hard it is to prove cheating in many universities. That's life experience training if I ever heard of it.

  4. Sounds good, but far from air-tight advice... by WaterBreath · · Score: 5, Insightful

    From the article:

    Also remember that someone who points out a problem early is a troublemaker; someone who fixes a problem at the last minute is a hero.

    That's a dangerous line to tread, because there's a third option: someone who identifies a problem at the last minute and can't fix it in time is shortsighted and incompetent.

    1. Re:Sounds good, but far from air-tight advice... by BlurredWeasel · · Score: 2, Funny

      Obviously, the solution: be smart and identify problems early, and solve them early, but publicly identify and show the problem at the last minute, go back to your cube, read slashdot for 3 hours, and then check in the new code and claim your raise/vacation time/complimentary release t-shirt.

    2. Re:Sounds good, but far from air-tight advice... by SharpFang · · Score: 3, Funny

      Fix: Report the problem early, but don't shout about it. Whisper it. Make the information get lost in the early phase. Phrase it as "There is a risk of... but this problem should be taken care of in a later phase of the project", or "We have to take * into consideration as well". Then it's "I said it would fail! Why didn't you listen?" Then even if you can't fix it on time, the manager who neglected the memo and assigned you other, less important work is to take the blame.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    3. Re:Sounds good, but far from air-tight advice... by fishbot · · Score: 2, Interesting

      That's a dangerous line to tread, because there's a third option: someone who identifies a problem at the last minute and can't fix it in time is shortsighted and incompetent.

      Sadly, that's why if a problem is found at the last minute and cannot be immediately fixed by the finder, it is never mentioned and the product ships, bugs and all.

      In my varied career as various types of software developer (web, database, UI, engineering, etc) I have found that the single most destructive force in software development is fear of retribution by clueless idi^H^H^Hmanagers.

      When an engineer cannot create without being labelled a disruptive force, cannot mention known problems without being labelled a trouble maker, and cannot ensure quality without being labelled incompetent, it is a sure sign the the prime reason for software failure is incompetent management who do not understand the, how shall I put it, unique mindset of the average engineer.

  5. Government by digitalchinky · · Score: 2, Interesting

    The good thing about arse covering is that it works both ways - management send you a metric crap load of hate mail, store it, print it, keep it.

    Management meeting, threatened to sack you for simply existing, sideburns too long, whatever.

    I've think I've been on both sides of the fence long enough to know government is about running favors for each other.

  6. CYA can be a dragged... by __aaclcg7560 · · Score: 5, Interesting

    Covering Your Arse (CYA) was a big thing at the last company I worked for. Being a lead tester, I had to document everything that could be used against the developer to put the blame on them if the project screws up. The developer was also doing the same thing to me. That made crunch time in the last two weeks of the project particularly difficult since we're being nice and stabbing each other in the back at the same time.

    The department manager has the option of casting the blame on the lead tester and firing him if QA loses the blame game. I didn't like that option and documented everything that the manager did (but usuually didn't) do to protect my job. One manager got himself promoted out of the department because he thought I was going to get him fired on numerous occasions. (Not surprisingly since he was trying to screw up my projects to get me fired.) The next manager wrote me up for insubordination when he found out that I was documenting his actions when he explicitly told me not too. I quit my job soon after that. After six years of that crap, there has to be something better out there.

    1. Re:CYA can be a dragged... by NemesisStar · · Score: 4, Funny

      "The next manager wrote me up for insubordination when he found out that I was documenting his actions when he explicitly told me not too."

      If a manager asked that of me, I'd ask for it in writing.

    2. Re:CYA can be a dragged... by eric76 · · Score: 2, Funny

      I knew one programmer who had a boss who was continually giving conflicting orders and trying to add useless projects to his workload.

      So he went out and bought a tape recorder and took it to the office.

      Whenever his boss came in to his office, he'd turn the tape recorder on and hold the microphone up for his boss to speak into.

      His boss would get pissed off and turn around and leave.

    3. Re:CYA can be a dragged... by __aaclcg7560 · · Score: 2, Informative

      Maybe the prior poster actually did that.

      That manager wouldn't put anything in writing. I wanted him to put in writing that I was required to work 80+ hours, seven days a week until my project was done. That, of course, would be in violation of the company's 60 hour/six day policy.

      About one-third of the department was trying nail the manager on anything, and (last I heard) about half of them choose to leave instead. Upper management isn't doing anything since the coporate office loves the manager's bottom line results. It takes a while for results of experienced people walking out the door to show up on the bottom line.

    4. Re:CYA can be a dragged... by NateTech · · Score: 2, Interesting

      This all comes back to the fact that most management can't seem to learn -- you shouldn't have a job.

      Sorry, but Quality Assurance is an attitude, not a department.

      Making it into a Department is a sign that people actally WANT someone to blame everything on, instead of taking the correct amount of time and resources to design and build correctly in the first place.

      --
      +++OK ATH
  7. Quite good article but forgot the main reason. by luvirini · · Score: 5, Insightful
    Having read the article have to say that most of what is said is correct and unfortunately true.

    The only part that I really disagree with is the first point 1. Most software fails because it is designed to fail

    By the quite long experience the real reason why projects fail is much simpler: STUPIDITY

    Be that stupidity of those who defined the project, stupidity by those implementing, stupidity by the management, stupidity by the client, stupidity by subcontractors, stupidity by equipment providers, stupidity by...

    I am sure you get the point.

  8. Qualified people by Anonymous Coward · · Score: 2, Insightful

    This type of stuff is why the government normally has so few qualified people.

    The brainiac folks know how insidious politics like this are, and simply wont put up with working at a place that doesnt judge you on your skills.

    Its just a theory, but it explains an awful lot :)

  9. Re:I'm surprised corporations don't censor email m by plover · · Score: 4, Interesting
    Lots of companies have had the problem mentioned in the article. While it's not exactly "censoring", ours has set up Exchange server to DELETE email older than 30 days, and called it a policy.

    Nobody can pull out the old emails and pull a trick like this if they've been deleted. And if you save them, you're violating policy, so you're screwed either way.

    Talk about a clusterfsck. My problem is I get documentation in emails, and that doc gets wiped after 30 days if I forget to save it somewhere.

    --
    John
  10. Read 'em and wipe. by Anonymous Coward · · Score: 2, Funny

    "Politics-Oriented Software Development"

    I work in the toilet-paper industry doing software development. I know all about ass-covering.

  11. nothing new by Yonkeltron · · Score: 5, Insightful

    i might get modded down for this but the thing i find most interesting is that so many of the points being attributed to software-development in the article seem to be applicable in any project in any environment.

    i help out in a school district and every single meeting i go to has me thinking about the same types of things. who is in it for education's sake and who just wants a feather in their cap?

    maybe it's more of a human element that just happens to be looked at here in the context of programming.

    --
    Keep the faith, share the code
  12. Re:I'm surprised corporations don't censor email m by Bill+Dog · · Score: 4, Informative
    Nobody can pull out the old emails and pull a trick like this if they've been deleted. And if you save them, you're violating policy, so you're screwed either way.

    Run away, if you can, from places like that. TFA says to keep a daily record of what you've done. I've worked at a place where that was violating policy, and was a firable offense. Needless to say, I ran away, when I could. (They also prohibited managers from saying anything good about people on their reviews (I'm not joking or exaggerating) -- basically, they wanted to be able to fire you in a trouble-free manner, and they wanted you to help!)

    --
    Attention zealots and haters: 00100 00100
  13. Misleading title by Stormwatch · · Score: 3, Funny

    Politics-Oriented Software? Oh... I thought it was about the developement of something like Campaign 84 for the Colecovision...

  14. What a good article by turgid · · Score: 2, Interesting
    That is a really good, well-written and insightful article. I wish I'd seen it 10 years ago.

    You young ones would do well to read it carefully and think about it. It will help you not only to survive but also to move up the food chain.

    Remember, if you do things "right" in your current job, even if you get fired for it (i.e. keeping a record of your work, achievements, problems, conflicts, etc.) it will help you when you go to get your next job.

    You can be choosy about who your next employer is.

    A good idea is to be a member of a professional organisation, such as the Britsh Computer Society, where you can achieve recognition for your efforts as you go along. It's more evidence to take with you when you go looking for a new job when the inevitable happens.

  15. Wrong Attitude by cowtamer · · Score: 3, Informative
    This article is quite exemplary of why software developers (i.e., "The Slashdot Crowd") have very low credibility with management.

    It is not because they dislike management (although I am sure that has some role). Nor is it because the Machievellian environment described in the article is inaccurate. It is because they prefer complaining about problems to solving them.

    Here's my version:


    "Politically Oriented Software Development"


    0) Don't Tick Anyone Off


    1) Be Smart, Willing, Able, and Nice to work with (SWAN)

    2) Don't add negative value. Remember that you are being paid to help your group/company make money. If this is not kosher, move on and join the Peace Core.

    2) Avoid sending e-mails whenever possible. If you must, keep them extremely neutral. Use phone calls and personal conversations for any type of discussion or criticism--technical or otherwise.

    3) Make sure your work is visible, and helps your group's visibility. Well developed, flexible software that meets the customer's needs provides the ultimate visibility.

    4) Disabuse yourself of the ridiculous concepts of "Customer Requirements" and "Use Cases." They will not come. If they do, they will mutate into uselessness VERY QUICKLY. Avoid people who believe in such nonsense. Instead, thoroughly analyze the problem, the customer, and the market and create your own "requirements."

    5) Innovate. Do "cool stuff" (prototypes, new concepts, algorithms, research) whenever there is a lull. If you do not do this, you will either get replaced or doom yourself to a life of mediocrity--probably both. Leverage the "cool stuff" at an opportune time to help your group.

    And if you think management is unnecessary (as many commenters on K5 seem to), go ahead and start your own _successful_ company.

    (BTW, IANAM--I am Not A Manager).

    1. Re:Wrong Attitude by Raseri · · Score: 3, Insightful
      I can sum up your post in 8 words:

      "Roll over and take it in the ass."

      I have had jobs in restaurants, factories, warehouses, IT, and even telemarketing, and almost all of my past employers engaged in the sort of disgusting behavior described in the article. It's never enough to just go to work, do your job, and go home. Some insecure prick above you will not stand for it and will do whatever he can to get rid of you, legal or otherwise.

      One of the things not mentioned in the article (at least not that I can recall) but worth pointing out is that this childish nonsense actually increases in frequency with larger companies, where there is typically more room for advancement. The best way to avoid this shit altogether is, as you mentioned, to start your own company; however, that is not plausible for most people, due to financial reasons, not having business know-how, et cetera. Unions aren't necessarily the answer either, as your union rep may be in with the person out to fuck you over (this was actually the case when I worked for a large plumbing-products manufacturer in Wisconsin). That sort of situation is, in fact, worse than no union representation at all because you pay your union dues every month and end up getting railroaded anyway.

      Back to your post now. I find it very telling that you chose the phrase "wrong attitude." You claim you are not a manager, but this is exactly the sort of empty phrase that managers use to cast non-asskissing employees in a negative light. "Attitude" is purely subjective; there is simply no way to quantify it. Therefore, any discussion of "a bad attitude" in regards to an employee's job performance can be interpreted as: "This person is good at what she was hired to do, but I don't want to say anything good about her because she doesn't kiss my ass." If it's true that you're not a manager, my guess is that you wish you were.

      </rant>


      Sorry for the long post, but I think you're dead wrong on this one.
      --
      Writhe your naked ass to the mindless groove.
    2. Re:Wrong Attitude by SharpFang · · Score: 2, Insightful


      0) Don't Tick Anyone Off

      okay.

      1) Be Smart, Willing, Able, and Nice to work with (SWAN)

      Be the pack mule of the team. Remember the budget rule? Spend less than your budget, have your budget cut next year. Slightly overspend and you have a chance for your budget to be extended. Same applies to work load. Do everything on schedule and next time the schedule will be tighter. Show you're willing and able to take project A and they will give you project B because it seemed you'd have too much slack.

      2) Don't add negative value. Remember that you are being paid to help your group/company make money. If this is not kosher, move on and join the Peace Core.

      If it's designed to fail, all the blame will be on you anyway.

      2) Avoid sending e-mails whenever possible. If you must, keep them extremely neutral. Use phone calls and personal conversations for any type of discussion or criticism--technical or otherwise.

      When it comes to blame, it's their documents vs your word. What is stronger?
      The key is to make the trail contain what you WANT it to contain, no matter what the communication says. Email them "I predict that can't be done on schedule", then call them 5 mins later stating you caught a bug in your calculations and it can be done after all. The email remains, the call is gone.
      3) Make sure your work is visible, and helps your group's visibility. Well developed, flexible software that meets the customer's needs provides the ultimate visibility.

      Yes, except - NOT TOO EARLY. First gain enough influence by quiet means. Then smash the others and remain on top. If you shout "Look, Daddy, Look at me!" you will get slapped by bigger kids really fast.

      4) Disabuse yourself of the ridiculous concepts of "Customer Requirements" and "Use Cases." They will not come. If they do, they will mutate into uselessness VERY QUICKLY. Avoid people who believe in such nonsense. Instead, thoroughly analyze the problem, the customer, and the market and create your own "requirements."

      This method gives your team and company automatically a long line of "maintenance and correction" opportunities. If they say Ethernet and you think "WiFi will be easier", prepare to crawl with the TP wire waist deep in snow in -30C because the WiFi antenna has frozen.

      5) Innovate. Do "cool stuff" (prototypes, new concepts, algorithms, research) whenever there is a lull. If you do not do this, you will either get replaced or doom yourself to a life of mediocrity--probably both. Leverage the "cool stuff" at an opportune time to help your group.

      You'll be the first one to blame.
      Nobody got fired about choosing Microsoft. Implement any experimental technology and whatever fails in the project (no matter how unrelated) it will be blamed on the technology and you.

      (BTW, IANAM--I am Not A Manager).
      Yes. You're redundant.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    3. Re:Wrong Attitude by KontinMonet · · Score: 5, Interesting

      I am a manager and I have seen this sort of politics all too often. SWAN is all very nice but unless you have support all the way up the chain, you end up spending vast amounts of time fending off back-stabbers, however SWAN you might be.

      Phone is better than email, but email must be used when people outright lie about what took place. If you confront people who are simply out to sabotage your every effort (perhaps because you got 'their' job), email trails and signed off notes in meetings followed by an email listing actions are mandatory. Otherwise, the job will not get done.

      Most people in this business strive for well-developed, flexible and accurate software. Unfortunately, 95% of the time, for some reason we inherit hurried, buggy and inflexible software. And we (as managers) are still expected to perform miracles in very limited timescales with despondent developers. Telling senior management you'd like 9 months and another 1.5 million to get their piece of shit looking like a shiny gold nugget just doesn't go down well, however diplomatically you put it.

      Use cases work well if they are targeted correctly. They can be very useful as an overview of the system to users. And how am I supposed to write my own requirements when the customer has a very different view? Customer requirements are a result of back-and-forth discussions, they know the market and the process better than you do.

      Innovation is all very well, but it has to be relevant. As a manager, if there is a lull, there is nearly always a ton of other things that have more priority.

      Finally, in my experience, most management in the software filed is dire. For example, in one place when I arrived, a project was already going badly. I had senior (and board level) managers coming to my teams and asking them to 'do just this little bit of documentation' or 'fix my laptop'. Senior managers who know just a little about software decided (over my objections) that the team should fix bugs their way (ie the stupid way). They would arbitrarily move people between teams working for different clients (again over my and other people's objections). It all ended up wasting large amounts of my teams' time in critical situations. On those occasions when I pointed out and proved time was being inefficiently used, I got flak for not being a 'team player'.

      After nine months of this crap despite repeated pleas and discussions and explanations of why they were jeopardising the project, the CEO started a 'blame hunt'. In a crisis meeting in the board room, he pointedly asked me that if the project slippage and possible loss of a big client was not my fault, then whose was it?

      By now, I'd had enough of diplomacy. He was not the one facing the ire of the client on a daily basis, I was. So I said it was his fault. I hadn't hired the people who were screwing up this project, he (and other senior management) had. If the buck stopped anywhere, it was with him.

      I expected to out of the door that day. After they found out what happened (this stuff rarely stays quiet), my teams and co-workers expected not to see me the next day either.

      What actually happened was that the owner of the company (who was in another country) sort of agreed with me. I outlasted the CEO and a number of the senior management. But, unfortunately, the damage had already been done and we lost the big project. I moved onto other things in the company and saw the owner a lot more. The company started going through a bad patch and shrunk considerably. Other parts were being poorly managed too. I saw the writing on the wall and jumped ship.

      --
      Did he inhale?
    4. Re:Wrong Attitude by SharpFang · · Score: 2, Insightful

      Oh, that's wonderful!
      Write down every piece of the bullshit the customer says.
      Then write the program EXACTLY to the specs.

      And when they complain, write down everything again, and charge them a nice $$$ for "program extension" over everything that you do that wasn't in the original specs. Point it out exactly.

      The original contract was that the software does A, B, C and D, and D is done in X way. (though obviously it's stupid. You might have suggested it's stupid, but accept it if klient disagrees!) Now client decides C is redundant, D should be done in Y way and E and F are needed. So charge them for all that - it wasn't in the first specs...

      Next time they will state clearly what they really want.

      Remember: A correct program is not a program that does what the user thinks it should do. A correct program is a program which does everything (and nothing beyond) what the specification says. This is the only metrics. If you start guessing, you get the blame.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    5. Re:Wrong Attitude by johnjaydk · · Score: 4, Informative
      And how am I supposed to write my own requirements when the customer has a very different view? Customer requirements are a result of back-and-forth discussions, they know the market and the process better than you do.

      I have a very simple system for figuring out requirements.

      First throw out the spec. it's either written by the users (and they don't know how to write it) or a manager (who don't have to write the code himself). Anyway the spec is wrong incomplete and misleading.

      Go see the users themselves (great excuse: I need to clear out some details) and have them TEACH you how to do the relevant part of their job. Then you know the environment, the lingo and get into a ping-pong on requirements and possibilities. This part can easy turn into the most interesting part of your day to day work and you end up knowing your business top-to-bottom.

      Second: The version 2 excuse. Promise two releases: rel 1 that only covers the bare essentials and rel 2 that covers the whole shebang including a gold-plated kitchen sink. The trick is to be agressive about moving features to rel 2 and focus on rel 1. When rel 1 is rolled out only the morons will complain about the missing sink or it's lack of gold. These morons are easily marginalised in a debate on return on investment on sinks wiht gold plating.

      These methods only works on reasonable small projects for inhouse consumtion. YMMW etc.

      --
      TCAP-Abort
  16. Politics is typical for the US by bvankuik · · Score: 3, Interesting
    I'm working for a North-West European branch of a large multinational with HQ in the US. The general opinion here is that the game of politics is played by the Americans. When we are at work without them, we just do our jobs and if the project fails, it's the fault of the team and not one of its members. Any disagreements or irritations (which WILL come out when the going gets tough) are treated with extremely blunt honestness; first discussed in private to get the sharp edge off, then in the team.

    Yes, that includes QA saying things to developers like "you don't even smoke-test your work and I'm NOT going to do that for you", or (developer to manager) "why do you ask with what I'm busy? You're the project manager".

    Of course, you have to let some steam off once in a while by joking and horsing around.

  17. Incremental dev. and time lines by KontinMonet · · Score: 2, Funny

    The article may be tongue in cheek, but it is bang on right about one thing: You might be doing incremental development but the senior management still want a 'clean' project. The system will be delivered end Q4 and no later. Yessir Mr. Big Customer, you have our word on it (without asking the development department if it's possible).

    After that, they hurry down to the development departments and after some panicky discussion and massaging of the project sheet, decide that Release 2 will happen 9am Nov. 15th. So yes, you do end up de-scoping during development. I have deliberately targeted sections for de-scoping and I am sometimes deliberately vague about will be delivered (rather than adding 40% contingency). For example, administrative functions will be delivered (but they might not have the gleaming front-end that they expected). And anyway, I get lumbered with a development team cobbled at the last minute (gotta save costs!) from half the losers in the company and a prima-donna who just sneers at the usefulness of unit testing and documentation.

    Managers have surprisingly little power to get the best people for the job. When a board level manager decides that all sourcing will be now be internal, instead of the shit-hot guy I interviewed the day before, I now have to persuade a luke-warm candidate who really didn't want to move, to relocate 800km. Senior managers so often think people are like PCs. Roll 'em in, plug 'em at the desk, they start being productive that morning! Project finished (well,sort of)? Roll 'em out, there's another desk waiting.

    --
    Did he inhale?
  18. Visible unpaid overtime by eric76 · · Score: 2, Interesting
    Keep to the minimum possible. Remember that the earliest part is most valuable since there are more witnesses: better to do half an hour Monday to Thursday than two hours on Wednesday. It also sounds better to say: "I've worked late four nights this week." No-one will be keeping track that closely anyway.

    At my first job out of college, being in a strange town with nothing to do anyway, I would routinely work late. When I left, instead of going down to the bottom floor, signing out, and then walking up several flights of stairs in the parking garage to where I was parked, I would just exit through the fire escape and walk down to where I was parked.

    Then one day I walked into the senior vice president's office and saw him looking at the night and weekend signin/signout log maintained by the guards on the first floor.

    After that, I always went down to the first floor and signed out.

    And it worked. One morning I really overslept and came in about 11 am to find a note that I needed to report to the senior vice president's office.

    So when I went in to report, I apologized for being so late. He told me not to worry since I worked late so much of the time.

    1. Re:Visible unpaid overtime by eric76 · · Score: 4, Interesting

      In my case, it was really two things:

      1) I didn't have much else to do. I wasn't into hitting the bars nightly and I didn't want to sit around watching tv. Also, I only knew about two people in town (a couple of cousins) outside of work).

      2) I didn't necessarily spend all the time working. At the time, home computers were barely out, but I was too busy paying college debts to afford them.

      Those home computers that were affordable like the Radio Shack Color Computer weren't very attractive to me. What I wanted was a PDP-8 for home, but I just couldn't afford it.

      So I spent part of my evenings at the office figuring out how to really use the company's PDP-11/70 with RSTS/E.

      ---

      For example, we really needed more computing power when I arrived. The PDP-11/70 just wasn't enough. The funny thing was that it was only using about 30% of the CPU under heavy load. Most of the time it was waiting for disk accesses.

      We added 1 megabyte of memory, but that didn't make any difference.

      I experimented with disk caching. Under RSTS/E, you could either turn disk caching on for everything or just for selected files. Turning it on for everything didn't improve much apparently because you didn't have much memory to really cache much.

      But I dug through all the documentation and was appalled at how the disk caching worked. A minimal cache time of 30 seconds was defined. In other words, when you cached a disk block, it was there for 30 seconds before it could be removed and so there wasn't enough room to cache most disk accesses. Even allocated much of our new memory didn't help.

      So late one night, without telling anyone what I was going to do, I patched the operating system to change the thirty second cache time to five seconds. The results were phenomenal. We went from 70% CPU idle time to 0% CPU idle time. Since the vast majority of the cached disk blocks weren't needed after a few seconds, keeping them there thirty seconds was just blocking additional disk blocks from being cached. Caching all disk reads for five seconds had a phenomenal positive impact on the computer.

      When adding disk blocks to the disk cache, the algorithm would first remove any that had been there longer than the maximum cache time. So after patching the system to change the cache time, it was useful to observe the amount of memory used for the cache for a day or two and then adjust the maximum disk cache time up or down. If it was full most of the time, reduce it slightly since there were likely to be eligible disk blocks that weren't being cached. If it was not full, increase the time slightly until most of the memory allocating for the disk cache was being used.

      Modifying the disk cache time did lead to one problem.

      My boss didn't really understand computers much. When certain employees would complain that the computer was too slow, he'd up their priority.

      Before the disk cache time change, it made little difference because their processes still had to spend much of the time waiting for disk accesses. After the change, increasing the priority would allow the one process to use nearly 100% of the CPU time until it finished. Noone else could run anything -- it was as if the entire computer was frozen.

      Of course, everyone but my boss and the people who would get him to raise their priority hated this. But once he had raised the priority, it might take an hour or more to get enough CPU time to drop the priority back down.

      So it was time for another late night modification. I modified the utilty (correctly spelled - it had to fit in 6 leltters) program to act like it had raised the priority without actually doing so.

      Then everyone was happy. Someone would call my boss and he'd raise their priority. They were happy because their job would finish faster and he was happy because he'd look better to their boss. The rest of us were happy because we could still get our work done.

      I told a number of other RSTS

  19. Re:Developers! Developers! Developers! by Black+Noise · · Score: 2, Informative
    --

    Cig? No, thank you.
  20. Personal vs. Collective Motivations by letdinosaursdie · · Score: 2, Insightful

    I think that this article is a huge reason why the "open source" model is working... not just because it is a development strategy that may or may not be superior, but because it is a political alternative to the sort of corporate politics that are almost inevitable in a capital/industrial environment. Econodwarf wisdom idealizes a competition as a deliverer of optimal performance... tighten the screws, and output increases. but the competitive mindset doesn't disappear when employees clock in. The pressure that drives companies to compete among each other can also generate the internal competition that drives this sort of political BS. And the more complex and collaborative the problem is, the more vulnerable it becomes to this internal ego jockeying. I conjecture that's a huge reason why we see politics playing such a deadly role in the development of software. The problem with the "economic incentive" model that we seem to hold as the solution to all of societies problems and the deliverer of all of our culture's wants is that the incentive emphasizes the wrong thing. It pushes us to promote ourselves, whether for the sake of vanity or survival, and the product that results is often merely byproduct. Better would be an incentive that drove each toward the collective goal. In free software projects the incentive, while perhaps somewhat vanity oriented, seems much more about loyalty to the creation itself. The systems may break down along less integrated lines, like two unrelated projects that mesh together after the fact for an unplanned-for synergy, like the LAMP platform, but less energy is wasted in painful CYA-like activity. Obviously not every project can be developed collectively like this. Any ideas on how the community spirit can be better harnessed in an environment in which the job is less fun? Managers, from my experience of layer upon layer of them, don't seem to be it. How do companies make people want to work toward the project working? Is the current, sad, mess of a situation the best we can do? What do developers suggest?

  21. TFA is very good by roman_mir · · Score: 2, Insightful

    Very good description of the first principles. The projects don't matter, good design does not matter.

    All that matters is what is easily visible and even more importantly - the perception.

    -disclaimer-
    I am a contractor, worked as a contractor for the past 4 years. Prior to contracting I've done 5 years of permanent work. I live and work in Canada, Toronto. In the past 4 years I worked at 6 different organizations on a total of 18 contracts.
    --

    The goal of any contractor is to find a well-paying contract and to make sure that the job is done satisfactory, so that the contract maybe extended for other projects within the same organization (hopefully for more money.)

    My latest contract is quite interesting in that it is with an organization (no names) where the tactics are very close to those described in this submission. I was hired because a different architect was let-go (the union will not allow contractors to stay for more than 2 years,) and there was an important project to be done (the project is a legal obligation to the government, so it's serious.)

    The overal feeling within the department is that the head manager of the department is a micromanaging, self-indulging, brainless moron with a serious attitude problem. From point of view of this k5 story, this is the only IT department, so there is less competition between the management on the higher levels to compete. But there are many other problems. The air within the department is that of complete secrecy.

    You probably know the expression: job security?

    Well, everything around here is based on that. The projects' success does not matter. The effectiveness does not matter. Maintainability does not matter. What matters is that you do not do what you are not supposed to do, even if it takes you 5 minutes instead of waiting for the specialized help for a week. You do not invade into the very narrow spaces of very narrowminded people, who are good at one thing - maintaining their job security.

    Documentation to the projects is obviously outdated and has nothing to do with the system that needed to be improved upon. The system itself is based on technology (from a well known company) that should never have been used, but someone's ancle/aunt/father/brother whatever helped this tech to be pushed into the environment (obviously this tech is so obscure and specialized that noone else in the world uses it, so it's not updated.) The project is understaffed, the deadline is too damn close and the resources are not there (not enough money)
    --

    As a contractor I am interested in the project succeeding and as a developer I am interested to make sure that the design and development are based on some good principles.

    So here are the problems (obstacles) to success and the steps I had to take to go around them.

    1. The sources of the original system are controled by a special team. To gain access to the source control system there are too many obstacles. The advice to me was for our group to use a shared directory as a source control tool. Obviously this would not have worked - we would have spent all our time synching the sources. There are very serious barriers to getting a different source controlling tool being installed on a dev server.

    solution: install a source controlling tool on your own machine. Import the sources. Set up you developers as users. Don't forget to make sure that the master source gets backed up somewhere every night.

    2. Documentation to the original system is not good at all or non-existant. Knowledge is power and power is not to be shared with anyone. The tools for documentation control are out of reach.

    solution: install a Wiki server on your machine (I use Tomcat and JSPWiki, it's good enough.) Start by setting up project space in Wiki, create sections for requirements, design, testing, assumptions, team, migration, issues, resources, standards etc.
    Always update Wiki. Nothing must get past it. Remember: