Slashdot Mirror


Customer Feedback Surveys Could Be Considered Harmful (easydns.org)

Longtime Slashdot reader Stunt Pope writes: Customer Feedback surveys are now near-ubiquitous, subjecting us all to near-Black Mirror-esque pursuit to "rate your experience" for everything from going to the bank to ordering a pizza. Thanks to The Curse of Goodhart's Law, all of these surveys are beyond useless and even damaging. Mark Jeftovic writes in a blog post: "The shop/hire-rate-reward feedback loop has become baked-in to some systems. Many live marketplaces incorporate these feedback transactions into ratings, which then become a score which then impacts future prospects of whomever is being rated. And that's where the trouble starts. There is a point where this stops being useful and the knock-on effects of a ratings system predicated on feedback results becomes counter-productive. That point is when the ratings become targets. When a company decrees 'All customer feedback ratings must score a minimum of X, or else...' the company has just commenced the process of invalidating and corrupting all useful information to be gleaned from that feedback/survey process. A label which captures this concept is 'Goodhart's Law' -- after economist Charles Goodhart, who posited in essence that 'when a measure becomes a target, it becomes useless.'"

196 comments

  1. Yeah but by Anonymous Coward · · Score: 0

    You can get 10 bucks off your next purchase.

    1. Re:Yeah but by Anonymous Coward · · Score: 0

      Every time a sales associate tries to pressure me into signing up for a loyalty card, I just say, "No thanks, I don't shop here often enough."

    2. Re:Yeah but by Anonymous Coward · · Score: 0

      I take the card for the discount but give them fake info.

    3. Re:Yeah but by PPH · · Score: 1

      but give them fake info

      CowboyNeal thanks us all for the discounts he gets.

      --
      Have gnu, will travel.
    4. Re:Yeah but by Imrik · · Score: 1

      Start trying to fill it out with the salesperson's info, they tend to give up quickly after that.

    5. Re:Yeah but by sexconker · · Score: 1

      Nope. Rusty Shackelford.

    6. Re:Yeah but by Joe_Dragon · · Score: 1

      and 1060 west addison as your address

    7. Re:Yeah but by SpiritualRemains · · Score: 2

      If it's a phone number based system, just give them Jenny's phone number.

    8. Re:Yeah but by Anonymous Coward · · Score: 0

      I always use pi.
      314-159-2653

    9. Re:Yeah but by Darinbob · · Score: 1

      I see a lot of pressure to make sure all the numbers are maxed out on the survey, or that item X be given top marks, etc. I bought a car once, over a decade ago, where the salesperson was intent on telling me that box 5 on the survey I was going to get in a couple weeks had to be given a 10 rating, or else things would go very badly for the dealership. It was sort of hard to tell if the home offices do punish the groups or employees that don't get top ratings, or if there is more of a local push to make sure they end up better rated than the other branches. (and for auto sales that's a dog-eat-dog competitive market, even at the same dealership they're often backstabbing each other)

    10. Re:Yeah but by Dread_ed · · Score: 5, Informative

      I work in the auto industry. Consider all manufacturer surveys on a logarithmic scale. On a 1 through 10 rating system with 1 being the lowest and 10 being the highest, most dealership operators and manufacturers consider 9 a failing grade for the salesperson. Yes, you read that right. A survey filled out with 9's all the way down will get most salespeople called on the carpet. And if you average a 90% rating for the month you may not work there the next month.

      Many salespeople's living wage is ties to bonuses that come from customer satisfaction ratings. You get paid one amount for selling a car. You get paid a higher amount if your average customer satisfaction for the month (or sometimes a 3 month rolling average) is above a certain very high number (like 97%.) Some dealerships tie all performance bonuses to high customer satisfaction scores, easily halving the pay of the salesperson if they get one survey with low scores.

      For instance, as a salesperson I have had one customer who scored a survey in the 85% range and due to the circumstances of that month, it cost me over $3500 in lost bonuses. This is not an isolated instance. It happens routinely at dealerships all over the country.

      The first time I heard from a manufacturer's rep that customer satisfaction ratings are directly related to not only future sales for the marque but also current resale value I knew it was a sham.

      --
      When the only tool you have is a claw hammer every problem starts to look like the back of someone's skull.
    11. Re:Yeah but by mspohr · · Score: 2

      Had the same pressure from an Audi salesman a few years ago. Told me I had to rate him a 10.
      Well, I didn't because he gave me the usual car salesman sleazy misinformation/ scam dog and pony show as all car salesman are trained to do.
      He was pissed.
      Last car I bought was a Tesla. No scams. No pressure. Just helped me pick out the options. Best car buying experience ever. (No survey)

      --
      I don't read your sig. Why are you reading mine?
    12. Re:Yeah but by Anonymous Coward · · Score: 0

      Same here. The last place I got a loyalty card at was a shoe store. I told them my name was "Lance Uppercut".

      As for customer feedback, if I am asked at all to provide it, I will always give very negative feedback and make up bad things about my experience.

    13. Re: Yeah but by Anonymous Coward · · Score: 0

      I just claimed this guys' free coffee!

    14. Re:Yeah but by Anonymous Coward · · Score: 0

      This is typical. I once lost a job because my scores were only 4.2 out of 5. As a general rule, if you see one of those surveys, just give the person the max ratings on everything unless they're actually incompetent or otherwise horrible. All too many companies will expect a minimum of 90% out of all their employees demonstrating a complete lack of comprehension over basic statistics.

      Yes, you hope when you're hiring that all your hires are above average for the population at large, but that's usually not the case. At least not if you're not paying markedly above average rates, finding especially talented people and funding their further development. And even then, it's somewhat questionable if you should have that many people that far above average.

    15. Re:Yeah but by turbidostato · · Score: 3, Informative

      "it cost me over $3500 in lost bonuses."

      That's part of the problem. Bonuses, by its very definition, can't be lost, only earned.

    16. Re:Yeah but by Anonymous Coward · · Score: 0

      It's just semantics. Clearly the point is that OP would have received that $3500 bonus *if not for that one review*... hence, that review "lost" the bonus.

    17. Re:Yeah but by Anonymous Coward · · Score: 0

      I always give my false info as... Mr Plod Station House 8-10 Broadway Westminster London SW1H 0BG Tel: 020 7230 1212 I use this for all surveys, scam phone calls, SPAM emails (especially all these scumbags who offer to design a website every time I buy a domain name), free samples and other general crap

    18. Re:Yeah but by TheRaven64 · · Score: 1

      Many years ago, I participated in a focus group for a marketting company (rating some new ads for Pepsi). They asked us to rate things from -5 to +5. It was quickly apparent that most people in the group didn't understand negative numbers, so rated from 0-5. I am certain that, when they presented the numbers to their client, they gave them in a range of 0-10 and were able to say that all of the scores were broadly positive.

      --
      I am TheRaven on Soylent News
    19. Re:Yeah but by SharpFang · · Score: 1

      I usually give a negative feedback about obnoxious, intrusive customer feedback demands.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    20. Re:Yeah but by Anonymous Coward · · Score: 1

      $3500? That's more than I ever earned per month. From where I'm standing you're in a position of luxury.
      Just save some money up when you do get your bonus and shrug your shoulders when you don't.

    21. Re:Yeah but by SharpFang · · Score: 1

      Except if your salary is so low, the salary + bonus is the actual realistic baseline, and bonuses lost are actually penalties incurred.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    22. Re:Yeah but by Anonymous Coward · · Score: 0

      I work in the auto industry. Consider all manufacturer surveys on a logarithmic scale. On a 1 through 10 rating system with 1 being the lowest and 10 being the highest, most dealership operators and manufacturers consider 9 a failing grade for the salesperson. Yes, you read that right. A survey filled out with 9's all the way down will get most salespeople called on the carpet. And if you average a 90% rating for the month you may not work there the next month.

      The more common method of calculating scores (in fact, it's a defined standard and used in many sectors) is called "Net Promoter Score" or NPS. Under this system, scores of 0 - 10 are collated. Anything scoring 6 or below is marked as a negative (-1). Anything scoring 7 or 8 is neutral (0), and anything 9 or 10 is positive (+1). Add all the -1, 0 and +1 values, and divide by the number of data points. Then multiply by 100 to give you an index score ranging between -100 to +100. Anything greater than zero is considered a good result.

      It's a much better system than described above for the auto industry. But the key here, as noted in the summary, is that it is not intended for use as target for beating up your sales team. Any scoring system could be used punitively in the way described, and the trouble is that it doesn't actually work.

      When I bought a car a few years ago, the salesman gave me the survey and explicitly told me that I had to complete it and give him top marks, as his commission was on the line. I've heard the same from others, and it kinda destroys the purpose of the survey, because people if people know it's going to be used for that, they'll game the system; they'll give a score based on how vindictive they feel toward the salesman. Do I believe that he deserve to earn any commission from this sale? That isn't the information that the survey is intended to find out (or at least, it shouldn't be), but it's what they're going to get when it's framed in this way.

    23. Re:Yeah but by laughingcoyote · · Score: 2

      Most of these places will look you up by phone number if you tell them you don't have the card with you.

      The local area code plus "867-5309" has worked at any place I've ever been. (From the "Jenny" song, from those of us who wouldn't remember it.) And I'm apparently not the only one who knows this. According to my store receipt, Jenny spent over $30,000 at my local grocery store last year.

      --
      To fight the war on terror, stop being afraid.
    24. Re:Yeah but by Anonymous Coward · · Score: 0

      Don't forget to take out taxes...

    25. Re:Yeah but by GuB-42 · · Score: 1

      In some cases, there are only two grades : the maximum score and less than the maximum. The scale is a decoy.

    26. Re:Yeah but by Quirkz · · Score: 1

      You know, a scale than runs from -5 to 5, with 0 being neutral, actually makes a lot more sense than the 0 to 10 scale. Shame people don't understand negative numbers, because I'd like that one to catch on.

    27. Re:Yeah but by TheCastro1689 · · Score: 1

      I take a page from the President, only a fool pays taxes.

    28. Re:Yeah but by turbidostato · · Score: 1

      "Except if your salary is so low, the salary + bonus is the actual realistic baseline, and bonuses lost are actually penalties incurred."

      And that's exactly why I said "that's part of the problem": bonus should never be counted as part of a baseline -because it isn't.

      "bonuses lost are actually penalties incurred."

      Only by the same logic than me copying a Sony film becomes lost revenue for them.

    29. Re:Yeah but by Coren22 · · Score: 1

      But that is not your real name! According to a certain someone in my sig, we are pussies if we don't use our real names every time!

      That is a good one, I will have to start using it.

      --
      APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
    30. Re:Yeah but by Coren22 · · Score: 1

      All too many companies will expect a minimum of 90% out of all their employees demonstrating a complete lack of comprehension over basic statistics.

      So, what you are saying is that the company expects any person who shows a complete lack of comprehension over basic statistics to score a minimum of 90%.

      Perhaps you could use a comma, here are a few for you. ,,,,

      --
      APK likes to ask for responses to the same things over and over. Maybe he just likes the responses?
    31. Re:Yeah but by SharpFang · · Score: 1

      Except going without a major part of your salary is far less optional than going without watching a shitty action flick.

      I agree the system is wrong, but as opposed to Sony's claims, it's a fact - not an delusional belief.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
  2. Please take the time to provide some feedback.... by Xenx · · Score: 4, Funny

    How would you rate the quality of this story?
    [ ] Ehh, good enough.
    [ ] Could have been better, I guess.

  3. agreed by Anonymous Coward · · Score: 0

    this!

    i understand the hell that contact centre employees go through, but why should i give you 10/10 if you were barely average?

    as a manager i would much prefer to have real feedback rather than synthetic 'brilliance' i could report up the management chain

    1. Re:agreed by WarJolt · · Score: 1

      Because if you don't vote 10/10 then the retaliatory customer rating will be 0/10 and you won't be able to get and Uber anyone.

    2. Re:agreed by Nkwe · · Score: 5, Insightful

      And as a person filling out surveys who knows (just a little) about math and statistics, I think of ratings on a bell curve. On a 1-10 scale almost nothing is actually a 1 or a 10. On that scale I would rate a 5 as average service and give a 7 or 8 to what I think is well above average service, 9 would be excellent service. You would only get a 10 if there was no possible way to do any better under any circumstances and you completely exceeded all of my expectations. Unfortunately people get dinged if they don't get all 10s. Sucks to be you if I have to fill out your survey.

    3. Re:agreed by ShanghaiBill · · Score: 1

      Because if you don't vote 10/10 then the retaliatory customer rating will be 0/10

      I don't know how Uber works (I use Lyft) but the way Airbnb works is neither party can see the other's rating until both have posted. So using the rating system to retaliate doesn't work.

    4. Re:agreed by Imrik · · Score: 1

      Pretty easy to see the rating if you watch them enter it.

    5. Re:agreed by Carewolf · · Score: 1

      And as a person filling out surveys who knows (just a little) about math and statistics, I think of ratings on a bell curve. On a 1-10 scale almost nothing is actually a 1 or a 10. On that scale I would rate a 5 as average service and give a 7 or 8 to what I think is well above average service, 9 would be excellent service. You would only get a 10 if there was no possible way to do any better under any circumstances and you completely exceeded all of my expectations. Unfortunately people get dinged if they don't get all 10s. Sucks to be you if I have to fill out your survey.

      I do the same. Though I have learned to schew the scale up so average is 6 or 7, because otherwise all hell breaks lose when I rate people or services. I still never give 10s since those are reserved for truly outstanding service, and those will NEVER come from companies that ask you to rate them.. Asking to be rated in fact automatically pulls you down a rank :D

    6. Re:agreed by Anonymous Coward · · Score: 0

      every uber driver is an sob

    7. Re:agreed by mspohr · · Score: 3, Insightful

      I always give service people a 10 (unless the service really sucked).
      They have shitty jobs and the ratings are just another stick to make their lives miserable. I won't play that game. Hopefully they can get a better job some day.

      --
      I don't read your sig. Why are you reading mine?
    8. Re: agreed by Anonymous Coward · · Score: 0

      You're just supporting a broken system.

    9. Re: agreed by Anonymous Coward · · Score: 0

      Every system is flawed in one form or another.

    10. Re: agreed by Anonymous Coward · · Score: 0

      And getting the people who are still trying to do their best within a broken system fired helps in precisely what way?

      All you're doing by rating things accurately is taking away any possible incentive to even try. Why bother to work hard or even try if they'll fire you for getting less than 90% ratings? Especially, if those ratings come in weeks later, lack any information to help you improve and are probably the result of the company offering people bribes to fill in the information.

      Bottom line here, is that the system is broken, so you might as well do the guy a solid and not get him fired if he's at all competent in his duties. Otherwise, you're just supporting the race to the bottom where nobody with any shred of competence is willing to take the risk of working in that particular field.

      You're not seriously suggesting that is a better situation than just going along with the idiocy and let the poor shmucks keep their jobs, are you?

    11. Re:agreed by Anonymous Coward · · Score: 0

      Yes, but you are a person with some intelligence, unlike, say, a marketing director.

    12. Re:agreed by TheRaven64 · · Score: 1

      Same here, though for a subtly different reason. If you rate everything 1, then it's easy to discount (you're just difficult to please). If you rate the people 10 but everything that's part of the institutional structure 1-3 then they get a data point of someone who is using the full range of the rating system and thinks that everyone except the easily-firable staff is dangerously incompetent.

      --
      I am TheRaven on Soylent News
    13. Re:agreed by Anonymous Coward · · Score: 0

      Unfortunately for service people, they tend to treat me as a customer with the utmost contempt and disrespect, whether it be plain impoliteness, being overly pushy, being overly pally, simply trying to sell me stuff I don't need, or refusing to clearly state product information. So I do play the game and if I get a survey I tend to give them straight 1s.

    14. Re: agreed by SharpFang · · Score: 1

      Every system is flawed in one form or another. Let's give National Socialism one more try.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    15. Re: agreed by SharpFang · · Score: 1

      The only way to fix this system "from outside" is to break it thoroughly.
      You're shifting the blame on the victim. It's not your or the driver's fault that the manager decided 90% rating is the minimum. It's the manager's. And the only way to stop the scoundrel is to stop the money flow up stream.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    16. Re:agreed by houghi · · Score: 1

      Most people where I live will know that from their schooldays a 5 would be a fail, a 6 just passable 7 was average and 8 was good. 9 outstanding and 10 perfect. So people will tend to be in the 7 range as average. The thing is with one question service is that you do not have any way of knowing what my or what your average is. There is no baseline.

      To get around this, you can ask what you expect it to be and compare it to what you think it really was. You expect a 5 and you give a 7. Wow. I expect a 9 and give an 8. Improvement is needed.

      --
      Don't fight for your country, if your country does not fight for you.
    17. Re:agreed by Anonymous Coward · · Score: 0

      I do analytics on survey data for a very large company. My policy is to throw out any survey that is all 10's or all 1's because (thru reading survey results while listening to the actual phone call) almost no one is every completely happy or completely unhappy with their experience. I also have a weighting system for if someone added comments to a specific question. Thru research and data collection I have also found that people are much more passionate about their response if they took the time to actually write a comment. It has help us establish a much more accurate baseline for our results. I still hate using survey results as a metric because (as others have stated here) it makes people focus on getting a better rating and not doing their job. This means sometimes giving the customer more than they deserve to get a better score or chit chatting with them so they like you instead of getting off the phone and helping the next customer. I have watched other metrics suffer as "Customer Satisfaction" became a more important metric. Its a pipe dream and I can't wait until this fad passes.

    18. Re:agreed by Anonymous Coward · · Score: 0

      This, but also, if there's a comment section, I'll add something about stupid, worthless surveys and the morons that think they should force them upon people who are paying the bills for them. Usually I make a blatantly positive statement about the service staff and a blatantly negative one about the managerial staff, too.

      I'm probably why those comment sections are disappearing from most surveys.

      For the ones without a comment section, I simply never respond. If they value my opinion so much, they can pay me some of that value or they can get bent.

    19. Re:agreed by Trailer+Trash · · Score: 1

      And as a person filling out surveys who knows (just a little) about math and statistics, I think of ratings on a bell curve. On a 1-10 scale almost nothing is actually a 1 or a 10. On that scale I would rate a 5 as average service and give a 7 or 8 to what I think is well above average service, 9 would be excellent service. You would only get a 10 if there was no possible way to do any better under any circumstances and you completely exceeded all of my expectations. Unfortunately people get dinged if they don't get all 10s. Sucks to be you if I have to fill out your survey.

      My thoughts exactly. I sometimes piss people off on upwork because I give feedback as it should be. 3 is average, 4 is above average, and 5 is "there is no way to do any better at exceeding my expectations". And that's what 5 is - "exceeds expectations". If you do exactly the job that I paid you to do in the timeframe specified then welcome to "3" - you did what is expected. It's unfortunate that many people expect to get a "I exceeded your expectations" reward for not exceeding my expectations.

  4. Most forms of metric are like this by Zephyn · · Score: 5, Insightful

    " A label which captures this concept is 'Goodhart's Law' -- after economist Charles Goodhart, who posited in essence that 'when a measure becomes a target, it becomes useless.'"

    I've seen a similar effect in places where I've worked. A poorly defined metric that is used to rate employee performance will suddenly become the primary focus of the job, instead of actually doing the job.

    1. Re:Most forms of metric are like this by Anonymous Coward · · Score: 0

      Except that studies have proven multiple times that's not true.

      Once you're paid "enough" (which can be surprisingly little), then money is only a very small part of what people focus on at work.

    2. Re: Most forms of metric are like this by Anonymous Coward · · Score: 0

      Its not about the money, it's about management focus. If all your manager ever talks about is the percentage of correctly formatted TPS reports, that's what you'll be spending your time on.

    3. Re:Most forms of metric are like this by Anonymous Coward · · Score: 0

      Ok then employee based on your performance review you'll be receiving 4/5 of your usual pay this month.

    4. Re:Most forms of metric are like this by Anonymous Coward · · Score: 0

      You don't want to admit

      (Score:-1)

      Point proven.

    5. Re:Most forms of metric are like this by AmiMoJo · · Score: 1

      It's abused the other way too. If I get a survey, I'll give the answers that I think will get the result *I* want.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    6. Re:Most forms of metric are like this by Imrik · · Score: 1

      If you are aware that you get paid more money for doing x than doing y, you will most likely do x, even if y is better for the company.

    7. Re:Most forms of metric are like this by sir-gold · · Score: 1

      The place I work at had to fire a store manager recently for cooking the books in order to meet his bonus requirements. It took 2 people 3 weeks to double check everything and get real numbers.

    8. Re:Most forms of metric are like this by Hasaf · · Score: 1

      Of course one will. In the case you set forward, the money is a signaling mechanism. Even if I happen to feel that Y is more productive for the company, It has been signaled to me that the company places greater value on X. As such, I should engage in X.

      This assumes that the X in question isn't some perverse gaming of the system.

      To use as an example, I worked at a company that was obsessed with EBITDA. All meetings, and management contact, were required to include emphasis on EBITDA objectives (yes, this resulted in a manager hiding in his office a lot). I realize that was just plain stupid. However, it was clearly expressed that the EBITDA objectives were what the company was concerned with.

      I could have forged off in my own direction. I do think the company would have been better for it. However, to do so would have been an act of insubordination, yes, I would have also missed my bonus. However, the bonus was not the issue; the issue was that the company had, clearly, signaled its primary area of concern. It was my job to focus on that concern.

      [EBITDA -- Earnings before interest, tax, depreciation and amortization is a measure of a company's operating performance. Essentially, it's a way to evaluate a company's performance without having to factor in financing decisions, accounting decisions or tax environments.] BTW, it is a worthless measure https://hbr.org/2009/11/how-eb...

    9. Re:Most forms of metric are like this by cats-paw · · Score: 2

      Have you ever noticed that in a lot of places employees will sit right in front of you handling issues having to do with "internal processes" and not actually help the customer first ?

      I've noticed this quite a bit.

      When your "process" doesn't put the customer first, you should probably re-examine.

      Also too please train your employees.

      --
      Absolute statements are never true
    10. Re:Most forms of metric are like this by Dread_ed · · Score: 4, Insightful

      This is how people become hopelessly dissatisfied with their work.

      I am in sales and I live and die by a simple axiom that resonates with my internal model of the way the world should be:

      If I help enough people get what they want I never have to ask for what I need.

      My focus is always on the customer, never on money. My objective is to help others, not myself. Magically this has led to a low 6 figure income in the most unlikely of places. It has been sufficient to support my wife and I and our three children with only me working for 20 years.

      I see people who get into sales because they think they are motivated by money. These people become disillusioned when they start earning money and find they are terribly dissatisfied with their life. I relate this to misapprehension of their true motivation. Finding what truly motivates you, what makes your heart sing, what fulfills you and gives meaning to your life, and aligning your life with those principles in a way that generates income is what leads to long term success and happiness.

      My $0.02, for what its worth.

      --
      When the only tool you have is a claw hammer every problem starts to look like the back of someone's skull.
    11. Re:Most forms of metric are like this by Toddlerbob · · Score: 1

      " A label which captures this concept is 'Goodhart's Law' -- after economist Charles Goodhart, who posited in essence that 'when a measure becomes a target, it becomes useless.'"

      I've seen a similar effect in places where I've worked. A poorly defined metric that is used to rate employee performance will suddenly become the primary focus of the job, instead of actually doing the job.

      I've seen a similar effect in places where I've worked as well, that is, public schools. Since the nineties, both school and pupil evaluations have been based on achieving questionable targets using questionable metrics. It's nice to know that even if the metrics weren't questionable, using a target like that would make them so. And not only that, a term, Goodhart's Law, exists to describe the phenomenon. I'll place it up there on the shelf right next to Godwin. Thanks!

    12. Re:Most forms of metric are like this by Anonymous Coward · · Score: 0

      as in big companies spending most of their effort on making the quarterly report meet the stock-market expectations rather than doing what is best for the future of the company

    13. Re:Most forms of metric are like this by TheRaven64 · · Score: 1

      But our compiler makes SPEC run really fast! It must be your code that's wrong!

      --
      I am TheRaven on Soylent News
    14. Re:Most forms of metric are like this by houghi · · Score: 1

      With measurement what I learned is to never ask too many question, but the minimum is 2.
      1) What did you expect
      2) What did you get

      This means that if people expect a 3 and get a 5 it is much better than expecting a 9 and getting a 6.

      I have seen where we implemented this. Service level was 65% instead of the standard 85%, however the customers where extremely satisfied. The CEO then said we should start to go for 85% and we said: Why? You told us we where a customer driven company and the customers are happy, so we can not spend the budget on that. Luckily after 2 or 3 meetings the CEO agreed.

      What this means for you as a sales person is a bit the same. You are customer driven. That will mean that you get repeat sales. My Dad was a sales director and he always said: The first sale is easy. Everybody can do the first sale. The difficult one is the second one. Always go for the second one.
      The only way to do that is sell what the customer needs, not what you want to sell or even what the customer says he wants to buy.

      And that is also where you start to build relationships with people and that is hell a lot of fun.

      --
      Don't fight for your country, if your country does not fight for you.
  5. Venue for Data Mining & Micromanagement? by Neuronwelder · · Score: 1

    Maybe they dangle the prize in front of your face and meanwhile extract as much data about you and your habits as they can. This way your life may be complicated by too much information. But sometimes they actually DO show you something that you can actually use. On the dark side, they can mistakenly fire people who don't deserve it though ratings. Or they can figure out how to further thin out employees.

  6. Re:Please take the time to provide some feedback.. by NatasRevol · · Score: 4, Funny

    Would you rate this story a second time if we gave you a 5% off coupon?

    --
    There are two types of people in the world: Those who crave closure
  7. Purposefully False Feedback by rtb61 · · Score: 4, Interesting

    Due to the growing abusiveness or corporations, invasions of privacy, and wide spread deceit, I have decided to follow the principles that many corporations expose and purposefully lie in feedback to companies I dislike. They want quality consulting services, well, the fuckers can bloody well pay for them, nothing is for free according to them, for free, they just get lies. Turnabout is fair play after all, lie to me, well I'll lie to you ;) (only for poorly behaved corporations, which seems to be the majority, especially multi-nationals).

    --
    Chaos - everything, everywhere, everywhen
    1. Re:Purposefully False Feedback by Anonymous Coward · · Score: 0

      Hello, Black Hat. Will you admit you lifted this idea from xkcd, or are you a liar?

    2. Re:Purposefully False Feedback by irving47 · · Score: 1

      What're you talking about? OP made this.

      --
      I had a sucky sig.
    3. Re:Purposefully False Feedback by Anonymous Coward · · Score: 0

      Dumbfuck needs a oblig link?

      Here, dumbfuck: https://xkcd.com/958

      Transcript because you can't be trusted to follow a link. I hope you fucking choke on it.

      [Cueball is sitting at a desk with a laptop, looking at a review website]
              Cueball: What's with this negative review? You liked that hotel.
              Black Hat: I have a script that posts a bad review for every hotel I stay at. It reduces demand, which means more vacancies and lower prices next time.

              Cueball: What if the place sucks?
              Black Hat: I change the review to positive to steer other people over there.

              Cueball: You punish companies you like!
              Black Hat: The odds of my review putting a hotel out of business are negligible.
              Cueball: If we all did that the system would collapse!
              Black Hat: Doesn't affect my logic. Tragedy of the commons.

              Cueball: That's not even the tragedy of the commons anymore. That's the tragedy of you're a dick.
              Black Hat: If you're quick with a knife, you'll find that the invisible hand is made of delicious invisible meat.

  8. I've seen it in action by npslider · · Score: 5, Insightful

    An experience at a local biz in town with a customer service rep... Was told that anything less than 5 out of 5 on his customer review is considered a bad review, and he all but begged me to give him 5-stars.

    He was so overly friendly it was past creepy. I felt conflicted: he did a good job, but I felt I was rating for his sake, not to give an honest assessment of how well I was served by him.

    1. Re:I've seen it in action by myrdos2 · · Score: 1

      I've been told (at Boyd Autobody) that if I don't give the guy a 10/10 rating, he'll call me to find out why. The impression I got was that I'd better voice my complaints to his face right now or keep my trap shut later when they call with the survey. I was looking forward to telling the survey person that I'm giving a 10\10 rating because he threatened to harass me if I didn't, but they didn't end up calling.

    2. Re:I've seen it in action by The-Ixian · · Score: 1

      Or... he could have just been playing on your sympathy in order to get the MVP parking spot....

      Honesty is the best policy no matter what.

      --
      My eyes reflect the stars and a smile lights up my face.
    3. Re:I've seen it in action by npslider · · Score: 3, Insightful

      The end of my story was that I did not fill out any survey. Life is too short for me to be filling out surveys every time I am asked. I get them from the doctor's office, the car dealership, random items bought online, and my cat.

    4. Re:I've seen it in action by taustin · · Score: 1

      "It's not my problem that you work for abusive idiots."

    5. Re:I've seen it in action by AmiMoJo · · Score: 1

      It puts the person being rated in a really difficult position. You can demand pretty much anything from them. 90% discount or enjoy your 1 star rating. Of course they have rules saying they can't give you a 90% discount.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    6. Re:I've seen it in action by Anonymous Coward · · Score: 0

      lol, forgot the bank.

      How was your last experience? WTF? I gave them a check, they deposited to my account and gave me $100 back. There really aren't many options there for the teller to change the experience! They don't ask if the lines are too long, only about the actual transaction. Besides spending 5 minutes in line and 3 minutes for a transactions doesn't get you another 5 minutes for a survey :/

    7. Re:I've seen it in action by taustin · · Score: 1

      I've been told (at Boyd Autobody) that if I don't give the guy a 10/10 rating, he'll call me to find out why.

      And you gave them your real phone number? If you really, really have to let them call you, maybe you should be a 900 number.

    8. Re:I've seen it in action by Anonymous Coward · · Score: 0

      That is the way it is with ALL ratings. I am not joking, its been a widely known secret for 15+ years. I hope you gave the guy 5 stars because he's a victim - it really isn't a rating of his service, its a tool for mgmt to screw with employees, to keep them always in fear of being fired. There is no dignity in that. They are real people in crappy jobs being treated as nothing but numbers. The least you can do is give them the best numbers.

    9. Re:I've seen it in action by Anonymous Coward · · Score: 0

      An experience at a local biz in town with a customer service rep... Was told that anything less than 5 out of 5 on his customer review is considered a bad review, and he all but begged me to give him 5-stars.

      He was so overly friendly it was past creepy. I felt conflicted: he did a good job, but I felt I was rating for his sake, not to give an honest assessment of how well I was served by him.

      This is actually true. In my past I managed at various retail stores and restaurants that had these surveys. Anything less than perfect score at all of these locations was considered failing. So even if a customer gave you 4 out of 5 it was counted against your store as a negative experience. So you had to "beg" and explain to the customer that 5 was the best, etc.

      In the end, my solution was to just cheat. May not have been the ideal solution, but the system was rigged against us, so I used proxys, and filled out enough surveys on a regular basis that real surveys generally couldn't get through for my store. Sad but true.

      On a side note, I worked for a couple places that gave the personality type tests to new hires, that asked all sorts of questions, in multiple ways with a scale of 1 to 10. These were graded in the same way. There was a scale of 1 to 10, but only 1s and 10s really counted. So anyone I really wanted to hire, I had to go in prepping them on how to take the test ahead of time letting them know they either agreed, or disagreed.

    10. Re:I've seen it in action by whoever57 · · Score: 1

      I had a similar experience leasing a car.

      Firstly, the car was not ready when it should have been. They blamed the delay on the time to charge it, but the dealer has a fast DC charger, so the charge time should have been no more than 30 minutes.

      The salesman who begged for the good review also kept me waiting in his office for no good reason. As far as I can tell, that time was purely so that he could entreat me to give a good review.

      I ended up giving no review, but had I given one, it would not have been good.

      --
      The real "Libtards" are the Libertarians!
    11. Re:I've seen it in action by npslider · · Score: 1

      I'm not sure which is worse: The survey after buying the car, or the service you get when it needs to be repaired...

    12. Re:I've seen it in action by sir-gold · · Score: 1

      A lot of places are like this now. They don't even average the score anymore, they just count the number of 5/5s or 10/10s.

      Under this rating, someone who totally sucks (would get a 4/10 on average), would beat someone who is really good most of the time (8/10 average), as long as the first guy gets a few of his friends involved to generate fake 10/10 reviews.

    13. Re:I've seen it in action by Calydor · · Score: 1

      If you're sending your car in for anything other than quick fixes (I'm assuming Boyd's Autobody fixes broken cars) you probably want them to be able to call you when your car is fixed.

      --
      -=This sig has nothing to do with my comment. Move along now=-
    14. Re:I've seen it in action by taustin · · Score: 1

      Or they can give you an estimate on time, and you can call them. Less convenient, sure, but more so than telephone harassment and stalking over a less than perfect feedback survey.

    15. Re:I've seen it in action by Calydor · · Score: 1

      Two words for your idea on calling them instead of having them call you:

      Caller ID.

      --
      -=This sig has nothing to do with my comment. Move along now=-
    16. Re:I've seen it in action by Anonymous Coward · · Score: 0

      You forgot the part where the clerk asks if you want their credit cards, loans, and any other random service they know you NEED.

    17. Re:I've seen it in action by nine-times · · Score: 3, Interesting

      Another aspect of this that's weird to me:

      I was sent a survey to rate a business I frequent-- not to be posted online, just as feedback to the owner. I was asked to rate my experience on a scale of 1 to 10. If I selected 10, it asked the question, "What did you like about your experience?" I selected 8, and the question automatically changed to "What did we do wrong?"

      I didn't think they did anything wrong, but to me, the service warranted an 8. To me, 8 is good, just not quite excellent. So I answered the question, "It's not that you did anything wrong. I liked [a bunch of stuff]. In my opinion, you could improve by [doing some things]." I thought it was a very fair review, and I tried to give constructive feedback. I few days later, I got a phone call from the owner to apologize. It wasn't quite annoying, but it definitely seemed unnecessary and awkward, but I said thank you and reiterated that I thought the service was good, and I didn't intend the rating of 8 as a complaint.

      Since then, the business has continued to send me requests for feedback. My overwhelming feeling is not wanting to go through that experience, so I either just rate them a 10, or I ignore the survey entirely.

    18. Re:I've seen it in action by Anonymous Coward · · Score: 0

      Uber and Lyft drivers will do the same. Anyone on Yelp does the same

      With the stupid as fuck star rating system, or any rating system for that matter. People put incorrect weight to those "reviews". Oh shit, this restaurant only has an average 4 star rating. What is wrong with this place?

      Yelp really needs to provide an out out for businesses. It should really be the business' choice to have a review site for themselves. Let people decide if the business doesn't want to be on Yelp if they want to patronize that business.

      My favorite teriyaki restaurant only has 2 stars on Yelp. It really is the best teriyaki within 20 or 30 miles, but they get slammed on bad service. Well it's Asian owned and ran and yes, the staff speaks little English and is hard to understand. It's a small place and the service isn't what you'd get at an expensive place. But you don't go to shitty little hole in the walls for the service. You go for the best fucking food around. Yet total fucking idiots rate these types of places low.

    19. Re:I've seen it in action by taustin · · Score: 1

      Which is trivial to block. Duh.

    20. Re:I've seen it in action by Dutch+Gun · · Score: 1

      The problem with an arbitrary 1-10 or 5-star/point rating system is that every person defines their rating in a slightly different way. For instance, I've seen people knock a star off a rating for a game or movie because "nothing is perfect", meaning that apparently they'll *never* give 5/5 stars. On the other hand, many people seem to operation in a binary mode, rating 5/5 for anything moderately good, while anything they don't care for is 1/5. Some people define 5/10 as "average", while others imply that's 7/10 or 8/10 is "average", probably due to the influence of academic grading systems.

      I often think surveys or ratings would be better suited with simple binary choices, eliminating all that variability. Each question can be answered with a simple yes or no. With enough people, you still get a sense for the overall quality, and doesn't require as much thought from the customer. If they had a bad experience, you can be certain they'll be checking "no", at which point it's fair to follow up and find out what when wrong.

      Did we provide you with excellent service? yes/no
      Were our employees courteous, friendly, and helpful? yes/no
      Would you recommend our company to your friends and family? yes/no

      I just don't see anything more complicated than that being reliable. And if you're trying to rate employees with these metrics by distinguishing between 9/10 satisfaction or 10/10 satisfaction, you're probably using your metrics wrong.

      --
      Irony: Agile development has too much intertia to be abandoned now.
    21. Re:I've seen it in action by Anonymous Coward · · Score: 0

      Life is too short for me to be filling out surveys every time I am asked. I get them from the doctor's office, the car dealership, random items bought online, and my cat.

      TBH, the cat's surveys are pretty rewarding with all the purring and pushing they involve. You might want to consider filling those.

    22. Re:I've seen it in action by Anonymous Coward · · Score: 0

      My response to 'would you recommend' is always either 'no' or the lowest rating, even if the service/product was excellent. If then asked why, I say that I never make recommendations.

    23. Re:I've seen it in action by Anonymous Coward · · Score: 0

      Your cat? o_O

      Question 1: Meow, please rate my gift of a dead bird on a scale from 1-5. Keep in mind that 4 is a passing grade."

      Question 2: Do you prefer it when I destroy the garden, or would you rather me shred your important paperwork at 3am? Please be honest. This is for science.

      Question 3: Take a good look at my butt hole. Hey! You! LOOK AT IT! Do you like what you see? How about meow?

    24. Re:I've seen it in action by SharpFang · · Score: 1

      "First, you just lost your chance for 10 out of 10 by badgering me about that. There, no need to call me - I absolutely hate being pressured into giving dishonest reviews, that's the reason.

      --
      45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
    25. Re:I've seen it in action by houghi · · Score: 1

      There is a part missing here and that is often forgotten: What did you expect. If you expected an 8 and you got an 8, service was spot on. If you expected a 10 and you got an 8, there are issues (for you). If you expected a 6 and got an 8, service is too good and could be toned down a bit, saving some money.

      Also: These things should NEVER be looked at individually. You will always have the odd ball out and you need to understand that some people will give points differently (hency why you need to know their expectation) even if they have the same experience.

      I once had a teacher that gave out a lot of 6 and 7 (on a scale to 10). He once told me that what I did was perfect and so he would give me an 8. I asked him why I did not get a 10 if it was perfect. His answer was that 10 is for our Lord, 9 is for the teacher, so he could not give me more than an 8. (Another once gave be 11.5 out of 10, so there's that.)

      I would have beeen disapointed, but because I knew what his expectations where an 8, I was very happy.

      --
      Don't fight for your country, if your country does not fight for you.
    26. Re:I've seen it in action by Anonymous Coward · · Score: 0

      How would you rate the frequency with which I purr on your lap:
      1) Not nearly enough
      2) I could use more
      3) Purrfect
      4) A bit too often
      5) Get off my damn lap!

    27. Re:I've seen it in action by Cajun+Hell · · Score: 1

      Honesty is the best policy no matter what.

      Unless you want a MVP parking spot.

      --
      "Believe me!" -- Donald Trump
    28. Re:I've seen it in action by Trailer+Trash · · Score: 1

      I rarely fill them out, typically only if it's a couple of questions.

      You know what *really* works when you get excellent service? Write a letter to the manager. I have a former neighbor who is 85 years old and she mentioned this a few years back. When she gets excellent service in a restaurant or whatever she hand-writes a letter to the manager mentioning the employees by name. She often gets letters back thanking her. That's how you reward excellent service.

      I do the same but with email :)

    29. Re:I've seen it in action by Cajun+Hell · · Score: 1

      Since then, the business has continued to send me requests for feedback.

      That's the kind of behavior that would get me to reply with, "Ok, I changed my mind. 7."

      --
      "Believe me!" -- Donald Trump
    30. Re:I've seen it in action by nine-times · · Score: 1

      Well part of the thing is that I do like the service this business provides. I like the owner and I like the people who work there. I have no desire to complain, and I don't want to cause them to think that I'm generally unhappy with the service I've received.

      It's just, if I'm being honest, they could improve a little.

    31. Re:I've seen it in action by Anonymous Coward · · Score: 0

      The end of my story was that I did not fill out any survey. Life is too short for me to be filling out surveys every time I am asked. I get them from the doctor's office, the car dealership, random items bought online, and my cat.

      My cat has never asked me to fill out a survey, yet.

    32. Re:I've seen it in action by Anonymous Coward · · Score: 0

      Some people define 5/10 as "average", while others imply that's 7/10 or 8/10 is "average", probably due to the influence of academic grading systems.

      The issue here is actually theoretical vs. practical. Theoretically, the average of a random sample in terms of quality would be 5/10. But various controls (QC inspection, focus group testing, funding, etc.) weed out a lot at the low end, so the average result visible to the end user is closer to a 7 or 8 on a purely objective quality scale. This is the same effect seen in academics, where the failing population will eventually wash out (or have grades falsified to let them pass). The average performance (central limit theorem average of distributions across all populations) is 5/10, but the average in a given population will likely be higher (distribution of population already selected for quality).

  9. More evidence good product people... by Anonymous Coward · · Score: 0

    are of extreme importance. I know at my company all of the feedback we've gotten from customers was invalid. The feedback we've received thinks in the short term and within their own bounds. We have a much bigger goal. We're in the education field, and most of our customers only think in terms of getting test scores higher for their dumb students that don't know English since they're from Mexico. Instead, we try to measure differential learning. Teachers are measured on averages so they tend to just want to only teach to the bottom of the students since that is the best way to increase the average.

    1. Re: More evidence good product people... by Anonymous Coward · · Score: 0

      They're preparing for the test so you can't blame them for their hatred of STEM.

  10. Please validate me by Anonymous Coward · · Score: 0

    On first blush, seems like this principle can be applied to teaching kids how to take tests instead of teaching critical thought and problem solving.

  11. Since every target is a measure... by Anonymous Coward · · Score: 0

    ... how then do we have targets at all?

    1. Re: Since every target is a measure... by Anonymous Coward · · Score: 0

      By having REAL measures, not fake feely spam.

  12. Goodhart's law GDP by Anonymous Coward · · Score: 0

    Sounds like it would apply admirably to both GDP and CPI, given that the Fed is targeting them.

  13. Overblown story, in my view by shilly · · Score: 4, Insightful

    It's no surprise to know that targets can be gamed, and that performance metrics can be poorly implemented. But this is a false dichotomy: the choice is not between poorly implemented metrics/targets and no metrics/targets. There's also the option of implementing metrics/targets well. Not perfectly: what is, in this life? But certainly possible to implement them well -- and it would be damaging for the organisation not to do so. And if the behaviours and mindsets of the organisation are broken in the first place, then an absence of metrics/targets can be just as disastrous as poorly implemented metrics/targets -- and what's really needed is effort to work on the underlying issues.

    1. Re:Overblown story, in my view by npslider · · Score: 1

      There must be better ways to determine how well employees or departments are doing other than surveys. I see a survey and my mind thinks... "Circle all the 5's and get it over with". Unless, I have a real gripe with the service I received or too much time on my hands.

      Maybe hidden cameras in every room or undercover bosses posing as customers... oh wait, that's been done already!

    2. Re:Overblown story, in my view by Carewolf · · Score: 1

      It's no surprise to know that targets can be gamed, and that performance metrics can be poorly implemented. But this is a false dichotomy: the choice is not between poorly implemented metrics/targets and no metrics/targets. There's also the option of implementing metrics/targets well. Not perfectly: what is, in this life? But certainly possible to implement them well -- and it would be damaging for the organisation not to do so. And if the behaviours and mindsets of the organisation are broken in the first place, then an absence of metrics/targets can be just as disastrous as poorly implemented metrics/targets -- and what's really needed is effort to work on the underlying issues.

      The metrics are fine. The problem are only if you set specific measurements as targets that issues arrise. You can't get meaningful data if you demand the data to fall in a specific way.

    3. Re:Overblown story, in my view by Anonymous Coward · · Score: 0

      Furthermore, it is in practice usually impossible to actually improve something you don't measure.
      People will say it's improved, maybe even think it's improved, but half a year down the line you look back and see you're in exactly the same shit as half a year ago.

  14. Re:Please take the time to provide some feedback.. by The-Ixian · · Score: 2

    I don't generally fill out surveys. When I do, though, I am as honest as they let me be. Sometimes, the pre-provided answers don't conform to my true feelings or are not applicable.

    I prefer the freeform surveys where I can state exactly what I like and don't like.

    --
    My eyes reflect the stars and a smile lights up my face.
  15. The only way to win is not to play... by sconeu · · Score: 2

    I follow Joshua's advice and rarely, if ever, fill out the "customer feedback survey".

    --
    General Relativity: Space-time tells matter where to go; Matter tells space-time what shape to be.
    1. Re:The only way to win is not to play... by Anonymous Coward · · Score: 0

      I'll fill out some stuff if there is some sort of carrot dangled, but any resemblance between my responses and my actual feelings is usually accidental.

      "Sure I'd love a shiny prize, what answers would you like to hear?"

    2. Re:The only way to win is not to play... by houghi · · Score: 1

      So what was the advice Dr. Falkens dead kid gave you?

      --
      Don't fight for your country, if your country does not fight for you.
  16. Yeah, well, that's the point by H3lldr0p · · Score: 2

    It's supposed to demoralize the front-line people. It's supposed to make them hate every second with the customers. This isn't a big revelation. It's applied psychology being used for anti-social ends.

    The ends which state that time is money.

    For every second you're not selling, you're costing someone money. For every second you're not adding value to that sale, you're costing someone money. For every second you're spending getting to know that other human, you're wasting someone else's money. That's how retail works now. How's it's been working for the past 15 years or so when those got first introduced. It was never about getting someone to better themselves. It was always about manipulation.

    1. Re:Yeah, well, that's the point by whoever57 · · Score: 1

      It's applied psychology being used for anti-social ends.
      The ends which state that time is money.

      Then it's counter-productive because, in my experience, two things happen:

      1. Customer service person wastes time begging for good reviews.
      2. Customers hate the business because of their wasted time and the embarrassment of being the recipient of the begging.

      --
      The real "Libtards" are the Libertarians!
  17. Re:Please take the time to provide some feedback.. by ShanghaiBill · · Score: 1

    I am as honest as they let me be.

    You are a horrible person. Do you realize that by rating a good, but not fantastic, interaction as only 4/5, you are jeopardizing someone's career?

  18. Re:Please take the time to provide some feedback.. by npslider · · Score: 1

    Does that mean 5% less ads on the page?

    Hummmm... no deal!

  19. Re:Please take the time to provide some feedback.. by npslider · · Score: 1

    Just rate them double-plus good! Then both you and their big brother will be non-sad happy!

  20. "That point is when the ratings become targets" by fred911 · · Score: 0

    Or when a company (Uber) forces a rating on a previous transaction (Uber) before allowing additional transactions (Uber). It's especially
    annoying when you're in a bandwidth challenged location and all you want to do is use the service without being forced (Uber).

        It's invasive and a waste of bandwidth and time(Uber).

    --
    09 F9 11 02 9D 74 E3 5B - D8 41 56 C5 63 56 88 C0 45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
  21. Re:Please take the time to provide some feedback.. by npslider · · Score: 2

    Will this work for you? ;)

    On a scale of 1 to 10, please rate to the nearest ten-thousandth place, EXACTLY how you felt about your service today:

    1. Your Service reps handshake: 7.67565
    The reps hand placement was not in perfect alignment with mine, and I detected a slight amount of clamminess on the skin...

    2. The quality of the tires you received: 3.14159
    The tires were very round, but the font face of the sidewall was less than ideal for viewing at high speeds.

  22. Re:Please take the time to provide some feedback.. by kimvette · · Score: 1

    *fewer

    --
    The Christian Right is Neither (Christian nor right). See: Matthew 23, Matthew 25, Ezekiel 16:48-50
  23. Maybe if the workers don't know what the metrics a by raymorris · · Score: 1

    I've put some thought into metrics for programmers / software jobs and have come up with damn little that's useful *if the programmers know what the metrics are*. If management looks at different metrics each month or quarter, and nobody knows ahead of time what they'll be looking at, you might get some semi-useful numbers. The metric doesn't become the goal when you don't know what the metrics is.

    Whenever the people doing the work know what the metric is, and have motivation to increase it, most focus more increasing the metric than doing the job well, in my experience. Obviously *some* jobs can be measured with a simple number, though even most of those fail to capture quality of work, when you just measure quantity. If you have some ideas that you've seen work long term I'd love to hear about it.

    In software programming, my most productive work often involves deleting superfluous and redundant code, and deleting code that's based on assumptions, in order to make it work in more general cases. That makes the code more useful, faster, more maintainable, and most importantly more reliable - it's impossible to have bugs in code that isn't there. Bso anyway that's my *most* productive work, for the time spent. (Deleting is fast.) Some morons have tried to measure programmer productivity by "lines of code added". Well that's exactly wrong. It rates the most productive work as having negative productivity. Other measurements are slightly better in that they don't measure the exact OPPOSITE of what they are supposed to measure, but none I've seen is particularly useful.

  24. Re:Please take the time to provide some feedback.. by Anonymous Coward · · Score: 1

    Pedantry. 0/5

  25. Re:Please take the time to provide some feedback.. by tsqr · · Score: 1

    Precision and clarity. 5/5.

  26. Re:nosedive by Anonymous Coward · · Score: 0

    See, the posers around here like to pretend they watch Black Mirror, but if you post the name of the episode referred to in TFA and quote the last line of the episode, and it doesn't get modded +5 Funny, that's how you know the posers around here don't actually watch Black Mirror.

  27. Re:Please take the time to provide some feedback.. by Anonymous Coward · · Score: 0

    Would you rate this story a second time if we gave you a 5% off coupon?

    How do you rate the dupe?

  28. Re:Please take the time to provide some feedback.. by npslider · · Score: 2

    Thank You for your thoughtful response. Please take 5 minutes and complete a free survey regarding your recent Slashdot posting experience!

    1. On a scale of 1 to 9.99, 10 being the best, how would rate the grammatical content of that post you replied too?
    2. On a scale of noon to midnight how would you rate the timeliness of the post?
    3. On a scale from A to Z, how was the speling?

    For completing this *FRee survey, you get a sticker!

  29. Someone should invent a metaphysics of quality. by Anonymous Coward · · Score: 0

    This comment is neither zen nor about motorcycles.

  30. Re:Please take the time to provide some feedback.. by Anonymous Coward · · Score: 0

    And if the Ehh, good enough doesn't win, I'm firing Slashdot!!

  31. Re:Maybe if the workers don't know what the metric by shilly · · Score: 1

    I dunno. Take a call centre. ASA (average speed of answer) is a common and important metric. Organisations will often have a target or SLA for their ASA, and this is something customers really care about. It's driven by a range of factors: how call centre operatives handle calls, matching of demand and supply, actions to reduce demand such as self-service (eg online) or bots to answer, etc etc. I can't see how a call centre could manage itself effectively without having both an ASA target for the centre as a whole and for individual operators.

    Or in another field: mortality rates for surgeons. Distinguishing case-mix and other effects from surgical competence effects is very very hard -- but that doesn't mean we can afford to stop trying, or stop looking at these numbers.

  32. And Yet by Anonymous Coward · · Score: 0

    According to Bob Lewis, every measure becomes a target.

    Seriously, the mere act of measuring something sends a message: "This Is Important. If you want to Look Good and Get Ahead, make the numbers better. Every quarter."

    http://issurvivor.com/

    Which led to the Bob Lewis Metric Corollary: Be Careful What You Measure

    The numbers will move and get better, as sure as the night follows the day. It won't matter what it takes to move those number either, just know that the numbers will move. To make the people responsible for them look better.

  33. Okay, so let's flip that... by Actually,+I+do+RTFA · · Score: 1

    How do I get honest feedback? I mean, I'm actively developing software, and adding new features. I would love to be told "most of your customers want X before Y" (or most of your on-the-fence non-customers). That seems to be a win-win for everyone (except those minority who want Y, but that would be true of any system that accurately measured).

    --
    Your ad here. Ask me how!
    1. Re:Okay, so let's flip that... by rtb61 · · Score: 1

      Want honest feed back, pay for it, the free ride is over. Blame no one but the abusive corporations, all good will dead, due to endless false marketing, bad customer support and services and failing products. Why should consumers serve companies who do not serve them, suck it up or get rid of the psychopaths in corporations.

      --
      Chaos - everything, everywhere, everywhen
    2. Re:Okay, so let's flip that... by Actually,+I+do+RTFA · · Score: 1

      Yeah, most of my work is at small shops. They cannot afford to pay for that level of market research in an ongoing manner. I'm not saying "help AT&T whittle its cell service to the minimum allowable". I'm talking about "you've downbloaded a $0.99 app, what should we do next."

      Hell, OSS has the smae problem, only witht eh added rub that most developers are doing it on their spare time, so they are going to work on whatever interests them.

      --
      Your ad here. Ask me how!
    3. Re:Okay, so let's flip that... by Marxist+Hacker+42 · · Score: 1

      Do a Survey Monkey instead. Use a ranking question with planned features.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    4. Re:Okay, so let's flip that... by Actually,+I+do+RTFA · · Score: 1

      Just to be clear, you're suggesting that instead of asking for feedback in app, that I link to an external website? Or that I contact people via alternate means (e.g. email) when they are not using my product?

      That may make sense, I'm just trying to imagine how I would respond. Or is there a better way you can explain the user experience.

      As a side note, I've used Survey Monkey before to do similarish things, but only with internal users where they're use was mandatory (hey, that wasn't my rule).

      --
      Your ad here. Ask me how!
    5. Re:Okay, so let's flip that... by Marxist+Hacker+42 · · Score: 1

      It's easier to use the external tool, however you contact your users, than to include it in the app itself. You may still run into a bit of confirmation bias, but by limiting the choices you also limit that.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
  34. Re: "That point is when the ratings become targets by Anonymous Coward · · Score: 0

    That is when you bring up the Lyft app or even call a yellow cab. It is not like they are a monopoly.
    Now if the rating is a simple "Would you ride with this driver again?" yes/no question you are complaining about nothing. I'll give you the benefit of assuming it is at least a 5 star style rating.

    Customer feedback surveys are a chance to give some easy feedback if someone drops the ball or goes above & beyond. Beyond that I don't bother with one exception; I'll provide someone their first feedback so later customers have something to start from (ebay, gunbroker and the like)

  35. Don't treat people who are very sick (opposite int by raymorris · · Score: 1

    > Or in another field: mortality rates for surgeons.

    So the most reliable, and most obvious way for a doctor to increase their rating is to try to avoid treating patients the who are in poor health - exactly the opposite of what we want doctors to do. A doctor who aims to reduce their mortality rate should if spend their time with althletes and college students, maybe handing out steroids and stimulants. Again, if the doctor doesn't *know* anyone is looking at the mortality rate of patients, it can be a very crude but marginally useful number. As soon as you tie doctor pay to mortality rates, you're paying them to avoid sick people.

  36. Re:Maybe if the workers don't know what the metric by LunaticTippy · · Score: 1

    I worked somewhere that metricked lines of code. Our "top coder" put all arguments on their own line, added lots of blank or stupid comments and did everything the hard verbose way. Had to look at that shit for years afterward.

    --
    Man, you really need that seminar!
  37. A major company? So I can avoid them by raymorris · · Score: 1

    I don't suppose that place managed to become, and remain, a large company, given their idiocy? Of so I'd love to know the name, so I can avoid them. I wouldn't want to bother interviewing there, and it would probably be best to avoid buying their products if their coders are rewarded for creating the biggest pile of garbage.

    1. Re:A major company? So I can avoid them by LunaticTippy · · Score: 1

      They deservedly went belly up during the dotcom crash. I had left by that point and learned new depths of schadenfreude hearing about their fate.

      --
      Man, you really need that seminar!
  38. Perfect scores expected by Anonymous Coward · · Score: 0

    This is exactly why I quit filling out customer surveys -- because I was using the whole range of 1-10, then later I learned that every one of them expects perfect scores on every line item, so their scale is actually 9-10 with 9 being unacceptable and 10 being acceptable. It's a joke and not a funny one to the poor employees on the receiving end of this corporate BS.

  39. Re: Please take the time to provide some feedback. by Anonymous Coward · · Score: 0

    Slashdot was fired long ago but a glitch kept him on payroll. Nobody told him but we fixed the glitch. It should work itself out eventually.

  40. Tell a manager in person by myid · · Score: 3, Insightful

    If you want to reward someone for doing a good job, you can tell a manager (look for someone walking around the store who looks like a manager), or go to the store's "Customer Service" department, and tell them. Be specific as to how that person was helpful.

    Once in a busy pre-Christmas shopping season, a store employee went out of his way to help me. I told a manager, who was walking around the store, how much that employee had helped me. About 1/2 later, the employee rushed up to me all happy. He thanked me for telling the manager how helpful he had been. He said that because of what I'd said, he'd gotten a star (whatever that is) and a bonus.

  41. Selection bias by nine-times · · Score: 3, Insightful

    I think it's also important to consider that satisfaction surveys tend to suffer from a sort of selection bias. You're only getting feedback from people who feel compelled to give feedback. In my personal experience you'll get:

    - Sometimes people who are angry
    - Occasional people who are extremely pleased
    - Often people who have excessive esteem of their own opinions**
    - Rarely people who just want to give helpful feedback

    I'm not pointing this out to necessarily disparage these groups or say that their opinions aren't valid, but it's important to understand you're unlikely to get a true random sampling.

    **I know someone is going to take issue with my third item, "people who have excessive esteem of their own opinions", so I'll try to explain what I mean by that. Obviously people's opinions are important, or you wouldn't be asking for feedback. And yes, everyone values their opinions more than others'. However, there are some people who... you read their online review, and you can tell that they believe their review will impress everyone and settle all disputes. Like you'll read a negative Yelp review, and the reviewer isn't just saying, "I had an bad experience," or "I didn't like it," but something more like, "This place is simply objectively terrible and though I see other people saying that they like the place, they're all wrong and stupid and not worth listening to." You can almost imagine that they've finished writing the review, leaned back in their chair, and thought, "Well that waiter crossed the wrong person. I expect they'll go out of business any day now."

    So my

    1. Re:Selection bias by Keith_Beef · · Score: 1

      I think it's also important to consider that satisfaction surveys tend to suffer from a sort of selection bias. You're only getting feedback from people who feel compelled to give feedback.

      I worked for a big, big global company for a number of years. IT was run from call centres around the world, so that anybody working anywhere would always find somebody in a convenient timezone to work on the problem for at least a few hours, even if the ticket was submitted at the end of the business day for the person with the problem.

      And if the IT people fixed the problem quickly, there was always a request to complete a satisfaction survey.

      Curiously, if they didn't fix the problem quickly, there was no such request.

      This kind of situation is not limited to customer surveys, it applies to all manner of Key Performance Metrics and other measurements.

      Where I live right now, there is a straight section of road through a residential area.

      There were complaints to the town police about cars being driven at excessive speeds, and requests for traffic calming measures. The town opposed the expenditure.

      To prove that the measures were not necessary, a few police officers were given the task of measuring average speeds along the road. Of course, being deployed along a public road they had be be safe, so they wore high-visibility jackets at they pointed radar speed-detection guns at oncoming vehicles. And guess what? Not a single vehicle exceeded the limit during the operation. Ergo, no need to install expensive traffic calming measures.

  42. Another Reason Not To Trust These Surveys by Somebody+Is+Using+My · · Score: 2

    I also once read that customer satisfaction surveys are, in general, only answered by people who were on the extreme ends of the customer satisfaction ratings; that is, most of the time the only people who bother with a survey are those who had a really awesome or a really bad experience. The experience left them emotionally charged, and they feel the need to share/vent, and the survey gives them that opportunity. The average customer, on the other hand, doesn't have this emotional need and so - when offered an opportunity to rate their experience, gives the whole thing a pass and - if forced into it - tend to give wishy-washy middle-of-the-road answers (e.g., all 5 out of 10s) just so they don't have to think about it.

    I imagine it is also easier to be on the receiving end of a "terrible experience" than an awesome one too, which only further biases the reviews. I mean, as a customer I can imagine a dozen ways in which a cashier could piss me off, but have a hard time thinking up a way that cashier could make me EXCITED about paying for my groceries). So the end result is very biased against the person getting reviewed, because most of the people who bother to respond to the reviews are those who had a bad experience. If they forced /all/ customers to take the survey and somehow ensured their honesty, you might get a better overview of how the employee is performing, but by leaving it up to the customer the employer is getting a very unbalanced response.

    Not to mention I never know how to answer those because I never know what is considered "average". Is a 5/10 average or do I have to base it on the US grading system, where 7/10 is "average"?

    1. Re:Another Reason Not To Trust These Surveys by Anonymous Coward · · Score: 0

      I've had to point this out many times to somewhere I work part-time at: they gauge team performance on reviews on TripAdvisor. Generally, the reviews are either "Yay! Best experience of my life!" or "I hated everything", no middle ground. The reviews also make up a tiny fraction of the number of customers who visit every day. I pointed out that people are more likely to register a complaint than praise, partly because good service is usually expected - it's the assumed default experience.

      I also get annoyed with things like "didn't meet / met / exceeded expectation". Different people are going to go in with different expectations. Someone dragged along reluctantly might not be expecting much, so anything is going to exceed expectations. Someone who has massively hyped up the experience in advance might come away disappointed with what someone else might think was "Yay, best experience of my life!".

      The same company also has a staff appraisal rating from 1 to 5. Anyone with a rating of 1-2 shouldn't be working there as they're no good. 5 is considered an impossible target as there's no such thing as a perfect employee. 4 is considered really good, but there's no incentive to improve. So everyone with a job gets 3: meets their role's requirements but needs to improve.

    2. Re:Another Reason Not To Trust These Surveys by Attila+Dimedici · · Score: 1

      Well, I have dealt with several companies which have apparently decided to fix the problem with people not responding to surveys by repeatedly emailing me to piss me off enough to respond to the survey. I usually put in the comments, "I have no idea what the issue was that this ticket was about any more, nor do I remember what the service was like, but you badgered me with emails to fill out this survey often enough to make me angry."

      --
      The truth is that all men having power ought to be mistrusted. James Madison
    3. Re:Another Reason Not To Trust These Surveys by Somebody+Is+Using+My · · Score: 2

      The same company also has a staff appraisal rating from 1 to 5. Anyone with a rating of 1-2 shouldn't be working there as they're no good. 5 is considered an impossible target as there's no such thing as a perfect employee. 4 is considered really good, but there's no incentive to improve. So everyone with a job gets 3: meets their role's requirements but needs to improve.

      I had a similar experience, except the reasoning behind it was more blatantly self-serving. Raises were tied to your rating, with "5"s getting a raise (although it was barely a cost-of-living increase), "4"s getting to keep their jobs but no raise, "3"s getting warnings and "1-2s" were basically "we're looking for your replacement". I was specifically instructed numerous times not to give any employees any "5"s, because that would cost the company money; only give the very best employees a "4" (to show we "appreciated" them), give everybody else a "3" (to put the fear of unemployment into them so they would work harder), and was required to give out a few "1-2"s, because new employees tend to be cheaper.

      I said fuck that, gave my best direct reports "5"s and most of the "4"s rest (it was a great group), got chewed out for it, successfully fought for the "5"s, lost out on the "4"s, and generally got reamed for not playing ball. I left the company shortly thereafter and later learned that my reviews were "re-done" by my replacement, and they got "4"s instead (a year later, the division was closed down and shipped to India). Yeah, it was that sort of place.

      I have no doubt customer satisfaction surveys are treated similarly, where they are ignored if they don't meet the expected narrative of the executives. They are pointless and probably mostly used to prove the employee is in the wrong rather than truly encourage and reward good service.

  43. Re:nosedive by Darinbob · · Score: 1

    You need to approve my cute kitten videos before I mod your stuff.

  44. Re: Please take the time to provide some feedback. by Anonymous Coward · · Score: 0

    Although the party is working on it, the word "sad" is not part of the current edition of newspeak.

  45. Wish I'd known about this sooner by buss_error · · Score: 1

    I do third to final tier support. My ratings from customers and lower tier support is abysmal because most of the time, I have to say "Nope! Can'tWon't do that." Lost a promotion because of the score as well, so it cost me around $15K.

    My favorite rant from someone that said I was "stupid" because I can't configure a F5 to act as a master/master SMB share. Oh, I could get them something like SMB with HA, but not for the incremental price (about $4 a month) they were looking for.

    I am actively seeking other employment, for several reasons. The biggest is the 24x7x365 insistence of being on call and less than 5 minutes from being able to spring into action and fixing things. Hell, I can't go to the store and buy skittles without breaking that SLA. If they want a 24 hour support staff, they can damned well hire to staff for 3 shifts.

    --
    Necessity is the plea for every infringement of human freedom. It is the argument of tyrants; it is the creed of slaves.
    1. Re: Wish I'd known about this sooner by Anonymous Coward · · Score: 0

      If you are on 24/7 you are either not 3rd tier support or youre a moron for accepting such shit. Call your union.

    2. Re:Wish I'd known about this sooner by Anonymous Coward · · Score: 0

      [AC for a reason]

      One place I worked, the bosses had to give their underlings a rating from 1-5. One guy got a 3, because, well, he was okay, but not brilliant, so 3 seems like a reasonable outcome. Some C-level PHB decides "anyone with 3 or less gets no bonus this year", so this guys gets no bonus (bonuses weren't amazing, but paid for a bit of a holiday or some such).

      The next year, our intrepid boss wants to make sure all of his team get a bonus, so rates everyone either a 4 or a 5. All the 5s get 'calibrated' down to 4s by HR (because 'everyone's got something they can work on').

      After all that, we didn't bother with working out ratings any longer. Everyone got a 4, and the journey to the bottom was complete. All because of a seemingly arbitrary, unilateral decision by a PHB who had no clue that all the people that worked for him were smarter than he was.

      Moral of the story: don't ever get fsck'ed over on the money. Ever.

  46. Give'em all a 10 by jimbrooking · · Score: 2

    I don't think these surveys are worth crap. The companies that rely on them to rate employees have HR policies that suck. I usually just ignore the pleas from "anonymous data collectors" about my visit to see my doctor, or the pizza order (really!). When an employee implores me to rate my visit (for which she is being held responsible) highly, in what might be a personalized way, I just rate the "experience" at 10's from start to finish unless they performed some egregious bit of malpractice on me or my car. It's like tossing a fiver into the hat of a street musician. He needs it and it costs nothing to help him out. I'm hoping that after seeing a few of these the companies will stop asking for my meaningless "feedback". Otherwise, I will continue (with little enthusiasm or optimism) to try to improve the quality of life for those who depend on 10's.

  47. EDUCATION: GRADES by bussdriver · · Score: 1

    Natural adaptive human behavior will always have humans finding ways to game systems. Static simple systems can not compete with a dynamic complex human (not just smart, but fools are also ingenious.)

    WellsFargo just had a huge huge problem with their management--- remember? they were nuts about metrics and linked incentives which ended up in a massive fraud that should have people leaving that bank in groves... But if their big part in the housing collapse didn't get their suckers to quit I am not sure what else would.

    1. Re:EDUCATION: GRADES by Anonymous Coward · · Score: 1

      You mean droves. You didn't really think they should be running into the trees.

  48. Re: Please take the time to provide some feedback. by Anonymous Coward · · Score: 0

    Its not our responsible to give power to horrible systems and managers. Grow a pair or move to Africa.

  49. Re:Don't treat people who are very sick (opposite by Anonymous Coward · · Score: 0

    A similar effect is schools trying to get rid of poor students in order to boost their average test scores.

  50. Re: Don't treat people who are very sick (opposite by Anonymous Coward · · Score: 0

    So the measure works and we get rid of some plebs

  51. Re:Don't treat people who are very sick (opposite by Shimbo · · Score: 1

    So the most reliable, and most obvious way for a doctor to increase their rating is to try to avoid treating patients the who are in poor health - exactly the opposite of what we want doctors to do.

    shilly addressed this point in the parent post. Crudely looking at success rates, and over-incentivising them is bad. Not collecting the data because it is liable to misinterpretation is not the solution, however. There are huge benefits in clinical outcomes available by using these metrics sensibly; even some counterintuitive things like closing some regional units - because they saw the trickier cases too rarely to keep their clinical skills up to date.

  52. Rating inflation by KozmoStevnNaut · · Score: 1

    You see it a lot of places other than consumer ratings. For instance, whisky is commonly rated on a 0-100 scale, where 70 or below is considered "shit, not worth buying". Same thing with ratings in game magazines, where 70% is "crap" or "only for really dedicated fans".

    And Ebay reviews. Every single time I buy something from China, I get a bunch of messages thanking me for shopping with them, and expressing an expectation that I will give them a perfect 5-star review, for nothing more than shipping me the item I bought.

    Everything gets skewed to the high end of the range, so effectively you're only using half or even just a third of the actual scale.

    If I had my way, we would all move to a simpler system, a 4-point scale at the very most, with a mandatory paragraph to elaborate on your rating:

    0 stars for absolute shit
    1 star for bad
    2 stars for just OK
    3 stars for good
    4 stars for great

    But unfortunately, that's A) far too simple for the numbers-obsessed sadcases who insist on rating everything on strict numbers, so they can go "but this is 3 more better than that other one" without having to think for themselves, and B) takes too much effort for the lazy fucks who inhabit this world and can't be arsed to write even a single cohesive paragraph about why they like/dislike a certain thing.

    --
    Eat the rich.
    1. Re:Rating inflation by Keith_Beef · · Score: 1

      You might find this appropriate https://xkcd.com/937/

    2. Re:Rating inflation by Attila+Dimedici · · Score: 1

      The current ratings system has made using customer ratings to evaluate products almost useless. You can gain a little bit by reading the comments, but that is about it. It drives me nuts when I am trying to decide if a $50 device is worth it vs the $5 device that lists exactly the exact same functionality (sometimes the price difference is because the more expensive item is prettier, sometimes the price difference is because the more expensive item is more durable...greater durability might be worth that price difference).

      --
      The truth is that all men having power ought to be mistrusted. James Madison
    3. Re:Rating inflation by KozmoStevnNaut · · Score: 1

      On Amazon and similar sites, I find it best to simply ignore the 5-star and 1-star reviews, because they're usually sycophantic for the 5-stars, and pissed off bullshit for the 1-stars.

      The reviews in the middle are much more interesting, since they actually put some kind of effort into choosing a rating.

      --
      Eat the rich.
  53. Re:Please take the time to provide some feedback.. by SharpFang · · Score: 1

    It's hardly a career if 95% performance means losing it. They are better off moving to greener pastures.

    --
    45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
  54. Re:Maybe if the workers don't know what the metric by Attila+Dimedici · · Score: 1

    Whenever the people doing the work know what the metric is, and have motivation to increase it, most focus more increasing the metric than doing the job well, in my experience.

    If increasing the metric does not result in the job being done better, then you have the wrong metric (or, at least, a metric that you should not be using to evaluate the employee. One company I worked for had a phrase they imprinted on certain tools they gave managers, "What does not get measured does not get done."
    Customer satisfaction is a terrible metric for which to hold employees accountable because there are too many variables which the customer facing employee cannot control. I have interacted with a company which gives out these surveys. I always give them poor ratings while emphasizing in my comments that the employees I dealt with went above and beyond to help me, but my experience interacting with customer support for that company had been awful because of the tools company management had given those employees to work with.

    Companies should seek to have high customer satisfaction, but they need to find ways to measure what results in good customer satisfaction and measure their employees against that.

    --
    The truth is that all men having power ought to be mistrusted. James Madison
  55. Goodhart's law by Lord+Kano · · Score: 1

    I think that we all instinctively understand this but this is the first time I have seen it codified in such a way.

    I have noticed how some people use what car someone drives or the cost of someone's home as an indicator of their financial status but then there are people who will buy outrageously expensive cars while they live with their parents or people who buy expensive houses but don't have the financial means to buy enough food.

    LK

    --
    "Hi. This is my friend, Jack Shit, and you don't know him." - Lord Kano
  56. Re:Please take the time to provide some feedback.. by Anonymous Coward · · Score: 0

    Nope. Whoever is reading the surveys and taking the numbers seriously, is the person who is jeopardizing careers. (Not that anyone should care about the "career" of a salesperson. Where I work, sales is just where many people mere started, to get their foot in the door, before they changed jobs to something completely different. I didn't, but it seems like damn near everyone else did that.)

    And that same incompetent manager is also jeopardizing the business, since they are measuring something other than revenue (well, really: profit) as being what's important. Sounds like the same kind of mentality that is happy to tell a hundred paying customers to go away, in order to delay a pirate by 45 seconds.

  57. Re:Please take the time to provide some feedback.. by Anonymous Coward · · Score: 0

    >I prefer the freeform surveys where I can state exactly what I like and don't like.
    Yeah, we don't actually give a fuck what the customer likes, we just want a pile of automated metrics that make it easy to declare underperformance. Easy to raise turnover, easy to deny requests, easy to keep pay down, easy to fire someone.

    Read shit? That takes effort. We'll just assume a single number is not merely representative, but gospel.

  58. Re:Don't treat people who are very sick (opposite by shilly · · Score: 1

    It would really help if you looked up terms you're unfamiliar with, such as casemix. It would have saved you the bother of typing all that.

  59. Re:Don't treat people who are very sick (opposite by shilly · · Score: 1

    Thank you for that. Glad that someone else here knows this stuff.

  60. surveys by Anonymous Coward · · Score: 0

    i went to dave and busters recently with friends. we went to the bar for a drink. the bartender said they where doing an online survey and it if we filled it out with 5 starts he would set our cards to get free games for all games that didn't produce tickets. so we all filled it out. it came time to pay for the drinks and the bar tender gave it to use for free since we helped him out with the survey. the business lost hundreds of dollars just from my small group that night between games and drinks. i'm sure the bar tender gave away a ton of free stuff to others too. but when management looks at his metrics they will see he is doing fantastic, maybe the best performing bar tender in the place.

  61. Re:Don't treat people who are very sick (opposite by Anonymous Coward · · Score: 0

    This problem has already been solved by sports bodies that judge things like diving or gymnastics. The score is adjusted based on the difficulty, so everybody doesn't just go for the easiest routine just to get better scores.

    For surgeons, you'd adjust the success rate based on the expected success rate. So if a moribund patient dies, it doesn't negatively affect the success rate nearly as much as if a healthy patient dies.

    Of course, maybe you would want to compare life expectancy with and without the surgery to determine whether a surgery is a success.

    dom

  62. Teaching to the test by MisterFnortner · · Score: 1

    This phenomenon is a corollary of teaching to the test, where teachers and schools are criticized for only teaching things that will appear on a standardized test. Of course, this is nonsense. If a topic is important enough to be taught, it is also important enough to be (with non-trivial probability) on the test. Or said differently, if it's not important enough to be on the test, why are you teaching it? In reality, if it's important enough to be on the test, it should be taught. Therefore, all teachers should teach to a test that contains questions about all relevant topics. Likewise, customer rating subjects should reflect actual performance criteria. If it's not on the customer satisfaction survey, it is not important on the job, and vice versa. The problem here is actually that the scoring scheme is bizarre and unknown to the test taker/satisfaction survey taker. There is nothing wrong with a well-formed satisfaction survey. The giant fault is with the scoring system and how it is used. Don't throw out the baby and keep the bath water.

  63. Coren22 you're a lying punk proof inside by Anonymous Coward · · Score: 0

    "Apk doesn't think DNS servers are worth running & believes Microsoft Active Directory can run w/out DNS." - by Coren22 (1625475) on Tuesday October 27, 2015

    Prove your quoted words above Coren22: Where'd I say it? Show us. I say AD needs internal DNS far back as 2007 http://forums.tweaktown.com/windows/25596-how-secure-windows-2000-xp-server-2003-vista-fully-per-cis-tool-scoring-3.html?s=0ae07d5b5389e06fd6bcfd05bc2d2cc0/

    See "To warn users who have ActiveDirectory/AD LAN-WAN setups to NOT use external DNS servers" there on OpenDNS free (I use it) + AD in my security guide.

    APK

    P.S.=> Whose mistake is that Coren22? YOURS, lol (again) along with https://slashdot.org/comments.pl?sid=10141067&cid=53725817/ idiot (I've got TONS more too)... apk

  64. Sounds like refactoring mostly (easy), &? by Anonymous Coward · · Score: 0

    See subject raymorris: Big F'ing deal & easy (bigtime) + I'd like to ask you a question & point out some things about it where it backfires too in 2 points (though usually I am all for it, for easier maintenance, but it IS easy shit):

    1.) Do you know what loop unrolling is & WHY it's done? Inlined code, though harder to maintain, has speed benefits (it's what compilers do for the most part) plus efficiency (NO FUNCTION CALL OVERHEADS).

    +

    2.) A time refactoring (taking repetitive code & centralizing it into a called procedure, saving lines & easing maintenance) backfires, is when you have a SECURITY oriented set of code in EACH proc/function you fire.

    E.G. - sizechecks (or CRC etc.) on procs so your prog can't be infected by traditional .exe attaching @ tail end of program to alter jump tables.

    I.E.-> You centralize it to 1 called function/proc? The interloper only has to TAKE OUT 1 spot (vs. potentially tons of them) which is MUCH easier than step-tracing thru a code dump to find them all.

    APK

    P.S.=> It works & that's why it can be GOOD to leave it alone (yes, it's breakable, most anything is) but like ASRL? It makes it MUCH harder on the hacker/cracker + yes, inlined code IS faster with NO function call overhead too... apk

    1. Re:Sounds like refactoring mostly (easy), &? by raymorris · · Score: 1

      I find it interesting - it seems you're not so stupid, just supremely full pf yourself and perhaps you need to take your meds.

  65. Ps - the defender has to get it *all* correct by raymorris · · Score: 1

    Ps, the point you've missed is that the defender has to remove *all* of the vulnerabilities, the attacker only has to find *one*. Duplicate code and other forms of poor maintainability mean that the defender is more likely to overlook something in one copy, peer review can't be as as thorough in the allotted time, etc.

    This is a very secure program (except in older versions of PHP):
    print 'Hello World';

    The defender can readily understand the potential behaviors of the program. Greater complexity means greater risk.

  66. Been coding since 1982 raymorris = why by Anonymous Coward · · Score: 0

    Professionally 1994-2008 & retired doing wares that use the technique ala APK Hosts File Engine 9.0++ SR-5 32/64-bit https://www.google.com/search?hl=en&source=hp&biw=&bih=&q=%22APK+Hosts+File+Engine%22+and+%22start64%22&btnG=Google+Search&gbv=1/ 4 fun & doing the right thing for others!

    & it's done well by /.ers estimations https://it.slashdot.org/comments.pl?sid=10172213&cid=53775597/ & https://it.slashdot.org/comments.pl?sid=10172213&cid=53775689/ + malwarebytes' (highly esteemed) hpHosts hosting & recommending it.

    Hassle in it? Sizecheck changes .exe size each time you add it to a proc/function (must redo check thru 100's of them = not fun but worth it - virus proof).

    APK

    P.S.=> Bulletproof & bugfree + safe https://www.virustotal.com/en/file/e01211ca36aa02e923f20adee0a3c4f5d5187dc65bdf1c997b3da3c2b0745425/analysis/1433430542/ (Verified by Malwarebytes' S. Burn "it's safe" http://forum.hosts-file.net/vi... )... apk

    1. Re:Been coding since 1982 raymorris = why by raymorris · · Score: 1

      That's interesting.

      I hope this doesn't come across as negative, but today your posts are even better than they normally are. More clear and focused. If you've been doing something differently lately, you might want to keep doing it.

  67. Not when my prog's literally virus-proof by Anonymous Coward · · Score: 0

    See my subject: It works ray, mostly for that & also vs. disassembler hacker/crackers too - Combined w/ exe compression?

    To quote TERMINATOR's Reese, Sgt. TechCom DN38416 "Assigned to protect you - you've been targetted for termination"??

    It's "It's a HYPER-ALLOW COMBAT CHASSIC - Microprocessor controlled: Fully armored, VERY tough" (per the above & more, below)

    WHY?

    "That terminator, is out there - it can't be reasoned with, it can't be bargained with - it doesn't feel pity, or remorse, or fear & it absolutely WILL NOT STOP, ever (until YOU are DEAD!")

    * Why'd you reply to yourself for?

    (Only 'bitch' I ever saw was stupid & I overturned it vs. 10 antivirus programs on exe compression - they flag that in many of them automatically as a 'virus'... so much for 'experts')

    APK

    P.S.=> Does other neat things like keeping exe size & memory occupancy low, offsetting added code for sizechecks built-in antivirus protection in my program (string vs. shortstring (255 char limits on filepath & hostnames = perfect for this) & integer vs. short - BOTH keep it faster on the local stack vs. global heap, register/fastcall procs/functions on workhorses (there's limits, 8 in 32-bit, 16 in 64-bit iirc) - tricks you MIGHT like & use yourself, all of this... apk

  68. It doesn't but on my "terminator" kick? by Anonymous Coward · · Score: 0

    No sleep, not good & had to help a crippled tenant move out today (good tenant for 1 yr. & I promised I would) so... there you go & per my subject + my other reply to you here https://slashdot.org/comments.pl?sid=10168471&cid=53784671/

    * We're fighting the SAME fight I figure so, here goes again:

    "They lived only to face a new nightmare: The WAR against the MACHINES..." ... & a little "visual ambiance" to go w/ this one this time (enjoy)-> https://www.youtube.com/watch?v=ih_l0vBISOE/

    LOL!

    APK

    P.S.=> You must be thinking about the dorks that impersonate me around here constantly (they do, nigh constantly)... apk