Slashdot Mirror


Why Hiring the 'Best' People Produces the Least Creative Results (qz.com)

An anonymous reader shares an excerpt from a report written by Scott E. Page, who explains why hiring the "best" people produces the least creative results: The burgeoning of teams -- most academic research is now done in teams, as is most investing and even most songwriting (at least for the good songs) -- tracks the growing complexity of our world. We used to build roads from A to B. Now we construct transportation infrastructure with environmental, social, economic, and political impacts. The complexity of modern problems often precludes any one person from fully understanding them. The multidimensional or layered character of complex problems also undermines the principle of meritocracy: The idea that the "best person" should be hired. There is no best person. When putting together an oncological research team, a biotech company such as Gilead or Genentech would not construct a multiple-choice test and hire the top scorers, or hire people whose resumes score highest according to some performance criteria. Instead, they would seek diversity. They would build a team of people who bring diverse knowledge bases, tools and analytic skills. That team would more likely than not include mathematicians (though not logicians such as Griffeath). And the mathematicians would likely study dynamical systems and differential equations.

Believers in a meritocracy might grant that teams ought to be diverse but then argue that meritocratic principles should apply within each category. Thus the team should consist of the "best" mathematicians, the "best" oncologists, and the "best" biostatisticians from within the pool. That position suffers from a similar flaw. Even with a knowledge domain, no test or criteria applied to individuals will produce the best team. Each of these domains possesses such depth and breadth, that no test can exist. When building a forest, you do not select the best trees as they tend to make similar classifications. You want diversity. Programmers achieve that diversity by training each tree on different data, a technique known as bagging. They also boost the forest 'cognitively' by training trees on the hardest cases -- those that the current forest gets wrong. This ensures even more diversity and accurate forests.

12 of 333 comments (clear)

  1. The headline is garbage by phantomfive · · Score: 5, Insightful

    The headline is garbage, but there is some truth in the waterfall of words in that summary: we have become a nation of specialists. Not only are we specialists, but the amount to which we've specialized is actually quite stunning.

    --
    "First they came for the slanderers and i said nothing."
    1. Re:The headline is garbage by ShanghaiBill · · Score: 5, Insightful

      The headline is garbage

      Indeed. TFA is pure conjecture. It provides no actual evidence that hiring worse people leads to better or more creative results.

    2. Re:The headline is garbage by Kjella · · Score: 5, Insightful

      The headline is garbage, but there is some truth in the waterfall of words in that summary: we have become a nation of specialists. Not only are we specialists, but the amount to which we've specialized is actually quite stunning.

      I'm not against the idea that a project might need many different competencies and functions. What I am against is the idea that we'll have better solutions if we put it to a popular vote. Because that's my usual experience with "diverse teams that aren't necessarily very bright", to rephrase the argument. Competent people usually know what they know and don't know. Incompetent people go through life like a bull in a china store, they don't mean to break things but they leave disaster in their wake. I've been through that at work, the only reason my part of the system is working is that I've ignored 90% of the "input". Everything else is so buggy and crappy they're considering a rewrite before 1.0 is delivered. Meritocracy is fine, mediocracy is terrible. YMMV.

      --
      Live today, because you never know what tomorrow brings
    3. Re:The headline is garbage by alvinrod · · Score: 5, Insightful

      Probably because most of the people clamoring for diversity today don't go much further than skin deep in terms of what they mean by diversity. I think those people are absolutely foolish though, as if what they believed (diversity of skin color or gender being important for its own sake) were true , it would essentially mean that racial and gender groups are inherently different (or else how would the results of hiring these people be any better or worse), which is something those same people try to argue against.

      However, I don't think that this article is making that case at all. The central point seems to be that whatever test you think you have to determine who the best candidates are is likely to be flawed in some way as to produce a monoculture that is likely to be missing something useful in producing better solutions or outcomes regardless of endeavor.

      I think some people are probably getting another wrong impression in that they believe the author is suggesting that companies hire mediocre individuals or something along those lines, but I don't get that impression either. I think it's more along the lines of making sure to hire some people with a different set of skills and tools. This is because if your hiring process filters in some biased manner, you've likely got a team that's missing some skills or tools and the people you do have are not going to magically discover or invent them on their own. Imagine a group full of people with hammers that are trying to pound in a screw when there's a better way that may not be obvious to them because no one ever showed them a screw driver. This isn't because they're not intelligent or only good with hammers, but because there's more to know in this world than anyone could possibly hope to learn in one hundred lifetimes.

    4. Re:The headline is garbage by LostMyBeaver · · Score: 5, Interesting

      From the headline, I expected conjecture. Then I clicked the article and it struck me as a rant.

      When someone writes an article like this, they should include facts or at least legitimate testable theories. This was more like a one man jam session to listen to his own voice.

      Oh... and what he considered genius with regards to mapping the space between the cars... utter crap. The problem with mathematicians is that they focus on optimization in the worst possible places. If they took a course on algorithms or at least studied graph theory, they would understand that you can model the cars and the space and derive what's not that. In addition, Modelling traffic jams in government sponsored research cannot be done because it requires a great deal of algorithmic data which is highly sensitive. For example, a person driving in direction X in a vehicle of type Y at time Z will close gaps between vehicles(50% chance), block people from merging ahead towards the bottleneck (75% chance), play music rich in bass loud enough to rattle nearby cars (90%). The result of this is that the neighboring cars will behave more aggressively. Seniors will be disturbed but submissive. Middle aged white men who drive larger or sportier vehicles will become extremely aggressive. Etc...

      I've been writing traffic modelling software for decades because I find it entertaining and relaxing. I would then occasionally move a few traffic cones in the morning and traffic would flow nicely both ways... until someone realized the cone shouldn't be there. The #1 factor I considered at all times was how does the behavior of one type of person impact the behavior of those around them. So, I'd place cones in places that would force people to do the right thing as opposed to permitting and therefore encouraging opportunism.

  2. But where are the diversity success stories? by DoctorBonzo · · Score: 4, Insightful

    Well, we all want diversity, don't we?

    But it seems evidence in favor is lacking.

    Shouldn't there be numerous success stories, even anecdotal, if it's really all that favorable?

    1. Re:But where are the diversity success stories? by fahrbot-bot · · Score: 4, Funny

      What you'll find is failure stories where a non-diverse team failed to notice something blindingly obvious.

      Been watching CSPAN again, I see. :-)

      --
      It must have been something you assimilated. . . .
  3. What a diverse team means to me by elrous0 · · Score: 5, Insightful

    Me doing all the work, and a bunch of other people sitting on their asses.

    --
    SJW: Someone who has run out of real oppression, and has to fake it.
    1. Re:What a diverse team means to me by fahrbot-bot · · Score: 4, Funny

      Me doing all the work, and a bunch of other people sitting on their asses.

      Hey, if it saves me from eventually having to redo all their crappy work, I'm all for it.

      --
      It must have been something you assimilated. . . .
    2. Re:What a diverse team means to me by fahrbot-bot · · Score: 4, Interesting

      Every time I hear a professor, boss, etc. start talking "team assignment," I know its just a polite way of having the strong students/employees carry the weak ones. Instead of some people getting A's and some getting F's, everyone gets a C. Kurt Vonnegut would be proud.

      Anecdotal, but I will note that the team project in my systems programming class (in 1985) to write a linking loader was made easier by the fact that I knew C very well and the retired Navy guy, who wasn't as strong a programmer, could do octal and hex math in his head. (We both got A's.)

      --
      It must have been something you assimilated. . . .
  4. Because "the best people" do NOT change paradigms by shanen · · Score: 4, Insightful

    Real innovation involves changing paradigms, and every definition of "best people" is based on the mastery of those people based on existing paradigms. There is only a partial exemption for people who become famous for creating new paradigms to solve important problems, but they were NOT recognized as "best" until AFTERWARDS. More often, they spend most of their lives fighting against the old paradigms. (Any better sources than The Structure of Scientific Revolutions by Kuhn? It's a classic, but old.)

    Anecdotal evidence, but I spent many years supporting a highly prestigious research lab, and I didn't see much that I would regard as real innovation. Mostly a stream of minor refinements hammered into patents with the support of skilled lawyers and even though most of them should have failed on the obviousness test. I do NOT think it was a cultural thing, though I should acknowledge (and disclaim?) that the lab I supported was located in a country with a reputation for copying and improving rather than innovating...

    Trivial example of a useful innovation that no one has apparently thought of yet: Why isn't there any Android app to turn off the sound for a period of time or on a regular schedule? At least I haven't been able to find one. I already know the answer as regards that research lab: Not likely to generate a patent.

    --
    Freedom = (Meaningful - Coerced) Choice != (Speech | Beer^2), and sad sock puppets' bad mods avail them naught.
  5. architecture and design approach by digitect · · Score: 4, Interesting

    The architecture profession has never emphasized grades, realizing that creative design is hardly measurable. There are a lot of successful practitioners with hardly notable academic backgrounds. Who cares if they got good grades if they can produce a great building? It is a stark contrast to the helicopter parent types that force their kids through heavy science and math curriculum, while totally omitting relaxed, creative, and intuition growing explorations that aren't as easily measured.

    I'm glad to hear Amazon eschews MBA types, but I'd like to hear of other business grasping the value of a design approach. We've mistakenly use the word "success" for business that make a lot of money, but I see it defined by the usefulness of solutions, individual growth of their employees, long term (>25 years) contributions to their communities, strong consumer reputation, safety and durability of their products, and a noble reputation across several continents. It's a scam that a phone becomes unusable after three years. Is that how we define a successful company?!

    Fortunately, the US is still hanging on to a culture that encourages scrappy, non-linear entrepreneurship. I'm frustrated by universities that value grades above creativity, and the current trend where our youth have to compete on such shallow metrics. (Against youth raised by helicopter parents from other cultures with no other purpose than to have the highest GPA.) Fortunately, these are short term problems and creativity triumphs in the long view. It always will. And that's the original American way. But I wonder why so many businesses grow out of this skill to their ultimate decline?

    --
    There is no need to use a SlashDot sig for SEO...