Slashdot Mirror


All Your Child's Data Are Belong To InBloom

theodp writes "Q. What do you get when Bill Gates and Rupert Murdoch put their heads together? A. inBloom (aka SLC), the Gates Foundation-bankrolled and News Corp. subsidiary-implemented collaboration whose stated mission is to 'inform and involve each student and teacher with data and tools designed to personalize learning.' It's noble enough sounding, but as the NY Times reports, the devil is in the details when it comes to deciding who sees students' academic and behavioral data. inBloom execs maintain their service has been unfairly maligned, saying it is entirely up to school districts or states to decide which details about students to store in the system and with whom to share them. However, a video on inBloom's Web site suggesting what this techno-utopia might look like may give readers of 1984 some pause. In one scene, a teacher with a tablet crouches next to a second-grader evaluating how many words per minute he can read: 55 words read; 43 correctly. Later, she moves to a student named Tyler and selects an e-book 'for at-risk students' for his further reading. The video follows Tyler home, where his mom logs into a parent portal for an update on his status — attendance, 86%; performance, 72% — and taps a button to send the e-book to play on the family TV. And another scene shows a geometry teacher reassigning students' seating assignments based on their 'character strengths', moving a green-coded female student ('actively participates: 98%') next to a red-and-yellow coded boy ('shows enthusiasm: 67%'). The NYT also mentions a parent's concern that school officials hoping to receive hefty Gates Foundation Grants may not think an agreement with the Gates-backed inBloom completely through."

43 of 211 comments (clear)

  1. All it takes is one zero day exploit... by RevDisk · · Score: 2

    And all of that collected data can end up on a torrent. I wouldn't want to be on the receiving end of all those lawsuits.

    1. Re:All it takes is one zero day exploit... by ObsessiveMathsFreak · · Score: 4, Insightful

      Exploit? All of that data is on an unencrypted USB stick on the table next to a marketing exec having an outdoor espresso lunch right now.

      New rule of thumb for data: If you've collected it, the internet already knows.

      --
      May the Maths Be with you!
  2. Speaking of classic literature... by vlpronj · · Score: 5, Insightful

    Sounds a little like Brave New World, too

    1. Re:Speaking of classic literature... by buchner.johannes · · Score: 4, Insightful

      Sounds to me like those people think the essentials of education can be quantized. Sure some measurements are important, but that's not all there is to learning. And those students probably will start valuing themselves by their ranking, and only have those numbers in their heads.
      I can see how HR departmants will be fans. Another method, like the IQ statistic, to assign numbers to people. What a dumb idea to get yourself ranked.

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    2. Re:Speaking of classic literature... by Anonymous Coward · · Score: 4, Funny

      Sounds like we got ourselves a salty Beta Minus right here.

    3. Re: Speaking of classic literature... by Anonymous Coward · · Score: 2, Interesting

      That's basically how US public education has always been, since the time of Horace Mann, who modeled the system on Prussian regimentation, which relied heavily on absurdly precise measurements and uniformity. Hold your pen at a 51 degree angle, sit in rows and columns spaced exactly three feet apart, write out paradigms and submit your answers to be graded as percentages. The 19th and 20th century educational movements were largely about quantifying the student. Sometimes that data gathering gets dehumanizing, but few people challenge the quantification of students now, for better or for worse. Very little of what's in that video in terms of data collection and storage are new; the interface is shinier and the data is more integrated in their vision than it is now, but that's the only big difference.

    4. Re:Speaking of classic literature... by Anonymous Coward · · Score: 2, Insightful

      Everything can be quantized, the only question is whether doing so is better than not doing so. You've offered no evidence either way.

    5. Re:Speaking of classic literature... by mjr167 · · Score: 3, Insightful

      It will prepare them for having a real job where their value to the company will be quantized using whatever metrics make management feel warm and fuzzy today.

    6. Re: Speaking of classic literature... by jd2112 · · Score: 3, Insightful

      Not everything that counts can be counted, and not everything that can be counted counts.
      This however is mostly forgotten I'm the corporate, and apparently academic world.

      --
      Any insufficiently advanced magic is indistinguishable from technology.
    7. Re: Speaking of classic literature... by sjames · · Score: 2

      Actually, the burden of proof is on those who maintain that it CAN be. Until that evidence is presented, we work under the assumption that it cannot be.

      For your example, what makes you so sure jd2112 wasn't just in a hurry or unmotivated to proof read carefully for a quick /. post? Meanwhile, where is the SCORE? Where have you quantified the grammar in such a way that it may be meaningfully compared against other /. members?

      Where would James Joyce fall on your spectrum? How would he stack up against the editor for Reader's Digest's Humor in Uniform section?

  3. it's much worse than the summary indicates by Anonymous Coward · · Score: 5, Informative

    See this link where the Gates Foundation project is described as a database which tracks "student hobbies, career goals, attitudes toward school", and other factors, and makes that data available to private companies without the parents' consent.

    Furthermore, InBloom says: While inBloom pledges to guard the data tightly, its own privacy policy states that it “cannot guarantee the security of the information stored or that the information will not be intercepted when it is being transmitted.”

    1. Re:it's much worse than the summary indicates by MitchDev · · Score: 2, Insightful

      Corporations (which control the government effectively anyway) are worse than any government at this point.

    2. Re:it's much worse than the summary indicates by Anonymous Coward · · Score: 5, Insightful

      Corporations do not have SWAT teams, and cannot generally imprison you or kill you for "resisting arrest" ("stop resisting!" shouted over and over to the dying man unable to breathe whose chest is compressed by the weight of 5 officers). Corporations do not generally shell thousands of innocents to death. So no, they are not "worse than any government". It is far more dangerous for the government to have this data. Marketing is bad, and annoying, but it is nowhere close to what governments do to people they don't like.

    3. Re:it's much worse than the summary indicates by TooTechy · · Score: 3, Insightful

      Thankfully I did read your comment correctly.
      I agree with you.
      It seems that a large portion of the /. crowd just cannot read between the lines and require points to be spelled out. Perhaps, if they received a better education and used their HOTS (High Order Thinking Skills) which was under discussion a few years ago when Texas wanted to ban this in schools, they would have understood what you meant in your submission.
      Now you could consider this comment a bit of a troll. It is undeniable. However, just try to understand the point that is being made by a submitter before modding it. (This submission included).

    4. Re:it's much worse than the summary indicates by Lithdren · · Score: 5, Insightful

      Random Corp cant hold a gun to my head. Great, I feel so much better.

      They can however, prevent me from obtaining employment (and being self-employed is not always an option folks), obtaining credit (That's an awfully nice credit score you have there...be a shame if something...happened...to it.), track my every movement through various means, take me to court on bogus charges then drop them forcing me to miss days of work to defend myself (if I am already employed), or bill me for services they did not provide and force me to spend more time and money fighting them in court.

      They might not be able to kill me, but they sure as heck can make me want to kill myself. Is that really any better?

    5. Re:it's much worse than the summary indicates by Kielistic · · Score: 2

      Corporations do not have SWAT teams

      Tell that to Jason Chen.

  4. What's the problem? by Bogtha · · Score: 2, Insightful

    However, a video on inBloom's Web site suggesting what this techno-utopia might look like may give readers of 1984 some pause. In one scene, a teacher with a tablet crouches next to a second-grader evaluating how many words per minute he can read: 55 words read; 43 correctly.

    Since when is the idea of a teacher evaluating a student's abilities an Orwellian concept? Or does it magically become Orwellian just because a tablet is involved?

    --
    Bogtha Bogtha Bogtha
    1. Re:What's the problem? by Anonymous Coward · · Score: 5, Insightful

      Or does it magically become Orwellian just because a tablet is involved?

      It is Orwellian because it tracks data well beyond academic results, such as student's outside interests and "attitudes", and makes that data available to for-profit commercial interests: "federal law allows for sharing of it with private entities and then used to sell commercial education-related products ... The businesses operating in the sector call the data contained within the database a treasure trove..."

      That's why many parents are calling this Orwellian. And they have NO CHOICE. It cannot be opted out of.

    2. Re:What's the problem? by Lundse · · Score: 4, Insightful

      Since when is the idea of a teacher evaluating a student's abilities an Orwellian concept? Or does it magically become Orwellian just because a tablet is involved?

      Not magically and not because of the tablet. But when one actor becomes the keeper, gatekeeper and salesperson through yet another "nice-data-you-have-there-maybe-we-should-hold-that-for.you"-based (ie. cloud) solution, then yes, we are moving closer to an Orwellian concept (with a few corporate, not one state, big brothers).
      It is not because the teacher is marking it on a tablet, it is because one big corp is going to be analysing, using and reselling the data from everything both student and teacher does to advertisers, government and related industries that this becomes a problem.

      --
      IAIFARSIJDPOOTV - I Am In Fact A Reality Star; I Just Don't Play One On TV
    3. Re:What's the problem? by SirGarlon · · Score: 5, Interesting

      Since when is the idea of a teacher evaluating a student's abilities an Orwellian concept?

      I agree with you that the particular example of the teacher checking the student's reading speed and accuracy in real time is not Orwellian.

      What I am more uncomfortable with is the example of:

      ... a geometry teacher reassigning students' seating assignments based on their 'character strengths', moving a green-coded female student ('actively participates: 98%') next to a red-and-yellow coded boy ('shows enthusiasm: 67%').

      Here we have a system where, early on, students are being sorted by behavior -- or more accurately, on the teacher's subjective impression of their behavior. Let's hope the teacher is totally fair and unbiased, because anyone who's too different from his/her preconceptions is going to get labeled with an official-looking percentage. My concern is that these numbers, which sound very arbitrary and subject to emotional judgments, will create a self-fulfilling prophecy.

      In school, did you ever have a teacher you just didn't click with? I hated my sixth-grade math teacher's guts, and as far as I can tell that sentiment was totally mutual (I remember her body language.) But for me, it was no problem, because the seventh-grade math teacher didn't give a damn what Mrs. G. thought. With this system, Mrs. G. could have labelled me red (40%) in some "character" category and that data would stay with me into seventh grade. So the seventh grade teacher could say "oh, little Sir Garlon is an insubordinate slacker, I'd better not waste my limited time on him -- I'll concentrate on the yellow students because I need to end the year with 50% green to get tenure."

      This is more or less what happened to my brother, whose IQ is 10 points higher than mine but who had a hearing disability that made the educational system sideline him. Now he's driving a truck instead of curing cancer or building space probes.

      --
      [Sir Garlon] is the marvellest knight that is now living, for he destroyeth many good knights, for he goeth invisible.
    4. Re:What's the problem? by Anonymous Coward · · Score: 2, Insightful

      Its not a new thing that people place "judgement" on certain types of attitudes.

      But it IS a new thing that we track this subjective assessment in databases which are no longer private to the student/parents/teachers. It IS a new thing that "outside interests" outside of the school domain are logged in the same database. It IS a new thing that all this information can be sold and will follow students forever.

    5. Re:What's the problem? by Lundse · · Score: 2

      I am so sorry. I thought this was the discussion about a private company owning (and as such companies are wont to do) selling detailed data on all teachers and students, while providing a lock-in platform for serving and tracking all teaching. If they are only recommending a book or other teacher aid, then I must have completely misunderstood the article. Sorry, won't happen again!

      --
      IAIFARSIJDPOOTV - I Am In Fact A Reality Star; I Just Don't Play One On TV
    6. Re: What's the problem? by Anonymous Coward · · Score: 2, Insightful

      Simple: take it to its extreme. Every class mark, outburst, school habit from k-12 will be evaluated fr your college transcript.

      You have the grades, but so do 500 other applicants, and there are 2 slots left. And you happen to make the top 4, but you have recorded 'play problems' in grades 4-6, while the others don't. And now your rejected from college. Better off at a trade school, right?

      Point is, this moves toward a direction where future workers are highly redirected based on a learning system that only benefits those who are predisposed to that type of classroom learning environment.

      I'd be more receptive to this if steps in classroom size, as well as curriculum rewrite every few years weren't a concern, but that isn't happening. Instead we throw technology at it and hope it fixes the problem. There's 40+ years of Ed. Psych. data available almost proving that technology does not directly improve the learning ability in a child.

      When the hell did technology become a learning savior, and who the hell thought it was a good idea?

    7. Re:What's the problem? by SirGarlon · · Score: 2

      The median salary for a postdoctoral cell biologist is slightly higher than the median for a truck driver, but not as much as I would expect.

      My point, though, is that to take someone whose IQ is in the top .01% of the bell curve and put him to work driving a truck is a shocking waste of talent.

      --
      [Sir Garlon] is the marvellest knight that is now living, for he destroyeth many good knights, for he goeth invisible.
    8. Re:What's the problem? by mjr167 · · Score: 2

      My sister-in-law's kids were told by their teachers that Romney was going to take away all their candy if he was elected, while Obama would see to it they all got free candy.

    9. Re:What's the problem? by Bite+The+Pillow · · Score: 2

      Not "sorted".

      Students may be more inclined to participate when those around them do so. Having data based on at least more than one teacher's subjective opinion is a lot better, and likely to prevent exactly the scenario you describe.

      Mrs. G. would only be a part of your character input, and her contribution would decrease over time.

      There are important things to object to here, but you chose one that teachers and parents everywhere will support due to extrapolation based on anecdote. In fact, none of the examples in the summary give me pause directly. Knowing what will happen to the data based on every data collection activity ever, does.

    10. Re:What's the problem? by gallondr00nk · · Score: 2

      Here we have a system where, early on, students are being sorted by behavior -- or more accurately, on the teacher's subjective impression of their behavior.

      Not only that, but it also has absolutely no room for the cause of behaviour. It provides very little insight at all, nothing more than an observant teacher or parent can deduce in a few hours.

      A lot of fields like this seem to mistake collecting data for improving something.

      That said, I very much doubt better teaching is really the goal in this. We live in the age of the great data mines, where we take something, distort it into a metric and sell it on.

      This will be purely for the data, and to hell with how accurate it is. We know how this works. The teachers and kids will be the product, not the customer.

    11. Re:What's the problem? by stdarg · · Score: 2

      They were taught well. He was incredibly bad for anyone but the rich

      Check this out: http://en.wikipedia.org/wiki/File:Median_US_household_income.png

      How is that BAD for the non-rich in 1981-1989??

      specifically for his idiotic (probably more like disingenuous) "trickle down theory"

      Trickle-down economics is accurate. What problem do you have with it? Consult the graph I linked to above if you think Reagan didn't make everybody richer.

      and passing legislation that slashed the capital gains tax.

      Yeah, ooh, the evil tax cutter, hurting the middle class.

      Did you know that before 1997 the capital gains on selling your house was much more limited and only applied if you used the proceeds to buy a *more expensive* house?

      So cutting capital gains was a direct way of helping retirees who were selling their house and downsizing.

  5. Objecting to InBloom or the data collection? by walmass · · Score: 3, Interesting

    Sorry, formatting lost in my previous post. A lot of this data is collected now and goes to the state. Is the sky-is-falling reaction due to the fact that the data will go to InBloom, a private entity?

    In one scene, a teacher with a tablet crouches next to a second-grader evaluating how many words per minute he can read: 55 words read; 43 correctly.
    -- This has been done since typewriters were introduced in classes

    Later, she moves to a student named Tyler and selects an e-book 'for at-risk students' for his further reading. The video follows Tyler home, where his mom logs into a parent portal for an update on his status — attendance, 86%; performance, 72% — and taps a button to send the e-book to play on the family TV.
    -- Supplemental reading? The only difference is, it is going to a TV

    And another scene shows a geometry teacher reassigning students' seating assignments based on their 'character strengths', moving a green-coded female student ('actively participates: 98%') next to a red-and-yellow coded boy ('shows enthusiasm: 67%').
    -- And kids with vision problems are also moved to the front of the class. What the point?

  6. Common Tool Problem by Anonymous Coward · · Score: 2, Interesting

    At first glance this system I think has the common tool problem.

    It's naively neither good nor evil but depends on how it's used.
    The scenarios illustrated in the synopsis could very well be seen as beneficial, if it's used in good faith and understood as such.

    But I find it often is easier to use tools in non-beneficial ways. Will the teachers use the seating arrangement tool to try to make their problems with students other students problems (and they very well might not be able to handle the problem)?
    Will teachers use the evaluation tools to help out weaker students or just to select them out, shuffling them to the sidelines so they can concentrate on the more successful students?
    Will the company behind the system spring changes in the Terms of Use later on to make use of the data in malicious ways?

    I'm jaded enough to expect only the worst a few years down the line.

  7. False benchmarks by pla · · Score: 4, Interesting

    The privacy issues here really don't bother me so much - We already have fairly strong laws regarding who can store/share information about minors, and with whom.

    The bigger issue IMO comes from the described use of easily-measured statistics over more difficult, but meaningful measures of learning. 55WPM with 43 correct (what does that second number even mean, anyway? "No Billy, that says potato, not aardvark" )? Useless, unless we want to train a generation of speed-readers. More importantly, did he fully appreciate the racist subtext inherent in Jane ordering Spot to run?

    Sad. On the one hand, I weep for the future of humanity; On the other, I have absolutely no concerns about job security for as long as I want to stay in the workforce. But hey, I see a great future for the the trophy manufacturing industry!

  8. I have a charity and don't have to pay tax by tuppe666 · · Score: 4, Insightful

    "When you're dying of malaria, I suppose you'll look up and see that balloon, and I'm not sure how it'll help you. When a kid gets diarrhoea, no, there's no website that relieves that,"

    Not seeing this helping people dying of Malaria either.

  9. Re:Objecting to InBloom or the data collection? by semi-extrinsic · · Score: 3, Insightful

    And another scene shows a geometry teacher reassigning students' seating assignments based on their 'character strengths', moving a green-coded female student ('actively participates: 98%') next to a red-and-yellow coded boy ('shows enthusiasm: 67%').
    -- And kids with vision problems are also moved to the front of the class. What the point?

    Personally, one of the things I hated the most in school was being used like this to "help the teacher manage the unruly ones". Way to go, teacher, rewarding the students who do a good job by (implicitly) giving them a crappy job.

    --
    for i in `facebook friends "=bday" 2>/dev/null | cut -d " " -f 3-`; do facebook wallpost $i "Happy birthday!"; done
  10. Education data systems rely on teacher input by anegg · · Score: 5, Interesting

    My county's school system uses an on-line system to involve parent's in the education process. Student attendance, assignment status, and grades are posted in the system; parents access the system to monitor how their children are doing, and can theoretically use the information to apply virtually real-time corrective action. Everyone's involved, so this is good, right?

    Unfortunately, we have discovered that not all of the teachers are good at getting data in. After several episodes of us correcting our child and then finding out that the data in the system was inaccurate (assignments turned in were not credited, leading to fails and missing assignments) we have very mixed feelings about using the system.

    On the one hand, having access to see that assignments are/aren't being turned in, and seeing grades even if the work doesn't make it back home, is good. On the other hand, when the quality of the data is bad, it becomes virtually useless for the purpose of involving the parent in the education process. We can never be sure that a missing assignment is really missing; often a week or more later the system will be updated to show that the assignment was turned in after all.

    In one extreme example, a report that was delivered in class and turned in at the end of the presentation was given a grade of zero for never being turned in, and it was an end of the year project report worth a significant portion of the grade. When we went to bat for our kid, the teacher eventually admitted that the report had been delivered in class but didn't know where the hardcopy went. It was too late to turn in a copy of the hardcopy, so in the end that grade was just removed from my child's average. Since she had an "A" anyway, it wasn't harmful, but could have been if she had a lower grade and the report would have brought it up.

    My point with all this is that these systems all sound great, but unless an incredible effort is put in the data quality may not be sufficient for the purpose of the system. Its worse to have a system with low quality data that can't be relied upon than it would be to not have the system at all, in my opinion. Depending on how many people are relying on the system and in what ways, it could be extremely problematic. The traditional "end of marking period only" grading system has lots of play where teachers can make adjustments. This is bad if they abuse the power, but is good if they simply correct for lapses. A more realtime scoring system may not have the same flexibility yet may be being used in a more direct feedback manner. Data quality issues will be harder to correct, yet the dependency on the data correctness will be higher.

  11. Re:the debate rages on... by ebno-10db · · Score: 4, Insightful

    it's easy to argue both sides of this Gate's Foundation initiative to track student progress

    Then go ahead and argue the pro side, because I seem to lack the imagination (or ability to lie without laughing at the idea tht anyone would believe me). Students have been tracked for many years - they're called school records. Part of them was kept confidential, and there is no reason to share them beyond a student's parents, teachers, and maybe a few school officials. Let's keep it out of the "cloud". Woz was right - the "cloud" is dangerous and downright un-American. People should own their own data.

    isn't this the promise of the Network Society

    What the hell is a "network society", and where do I go to opt out (and opt out on my children's behalf)? Sounds a lot to me like the old society, except with information needlessly given to certain parties with a vested interest.

  12. Re:The Snake and the Crab by ebno-10db · · Score: 3, Insightful

    What's sad thing here is that Gates is probably well-meaning.

    The road to hell is paved with good intentions.

  13. Yeah, but ... by gstoddart · · Score: 4, Insightful

    inBloom execs maintain their service has been unfairly maligned, saying it is entirely up to school districts or states to decide which details about students to store in the system and with whom to share them

    And do the parents and students have any say?

    Because quite frankly it's not really up to the school boards to share private information about children with a corporation.

    This definitely sounds like from pretty creepy level of tracking -- and the 'permanent record' we used to joke about as kids might become real. By the time a kid is out of highschool, companies are going to know every detail about them and have that information to use for their own purposes.

    --
    Lost at C:>. Found at C.
  14. Re: the debate rages on... by Impy+the+Impiuos+Imp · · Score: 4, Funny

    THE GATES FOUNDATION AutoRecommend-O-Bot recommends a second-grade grammar and punctuation book for you.

    --
    (-1: Post disagrees with my already-settled worldview) is not a valid mod option.
  15. This Has Been A Fun School Year... by Jason+Levine · · Score: 3

    ... For very sarcastic definitions of fun.

    Between the InBloom data collection, Common Core being implemented in such a way that the quality of education is declining fast, the high stakes testing in New York last school year which only 30% of students passed and which was administered by Pearson without any independent oversight whatsoever, and the governor of New York saying that public schools should be closed if they don't raise said test scores, I really fear for my kids' education. Right now, the teachers are being forced to use curriculum that they haven't designed and can't modify for individual students' strengths and weaknesses. Instead, they need to do what the book says when the book says to do it. They need to teach only what's going to be on the Pearson tests or else their kids will do poorly and then their jobs will be at risk. All in the name of getting "more data" on how our schools are performing. I feel like this is a really bad Heisenberg Uncertainty Principle joke where they're destroying the schools by attempting to measure them.

    --
    My sci-fi novel, Ghost Thief, is now available from Amazon.com.
  16. Creepy by sl4shd0rk · · Score: 2

    It's almost like Gates and Co. have the intent to socially profile people starting at a young age while at the same time convert the entire educational learning process into a format and content delivery system which he can sell at whatever price he wants, along with controlling what kind of media is in the content. It's digital book burning and your kids will only know what Bill's educational system teaches them. Freakin creepy.

    --
    Join the Slashcott! Feb 10 thru Feb 17!
  17. Y'all are starting to sound like Glenn Beck, et al by PseudoCoder · · Score: 2
    --
    "Now, I doubt any of you would prefer a rolled up newspaper as a weapon against a dictator or a criminal intruder."
  18. Anecdotes, data, and all that, but... by zooblethorpe · · Score: 5, Insightful

    Quantizable and meaningfully quantizable are both beside the points of usefully quantizable, and useful to whom.

    Case in point: one of my wife's middle school students in humanities (basically English + history) was getting quite competitive and was obsessing over her grades in specific, narrow areas, to the point that her overall performance in class was deteriorating -- her scores on individual tests and assignments were good, but her actual comprehension was lacking. After talking with the parents, my wife floated the notion of not providing the child with a grade, i.e. not quantizing her performance, in an effort to get the child to stop obsessing over the number. The student calmed down, stopped obsessing, and her understanding of the material increased. And, in not being so competitive about the number she was assigned, she became friendlier and socialized more.

    Part of the dynamic in this case is something that gets lost by any test-centric approach. Specifically, there's more to school than just the subject matter, particularly at the younger grades. How does one quantize a student's sociability? Friendliness? Cooperativeness? Etc. Many of these different aspects certainly can be quantized, but without any objective measure for doing so, these numbers are meaningless outside of the subjective context of whomever is assigning them. Sure, 1 + 1 = 2. But how does one objectively work out the math for "my pet hamster died and I feel sad and don't know how to talk about it, and don't want to"? Or, "I don't get along well with this teacher because our communication styles are too different, and she reminds me of that horrible Aunt Edith who spits when she talks and always gives me scratchy wool for Christmas, and I'm allergic to wool"?

    Humans are deeply contextual. Math isn't. Trying to apply math to human contexts doesn't always work very well, and often has unintended consequences. One of the biggest issues is when a number score ostensibly represents a particular metric, but a deeper inspection of the scoring algorithm reveals that the metric doesn't actually measure what it's supposedly measuring. Quantization represents a gross kind of summarization, and in extreme cases, the baby does get thrown out with the bathwater (that is, all of the detail that's been summarized away). Sometimes the numbers do effectively lie.

    --
    "What in the name of Fats Waller is that?"
    "A four-foot prune."
    1. Re:Anecdotes, data, and all that, but... by sjames · · Score: 2

      One (of many) problems is that once we have a metric, we tend to treat the metric itself as above reproach. We aren't very good at realizing that the metric itself is deficient. Instead, we tend to either make the metric self-fulfilling or heap on a bunch more metrics until the collection is sufficiently complex to defy further analysis. Then we declare the analyst wrong and the metrics unassailable.