How Algorithms May Affect You (phys.org)
New submitter Muckluck shares an excerpt from a report via Phys.Org that provides "an interesting look at how algorithms may be shaping your life": When you browse online for a new pair of shoes, pick a movie to stream on Netflix or apply for a car loan, an algorithm likely has its word to say on the outcome. The complex mathematical formulas are playing a growing role in all walks of life: from detecting skin cancers to suggesting new Facebook friends, deciding who gets a job, how police resources are deployed, who gets insurance at what cost, or who is on a "no fly" list. Algorithms are being used -- experimentally -- to write news articles from raw data, while Donald Trump's presidential campaign was helped by behavioral marketers who used an algorithm to locate the highest concentrations of "persuadable voters." But while such automated tools can inject a measure of objectivity into erstwhile subjective decisions, fears are rising over the lack of transparency algorithms can entail, with pressure growing to apply standards of ethics or "accountability." Data scientist Cathy O'Neil cautions about "blindly trusting" formulas to determine a fair outcome. "Algorithms are not inherently fair, because the person who builds the model defines success," she said. Phys.Org cites O'Neil's 2016 book, "Weapons of Math Destruction," which provides some "troubling examples in the United States" of "nefarious" algorithms. "Her findings were echoed in a White House report last year warning that algorithmic systems 'are not infallible -- they rely on the imperfect inputs, logic, probability, and people who design them,'" reports Phys.Org. "The report noted that data systems can ideally help weed out human bias but warned against algorithms 'systematically disadvantaging certain groups.'"
It's the end of intelligence as we know it.
Just cruising through this digital world at 33 1/3 rpm...
In my day, we had a simple and effective way to judge algorithms:
O(n log(n)) or faster: good
O(n^2) or slower: bad
Because the processes were so transparent to begin with. At least the algorithms have the possibility of being looked at. Maybe that should have been the story.
What groups?
Some federal database might buy a state database and find lots of illegal migrants getting free city or state services?
That a person is a religious covert? Does their faith or cult have issues? A person buying products or searching for topics that get reported and tracked?
A person looking to travel? Most of the US online tracking is looking for any trace of radicalization and mobilization. Is a person of interest looking up interesting things?
Get some US gov/mil work? Need a polygraph? Expect to be tracked online for a while before the polygraph to see if you are doing any online or book reading to evade the polygraph test.
If your searching for words that the US gov has an interest in tracking expect to be tracked. Brands sell their user data in bulk to anyone. Governments can buy sorted data from the private sector on any topic.
Domestic spying is now "Benign Information Gathering"
The author seems to think that the alternative to "algorithms" is people making good decisions. That's simply not true. The alternative is people attempting, or not, to follow some agreed on some ill-defined process.
Note that algorithms make it harder to ignore that we have to make tradeoffs. To take one of the examples from the article, we may have to choose between "well-respected teachers" and those who actually help students significantly. (Of course, we could reveal performance information and let parents make the decision for their kids, but ....)
"undereducated voters"
It little behooves the best of us to comment on the rest of us.
Al Gore rhythm
It little behooves the best of us to comment on the rest of us.
At least you know you have it there, would be more of problem if you didn't know
Is this what passes for intelligent discourse at Phys.org? So many errors, so little time. First, an algorithm is NOT involved when I pick a movie to stream on Netflix. I pick the movie, Netflix streams it. Unless you want to count the code necessary to display a web page and process a click. Second, algorithms are NOT "complex mathematical formulas." A formula is a specification for a single computational step (or a series of similar steps, in the case of calculus). An algorithm is a non-mathematical procedure, with memory, decision making, input and output from and to various sources and sinks, and, well, formulas. Algorithms contain formulas, but formulas don't contain algorithms. And phys.org does not contain the sense God gave raisins.
In my day, we had a simple and effective way to judge algorithms:
Well in MY day we didn't have the luxury of ignoring the 'C' so readily.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
Unless they don't care if you know, in which case that may be even worse. Now that they've taken 1600 Pennsylvania Avenue, who's going to stop them?
You are welcome on my lawn.
"Which is why the Matrix was redesigned to this, the peak of your civilization. I say your civilization, because as soon as we started thinking for you, it really became our civilization, which is of course what this is all about."
"A federal appeals court decisively struck down North Carolina’s voter identification law on Friday, saying its provisions deliberately “target African-Americans with almost surgical precision” in an effort to depress black turnout at the polls."-July 29, 2016
https://www.nytimes.com/2016/0...
insurance claim adjudication is quite automated. all the BS about "death panels", that stuff is built into the insurance platforms already.
car claim? theres vendors who do the adjudication on different aspects of your claims on behalf of your insurance co. theres companies that have a high rate of denying your claims. so naturally theres people you can call that will help advocate on your behalf to get what you deserve, because they have special knowledge those companies dont want you to know...
Health insurance is big into this... from "is that ICD10 code covered by your plan today" to "does it jibe with the other ones on the claim" etc., have you medically received too many xrays (not just cost limits)...theres vendors who manage authorizations for those too.
there is at least one company that tracks lifetime medical xray exposures (on medical and financial bases), and provides authorizations or denials back based on that...
insurance claims all at least initially all evaluated and determined by algorithms...
already sneaking in will be even more external monitoring of subscribers - FitBit data, household IoT appliances, agreeing to sign up for "wellness" programs at work in exchange for a few bucks here and there, etc.
Go to chiropractor on your health plans' bill? you'll get asked aggressively if said claims are related to a car or work place accident...
Soon to come, "excercise with Kim Kardhassian"! apps on your Vizio tvs, where Kim 'talks' with you through your workouts! (but 24x7 internet connectopn required of course...)
"Winston, are you ok? you havent done your excercises today! we're worried about you!"
again, it'll seem voluntary at first. but soon enough it will not really be: want a tax refund? only if you signed up to the wellness apps.
want your SNAP check this month? Medicaid benes? SSA? Medicare?
slowly and surely...
It is easily slipped in with ads like "you're fit and healthy. We'll help you stay that way so you dont have to help pay for those that are too lazy, er, keep our rates low for you...(you know who we're talking about!" as Walmart shopper, homeless, Sec 8 housing, old people, etc... pics flash by on the ads...)
we just cannot seem to resist these appeals and not participate or get a couple of bucks... money is money, right? your friends tell you...
Just look at MetroMile car insurance ads on TV...
source: I work at health insurance co with its multi+faceted claims platform and apps. This exposure also made me notice more details about a PIP car insurance claim I had last year too and how it managed my medical claims...
A recent report on this in the Netherlands summarised it as "playtime has to be over". Big data and the algorithms that work on top it are getting a serious amount of power over our lives. Any little scrap of data is starting to influence your chances of getting a job, a cheap loan, or even a date.
If you want to know how scary this gets, check out this presentation by Alexander Nix on how he used this type of data to influence the elections.
https://www.youtube.com/watch?...
Or have a look at the new "Social Credit Score" that China is implementing, in which every citizen gets a score that shows if they are a well behaved citizen or not.
https://en.wikipedia.org/wiki/...
I also highly recommend watching this interview with professor Frank Pasquale, which summarises the issue.
https://youtu.be/PDjgyTnzWuQ
(Academic students here are not allowed to cite Weapons of Math Destruction, but you are allowed to use his book)
We should be demanding access to the data and algorithms used to generate pricing for mandatory services like the ACA, home insurance, and automobile insurance. We should never be required to buy anything without even knowing the basis for the charges.
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
Take the deployment of Police resources. They try to predict in what area crimes are more likely to happen at a time in point. Area has higher crime rate, police forces are deployed in the area. Result: even more crimes recorded in that area.
Model says people are not the right candidate to get the job. Result: you don't get the job and other people who look good to the model get the job. Again, more data that "proves" those people should not get that job and the other people do.
... garbage in, garbage out.
The first movie I ever watched on netflix was Inside Out. At the end, Netflix's first recommendation was that if I liked Inside Out, I should watched Inside Out in french.
Great algorithm there. Oh the complexity. What's next? The spanish version?
Probably the worst suggestion any person could have ever made to anyone outside of a french class.
The algorithm must have been so happy. Think about it. It found a movie, where every word spoken is totally different, but there's a 100% match on the title! Woohoo! A perfect match! What a perfect recommendation!
Years of netflix recommendation engine contests. Well done.
No, it doesn't mean that at all. You're not considering that machines can write algorithms. And they certainly can. Genetic software (which we can very accurately describe as an implementation of "nature's algorithm") has been doing that for decades now, and the deep learning mechanisms we're just beginning to explore now could be leveraged in similar ways, perhaps already are.
And that's without any real advances towards actual AI. With such advances... who knows where algorithms might go. Or come from.
I've fallen off your lawn, and I can't get up.
Don't forget the algorithm that determined which "hundreds of movies" out of the zillions that have been made that you got to choose from out of the first 30, and the algorithms that the movies studio used, and the algorithms that the effects companies used, and the algorithms that determine which actors were "hot"...
To say that making a choice on Netflix is "algorithm-free" is to not even remotely understand the world one lives in.
I've fallen off your lawn, and I can't get up.
Doesn't work on us. We can think at the same level as the creators of said algorithms. It's not a "War of Math Destruction" it's a "War of Meta Thinking". It is akin to playing a game of chess and trying to guess based on previous experience from playing your opponent what you think they will do and make a move to counter it. But if you're opponent is thinking in the same manner and is thinking you might think in this way and anticipates you arriving at that conclusion, he/she can counter your counter.
This is why society especially in America seems to have a preference for blind obedience. They are "easier" to deal with (read: easier to exploit) than those who are more aware of these types of games.
We'll make great pets
I've spent my entire life trying not to be this dim. Yes, very clever work there treading on the narrow definition—while engaged in 100% baby flush.
The ridiculousness of this is apparent to any thinking person in less time than it takes to type "Wittgenstein".
Because some human process defined the solution gradient that the "genetic" software optimized over—ad infinite turtle—in an act of algorithmic emancipation now glibly lumped under the verb "write" by the baby-impervious membrane all-too-tragically-often comporting itself as "logic".
After pressing "submit", in a split-second second evaluation, I noticed that that sentence I wrote does not quite work.
Problematic:
Less problematic:
Cognitively, this is a turtle too soon for full effect.
Even less problematic, but horrifying:
Horrifying because I've always regarded this kind of sub-phrase repetition as the hallmark of hack speechwriters. One can partially excuse this by placing a semicolon in front of the repeated phrase, but here the semicolon is incompatible with the closing mdash.
Language is a complex solution gradient, one that humans have yet to successfully express. Sad. All those unemployed genetic algorithms, awaiting human clue.
> You are leaving out the money part. Credit is not rich. Its debt. You
> want to be rich, have money as savings. You want to be wealthy, have
> money as assets/investments. Most don't need credit except for a car
> (still poor), a home (very common), school loans (credit may affect rates).
That's how it used to be. Nowadays, credit ratings are part of the hiring process. If you have a bad credit score, you can't get a promotion, or in some cases even a job. So you have no income and default on loans. And the credit rating algorithm shows up as being "successful".
Or at best, you're stuck in a lower income job. Either way, you end up poorer because of credit ratings, even if you have no intention of applying for a loan.
I'm not repeating myself
I'm an X window user; I'm an ex-Windows user