Slashdot Mirror
Microsoft Patents A User-Monitoring AI That Improves Search Results (hothardware.com)
Slashdot reader MojoKid quotes a HotHardware article about Microsoft's new patent filing for an OS "mediation component":
This is Microsoft's all-seeing-eye that monitors all textual input within apps to intelligently decipher what the user is trying to accomplish. All of this information could be gathered from apps like Word, Skype, or even Notepad by the Mediator and processed. So when the user goes to, for example, the Edge web browser to further research a topic, those contextual concepts are automatically fed into a search query.
The search engine (e.g., Bing and Cortana) uses contextual rankers to adjust the ranking of the default suggested queries to produce more relevant [results]. The operating system...tracks all textual data displayed to the user by any application, and then performs clustering to determine the user intent (contextually).
The article argues this feels "creepy and big brother-esque," and while Microsoft talks of defining a "task continuum," suggests the patent's process "would in essence keep track of everything you type and interact with in the OS and stockpile it in real-time to data-dump into Bing."
The search engine (e.g., Bing and Cortana) uses contextual rankers to adjust the ranking of the default suggested queries to produce more relevant [results]. The operating system...tracks all textual data displayed to the user by any application, and then performs clustering to determine the user intent (contextually).
The article argues this feels "creepy and big brother-esque," and while Microsoft talks of defining a "task continuum," suggests the patent's process "would in essence keep track of everything you type and interact with in the OS and stockpile it in real-time to data-dump into Bing."
"creepy and big brother-esque,
That means it will succeed wildly. People dig that shit. The more surveillance they are subjected to, the happier they seem to be. If they weren't, the modern world would be a very, very different (and less Orwellian) place, because they wouldn't keep buying commercial products that spy on them and voting for political candidates that promise to increase government-originated surveillance to keep them "safe".
So yeah. This should fit right in with what we've come to expect from modern consumer computing. No keystoke people ever type will remain un-mined.
that I'm moving to Linux.
"would in essence keep track of everything you type and interact with in the OS and stockpile it in real-time to data-dump into Bing."
Just what we need. A private company storing everything we type on their servers without our approval.
You know what I don't need? Someone telling me what they think I'm thinking. It's bad enough Microsoft has gotten people into the nastily bad habit of thinking they have to search for everything on their own system or network* rather than going to the source, now they want us to believe we're incapable of asking the questions we want.
Guess it's a good thing I won't be using W10 except at work where we can turn this crap off.
* Even after we show them how to use the command line to connect to a print server, people are still insistent on "searching" the network to find a printer then complain when they can't locate it. Stop searching! Go to the source.
We will bankrupt ourselves in the vain search for absolute security. -- Dwight D. Eisenhower
More than 10 years ago I wrote something similar for KDE. It was called Knapsack. It monitored all keys pressed on the X desktop, all text on the clipboard and the title of the active window. It used all that text to show files related to the users current activity.
Every time a user would click a suggested file, the system would get positive feedback about that suggestion in that context: it learned.
https://mail.kde.org/pipermail...
DNA is the ultimate spaghetti code.
Agreed. A lot of us envisioned these sorts of "intelligent agents" many years ago, but I think we always envisioned they'd be local agents, or under our control somehow. Probably a bit naive, I guess.
Even so, the problem with using a local agent is that it would be difficult to automatically synchronize this information across all your devices. That's the benefit of a cloud-based service. The downside? Someone else has complete access to all the most intimate details of your life. And what privacy guarantees do we have? A "we promise" statement from the company that they won't abuse that power. Nevermind that all that data is a virtual goldmine to advertising agencies... I'm sure we can trust them.
I think that this could be done locally (and share an encrypted database in a service like Dropbox, etc), but there's no incentive for a corporation NOT to keep all that personal data in their own cloud. They'd have to work harder to cut out their own ecosystem and protect the user's privacy. And frankly, it would be harder for the end-user to use, and less convenient than using Cortana, Siri, Alexa, or Google's bots. It would be tough for such a system to gain widespread adoption. And we've seen, via Linux as a desktop OS, that simply being free and open is NOT enough to drive mass adoption.
Irony: Agile development has too much intertia to be abandoned now.
I hate this sort of thing. Not just for the surveillance problem, that's self-evident how awful it is.
I hate it because I want a search engine to give me clean results for every search. I search for very different things for very different reasons, and they don't frequently have anything to do with anything I'm typing in an app. Having even my previous searches coloring the results I get is worse than unhelpful, it's actively detrimental.
If I'm searching for an app install failure, I don't want results related to the movie I was looking for yesterday, and I don't want results related to the Arizona Revised Statutes search I did an hour ago to answer a legal question for a friend. And I certainly don't want it to know about the sales proposal I typed up earlier today.