Slashdot Mirror
Facebook Filed a Patent To Predict Your Household's Demographics Based On Family Photos (buzzfeednews.com)
An anonymous reader quotes a report from BuzzFeed News: Facebook has submitted a patent application for technology that would predict who your family and other household members are, based on images and captions posted to Facebook, as well as your device information, like shared IP addresses. The application, titled "Predicting household demographics based on image data," was originally filed May 10, 2017, and made public today. The system Facebook proposes in its patent application would use facial recognition and learning models trained to understand text to help Facebook better understand whom you live with and interact with most. The technology described in the patent looks for clues in your profile pictures on Facebook and Instagram, as well as photos of you that you or your friends post.
It would note the people identified in a photo, and how frequently the people are included in your pictures. Then, it would assess information from comments on the photos, captions, or tags (#family, #mom, #kids) -- anything that indicates whether someone is a husband, daughter, cousin, etc. -- to predict what your family/household actually looks like. According to the patent application, Facebook's prediction models would also analyze "messaging history, past tagging history, [and] web browsing history" to see if multiple people share IP addresses (a unique identifier for every internet network). A Facebook spokesperson said in response to the story, "We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans."
It would note the people identified in a photo, and how frequently the people are included in your pictures. Then, it would assess information from comments on the photos, captions, or tags (#family, #mom, #kids) -- anything that indicates whether someone is a husband, daughter, cousin, etc. -- to predict what your family/household actually looks like. According to the patent application, Facebook's prediction models would also analyze "messaging history, past tagging history, [and] web browsing history" to see if multiple people share IP addresses (a unique identifier for every internet network). A Facebook spokesperson said in response to the story, "We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans."
When image recognition gets really good, you can get even more info than is laid out here - you can probably nearly 100% recognition of any brands worn or displayed prominently.
You could probably guess really well how much a family makes by knowing the brands of clothes they generally wear, and what kinds of cars they drive...
"There is more worth loving than we have strength to love." - Brian Jay Stanley
Just had a second thought - apply that to photos everywhere in general. Now you don't just know the demographics of a family, but of every neighborhood in every city on Earth thanks to geotagged photos from all over the place. You can see what parts of town are driving 2011 Honda Civics and where are the brand new Mercedes. Even if you yourself never post a single photo on Facebook and avoid being tagged, just your address alone will fit into some neat demographic slot that will say everything about you you did not want to reveal.
"There is more worth loving than we have strength to love." - Brian Jay Stanley
"We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans."
That sounds suspiciously like proudly admitting to being a patent troll.