Slashdot Mirror


Facebook Filed a Patent To Predict Your Household's Demographics Based On Family Photos (buzzfeednews.com)

An anonymous reader quotes a report from BuzzFeed News: Facebook has submitted a patent application for technology that would predict who your family and other household members are, based on images and captions posted to Facebook, as well as your device information, like shared IP addresses. The application, titled "Predicting household demographics based on image data," was originally filed May 10, 2017, and made public today. The system Facebook proposes in its patent application would use facial recognition and learning models trained to understand text to help Facebook better understand whom you live with and interact with most. The technology described in the patent looks for clues in your profile pictures on Facebook and Instagram, as well as photos of you that you or your friends post.

It would note the people identified in a photo, and how frequently the people are included in your pictures. Then, it would assess information from comments on the photos, captions, or tags (#family, #mom, #kids) -- anything that indicates whether someone is a husband, daughter, cousin, etc. -- to predict what your family/household actually looks like. According to the patent application, Facebook's prediction models would also analyze "messaging history, past tagging history, [and] web browsing history" to see if multiple people share IP addresses (a unique identifier for every internet network).
A Facebook spokesperson said in response to the story, "We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans."

16 of 98 comments (clear)

  1. Could be a huge amount of data to glean by SuperKendall · · Score: 3, Interesting

    When image recognition gets really good, you can get even more info than is laid out here - you can probably nearly 100% recognition of any brands worn or displayed prominently.

    You could probably guess really well how much a family makes by knowing the brands of clothes they generally wear, and what kinds of cars they drive...

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  2. In fact, take that a step further. by SuperKendall · · Score: 5, Interesting

    Just had a second thought - apply that to photos everywhere in general. Now you don't just know the demographics of a family, but of every neighborhood in every city on Earth thanks to geotagged photos from all over the place. You can see what parts of town are driving 2011 Honda Civics and where are the brand new Mercedes. Even if you yourself never post a single photo on Facebook and avoid being tagged, just your address alone will fit into some neat demographic slot that will say everything about you you did not want to reveal.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
    1. Re: In fact, take that a step further. by Anonymous Coward · · Score: 2, Insightful

      Even better. Someone tricks the algorithm into thinking they are poor and can't afford anything, so everything online begins dropping prices.

      I can't wait for the day all this stuff gets aggregated and stuck together, and the public goes absolute ape-shazbot feeding the beast bad data intentionally. The network effects would be unreal. Advertisers will literally demand Fraud convictions for wearing a Cheap watch with "Gucci" taped over the tag.

    2. Re: In fact, take that a step further. by laze2000 · · Score: 2
  3. Ballsy by jargonburn · · Score: 3, Interesting

    "We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans."

    That sounds suspiciously like proudly admitting to being a patent troll.

    1. Re:Ballsy by Narcocide · · Score: 2

      I'm still waiting for that promised Linux support for the Occulus Rift...

    2. Re:Ballsy by ShanghaiBill · · Score: 4, Insightful

      That sounds suspiciously like proudly admitting to being a patent troll.

      It is actual a form of oligarchy. All the big tech firms build patent portfolios, and then sign cross licensing agreements. So they are free to innovate. But individuals and small companies are locked out, and are likely to step on a legal landmine no matter what they do.

      In America, the proportion of wealth going to labor has been falling, and the proportion going to owners of capital has been climbing. A naive person might think this means it is smart to invest in factories and equipment. But this is wrong. Google, Facebook, Apple, Microsoft all have very few hard assets. The "capital" that is richly rewarded by our economic system is mostly intellectual property.

    3. Re:Ballsy by CaptQuark · · Score: 2

      "We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans."

      However, the spokesman never said they weren't going to implement this technology. They are trying to downplay the patent because of the sensitivity of people about their privacy. Classic misdirection. "Pay no attention to the man behind the curtain".

      Other statements of misdirection.

      • "Nobody beats our safety record." Yup, you and eight other companies have the same top safety record.
      • "Best crash test score in the industry." You and 42 other models have 5 stars. Can't get any better.
      • "I got the top score in the class." Yeah, you and sixteen other people in the class got A's so you also got the top score possible.
      • "John and I were in a race. I came in second but John was next to last." John actually won the race, but there were only two people racing so the statement is technically correct.
      • "Best warranty in the industry." Yeah, it is the same 10 year/100,000 mile warranty that five other companies offer.
      • "Top car in its class." Of course they define that "class" as narrowly as possible. Read the fine print. "Class is defined as all SUVs from the same manufacturer with less than 5000lbs payload."

      ---

  4. Playing defence isn't enough by Miles_O'Toole · · Score: 4, Insightful

    It's time to start actively creating misinformation on one's social media presence. Since we can't protect our personal information from these Big Brother wannabe's, we have to at least degrade its reliability, and therefore its value.

    I wonder how long will it be before those idiots who proudly proclaim "If you use Facebook, you deserve what you get" have their noses rubbed in the fact that owning a cell phone and being friends with anybody who does have a Facebook profile is enough to hand them quite a lot of personal information.

    --
    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.
    1. Re: Playing defence isn't enough by hyades1 · · Score: 2

      Well done for seeing ahead. We used to have a certain level of "herd anonymity". The pure information sorting power of today's computers has largely stripped that away. If what I've read is accurate, the NSA is capable of monitoring literally every telephone conversation on the continent (and probably more). That's not to say they look closely at all of them, but I'm sure somebody's peeking at people who have no idea they're even on anybody's radar.

      --
      I've calculated my velocity with such exquisite precision that I have no idea where I am.
    2. Re:Playing defence isn't enough by ShanghaiBill · · Score: 4, Funny

      It's time to start actively creating misinformation on one's social media presence. Since we can't protect our personal information from these Big Brother wannabe's, we have to at least degrade its reliability, and therefore its value.

      This is what I do too. To mislead them, I only visit websites I don't like, and I only buy things I don't want.

    3. Re: Playing defence isn't enough by hyades1 · · Score: 2

      More and more, I'm starting to think that old hardware...the stuff that existed before they were building back doors right into the motherboards and CPU's...is going to start appreciating in value. At least make the bastards work for their money.

      --
      I've calculated my velocity with such exquisite precision that I have no idea where I am.
  5. Re:Creepy by Narcocide · · Score: 2

    So you're saying this was the one step too far for you? They weren't creeps already?

  6. Ingenius response from spokesperson by swell · · Score: 2

    "We often seek patents for technology we never implement, and patents should not be taken as an indication of future plans."

    This is absolutely correct for many tech corporations. If you can preempt an innovation that would benefit someone else, you are a step ahead; even if you never use the patent. The most important feature of patents is not that you can make new and better products; it is that you can prevent others from doing that [unless they are willing to pay you for the right].

    Of course Fb could use this idea to generate profit. That doesn't change the correctness of the above statement.

    --
    ...omphaloskepsis often...
  7. Re:Accusations of racism in 3... 2... by serviscope_minor · · Score: 2

    Accusations of racism in 3... 2...

    Well, the 1 never happened. You get far more whining on slashdot about accusations of racism than you get actual accusations of racism.

    --
    SJW n. One who posts facts.
  8. Re:Accusations of racism in 3... 2... by nukenerd · · Score: 2

    My dad was quite upset when he called from his million dollar home ..[and] customer service representative suggested that the poor reception might be from the metal roof on his mobile home... You see he lived his life paying everything in cash or with store credit.. He never had a credit card because he never needed one. When he got a cell phone they had no credit history ..

    Someone once did a spoof of the Duke of Edinburgh applying for a credit card. He was refused because :

        Unemployed
        Lives on state support
        Status depends on wife
        Doesn't own a home [state provides one - or several actually]
        No fixed address [moves between different castles and palaces]
        No previous credit card
        And no spending history whatsoever [his flunkies do his purchases]