Slashdot Mirror


1,100 Schools Now Scan Social Media For Violent Students - and Alcohol Use (usatoday.com)

In the hunt for potential acts of student violence, "schools are increasingly turning to artificial intelligence-backed solutions," reports USA Today. Bark Technologies, Gaggle.Net, and Securly Inc. are three companies that employ AI and machine learning to scan student emails, texts, documents, and in some cases, social media activity. They look for warning signs of cyber bullying, sexting, drug and alcohol use, depression, and to flag students who may pose a violent risk not only to themselves, but classmates. When potential problems are found, and depending on the severity, school administrators, parents -- and under the most extreme cases -- law enforcement officials, are alerted. In the fall of 2017, Bark ran a test pilot with 25 schools. "We found some pretty alarming issues, including a bombing and school shooting threat," says Bark chief parent officer, Titania Jordan....

The Bark product [which monitors more than 25 social media platforms] is free to schools in the U.S. for perpetuity. The company says it can afford to give the service away to schools, because of the money it makes from a version aimed at parents... Bark is currently used in more than 1,100 school districts, covering 2.6 million children. If it detects something that is considered exceedingly severe such as a child abduction or school shooting threat, the issue is escalated to the FBI. According to Jordan, Bark sends out between 35,000 and 55,000 alerts each day, many just instances of profanity. But 16 plausible school shootings have been reported to the FBI since Bark launched its school product last February, she says.

The article notes these solutions have three major limitations:
  • "A school can't police a student's smartphone or other devices outside the ones it issued, unless the student signed into a social media, or other account, using the email or credentials the school provided."
  • "None of the companies USA TODAY talked to for this story claim the ability to catch suspect behavior every time."
  • "Students also are often more tech savvy than their parents and won't tell them about every account they have."

45 of 115 comments (clear)

  1. Good! by Anonymous Coward · · Score: 2, Funny

    Good!

    If only they had done this when I was a kid going to school in the Santa Clara county, maybe I would still have my upper teeth.

    1. Re:Good! by gl4ss · · Score: 1

      if you were really bullied, they would just use this system now to get you expelled.

      --
      world was created 5 seconds before this post as it is.
  2. And this is a good idea, because? by Anonymous Coward · · Score: 1

    Seriously, why is it good for the eventually-to-be-grownup pupil to get forced into reconciling themselves to a life of constant surveillance? Is that the message these schools want to convey? Because it's what they're doing.

    1. Re: And this is a good idea, because? by Anonymous Coward · · Score: 1

      Since we live now in the Surveillance Age and this fact is not going to change, the most sensible thing to do is to get the youth used to it as soon as possible. Watching one's own behavior, speech and manners is now an essential survival trait. The sooner you learn how to function within society, the better.

    2. Re:And this is a good idea, because? by gibbsjoh · · Score: 1

      Oh do fuck off. Pim Fortuyn wasn't some some saviour and he wasn't popped by the "establishment" now was he? "Deep state" - seriously, time to take off the tin foil hat, pal.

      --
      -- "...I'm a bad guy because I, well, I sing some rock-and-roll songs." M. Manson
    3. Re:And this is a good idea, because? by ctilsie242 · · Score: 1

      Here is the odd thing: My friends' kids in high school are quite aware that Facebook sells their stuff.

      Kids are not dumb. They don't really use Facebook other than to interact with the adults. They use other venues. Discord is popular with a lot of private servers. Telegram and Signal are common, and well out of the reach for monitoring services hired by schools.

      I'm sure the next step will be schools demanding their MDM software be used, but eventually phones will start having different VMs, where the school can "own" one container with one SIM card, while the other container actually has all the interesting stuff.

    4. Re:And this is a good idea, because? by gweihir · · Score: 1

      No. A) It is not "right around the corner", it is a gradual process over decades. And B) this has been going on for a few decades and became obvious in the last one. Stop being stupid.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  3. Why didn't they do something about it! by DNS-and-BIND · · Score: 5, Informative

    This is the logical end to those "why didn't they do something about it, all the warning signs were all over social media." Well, now they're doing something about it. They've started - and will never stop - surveillance of human activity for deviant behaviors. If you're thinking this is ripe for abuse by being the one able to define deviant behaviors, you're right. It's basically what happened to England in the plot of "1984". I hope you're happy and you got what you asked for.

    --
    Shutting down free speech with violence isn't fighting fascism. It IS fascism!
    1. Re:Why didn't they do something about it! by lucasnate1 · · Score: 1

      Look, nobody's forcing him to brag online about his violent escapades, but the moment he chooses to do so, other people have the right to use that knowledge. This really has nothing with 1984, where people are forced to disclose their information by ever present eavesdropping.

    2. Re:Why didn't they do something about it! by stephanruby · · Score: 2

      unless the student signed into a social media, or other account, using the email or credentials the school provided

      Tell me. If you create a private social media account online using your work email address, do you expect your work to reset your password and access that private online account you created? No, right? At least, not unless that account was work related.

      If anyone should have access to that secondary account, it should be the parents, not the school.

      Remember that incident where the school would spy on their students using the camera of the school issued laptops while the kids were in the privacy of their own bedrooms. If that incident taught me anything, and numerous other incidents like that one, it's that school administrators/staff are not properly trained to handle the private information of their pupils and also they're definitely not mature enough to handle that information professionally.

    3. Re:Why didn't they do something about it! by lucasnate1 · · Score: 1

      If you create a private social media account online using your work email address

      Then you're (not you personally, but the one who does what you said) an idiot.

      School issued laptops

      Unless they're used for programming lessons, I don't understand why they are issued.

      Maybe I just don't understand modern education, what can I say.

    4. Re:Why didn't they do something about it! by mysidia · · Score: 1

      Everyone is already happy, and for that, You can thank Big Brother for
        announcing the chocolate ration has been increased to 20 grams per week!

    5. Re:Why didn't they do something about it! by jouassou · · Score: 1

      This. It's similar to the fact that if someone leaves a password-protected private laptop on their work desk, you could easily use a LiveUSB to boot it up and get around their password protection. If their harddrive isn't encrypted, you can easily copy all their data onto an external harddrive, and have fun with it at home. But if anyone I know did that, including my employer, that should be grounds for suing them, and someone should end up in jail over it.

      That it's technically possible to do something doesn't make it right.

    6. Re:Why didn't they do something about it! by Gravis+Zero · · Score: 1

      They've started - and will never stop - surveillance of human activity for deviant behaviors.

      Monitoring social media hardly constitutes "surveillance of human activity" because is centralized repository where fools volunteer information to corporations. Corporations are under no obligation to keep any secrets you have and if you're actively broadcasting to the world what you are doing then it's certainly not a secret.

      --
      Anons need not reply. Questions end with a question mark.
    7. Re:Why didn't they do something about it! by The-Ixian · · Score: 1

      Uh... so maybe don't post your crap on social media?

      If you put things on servers you don't control, expect it to be seen by others...

      --
      My eyes reflect the stars and a smile lights up my face.
    8. Re:Why didn't they do something about it! by apoc.famine · · Score: 1

      Unless they're used for programming lessons, I don't understand why they are issued.

      Maybe I just don't understand modern education, what can I say.

      It has changed a ton in the last 10 years. A large percent of schools are issuing a portable device to every student. Google Apps for Education is a big deal, with tons of Chromebooks being issued to kids. Work is done using the Google suite of word processing tools, rather than the Microsoft ones. Kids are turning in video homework rather than paper homework. It's a crazy new world out there.

      --
      Velociraptor = Distiraptor / Timeraptor
    9. Re: Why didn't they do something about it! by phantomfive · · Score: 1

      If I were a teacher, I would go crazy if I had to grade video homework every day.

      --
      "First they came for the slanderers and i said nothing."
  4. They Automated Carl! by lobiusmoop · · Score: 2

    "ou guys think I'm just some untouchable peasant? Peon? Huh? Maybe so, but following a broom around after shitheads like you for the past eight years I've learned a couple of things. I look through your letters, I look through your lockers. I listen to your conversations. You don't know that, but I do. I am the eyes and ears of this institution my friends. By the way, that clock's twenty minutes fast!"

    --
    "I bless every day that I continue to live, for every day is pure profit."
  5. Not good, but survival. by Anonymous Coward · · Score: 3, Insightful

    This is the reality we are facing, lord knows we aren't gonna take away dangerous individuals rights to commit mass murder with guns.

  6. Next steps by kaur · · Score: 4, Insightful

    1) Students will shift away from public media / platforms to new semi-private networks
    2) OSINT surveillance services try to follow, but are blocked by privacy rules
    3) Surveillance tries legal hacks to get backdoor access to networks and students' media

    We will have a society where everyone is aware of someone listening in and potentiall taking action.

    I have lived through the Soviet times in ex-USSR. We have been there and this is not nice.

    I also have three kids (two teenagers and one younger). I strongly believe they should have options for privacy both from us the parents, the school and authorities.

    1. Re:Next steps by gweihir · · Score: 1

      Wise words. Unfortunately, the authoritarian scum that forms 30% or so of the population cannot abide anybody doing something they cannot see. To them, Fascism is an ideal that they try to establish again.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    2. Re:Next steps by knorthern+knight · · Score: 1

      >> 1) Students will shift away from public media / platforms to new semi-private networks
      >> 2) OSINT surveillance services try to follow, but are blocked by privacy rules

      > School equipment TOS/AUP will prohibit that.

      Every kid has a smartphone. Heck, instead of a $1,000 Itoy, have your parents get you a couple of $200 el cheapos. Use one at the library/Starbucks on wifi, no SIM card required.

      > Exists already. There are Schools that will demand kids login to their
      > various accounts, on the spot and WITHOUT parents being present.

      Response... "My parents don't allow me to have a Facebook/Instagram account".

      --

      I'm not repeating myself
      I'm an X window user; I'm an ex-Windows user
    3. Re:Next steps by Rick+Schumann · · Score: 1

      "Students will shift away from public media / platforms to new semi-private networks"
      They're already doing that. Facebook is becoming like Myspace and Livejournal before it: a place for the old people, uncool if you're young.
      They'll go talk to each other in threads on 4chan, or in Discord chats, or whatever. When the next cool, hip new 'social media' comes around, they'll be first on the scene.

    4. Re:Next steps by Anonymous Coward · · Score: 1

      Or, alternatively, the students might band together and start taking pictures of things that would set off the authorities en masse.

      Snorting sugar on the cafeteria table with a straw and posting to their school accounts with #boogersugar.
      Passing around a bottle of skol filled with water, everyone takes a drink. #Vodka #SoDrunkRightNow
      Having a full day of sexting everyone and everything. "HEY BEBE, YOU WANNA MONKEH AROUND!"

      And do not even get me started with where Deepfakes are going. You can remix a teachers face or the princaples face on porn stars and begin texting that around too.

      The problem with survielance networks is that if people decide, in any kind of co-ordinated manner, to mess with them, they fall completely apart and the surveilers lose their minds. All you can do is cryptographically sign each frame or pictures with a block chain to authenticate its source and even then. You've got to proove the kids were actually drinking, or shooting coke, or actually out to have sex.

      The correct protest kids, is to do the above. Have everyone start hiding bags of flour, and sugar, and god only knows what in their lockers; say inappropraite things to each other on their phones. Band together and make the state your enemy. They'll come down hard on you, and at that point you get the police involved and start pressing child abuse charges. Because giving out punishments without good evidence is child abuse. If the teachers want to involve the cops that is a two way street they won't win on.

    5. Re:Next steps by Anonymous Coward · · Score: 1

      I haven't been to Russia though my packets likely have. This is the kind of shit westerners aquired with immigration. It's completely NORMAL in some countries to expect this kind of authoritarian control. My grandfather, father and his brother all faught in wars to protect us against it too. They would be thrown in jail for protesting if they were alive now.

      It's not OK. It was never OK. Society didn't agree to it we've been stripped of our ability to lawfully prevent it.

      Actually, it's the other way around. It's more likely that the immigrants from countries that have experienced the Stasi, the Gestapo or the Great Firewall, are far more aware and against that sort of shit. The people that love this stuff are the power mongers, the 'protect me from teh evil terrorists', the 'free speech is ok as long as I (and my religion) agree with it', and the 'will someone think of the children' crowds. This round of public (and private) surveillance incursion is pure homegrown unadulterated western bullshit.

      So as much as you probably like to drum up a bit of random racial hatred, don't be blaming this shit on 'teh immigrants'.

    6. Re:Next steps by gweihir · · Score: 1

      From relevant research. Read up on it. I am not doing your homework.

      --
      Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
    7. Re:Next steps by Shotgun · · Score: 1

      I'm going to have to back the AC up on this one. My wife is from Eastern Europe. Grew up under some of the Soviet shit. She is aghast that we'd let it happen to ourselves here.

      --
      Aah, change is good. -- Rafiki
      Yeah, but it ain't easy. -- Simba
  7. Re:Thank FSM by gweihir · · Score: 1

    Aha! Found the dangerous deviant! Best lock you up indefinitely at once!

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  8. Chilling Effect for Your Safety by ememisya · · Score: 1

    So 35,000 and 55,000 students were psychologically damaged to feel exposed and never trust anything online again. 16 of those were plausible. How many actual? Totally worth the damage to society as a whole to live as terror stricken people living with the thought that everything that they write and say is judged by authority figures instantly.

    1. Re:Chilling Effect for Your Safety by JaredOfEuropa · · Score: 1

      Judged by an algorithm, that may have applied some hidden bias and/or might simply be wrong. So you get called into the principal's office about your booze problem, or a copper pays you a visit to talk about your latent violence issues, and then it's on you to explain to them and your parents that they are wrong.

      Something similar happened here: a couple of mayors wanted to nip mounting resistance against new refugee centers in the bud, and decided to visit the most vocal opponents. One guy was visited at his business by two coppers who told him: "You are tweeting rather a lot. We have been ordered to ask you to mind your tone, as some of your tweets could be taken as inciting." Just a friendly warning and not at all aimed at silencing an opponent, according to city hall, but those who were visited had a rather different interpretation. This was just a couple dozen people manually selected by monitoring Twitter feeds, but the effect is clear: these people no longer feel free to speak out in public. Now imagine if everything you say is monitored by an AI and flagged for potential issues.

      --
      If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
    2. Re:Chilling Effect for Your Safety by JaredOfEuropa · · Score: 1

      Happened here in the Netherlands. And yes, many people were outraged even if officials insisted it was only a friendly warning about possible consequences if things actually got out of hand. Article (from Google Translate)

      --
      If construction was anything like programming, an incorrectly fitted lock would bring down the entire building...
  9. Where's the student version? by magusxxx · · Score: 1

    You know, so they can see if the teachers/school administration has had any DUI, domestic abuse calls, etc?

    Oh, that's right. If you're under eighteen you have no legal right to know this information.

    ---

    And as for turning on the camera of student issued laptops to check up on them, let me guess...

    30 seconds to check to see if the quarterback is saying a racial slur.
    5 minutes to see if the head cheerleader is drinking during a sleepover.

    --
    Care killed the cat, but satisfaction brought it back.
  10. Happy To Not Do This To My Children by Anonymous Coward · · Score: 1

    I'm perfectly happy to NOT subject my children to this surveillance.

    Fuck Bark and the horse they rode in on!

  11. Blackmail is now normal business by Picodon · · Score: 1

    The Bark product is free to schools in the U.S. for perpetuity. The company says it can afford to give the service away to schools, because of the money it makes from a version aimed at parents.

    It would be more accurate and honest to say that the Bark product being used by schools is a business-critical marketing device to gain leverage over parents and “convince” them that they’d better pony up the 9 USD per month. Because, you know, it would be too bad if their child’s school found out whatever could be out there in the cloud, and proceeded to initiate some reprisal or even call the police on their beloved little one.

  12. Social media in the next decades by AHuxley · · Score: 1

    Stop using all social media that can be tracked.
    Don't get your image uploaded to any social media service.
    Dont use names, words, jargon, locations that will induce tracking online.
    Have an online computer for work, study, education. Have a VPN computer for computer games, searching.
    Need social media for some project? Set up an account with the min information just for that. Never use it again.
    Enjoy your freedoms like past generations did.

    Be aware of how many jobs, other nations, gov, mil, services will "demand" social media accounts in later decades.
    Show them the account that has nothing on it as needed.

    --
    Domestic spying is now "Benign Information Gathering"
  13. How would this have helped in Parkland?It wouldn't by schwit1 · · Score: 1

    https://www.sun-sentinel.com/l...
    https://www.asumag.com/safety-...

    Florida school officials and law enforcement had more than enough data to stop Nicholas Cruz.

    Technology and good intentions are no match for incompetent and corrupt government officials.

  14. Re:Isn't this the responsibility of the parents? by PPH · · Score: 1

    https://en.wikipedia.org/wiki/In_loco_parentis

    You drop your kid off for the day and expect that they will be kept safe. If they aren't, you sue the school district's ass off.

    --
    Have gnu, will travel.
  15. Re:Hypocrisy by PPH · · Score: 1

    it aided their successes in life

    Becoming a teacher is considered success?

    --
    Have gnu, will travel.
  16. It's here! by CaptainDork · · Score: 1

    Social cooling.

    People are starting to realize that this 'digital reputation' could limit their opportunities.

    Look: Remember the very first porn sites way back in the 90s? We clicked to see titties and then a question popped up: "Are you over 18 or over?"

    - Yes
    - No

    We clicked, "No," and went to Disney.

    Having IQs higher than asphalt, we made another run at it and gave the answer that fit our needs.

    Few on /. are unaware of behavioural modification techniques.

    People are slowly learning to shape their narrative on social media to avoid pain and gain favour.

    --
    It little behooves the best of us to comment on the rest of us.
  17. Re: Isn't this the responsibility of the parents? by edris90 · · Score: 1

    Ha, that is some lazy parenting if I ever heard any. "it's okay if the school fucks my kid over , I can make money off of it... It's a child not a paycheck. I'm not going to honor my responsibility to my child to vet and monitor those that are trusted to care my child and sit class once in awhile 2 monitor the school's environment ." If care so little for your kid, you might as well sell them. The school system doesn't have the time to do right by your child they won't compromise your child to stabilize their metrics and make their day easier. You're still at the child has no rights for advocacy. If you're not in their checking up on the schooled keep them on their toes, they're going to think they're in charge of your kid over you. That is an ultimate betrayal of your responsibility to your child

  18. Re:Hypocrisy by dryeo · · Score: 1

    it aided their successes in life

    Becoming a teacher is considered success?

    To raise that question says so much about American culture

    --
    https://en.wikipedia.org/wiki/Inverted_totalitarianism
  19. Re: Pollute the database by HornWumpus · · Score: 1

    The term you are looking for is 'poison the well'. Good idea, more people need to do it.

    But poison the primary source, facebook etc. The school is a symptom of too much useable data being available. Of course nannies are going to nanny, it's their fucking job.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
  20. Re: Isn't this the responsibility of the parents? by PPH · · Score: 1

    That is an ultimate betrayal of your responsibility to your child.

    It's not my kid that I'm worried about. It's the child of the parent who gets indignant and insists that its his job and his job alone to raise his kid. And then his kid brings the AK-47 to school.

    Sure, I'll visit the teachers and evaluate the classroom from time to time. But you might not like my input. Maybe I'll tell them to keep that Draper kid out of the school. Because he's a trouble-maker, unstable and one social media post away from shooting up the classroom. Or perhaps I should expect them to be watching for this sort of thing impartially.

    --
    Have gnu, will travel.
  21. glad I missed this by slashmydots · · Score: 1

    The AI would simply generate a report inquiring how it's even possible for a human to post THAT MANY MEMES. It just doesn't seem possible.

  22. Re: Isn't this the responsibility of the parents? by edris90 · · Score: 1

    Why would I send my kid to public school when most of public school is waiting for the teacher to shut up cuz you finished the homework 15 minutes into class before the teacher even assigned it. Because public School workloads are that lax and easy. People are in bad lessons from public school. Mainly that it doesn't matter how hard you work it doesn't matter how well you do .they'll never reward you with anything you truly value. Your time and freedom do as you choose and go where you want because you finished your work. If kids were rewarded with free roam time for finishing their curriculum for the week you can about guarantee they will get everything done by Monday or Tuesday, so that can go explore the world and live a while. if you give kids the freedom they burned by completing their daily responsibilities, will only ever be at school long enough to get their next week's curriculum. how would they waste their time with people when there's more interesting things to explore in the world?