Slashdot Mirror


'Something Is Wrong On the Internet' (medium.com)

"Someone or something or some combination of people and things is using YouTube to systematically frighten, traumatize, and abuse children, automatically and at scale, and it forces me to question my own beliefs about the internet, at every level," writes James Bridle. From the article: To begin: Kid's YouTube is definitely and markedly weird. I've been aware of its weirdness for some time. Last year, there were a number of articles posted about the Surprise Egg craze. Surprise Eggs videos depict, often at excruciating length, the process of unwrapping Kinder and other egg toys. That's it, but kids are captivated by them. There are thousands and thousands of these videos and thousands and thousands, if not millions, of children watching them. [...] What I find somewhat disturbing about the proliferation of even (relatively) normal kids videos is the impossibility of determining the degree of automation which is at work here; how to parse out the gap between human and machine. The New York Times, last week: Parents and children have flocked to Google-owned YouTube Kids since it was introduced in early 2015. The app's more than 11 million weekly viewers are drawn in by its seemingly infinite supply of clips, including those from popular shows by Disney and Nickelodeon, and the knowledge that the app is supposed to contain only child-friendly content that has been automatically filtered from the main YouTube site. But the app contains dark corners, too, as videos that are disturbing for children slip past its filters, either by mistake or because bad actors have found ways to fool the YouTube Kids algorithms. In recent months, parents like Ms. Burns have complained that their children have been shown videos with well-known characters in violent or lewd situations and other clips with disturbing imagery, sometimes set to nursery rhymes.

46 of 365 comments (clear)

  1. What a terrible headline by Anonymous Coward · · Score: 5, Informative

    "Something is wrong on the Internet" does not immediately translate to "so let me tell you about these absolutely bizarre and potentially illegal Youtube videos."

    1. Re:What a terrible headline by Opportunist · · Score: 4, Funny

      The same parents that watch afternoon talk and court shows and scripted reality shows?

      --
      We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
    2. Re:What a terrible headline by msauve · · Score: 2

      And use Youtube as a babysitter.

      --
      "National Security is the chief cause of national insecurity." - Celine's First Law
    3. Re:What a terrible headline by MightyMartian · · Score: 2

      I'm still trying to put a finger on what the problem here is. You might as well say a video of Andy Kaufman reading the Great Gatsby is a form of abuse.

      --
      The world's burning. Moped Jesus spotted on I50. Details at 11.
    4. Re:What a terrible headline by Bryansix · · Score: 4, Insightful

      Children tend to have a hard time distinguishing fantasy from reality. Usually they mistake unreal things for real but occasionally they mistake real things for unreal. https://www.ncbi.nlm.nih.gov/p...

      However, that isn't the only problem here. There is also the problem of being exposed to and having to deal with the very idea of violence and physical harm. To you or me, we are probably desensitized to such an idea. People die every day and we know it. A child hasn't processed this kind of reality and the first time they do process it, it will be hard even if they know it is unreal. This is because, they still have to address in their minds that it can happen in reality.

    5. Re:What a terrible headline by angel'o'sphere · · Score: 4, Interesting

      Well,
      kids (depending on age) are not scared by macabre jokes/cartoons.

      When I grew up we had a joke type called 'alle Kinder', aka 'all children', sorry I can not make perfect rhymes, as I lack knowledge about english names, but I try:

      All the children are watching the burning house,
      But not _Klaus_ (should rhyme with house)
      he looks out of the window (in german it would rhyme with house: 'er schaut raus')

      All the children are up to the neck in mud/swamp
      but not Porter,
      he is shorter.

      All the children watch the burning car
      just not Kell
      he is in the seat belt.

      I don't recall anyone getting psychological problems from such jokes ... but well, we are a tough generation! (*flex*)

      --
      Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
    6. Re:What a terrible headline by war4peace · · Score: 5, Insightful

      Must have been a "modern" psychologist bullshitting you like that.
      I don't remember the first time I was exposed to the concept of death, but it must have been before I was 4, when I buried my dead cat with help from my grandparents. I remember having been familiar with the concept of disease (cat died because it was sick) and physical harm (chicken and pigs being slaughtered for food, for example).

      At the countryside, kids are exposed to these things from start. If kids reach the age of 3-4 and are not yet exposed to reality of this kind (living things die, harm may happen to them, etc) then they're not raised well. Helicopter parenting is a plague - remember that.

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
    7. Re:What a terrible headline by cayenne8 · · Score: 5, Interesting

      Children tend to have a hard time distinguishing fantasy from reality. Usually they mistake unreal things for real but occasionally they mistake real things for unreal.

      Then I guess today's children are getting more stupid with every generation somehow.

      I grew up in the days of cartoons every afternoon and Saturday all morning....in the days of NON- censored Loony Tunes.....I knew full well at the youngest age I have memories that cartoon violence was different than reality.

      I knew that the anvil that hit Wily Coyote was not real and would kill a real person or animal.

      Hell, I remember one old Bugs Bunny cartoon....where he saw Elmer asleep against a tree...and Bugs whipped out a bottle of sleeping pills, labeled "Take Deeze and Dose"....gulped them down and fell asleep there too so he could enter Elmers dream and mess with him there.

      I saw this same cartoon not long back...and that part with the sleeping pills? It was fucking edited OUT?!?!

      Seriously? We can't let kids see that anymore? The snowflakes are now too sensitive, and can't know cartoon from reality?

      Ugh....

      --
      Light travels faster than sound. This is why some people appear bright until you hear them speak.........
    8. Re:What a terrible headline by AmiMoJo · · Score: 2

      The problem is that YouTube is being cheap. Rather than hire humans to do manual reviews, they want to rely on flawed AI. Just pay people to do it while the AI shadows, until you get it working properly.

      But no, they want kids to beta test it for them. They want YouTube creators to put their livelihoods on the line so they can save a few bucks.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    9. Re:What a terrible headline by PCM2 · · Score: 2

      However, that isn't the only problem here. There is also the problem of being exposed to and having to deal with the very idea of violence and physical harm.

      Meh. I had 14 stitches put into my face when I was three years old. It traumatized me only in the literal sense, not the psychological sense. If anything, I learned that my parents and doctors were there to take care of me. How old do YOU figure a child needs to be to learn about "the very idea of violence and physical harm"?

      --
      Breakfast served all day!
    10. Re:What a terrible headline by interkin3tic · · Score: 5, Insightful

      I don't remember the first time I was exposed to the concept of death, but it must have been before I was 4, when I buried my dead cat with help from my grandparents.

      Yes. With your grandparents or another adult right beside you. Not some anonymous asshole from 4chan who gets off on scarring you. Context.

    11. Re:What a terrible headline by nine-times · · Score: 2

      Yeah, I think it's also worth mentioning that "explaining things to children" might not work the way people think it does.

      I'm not sure how to explain for those who don't already know what I'm talking about, but a 5 year old isn't going to be able to understand certain kinds of things. Kids memorize things that they hear, and they try to mimic adults and say the "right thing". They'll parrot back the things they've been told, and so a lot of people think that the kids have taken in the information and understand what it means. Often, it's not the case. Kids get very focused, and are sometimes very good, at figuring out which thing you want them to say, and then saying it to get approval.

      So when you explain to a child "cartoons and monsters aren't real," young children will be able to tell you, from then on, that cartoons and monsters aren't real. That doesn't mean that they understand what that means.

      And honestly, a lot of adults have a hard time figuring out the difference between "real" and "not real".

    12. Re:What a terrible headline by Gr8Apes · · Score: 4, Insightful

      Just watch the original Pinocchio... the smoking, drinking, and general adult behavior in a "kid's" show may surprise you. What's even more surprising is that few adults remember any of those things when they saw it as kids, they do remember Pinocchio made some bad choices, but mostly his nose grew when he lied, and he was a wooden puppet. Oh, and he turned into a real boy.

      --
      The cesspool just got a check and balance.
    13. Re:What a terrible headline by ourlovecanlastforeve · · Score: 2, Insightful

      Parents avoid difficult conversations with their kids by claiming they are doing it to protect their children.

      Mental health professionals avoid having to tell parents they are terrible at parenting by diagnosing children with ADD or Aspergers or some other intangible mental health problem and sending them home with head candy drugs so they'll stop coming back.

    14. Re:What a terrible headline by Anonymous Coward · · Score: 4, Funny

      I never saw Pinochio. Thanks for the spoiler alert, asshole.

    15. Re:What a terrible headline by mattack2 · · Score: 2

      Even more general, many of the Grimm Fairy Tales (and I think Aesop Fables) were very adult.

      I remember several times I've seen books published about the 'censored' Fairy Tales.

    16. Re:What a terrible headline by Gr8Apes · · Score: 2

      Grimm's Fairy Tales, IIRC, weren't meant for kids, nor were Aesop's Fables. They were primarily a vehicle for teaching ethics among other things.

      --
      The cesspool just got a check and balance.
    17. Re:What a terrible headline by mattack2 · · Score: 2

      If you trust the Wikipedia info, they were *called* "Children's and Household Tales", though the "Composition" info following says "they were not regarded as suitable for children, both for the scholarly information included and the subject matter." Various info, like sexual references, were removed, but violence was increased! (So that's not just a US phenomenon!)

      https://en.wikipedia.org/wiki/Grimms'_Fairy_Tales/

    18. Re:What a terrible headline by war4peace · · Score: 2

      You mistake "traumatic" with "important", or rather a development keystone.
      I vividly remember burying my cat as well as going to a great country fair. Are you saying the country fair was traumatic too?

      --
      ...gis sdrawkcab (usually not responding to ACs; don't bother posting as AC)
  2. Ms. Burns by Osgeld · · Score: 5, Insightful

    quit showing your kids stuff you don't like, you are the parent and are responsible for what they consume you dink

    1. Re: Ms. Burns by Luthair · · Score: 2

      Ultimately it isn't a babysitter and the internet isn't a great place - you should be keeping an eye on what your kid is watching.

    2. Re: Ms. Burns by Squiddie · · Score: 2

      Yeah, back when I first started on the internet, it was well understood that you didn't post personal info or let kids wonder by themselves on it. It seems now we are on the reverse, where everyone posts everything on the internet, and parents expect the internet to raise their kids for them.

  3. Did somebody bring Happy Tree Friends back? by ffkom · · Score: 5, Funny

    If that is what happened, then please tell me the URLs, it was one of my favourite shows!

    (Here is some older example: https://www.youtube.com/watch?... )

  4. It's almost like.... by whyyisthissohard · · Score: 5, Insightful

    It's almost like some one is profiting from the effects of these attacks our childrens' minds. Like some one wants people to grow up and be triggered into hyperactivity by certain cues from screaming colors and sounds.
    *glances at media-driven political feud*
    I wonder why???????

  5. Obligatory xkcd by Chris+Mattern · · Score: 4, Funny
  6. The Problem Of Spam, this time with video. by Anonymous Coward · · Score: 2, Insightful

    The video titles are a continuous pattern of obscure branded lines and tie-ins: âoeSurprise Play Doh Eggs Peppa Pig Stamper Cars Pocoyo Minecraft Smurfs Kinder Play Doh Sparkle Brilho,â âoeCars Screaminâ(TM) Banshee Eats Lightning McQueen Disney Pixar,â âoeDisney Baby Pop Up Pals Easter Eggs SURPRISE.â As I write this he has done a total of 4,426 videos and counting. With so many viewsâSâ"âSfor comparison, Justin Bieberâ(TM)s official channel has more than 10 billion views, while full-time YouTube celebrity PewDiePie has nearly 12 billionâSâ"âSitâ(TM)s likely this man makes a living as a pair of gently murmuring hands that unwrap Kinder eggs. (Surprise-egg videos are all accompanied by pre-roll, and sometimes mid-video and ads.)

    No, this man makes a living programmatically cutting and pasting SEO-optimized terms, and he has enough actual unwrapping video that it bypasses the AI-optimized content filters.

    The only thing wrong with the Internet is that AdTech/BigData/AttentionEconomy's business model of "write a paper/get-VC-funding/get-acquihired about how to use AI to automatically select content that's safe for the target audience but doesn't involve Google hiring thousands of human beings to curate the content" involves, well, writing clever papers.

    Writing clever papers about automating content detection/rating may be more fun than solving the hard AI problem, but doesn't, umm, actually solve the hard AI problem of determining when a vlogger is (a) real, (b) spamming, or (c) trolling..

  7. Easy To Turn Off by Anonymous Coward · · Score: 2, Insightful

    Turn it off, make your kid go outside. Voila.

  8. Something is wrong? With...what? by da_Den_man · · Score: 2, Insightful

    With Parents who demand someone else watch and monitor their child's playtime activity? Instead of playing, the parents let the kids watch video's that the parents have not even watched once? That technology is good, but REAL interactions are the BEST? Yeah, something IS wrong indeed

    --
    You keep going until you die..."Me".
  9. Eh... by Gilgaron · · Score: 3, Insightful

    Next thing you know they'll be on Slashdot and click a link to goatse!

  10. How Hard Is It To Curate Youtube KIDS Properly??? by dryriver · · Score: 5, Insightful

    So you are creating a Youtube site/app for Kids and are using _algorithms_ to keep the kids safe from bad content? Er, Google... how many tens of Billion dollars does your company have in its coffers? Is it so bloody hard to hire 500 people whose job it is to watch the videos and determine whether they are suitable for kids?

    --
    Why did the chicken cross the road? Because Elon Musk put an AI chip in its head.
  11. An example by Harlequin80 · · Score: 5, Informative

    There is a video where gentle music plays and cutesy version of my little ponies slide across the screen into a box full of cotton wool. That is the original version. Goes for about 2 minutes. Sounds like torture when described like that but the kids liked it.

    Someone released a version where about 90 seconds in the box of cotton wool is replaced with a box of nails and the pony is eviscerated by them. There is also a change in the audio to a distorted "Oh Fuck". And it then goes back to the cutesy version.

    No other reason to do that then to get past the automated filters and mess with little kids.

    1. Re:An example by CanHasDIY · · Score: 3, Insightful

      No other reason to do that then to get past the automated filters and mess with little kids.

      Yup, some people are just plain ol' tacky assholes.

      What I don't get is how people think a website that literally anyone can upload a video to is a good babysitter for their kid. I mean, you wouldn't set up a playpen in the middle of Union Station and just leave little Johnny Bastard to the wolves, would you?

      --
      An enigma, wrapped in a riddle, shrouded in bacon and cheese
    2. Re:An example by cmseagle · · Score: 2

      What I don't get is how people think a website that literally anyone can upload a video to is a good babysitter for their kid

      Because that website's marketing implies that it's kid friendly. It even looks fine to a parent taking a quick pass over the type of content their child is likely to be exposed to. The bad content is deliberately obfuscated by bad actors.

      A better analogy would be advertising a service as a daycare, having a nice front to fool parents, and then leaving little Johnny in a playpen in the middle of Union Station. Yeah, the parent could have tried harder to vet the service caring for their kid, but the service provider bears some responsibility for misleading the consumer's guardian.

  12. Strong element of Corporate Cronyism. by Shalian · · Score: 2

    Regardless of the merits of the detailed examples, a lot of the article just struct me as saying, "If it's not from Disney you can't trust it!" Never mind your local children book authors! They may be up to something no good! CONSUME ONLY DISNEY.

    1. Re:Strong element of Corporate Cronyism. by ffkom · · Score: 2

      ... only to watch all those traumatizing genitalia in their movies? http://www.ebaumsworld.com/pic... :-)

  13. Question my beliefs? by Headw1nd · · Score: 3, Funny

    On the contrary, this only strengthens my beliefs about the internet. Like all the rest of it, at the very root is some man jacking off.

  14. oh wait ... by cascadingstylesheet · · Score: 3

    ... so it is OK for me to not let my kids have smart phones and for me to police their internet usage?

    Because the rest of the time that supposedly makes us backward freaks.

  15. Re:How Hard Is It To Curate Youtube KIDS Properly? by WolfgangVL · · Score: 3

    Can you imagine the trauma stories that would come out of that office? Have you ever actually sat and watched legit children's programming? I doubt the smut-porn police would last more than a week.

    Seriously though, if you replace the babysitter with a computer, your gonna get trolled. EVERY. TIME.

    --
    You are being ripped off every second of every day, so that advertisers can help rip you off even more tomorrow.
  16. Internet is not the problem, you are by joao.cordeiro · · Score: 3, Insightful

    The internet is like going outside it has war, killers, morons, sex, violence.
    And it should stay that way, as it should reflect all humans in this planet, not just middle class parents.

    The problem is ppl like you that think the internet could replace you as a parent.
    What you should do is to filter what your kind kids see, by seeing it 1st. In the same way you don't send you kid alone to the cinema. And while you do that, try to make your kids to think about what they are, in order to grow a strong personality and be able to face the internet and the street and a younger age.

  17. Missing the Point by nealric · · Score: 4, Insightful

    I think a lot of commentators are missing the point of the original article. The fact that kids might see somewhat inappropriate videos is just a symptom of the underlying problem.

    The problem is that the information we see and content we view is increasingly the result of the interactions of various algorithms. You see this in the way Google inadvertently promotes conspiracy theories. The content itself starts to become more and more automated as every video or article just ends up being a reconfiguration of popular keywords. I suppose the dystopic end-game if this were in an episode of Black Mirror would have everyone completely disassociated from reality as all information they consume is simply generated and and pushed out to them by various bots interacting.

  18. I really wish that YouTube did this differently by Anonymous Coward · · Score: 2, Interesting

    If YouTube would put the hosting channel into the URL I could filter based on that.

    I don't know how many times I let my son watch some Etholabs video and then came back and he had clicked on another Minecraft video from someone that was... less in control of their vocabulary.

    If I could have white-listed YouTube.com/Ethoslab instead of YouTube.com, I could have prevented that, but they don't include the channel in the URL so I can't.

  19. One site or app is poorly curated by istartedi · · Score: 4, Insightful

    Big company decides that bots are "good enough". They aren't. That's all this is. As bad as it is to sit your kids in front of the old fashioned tube, as much as you might complain about the FCC, there was pretty much zero chance that we were going to see Oscar, Big Bird, and the Count going at it in a 3-way. That's because real human adults were in charge, and were paid what they were worth. The Internet isn't broken. A bunch of greedy pigs just paid some cheap coders far less to create something much less safe, then a bunch of lazy parents sat their kids down in front of it. The results were predictable.

    --
    For all intensive purposes, "whom" is no longer a word. That begs the question, "who cares"?
  20. But the conservatives! by wjcofkc · · Score: 2

    YouTube is going nuts thought policing conservatives while this kind of garbage intended for kids gets right by? Yes, I watched some of the videos in question, and they are disturbing. I find it absolutely astounding that Google\YouTube puts human effort into censoring political material for adults, and then turns around and says it's up to adults to police the kids section. What the actual fuck?

    --
    Brought to you by Carl's Junior.
  21. Re: I really wish that YouTube did this differentl by TangoMargarine · · Score: 2

    Whitelist, not blacklist.

    --
    Unity? Screw that: XFCE. Slashdot Beta? Screw that: SoylentNews. Australis? Screw that: Pale Moon. UX developers DIAF
  22. Re:It's not 'something', it's the Internet itself by CanHasDIY · · Score: 2

    The Internet has been twisted and subverted from being the font of information and a vastly useful tool for humanity in general, into something driven by greed and the very worst that humanity has to offer

    So... I take it you were never on Usenet?

    --
    An enigma, wrapped in a riddle, shrouded in bacon and cheese
  23. Han Solo shot (first and last) by Evtim · · Score: 2

    Well, I think both the baby boomers and the GenX have gone senile so the millennials through no fault of their own are less capable to face difficulties in life.

    The Han Solo story illustrates this perfectly. Lucas commented that he never expected so much outrage for changing that scene. "If people want Han Solo to be murderer (!?!?!?) then so be it".
    Now wait a minute! What you say is that our children must be taught that if they have a professional murderer pointing a gun at them from 1m who has stated already that he wants to kill you (or take the money which from HS point of view is the same, if he had the money) and you have this one in a billion chance to come on top you should not take it because it is "bad" or "immoral"? What kind of retarded message is that? If I had children I would not want them to listen to senile uncle Lucas....