Slashdot Mirror
Yahoo Censors Tumblr Porn
coolnumbr12 writes "When Yahoo purchased Tumblr in May, Tumblr founder David Karp said Tumblr wouldn't be changing, and Yahoo CEO Marissa Mayer said, 'Part of our strategy here is to let Tumblr be Tumblr.' But a new search policy went into effect Thursday that excludes all adult blogs from Google, Bing, Yahoo and other search engines by disabling indexing of anything it tags as 'adult.' The policy effectively makes the content and 10 percent of Tumblr users completely invisible."
I think the point is that they're not allowing spiders to crawl pornographic tumblrs. That affects everyone who uses a search engine that respects robots.txt.
Give me Classic Slashdot or give me death!
It's like if I took something of yours that I didn't like, and welded into a box, then buried it in concrete. It's not as if I was censoring or stealing from you, right?
Isn't the result the same? Whether you take it down or hide it, people who want it can't find it.
Give me Classic Slashdot or give me death!
They didn't censor the content.....the just made it harder to find. Sensational headline.
yea.. so now you have to find some other blog that indexes them!
world was created 5 seconds before this post as it is.
More like 95% of Tumblr. Not reason to use it anymore....
it's sort of a half assed stance on the issue though.
pretty stupid too.
OOH NOW I GET IT! they're funding another search engine of their own that ignores robots.txt and will kill google off with that!
(seriously, that could be the only way googles search dominance will be beat).
world was created 5 seconds before this post as it is.
I imagine a lot more interesting content is on that part of the network.
That was really to stop two robots at either end fighting, forcing links to auto-generated pages to be instantiated, repeat ad infinitum. It wasn't really a censorship tool.
(-1: Post disagrees with my already-settled worldview) is not a valid mod option.
The summary fails. Not a big surprise, FTFA.
"Now, around 12 million Tumblr blogs marked "adult" have been removed from Tumblr's internal search; "
"Cowardice in a race, as in an individual, is the unpardonable sin." --Teddy Roosevelt
Not only Yahoo's index, they're blocking indexing for Google and Bing also. Presumably via robots.txt or similar.
2*3*3*3*3*11*251
Really? Erm, I think we should be given a list so that, you know, we can, err.., check their data-collating algorithms for accuracy. Yeah, that.
"When Yahoo purchased Tumblr in May, Tumblr founder David Karp said Tumblr wouldn't be changing, and Yahoo CEO Marissa Mayer said, 'Part of our strategy here is to let Tumblr be Tumblr.'
Yeah, and when an independent website gets purchased by a large corporation the executives never lie to the users of a new acquisition to keep them from doing a mass exodus. After all, the users themselves are a part of the deal.
and make your own blog. Or use Google blogger. Or any of a thousand different ways. Why is this even news?
I like pr0n as much as the next guy but a Slashdot groupthink seems to be developing that any entity restricting porn is bad evil censorship. Even if that entity is not government and it's not telling anyone else what to do except on its own site.
Try to replicate this behavior which was in place before the Yahoo buyout:
1. Place pornographic term in tumblr's own search engine
2. Receive lolcats
"When information is power, privacy is freedom" - Jah-Wren Ryel
I dont think somehow this is such a bad idea. I mean, they could have just deleted all those pages really
If nobody can find them what's the difference? Is this like getting out of a speeding ticket on a technicality?
Nobody is going to publish content to places no visitors will go. That defeats the whole point of publishing.
Rendering 10% of Tumblr invisible is an improvement and a great start. Please get to work on the other 90%, too.
Isn't this the equivalent of buying Slashdot and then censoring "Anonymous Cowards"?
Host $5 website. Post redirect to tumblr. Let google index your $5 website.
Your three words are meaningless. Coprorations can't censor speach (at least in this context, what actually goes on in Washington is another matter). Claiming free speach rights within the context of a private enterprise is like claiming that your free speach rights are being infringed if I throw you out of my house after you've broken in holding a megaphone. Its astounding to me how few people understand that the 1st amendment is a contraint on GOVERNMENT, not a general use wrench you can hit anyone over the head with.
Python: 'And then suddenly you have a language which says "we're all stuck with whatever the whiniest coder wants".'
Yahoo decides a tag should be filtered out.
If you at some point in the several year history of your tumblr posted something with this tag enough times you account automatically becomes set to NSFW->Adult, you cannot change this once it has been set.
From then on any post from your blog is filtered from tag search results and from search engines (via robots.txt).
The site wholly functions on tags, you can't find anything without them. You might get lucky and see a reblog from another account you follow but much like twitter the only way you can follow topics and not individuals is by the tagging system.
Given that Yahoo only recently purchased tumblr this is shaking up the user community.
my robots.txt contains one item which doesn't exist.
If you try to access that item your IP is added to the firewall drop list. (until the next reboot)
I don't even have much hosted, just some pictures I don't want to give to flikr.
Say it ain't so!!
point is that they're not allowing spiders to crawl
No, that's tangential. The point is people have made different types of information publicly available, using a private service, and now that information is being effectively taken offline with no recourse. The content is content tagged as "NSFW" or "Adult" which could affect educational content, or content not approrpriate for minors -- which isn't always porn.
This is really falls into the broader category of censoring information which was previously publicly available. FTFA that's about 12 million sites apparently
Join the Slashcott! Feb 10 thru Feb 17!
Yeah, but how do you know it's a honeypot, and not just a normal 404 situation? If you start excluding every site on the internet that has missing pages in one of its indexes, you aren't going to have a very good data set.
When they said "tumblr won't be changing", it's cute how ANYBODY believed them. Acquiring companies always say that. It's always a lie. In this case, most people even predicted it was a lie.
Don't worry, this is just step one. They'll totally wreck things later.
-- "So they told me that using the download page to download something was not something they anticipated." - Bill Gates
It's not just blogs that feature posts tagged as "adult," it's the entirety of any blog tumblr has already flagged as NSFW or adult (the overall blog flag, not just posts). My personal photography blog has been branded as NSFW, as I sometimes post risque work. Basically, there will be no new discovery of my blog, since Tumblr's also blocked internal tag searches for such blogs as well (unless one is already following said blog). My rate of addition of new followers dropped precipitously after that. Bastards...like the occasional nipple is going to end the world.
That? That was a pigeon.
That could be interpreted as unauthorized access under the CFAA.
Give me Classic Slashdot or give me death!
If only. Tumblr is incredibly awful in its design and execution, and it would be a blessing if it caused its users to flock to a better services, ideally leaving behind the social 'justice' thugs.
And, they are stipping the tags from those sites as well so that in internal search will not show those sites either. You have to either see their content through a reblog or if you're following them.
I got here through a series of tubes
David Karp insisted they weren't going to try and censor the adult blogs, while appearing on the Colbert Report just three days ago.
.: Semper Absurda
Free speech is the right that no coercive force will be used to stop speech. It mostly applies to government, but could apply to anyone being physically threatened for what they say.
Censorship, as is commonly used, isn't limited to free speech, but also in instances where there was an implied liberty to speak one's mind. If a television show bleeps someone out, that's called "censorship". If a library removes a book over interest group pressure, that's "censorship". If a newspaper fires a columnist for something they wrote, that's "censorship" (if said newspaper refuses to print someone's letter to the editor, though, that's distinctly not censorship).
And if Tumblr is changing their policy to restrict more forms of speech, that would be censorship.
Wonder what the public key field is for?
Also, I had noticed that most Tumblr pages did not have any warning for adult content.
When are they going to start warning people about childish content?
Give me Classic Slashdot or give me death!
Try doing your research using "speech" rather than "speach" next time. You'll get better information about how things in the Constitution apply to everyone, not just the government.
came here to say this as well. He just said that they would keep it pure when asked exactly this question! Hopefully colbert calls him out next week, or today.
As a potential lottery winner, I totally support tax cuts for the wealthy
To be classified as porn, two opinions have to be met: provokes a sexual response, and has no artistic merit.
Given that people have rather elaborate sexual fetishes, the first part can be (and is) used to classify practically any type of content as porn by at least someone. Not to mention that some people get a hardon from leather boots -- ergo leather boots are pornography? The second aspect is grossly subjective as well, as some people find art in the arrangement of trashcan contents.
Because of this, what get's classified as porn by one individual may not be classified as such by another. Strictly speaking, it becomes a scenario of "you can't look for this because I said so". Well, excuse me, but... I've outgrown the need for parenting on that level. We're basically all adults (or on the way of becoming one), and the world is ran by adults for adults. Subjecting all of us to childlike treatment is an insult.
If a corporation with market power over a particular medium uses a government-granted power to curate speech, is that censorship? For example, Apple and the game console makers curate their devices' respective stores, and they enforce this through anticircumvention provisions of copyright law.
Can you segregate your adult stuff into a separate blog, or is there a limit of one blog per account and one account per person?
Hey, if you like being treated like a retarded child that cannot decide this for himself for no apparent reason, sure... no sympathy necessary for you.
To be classified as porn, two opinions have to be met: provokes a sexual response, and has no artistic merit.
Who says? Because that really sounds like the legal definition of obscenity according to the ruling in Miller v California:
The Miller test for obscenity includes the following criteria: (1) whether âthe average person, applying contemporary community standardsâ(TM) would find that the work, âtaken as a whole,â(TM) appeals to âprurient interestâ(TM) (2) whether the work depicts or describes, in a patently offensive way, sexual conduct specifically defined by the applicable state law, and (3) whether the work, âtaken as a whole,â(TM) lacks serious literary, artistic, political, or scientific value.
http://www.law.cornell.edu/wex/obscenity
When information is power, privacy is freedom.
Slashdot is unusable without noscript.
is a really old signature, isn't it?
-- --
Self expression need not be limited to original content. Self expression is completely satisfied by the following statement: "I like X" (or XXX, or whatever). Publishing is no longer a profession in of itself (types of publishing may be). Furthermore, you don't really get a say whether their point was worth making, it's subjective and irrelevant to the discussion.
No shit... and where's the same treatment for stupidity? At least sex is wired up through biology. Stupidity legacy is that it's often responsible for shorter lifespans.
Yes, I don't change my sig often. I whitelisted slashdot in noscript, with the classic discussion system it's a lot better than it was when I wrote that. I will edit my sig, thanks.
Give me Classic Slashdot or give me death!
Here are all these blogs that are tagging themselves NSFW. It doesn't mean they are all porn, it's just that it's more adult themed. I've seen quite a lot of "adult" tumblr blogs that are quite artistic. Instead of univiversally blocking them from search engines... They should innovate and start a robots tag that tags the site or certain sections NSFW. That could be carried through to search engines and "safesearch" options that the user selects. Just as much as I want information to be free... I want user choices to be respected.
-- these are only opinions and they might not be mine.
Is it satisfying to show the world your bigotry and then have it tell you, in response, that it wants you dead (preferably unborn, but we're past that bit)?
Someone should make a search engine that *only* indexes the stuff that robots.txt suggests against.
I imagine a lot more interesting content is on that part of the network.
Yep. I want "Unsafe search" as an option for my search results - filter out all the mundane crap.
No sig today...
A new use for magnet links, perhaps?
While 10% of the blogs are estimated to be tagged adult.. It's actually closer to 25% of their traffic. I'm guessing internally they knew that tumblr's adult content was rising faster than the rest of the site, and they certainly don't want it to be primarily adult. It might be better for them long term, but there should be some brushback over this.
-- these are only opinions and they might not be mine.
Someone should make a search engine that *only* indexes the stuff that robots.txt suggests against.
Those entries aren't "suggestions" - they are instructions I want search engine spiders to unquestionably follow.
#DeleteChrome
Despite their explicit promise "not to screw it up", the very first action Yahoo has taken as owner of Tumbler, is to ruin Tumblr. Major bummer! Looks like I'm going to have to remove all my - decidedly non-pornographic - content and find a new home for it. Any suggestions /. for a less prudish microblogging site?
Can someone explain to me why Yahoo is still in business? Do they have actual users/customers??
well said
intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
Be fair - it's hard to think up cogent analogies for other situations when you're inside a welded box that's been encased in concrete.
I'm surprised he's got any Internet access in there at all, frankly. I'll have to figure out how that happened before the next time.
#DeleteChrome
...as if millions of wankers suddenly cried out in terror and were suddenly silenced.
Seriously though, Yahoo has a knack for turning acquisitions to shit. Nobody should be surprised here. Expect more "improvements".
It's better to vote for what you want and not get it than to vote for what you don't want and get it.
- E. Debs
I've never used Tumblr, but it sounds like they are saying that people with blogs marked 'adult' should mark their blogs as 'unicorns and puppys' so that they get indexed again?
We hate you back
Fine! I'm gonna go build my own image microblog, with blackjack and hookers!
Probably should make it distributed and censorship-resistant by design.
I propose this new site be named bendr!
the preceding comment is my own and in no way reflects the opinion of the Joint Chiefs of Staff
When are they going to start warning people about childish content?
But this is the default. Why should any warning be needed?
Il n'y a pas de Planet B.
porn ... legal definition of obscenity
obscenity != porn
(or at least not necessarily)
Sure would be nice if the search engines let you choose which of the two (if any) you wanted filtered.
Pornography is one of the MAIN driving forces behind much of what shapes the web today. It may be a waste of space in your opinion, but there are hundreds of advancements in web design, storage, streaming, and so on that would not be where they are today without Pornography.
If you don't like it, fine, but give it credit when it is due. Don't dismiss it.
Dream as if you'll live forever.
Live as if you'll die tomorrow.
~Anonymous~
This is brilliant. I'm going to set this up immediately on my own system. Kudos to your hacker mindset.
Bits of code, random ramblings: jakimfett.com
Most women can't stand porn? Are you a new kind of moron?
For a good discussion of this, see the following post at Eros blog:
http://www.erosblog.com/2013/07/19/tumblr-admits-then-denies-hiding-porn/
Eros reported on this back in May, and here has a good discussion of the evasions and falsehoods from Yahoo!
Wait, the internet still has ads?
::turns off my adblocker::
::visits a couple of sites::
::turns adblocker back on::
Oh right...wow...this has gotten a lot worse since I last checked...
Aaaahhhh...that's better.
Bits of code, random ramblings: jakimfett.com
More likely the company is trying to make itself more "family friendly" because they have seen that Ballmer is completely batshit insane and with the Yahoo Search deal going out soon are hoping to get daddy Ballmer to open that big fat wallet to either buy Tumblr or the whole thing.
Personally if the sweaty one gets his mitts on yahoo some programmer here needs to set up a free email with the yahoo look and a similar chat as they'll slaughter, all that Skype bullshit has caused a LOT of folks to go running to Yahoo (seen that sudden bounce Yahoo had a few months back? Well there ya go) and if the ballmernator replaces Yahoo with "Windows Live Bing 3.0 powered by Skype" you are gonna have a HUGE audience that will be happy to come to you, just charge for a couple of extras and enjoy the money truck that backs up to your place every month.
Oh and if you do this and make a mint? For a small fee you can have "help powered by Da Feet" which while not always helpful at the very least it'll be entertaining.
ACs don't waste your time replying, your posts are never seen by me.
Porn is, by definition, obscene. Also, as a radio DJ who must be familiar with such things, the FCC says that things that are sexually explicit and have no "literary, artistic, political, or scientific value" are obscene (just like the earlier commenter posted).
I understand that the government isn't always right, and that the FCC theoretically only has jurisdiction over the United States, but the fact that a vague-but-menacing government agency also says that porn is obscene only helps to defend my (our?) point.
~Jarmihi
"To be classified as porn, two opinions have to be met: provokes a sexual response, and has no artistic merit."
No, that's the legal test for obscenity (not porn).
We know where leadership by an anti-intellectual "strongman" who scapegoats minorities and likes boisterous rallies goes
"...just made it harder to find"
Imagine trying to find information at the Public Library if the librarians suddenly got rid of the catalog. Sure, you could find the information, but at serious cost to the amount of time you have available to you, and thereby preventing you from spending that time looking up other information. What Yahoo! has done is worse--they essentially took books off the shelves and put them in the fucking basement. Define it as you may, this is censorship.
Corporate Mass-Media is doing this with the Snowden/PRISM articles--they're there, just buried amongst all the Trayvon/Zimmerman articles. It's all Jedi mind tricks...
Also doesn't help that Mayer is a practicing Christian
Not surprising, this is the same thing they did after they bought egroups back in 2000, they waited a few months, then made the adult groups disappear from the listings and search.
Well, making it so the results don' show up when they could... that';s still textbook censorship. It may be ACCEPTABLE censorship, but too many people seem too oblivious lately to what the term actually encompasses or not just IMO.
If you believe in privacy, and believe you have "nothing to hide" at the same time, you're a goddammed idiot
Still wrong. The point is that yahoo has just killed the one use for Tumblr. Yahoo shutting down their search engine would be less surprising to me. Admittedly, I haven't looked at numbers on that, maybe people still haven't heard of this "google" thing, and maybe a lot of people love sharing cat photos on tumblr.
The censorship thing isn't important. There are one or two other websites on the internet where you can get porn.
You misunderstood the analogy (I think). "Free Speech Zones" were nonsense created by the government intending to hide and push speech they didn't like to irrelevancy. The definition of censorship is not the point, but rather the act of pushing things off to a dark corner effectively stifling the content/speech is what is comparable here.
PocketPermissions Android Permission Guide
Neat idea. How did you set that up? A custom fail2ban filter? Some other way?
I was thinking the same thing, except a wiki instead of a blog, so that they could add themselves and their favorite keywords. Many times when I search for something, among the top results are these idiot pages that have no information on my topic of their own, just lists of links to other pages. Here's a case where a page like that could actually be useful. The Hidden Tumblr Wiki Index could be a route around the search stoppage.
The people with porn Tumblrs don't need to move, they just need an easy way to be found. Why not a retro, Yahoo-style directory? That's how lots of us found things before search engines got so good. Just start tumblrporn.com (lawyers permitting) and list all the blogs Yahoo doesn't want indexed, in categories. Sell ads. Profit!
Q: What does the "B." in Benoit B. Mandelbrot stand for? A: Benoit B. Mandelbrot
It is censorship that is Constitutionally illegal in the United States.
Please, don't let little things like facts get in your way. The 1st amendment makes it illegal for the US Govt to suppress free speach, it does NOT prevent private entities from controlling content they publish. Yahoo is not doing anything illegal. It's fundamentally no different than Blockbuster deciding they won't stock X-Rated movies, or when 7-11 decided to stop selling Penthouse magazines, or Craigslist deciding to drop certain adult categories.
Don't like it? Then take your business elsewhere.
Another everyone is a techie solution. I invite you to go visit some of the tumblr porn feeds. Go to the first 10 odd posts and see just how basic people's understandings of how even the idiot proof tumblr works.
That site is not made up of techies.
my robots.txt contains one item which doesn't exist.
If you try to access that item your IP is added to the firewall drop list. (until the next reboot)
I don't even have much hosted, just some pictures I don't want to give to flikr.
On the other hand, you've just documented your disallowed content, so I actually don't need to access the content itself in order to index it -- I only need to know to download your robots.txt and shove it into my index.
As the service grows (assuming it does), then I can have a fleet of non-contiguous IP addresses which I use as "content verifiers" for the robots.txt contents (e.g. directories vs. files), and I can "burn" them against your site for content verification.
The arms race escalation is pretty obvious, and contains some interesting twists, but it's basically an arms race, and you will be as effective against it as the battle against SPAM has been so far (there are strategies there, too, but they involve forcing hosting of email bodies by the email sender and similar techniques).
So using the same tripwire technique that the phone companies used to use against wardialers (like I used to be, before it was a criminal offense, and then still, before I turned 18) won't prevent the eventual success.
Personally, I would never do this, since the stuff people think is very private, and then feed to robots in the robots.txt anyway, is generally not very interesting in the first place.
Especially now that Google has removed that math-undefined bug that basically acted as the opposite of safesearch, instead returning all porn...
Do not look into laser with remaining eye.
I'm a little surprised that it's only 10% that are blocked. I figured it'd be only 10% that weren't blocked...
Do not look into laser with remaining eye.
There had been a bug in Google that essentially was smutsearch. Basically some kind of irrational math bug that would bring up only porn. They seem to have fixed it though.
Do not look into laser with remaining eye.
Must be some pretty cheap steel, not even good enough to be a faraday cage...
Do not look into laser with remaining eye.
The firewall may redirect to an all-404 host instead of blocking.
it's a decent compromise between not wanting to appear as a smut hub but still allowing free speech for users.
Snowden and Manning are heroes.
That's why she's hiding the porn instead of removing it.
Me three
Would a hyperlink suffice? Do search engine spiders parse robots.txt when they arrive at a page from an external link?
Yes they do, so no, linking to a Tumblr page would not get the Tumblr page indexed.
$x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
$x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
Porn doesn't matter? Heathen!
Jonathanjk.com
Actually, corporations can censor speech.
Filthy, filthy copyrapists!
I was thinking that too. I wasn't aware that there was anything on tumblr that wasn't porn.
sub f{($f)=@_;print"$f(q{$f});";}f(q{sub f{($f)=@_;print"$f(q{$f});";}f});
Says one thing, does the opposite...
http://www.colbertnation.com/the-colbert-report-videos/427790/july-16-2013/david-karp
I kind of do that, except that I have the directory named in the robots.txt file handled by a CGI that generates a list of random email addresses along with a randomized "link" to follow that includes a depth count. If they follow the link, the CGI delays a little bit of time proportional to the depth, and gives them another page of bogus email addresses with yet another link. The idea is to tarpit their stupid bot, and if they happen to be crawling for email addresses, give them lots of those.
That's why she's hiding the porn instead of removing it.
Jokes on her; I fap to this.
Jesus was all right but his disciples were thick and ordinary. -John Lennon
I never mentioned the first amendment. You read that in yourself.
If someone were to break into your house and demand you not say that ever again, that would be a violation of free speech, just not by the government, nor in violation of the first amendment (just numerous other crimes).
Nor did I say public libraries. I really mean all libraries.
You can't cite yourself as a source, that doesn't prove anything.
Wonder what the public key field is for?
Jesus saves etc.
I do not want your cheap brainburning drugs. They are useless for work. And I am a working man today.
That really only works when you can count on hosts to not abuse robots.txt - if I were Google, I'd start ignoring all robots.txt on Tumblr. You can more or less expect them to be malicious, so you make rules to limit the damage. Easy peasy. You abuse it? Well, that's why you can't have nice things.