A User Archived Nearly 2 Million Gigabytes of Porn to Test Amazon's 'Unlimited' Cloud Storage (vice.com)
An anonymous reader shares a report: Reddit user beaston02 was determined to find the true ceiling of Amazon's cloud storage plan, which was killed off in June. He decided to push its limits with a petabyte of porn. For reference, a petabyte is one million gigabytes. "It is nearly entirely porn," he told me in a Reddit message. "Ever since I got into computers, I found myself learning more, and faster when it was something more interesting. Call me crazy, but women interest me more than most other things on the internet and there is a huge amount of data being created daily, so it was a good fit for the project." He said it took five or six months to collect one petabyte of porn, and he stopped collecting just shy of 1.8 petabytes. How long would it take one to consume 1.8 petabytes of porn? 1.8 petabytes is about 23.4 years of HD-TV video, but webcam streams are nowhere near that quality. A few good folks crunched the numbers: 720p is about two gigabytes per hour, and at 900,000 hours, that's 102 years of straight calendar time. If the videos are even lower quality, say, 480p, that's around 0.7 gigabytes per hour, or 293 years and six months.
or as a /. user would call it, a good Tuesday night.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
Well I guess they did say have goals in life.
I don't read AC
My roommate had twenty-five 8TB drives with porn that he has collected over 25 years. That's only 200 TB, and he works about an hour a day adding new Torrents, downloading from Usenet, and managing disk space. If I had to guess, that's over 9,000 hours which corresponds to about 4.4 years of full-time work.
Gee, I would need to get my glasses checked.
Imagine a grave stone that instead of an eternal flame there is an eternal stream of porn on a small display. The location may be problematic for the viewer to fully enjoy though.
“Common sense is not so common.” — Voltaire
...is a LOT of hand lotion.
HA! I just wasted some of your bandwidth with a frivolous sig!
This guy becomes President and Trump is the pr0n collector. "shocking"
Pied Piper will compress that down big time so that real hit is way less.
My collection of ASCII porn can fit on 5 double-sided floppy disks and it's lasted me 30 years.
You are welcome on my lawn.
The cams ripping script is open sourced on github
That's so much porn you can't even possibly look at most of it. If you wanted to test Amazon's "unlimited' storage, why not just randomly generate various files. You could probably have a computer make shitty modern art paintings much faster than you could curate a 1 petabyte porn collection, and you still get to test out how much you can store on Amazon's cloud storage service before they pull the plug. And when they invariably do, you won't lose your porn collection.
All this does is make me realize there's a lot of porn I will never see. And that makes me sad.
Whether it's unlimited data, unlimited backups, unlimited soup, salad and breadsticks- this is why we can't have nice things. Regardless of motive, people like this ruin for the rest of us.
"But not nearly as interesting as the assorted women parts I have archived in my basement freezer," he continued.
Only disgusting whores do it. They are not sexy in any way, in the vast majority of cases. Only disgusting. The females you would *want* to see naked never would do such things (in public).
no comment necessary...
Since many hosting services use Amazon as a backend, I'm wondering how much Amazon actually stored. 2PB in and of itself isn't that impressive anymore, you can fit it in half a rack or less with current densities.
Custom electronics and digital signage for your business: www.evcircuits.com
What kind of upload speed would be needed to transfer that much data in a reasonable (couple months mentioned in TFS) time?
That way you have just one peta file.
I guess we can figure out why they shut it down.
If it's porn, this guy has it.
If it weren't for deadlines, nothing would be late.
This is why we can't have nice things like unlimited storage on cloud servers. Some peon comes along and decides to childishly see if they can prove that the word, unlimited really isn't true by doing something inane and stupid. He satisfies his urge to say, "nay-nya-na-nay-nya," and everyone else suffers. Moreover, by loading up on content of questionable social value, he reduces what might have been a valuable resource (say, backing up the Internet Archive), to an unabashedly immature, indefensible act of petulance.
As Bugs Bunny would say, what a maroon.
Put my fist through my alarm clock with its ding-dong death inside my ear. - The Blackjacks.
Organized? rsync:// please
Unorganized porn is useless. There's only so many lesbian vids that I can stand.
And now I have to upload my few terabytes of backup somewhere else.. Please don`t suggest where that guy could test next, I don`t want to have to start over a third time (yeah, I was stupid enough to go for crashplan next since I had a good experience with it at work)
Sorry, no time to touch a keyboard for the rest of my life. Goodbye Internet!
...
"It was hell!" recalls former child.
And what if it's pictures? Say about 500k/pic, 5 minutes spent per pic plus a 45 minute refractory period...
'In unrelated news, Amazon announces a new adult streaming service, featuring over 200 million gigabytes of content.'
HA! I just wasted some of your bandwidth with a frivolous sig!
If a data storage service advertises "unlimited" storage they're lying to you. Nobody has the capacity to store unlimited data and businesses aren't keen to purchase storage because users take the business at their word.
No, if a data storage business shuts down or sharply curtails a so-called "unlimited" storage plan, it's because they got caught being taken at their word and learned they were unwilling to make good on a promise of service they never should have made in the first place. It's not possible to abuse a data storage plan that claims to let one store as much data there as they like (as opposed to paying more for storing more and using technical means to limit how much one can store on the service).
Digital Citizen
Just sayin'
I feel fantastic, and I'm still alive.
Someone has already mentioned the tragedy of this ruining it for other people and in a way I agree, but since he did it using the remainder of the unlimited storage period, I'm not going to feel bad about it either. This dude is a fucking hero even just for making the world's most obvious joke about Amazon's Cloud storage into a reality.
But it's a damned shame that the unlimited storage plans are going away because I really did have about 6TB of actual personal data (mostly photos, which are still unlimited for Prime subscribers anyway) on my account and the amazing thing about Amazon as opposed to every other big cloud service is that they never, ever seemed to run out of upstream bandwidth. I took a 4TB drive to my server colo and sent data to Cloud Drive. Amazon took it at the physical speed of the hard disk. Compared to Google or Carbonite or Backblaze, where data transfer throttles seem to be the name of the game, the idea that Amazon will take THAT MUCH data in so short a period of time is more impressive to me than just having the disk space to store it.
-- I wanna decide who lives and who dies - Crow T. Robot, MST3K
So much for Millennial math.
A Petabyte is 1024 Terabytes. 1024^5
A Terabyte is 1024 Megabytes. 1024^4
A Gigabyte is 1024 Megabytes. 1024^3
A Megabyte is 1024 Kilobytes. 1024^2
A Kilobyte is1024 Bytes.
Site for Nerds my ass, you pussies can't even do simple math.
It _used_ to be pics, but they're so easy to fake.
And HEY I'm being altruistic here -- I could have said "Just for me." You're welcome.
(Now if it's all slightly modified versions of goatse.cx and tubgirl I'm going to be REALLY upset. 1.7TB of THAT??? And you thought looking at the eclipse w/o glasses was blinding.)
If the universe is someone's simulation -- does that mean the stars are just stuck pixels?
My brief look through the comments didn't show anything except the obvious reactions. But there is something I'm curious about.
Why is there so much? Is there a way to make a profit from all this or is it amateurs doing it for fun? Is it mostly repetition of the same stuff that he's got, maybe from porn sites ripping off each other (because they're not going to sue each other for copyright violations)?
Just wondering.
How much is that in litres of sperm?
#DeleteFacebook
I'm prepared to do my duty to humanity and mirror the torrent (hmmm, 'torrent' might be the aggregated net effect).
It is totally feasible to watch all this .. is about 10,000 UHD Blu-ray disks, which is 20,000 hours, or 2.3 years.
Although after watching 2.3 years of HDR 4K porn you may have other issues.
Com on man, create a magnet link already ;)~
He said it took five or six months to collect one petabyte of porn, and he stopped collecting just shy of 1.8 petabytes.
Yet the actual disk usage was probably much smaller thanks to deduplication. The fact that he downloads porn rather than producing it means someone else already had it, and if it's already somewhere in Amazon's system, they just add him to the list of "owners" of each file and use next to no disk space. This is probably why they didn't care.
How is the Riemann zeta function like Trump rallies? Both have an endless number of trivial zeros.
2 M GB to transfer, even at a continuous flawless idealistic 100Mbps, about 10 MBps, would take more than 6 years ...
Slashdot, fix the reply notifications... You won't get away with it...
I hope he cataloged and tagged it properly or he never finds his most favourite again.
Cost free eBook I read (by iBook/Kobo/Amazon/ObookO/Gutenberg etc.): "The Green Odyssey" by Philip Jose Farmer.
With that ridiculous amount of porn, one wonders how much of it is likely illegal in various ways. (underage, secret recording, etc.)
There's been loads of instances of illegal porn on sites that has stayed up for months, even years. Youtube included.
Simply because it is hard to categorize amateur porn for authenticity, ages of the people involved, the consent to recording and so on, it is rather risky.
I mean, fuck, I remember back in my days of school, there were quite a few people that defy your typical age-related looks. (especially that one girl that had tits LARGER THAN MY MOTHERS at the age of 13. fuck)
Mind you, there is a presumption of innocence here due to the lack of official documentation and so on. (but IANAL)
In any sane jurisdiction, nobody could potentially get jailed over it even if there was illegal content simply because of that fact alone.
Unless they made an active habit of only seeking out that content alone, this was merely an experiment that had a wide-reach regardless of content.
There might even be Minecraft Let's Play videos if they scraped from some sites. I forgot which site, but I know they gave a place to people regularly being banned off Youtube for whatever reason.
I am the former President of the United States and I approve of this storage test!
PS: Any Monica.mp4's?
After watching cat videos I still/rather even more want to pet my cat.
(There may be like two videos of porn which do the same but mostly I'm very done with it afterwards .. one is asian girl in lingerie on schafold(?)/whatever and another one of those college teens videos. Good stuff.) This second part isn't necessary.
I don't WATCH the porn, I just watch how many gigs each porn uses. Oh, baby, 1.3GB. Yeaaaaah, that's the stuff... I want more!
My three 4K screens can show 12 full HD streams simultaneously, and my GPU's can definitely handle it. Don't assume someone wouldn't try this.
(Ahem.)
That's so much porn you can't even possibly look at most of it.
Challenge Accepted.
Now I know what my life's work will be. God willing, I shall finish before I die.
Doctor, doctor! I can't raise my hand.
violating the T&Cs of the sites in question.
The fact is, he never re-distributed the records.
And probably, given the huge archive (over 250 years worth of video according to TFA) there's simply no physical way he would even re-whatch himself.
So, at the end of the day, the data was exclusively used only to test the limits of the storage.
Meaning it's probably one of the rare occurrence where the guy could genuinely argue it was done solely for research.
Almost certainly without permission of the girls involved,
again, given the huge amount of data and how systematic and indiscriminate his grabbing scripts are, chances are very high there will be girls, boys, she-males, and all the other diversity variations found on the whole spectrum of LGBTWTFBBQ.
Don't automatically assume only girls are concerned, that would be inconsiderate toward all the other people implicated there.
He should rather hope that the automation script didn't actually catch by accident anything that would be legally problematic.
(Then again, given the context of high automation, enormous data gathering, the whole "testing" purpose instead of personnal consumption, and the fact that such accidents should be a lower occurrence in this project : he might get away or at least have an argument to reduce the impact).
"Sufficiently advanced satire is indistinguishable from reality." - [Tips: 1DrYakQDKCQ6y52z6QbnkxHXAocMZJE61o ]
To aid in consumption of so much porn, Amazon also provides this conveniently sized 55 gallon drum of lube. They have thought of everything.
https://www.amazon.com/Passion-Lubes-Natural-Water-Based-Lubricant/dp/B005MR3IVO?th=1
Now he has to write porn to text translator and then create porn generation service on demand based on user preferences. I don't think that people will manage to invent any new content in this area of entertainment business in the near future.
The summary doesn't describe if he did anything to weed out the redundant files. If you have Cheerleader Nurses Part 4 in three different file formats (or resolutions) they are three different files but ultimately the same material. Similarly if he has three different crops of the picture of Sarah Palin's head cropped onto a bikini model's body (holding an AR-15, of course), they are still the same image. If he didn't do something smart to trim down redundancy I'd be he has not more than .5PB of actual porn.
Damn_registrars has no butt-hole. Damn_registrars has no use for a butt-hole.
How does this guy get anything done?
... OMG they were right, I've start to go blind! Oh wait, that's just presbyopia.
Someone with more porn than you.
Totally watchable. This is 18,000 UHD Blu-rays so 36,000 hours, so about 4.1 years.
Stop
Watching
Porn.
/me clears 23 years of schedule.
Part of the appeal of porn is the disgusting whores. Are you new here on /., or new to the internets, or new to adulthood?
HELL do you get THAT much porn?
"Call me crazy, but women interest me more than most other things on the internet and there is a huge amount of data being created daily, so it was a good fit for the project."
How sad he thinks porn is data about women...