Quickly Filling Up 150GB of Legal Media Files?

Fred Nowicki asks: "If you have ever used the P2P client Direct Connect (or DC++) to find media on the Internet, you know that the best hubs have ridiculous sharing requirements, i.e., over 100GB. It isn't too difficult to amass a collection of 100GB of illegal movies and MP3s with all the crap that's out there, but I'd like to play it straight: I want to collect 150GB of pure legal stuff. So here's my million dollar question: What is the best and fastest way for me achieve this? I want to offer interesting, neat stuff (movies, music, programs, etc.), not just Linux distros, mind you. One thing I've found so far is a mirror of the Prelinger Archives on archive.org, which offers over 37GB of wacky, interesting stuff on divx format (in MPEG-2, it's over 350GB, but that seems like cheating if I take that route). One downside of this site is that it's not a very fast connection (about 50KB/sec through their FTP via my cable modem -- I'd like a throughput of at least 100KB/sec). I've considered mirroring the Gutenberg project, but there are all sorts of redistribution issues with a bunch of their files, and I don't want to go through all that hassle. Come on, Slashdot. Give me some URLs!"

Comments

SHN Audio of Live Bands

[owsla]

Many bands allow taping of their concerts and the redistribution of audience recordings. Lately, the most popular method of distributing these recordings is as .shn files which are a type of lossless audio. A two hour show can be about 1.0 GB so that's one way to fill a lot of space quickly. You can get started at http://www.etree.org. There are many other sites out there that will allow to download SHN shows right from their servers including, for Dave Matthews, http://www.antsmarching.org.

Re:SHN Audio of Live Bands

[MayorQ]

Check out http://www.furthurnet.com for a P2P Java app.

- MayorQ

scene.org

[dknight]

You can mirror them, they host demos. Those are really interesting, and not too many people have them. Admittedly, I dont think that it would be the whole 100+ gig you're after, but you could get a good 20-30 that way.

Re:scene.org

[BenV666]

Not only demos, but entire parties with movies (animation/wild compos), music (mp3/tracked) and more :)
Of course the 32 Kb game and 64 Kb intro compos wouldn't really fill up those 150 Gb but at least they're worth every bit they take.

These days a decent party has about 5 Gb of stuff so that'll fill up your space quite nicely...

Live Concerts

[estoll]

Furthur

Origin of the 24-hour myth

[yerricde]

The (mis)conception of a "24-hour trial period" in the warez community comes from various exceptions in U.S. copyright law pertaining to libraries. Warez sites claim that they are "checking out" files to patrons, putting the patrons on the honor system to "return" the files by deleting them. And the warez curators just may be able to pull it off if they disable each download for 24 hours, marking it "Checked Out".

Re:What's the problem with PG?

[zapod4]

I was thinking the same thing. From a PG header:

DISTRIBUTION UNDER "PROJECT GUTENBERG-tm" You may distribute copies of this etext electronically, or by disk, book or any other medium if you either delete this "Small Print!" and all other references to Project Gutenberg, or:

[1] Only give exact copies of it. Among other things, this requires that you do not remove, alter or modify the etext or this "small print!" statement. You may however, if you wish, distribute this etext in machine readable binary, compressed, mark-up, or proprietary form, including any form resulting from conversion by word pro- cessing or hypertext software, but only so long as *EITHER*:

[*] The etext, when displayed, is clearly readable, and does *not* contain characters other than those intended by the author of the work, although tilde (~), asterisk (*) and underline (_) characters may be used to convey punctuation intended by the author, and additional characters may be used to indicate hypertext links; OR

[*] The etext may be readily converted by the reader at no expense into plain ASCII, EBCDIC or equivalent form by the program that displays the etext (as is the case, for instance, with most word processors); OR

[*] You provide, or agree to also provide on request at no additional cost, fee or expense, a copy of the etext in its original plain ASCII form (or in EBCDIC or other equivalent proprietary form). [2] Honor the etext refund and replacement provisions of this "Small Print!" statement.

[3] Pay a trademark license fee to the Project of 20% of the net profits you derive calculated using the method you already use to calculate your applicable taxes. If you don't derive profits, no royalty is due. Royalties are payable to "Project Gutenberg Association / Illinois Benedictine College" within the 60 days following each date you prepare (or were legally required to prepare) your annual (or equivalent periodic) tax return.

Re:Perfect solution

[FunkyChild]

Bzzzt! Wrong. It's illegal as per the Berne Convention.

Read: Japanese Animation Legality and Ethics FAQ, by Andy Kent

Mirroring Gutenberg

[gbnewby]

For servers based in the US not trying to profit, there is no restriction on mirroring Project Gutenberg. In fact, we'll even list you in our official mirrors list (http://www.gutenberg.net/list.html) if you'd like!

If you're outside of the US, you might be mirroring some stuff that is under copyright in your country. But many mirrors still do this, prefering to mirror the whole collection rather than try to select items based on copyright rules. For commercial redistribution, the "small print" applies (basically, you need to pay a trademark fee -- details are in each eBook).

Here is the skinny:

The Project Gutenberg etext collection is distributed primarily by
FTP, although you can have your Web server point to the same directory
and distribute by HTTP. For example, these addresses point to the
same content:

ftp://ftp.ibiblio.org/pub/docs/books/gutenberg
an d http://www.ibiblio.org/gutenberg

(though ftp or rsync is best for mirroring; see below)

The collection is over 16GB (January 2003), and expected to grow another
few GB this year. New etexts are added almost every day, so it's best
to mirror nightly.

Our experience has been that a static IP address and T1 (~1.5Mb
symmetric) or better permanent network connection is desirable for
mirroring; DSL and cable modems do not seem to offer the necessary
bandwidth and sometimes suffer stability problems.

The best place to mirror from currently is our master download site at
ftp://ftp.ibiblio.org/pub/docs/books/gutenberg . Most mirrors use
rsync (easiest), wget (easy) or the mirror PERL software (requires
some configuration). Here is an overview for each:

1. Rsync (available for all Unix systems; standard on Linux). The last
argument is the local directory for the mirror destination:

rsync -rlHtSv --delete ftp@ftp.ibiblio.org::gutenberg /home/ftp/pub/mirrors/gute
nberg

2. Wget: Freely available from any GNU mirror. With appropriate
command-line options, this can be used with either a HTTP or FTP
interface, but please use the FTP URL above for Project Gutenberg.
The key is to only get updated files, not files you already have. A
wget command line that should work with some adjustment for your local
needs (run it from wherever you want the mirror to go) is:

wget --mirror --no-host-directories --passive-ftp --no-parent --cut-dirs=4 \
--output-file=/tmp/wget-gutenberg.log \
ftp://ftp.ibiblio.org/pub/docs/books/gutenberg

The wget homepage is http://www.gnu.org/gnulist/production/wget.html

3. Mirror PERL software: Available from
http://sunsite.org.uk/packages/mirror/ (among other places). We can
help you set this up for a Unix system. The mirror PERL software has
been reported to work with PERL for WinNT, as well as Unix/Linux/BSD.
Note that the wu-ftpd software patch supplied with the program must be
applied for it to work!

For any mirror method, run a daily job to check for newly updated
files. Unix/Linux employs cron for this; Windows systems could use
the task scheduler.

I can help you with setting up the mirroring software, or any other
details, if you would like.

We don't distribute the Web-based search engine that's available on
the main PG page at http://promo.net/pg. However, we'll add your site
to the list there, so people can find you. The FTP directories are
the only part we offer for mirror, while the central list of mirrors
and search capability is centralized at promo.net.

Once you tell us your mirror is active, we'll announce it in our next
weekly & monthly newsletters. After a month or so (to confirm
stability) we'll add you to the mirror list and download facility at
http://promo.net/pg

Let me know how else I can help. If you decide to go ahead with the
mirror, email me and/or webmaster@promo.net so we can add you to the
mirror list.

Thanks again for getting in touch! And, thanks for your interest in
helping Project Gutenberg reach more readers.

-- Greg

Dr. Gregory B. Newby
Chief Executive and Director
Project Gutenberg Literary Archive Foundation
A 501(c)(3) not-for-profit organization with EIN 64-6221541
gbnewby@ils.unc.edu // 919-962-8064

Here's 700 MB

[fugue]

I have a site dedicated to providing free classical music recordings. The recordings are performances that I've been part of (some are not great, but there are a few real gems), and I'd cleared the legality with the other members of the groups, sound engineers, etc. I'd like to see more people do this, and in the interest of encouraging this, please check out my Free Classical Music archive.

-Ben

Free music (in the sense of freedom)

[juhtolv]

There exist many musicians, that think about music in more or less same way as Free Software Foundation thinks about software: It must be free as a bird. Some of them are against a notion of "copyright" and "intellectual property".

So, get some free music. It will fill at least few gigabytes. Some of that music has such licence, that forbids selling that music, but for your purpose even that kind of music is good.

Here are my URLs:

http://www.ram.org/ramblings/philosophy/fmp/fma. ht ml
http://www.ram.org/ramblings/philosophy/fmp.ht ml
http://www.ram.org/ramblings/philosophy/fmp/co pyin g_primer.html
http://www.twisted-helices.com/th/t wisted_helices. html

http://www.negativland.com/

http://logosfoundation.org/
http://logosfoundat ion.org/copyleft/copyrigh.html

http://www.janisian.com/

http://kotisivu.mtv3.fi/hipit/

http://www.vorbis.com/
http://www.vorbis.com/mu sic.psp
http://www.vorbis.com/musicsites.psp

http://www.creativecommons.org/