Ask Slashdot: Huge Digital Media Libraries
An anonymous reader writes "Like many slashdotters, I have several TB of digital media: music, books, movies, tv shows, games, comics, you name it. I've put it all in a few HDs, but handling it all has proven to be less than optimal. I'm covered when it comes to music, since [pretty much any music player/library manager] allows me to quickly find songs by interpreter, album, genre... For everything else, all I have is a series of hierarchical folder structures, but hierarchies have limitations. I can find Blade Runner easily, but what if I wanted all of Scott Ridley's films? Where is 'Good Omens', in the Terry Pratchett folder or in Neil Gaiman's? Furthermore, in a collection with hundreds of similar items, it would help to have some extra clues such as covers (for comic books) or synopsis for TV shows' episodes. Do you have any software to help you handle digital media libraries? Specialized software (say, something that only work for comics, something else for movies), or generic media libraries? Opensource alternatives are preferred, but commercial software is fine as well."
I tend to just use directories of symlinks on the odd occasion where I want a logical collection of something. Kind of the hacked file system equivalent of a playlist. I can even put additional detail in the symlink name that I would leave out of my “main tree”. Generally though, a simple hierarchical structure has worked fine for me and my 6+ TB of media. If I anticipate wanting to search for something down the road, I also sometimes put it in the file name (indexed by slocate every night).
You are probably looking for a tagging/metadata tool but I think the problem with those is you have to obsessively tag/provide that metadata and they aren’t going to integrate with all your favourite viewers and such. It just seems more trouble than it’s worth to me, but with different levels of motivation and borderline OCD, it could work very well (and probably does for many).
You can admit it. Slashdot understands that you have a large *personal* media collection *AHEM*.
"I like it when the red water comes out.."
Use data crow and make a container for every HDD. It works for music, movies(imdb details import) and software. http://www.datacrow.net/
Just use what the libraries use:
Fedora
What you're looking for in general is either a repository (if you want it to manage the files) or a catalog (if you want it to just track info about the files). A catalog might also be called a 'registry' when dealing with sciences archives, where the term 'catalog' is used for something else.
For more options, see any of the following lists on wikipedia:
http://en.wikipedia.org/wiki/Category:Free_institutional_repository_software
http://en.wikipedia.org/wiki/Category:Digital_library_software
http://en.wikipedia.org/wiki/List_of_next-generation_library_catalogs
Build it, and they will come^Hplain.
Used iTunes? It's like that for books but less bloated. Syncs to many devices, and can scrape RSS feeds from magazines, build them into EPUBs and sync them to an ereader, like a text-based podcast. This works surprisingly well, superior in some ways to reading the same material on the Web.
And it's FLOSS.
http://calibre-ebook.com/about
How much of it do you really re-watch? You'll spend the rest of your life transferring it from medium to medium. Is it worth it?
I'm likely going to be flamed and modded into purgatory for this, but I use iTunes for most of this-at least, for music and videos. Some PDFs are starting to go in there if I want access to them on the go on my iPhone or iPad.
I understand that Apple's universe isn't perfect, but for me it all works together pretty nicely. I replaced my high-maintenance, increasingly noisy, power-hungry media PC with a second-generation Apple TV. This works great except that it won't play many video formats. Therefore, I've had to go through the obnoxious step of using VideoDrive to transcode videos into an Apple-approved format. However, it's not the end of the world.
Otherwise, I guess everyone's different, but personally I want to spend my time doing fun stuff like riding my bicycle or spending time with my family, not categorizing my "vast media collection". I guess I'm just getting old, but iTunes does a good enough job, with less work than any DIY system I've successfully maintained in the past.
www.clarke.ca
Well, now we know why he couldn't find them ...
I was going to say this, but you already have, so I'll just expand on it.
XBMC is great for organizing media. It has some neat features:
-looks really nice, suitable for a living/theater room, not geeky
-movies, pictures, sound
-IMDB integration
-scripts (do anything)
-contributed lists of Internet TV stations
-support for IR remote controls and universal remotes
-remote playback (playing computer being separate from the storage computer)
http://xbmc.org/
One thing it's not really designed for is to record TV. For that, use MythTV.
I'm not a lawyer, but I play one on the Internet. Blog
I use MediaTomb for my digital media library. It manages all my music, videos, and photos and is quite extensible through scripting if you are familiar with JavaScript. Then I use XBMC or my PS3 as the front-end to MediaTomb. I'm currently managing over 1 TB of data without issue. I cannot speak for other media, such as books, as all my books are still in dead tree format.
I certainly won't "flame" you for this suggestion. As maligned as the iTunes software is, I think its ability to index media and very quickly retrieve it by a number of different fields is pretty darn good -- especially for a program you can download free of charge for both Windows and the Mac.
As a Mac user myself, I started using another free program to manage my movies and saved TV shows though. I really like Plex (www.plexapp.com) for the purpose. It doesn't have the restrictions on playable video formats that iTunes has, and has a great UI to serve as your media center via a remote control.
I believe the latest update to Plex added some interesting, if slightly obscure, functionality -- like the ability to search the subtitles of your movies for specific strings, too.
You will apparently be shocked to discover this, but some people actually re-read books! And re-watch movies!
There are a handful of movies I've seen over a dozen times (Not including the family ones my son demands we watch on occasion). Some of them I still haven't got all of the juice out of (The Cook, The Thief, His Wife, and Her Lover), and some of them I just enjoy watching over and over (The Princess Bride, Amelie). I reread Fool On The Hill and Lord Of The Rings about every second year. Our library is tucked away in the basement out of the way, and isn't going to impress anyone. We have as many books as we do because we enjoy them, read them, and share them with friends.
Purging is great, but don't apply your opinions to the rest of us. Some of us have different points of view.
"People who do stupid things with hazardous materials often die." -- Jim Davidson on alt.folklore.urban
I own the David Attenborough Life Collection. It's 24 DVDs. Even assuming they are the single-layer type, that would be:
112.8 Gb. Roughly.
Now say I own, say, several boxsets of comedies, series, documentaries, a few dozen movies, maybe even a couple of dozen free promotional DVD's with full-feature films on them that are given out when the film stops selling.
Now, *NOT* including anything I've recorded from TV / Movie channels for my own consumption, not including any home videos, not including ANY Blu-Rays, etc. I can *EASILY* fill terabytes of data without even blinking an eyelid.
Hey, I could probably fill a terabyte or two with DVD images of cartoons (proper children's cartoons) and stuff I watched when I was younger (I have the complete set of Dangermouse, Batfink, etc.) and that's hardly something I go out and buy every day and keep buying. A terabyte, or even half a dozen terabytes, is NOTHING. It's just when you have to copy it all into a single place, like this guy is doing, that it appears to be a lot.
It's just that he's obsessively backing it up and/or converting it to free formats so that he can just browse from a media library, like the ones he desires, so it's all on one hard disk (or more likely RAID). It's not "abnormal". It's nowhere near "evidence of piracy". It's just a media collection stored on disk instead of the original DVD's.
No. "technically" DVD and BR rips are fair use.
Your attempt to hand Apple a stranglehold on the future on a silver platter is not appreciated.
A Pirate and a Puritan look the same on a balance sheet.
Some stuff gets "expired" from Netflix. The same goes for Hulu.
When you decide you want to watch something again, it might not be readily available.
This is usually the reason for having your own media collection. This seems pretty obvious for Music but it seems like a real revelation for anything else.
A Pirate and a Puritan look the same on a balance sheet.
What really drives me nuts about this is that there is no consistent way to apply parental ratings to content in a way that it is recognized by OSX and Windows. This keeps me from sharing my videos across the home network since there is no way I can easily block certain videos from my son's Xbox and his iMac.
Your son isn't going to die if he sees some gore or some tits. If he's too young to see something, he won't be interested in it at all. If he's interested, it's your job to provide context, not censorship. Parental controls are for lazy parents. Parenting is your job not the computer's.
Give me Classic Slashdot or give me death!
Having everything I want locally saves me time searching the internet for it
Agreed.
:D
Perhaps I'm the odd man out, but I do like going over my media collection (which is automatically sorted) and just trimming the fluff everyone once in a while. Making sure files are named right, getting all the movie trailers, filling in a gap where I'm missing a season, and so on.
It's not really that it's a compulsion, but more of a hobby. I like having a movie and TV show collection, and the fact that I can have a digital one sitting on a RAID array increases the usability and coolness factors.
Organize TV Shows with Sickbeard. Organize movies with either Media Center Master or MyMovies. Better stuff for movies undoubtedly exists, but I'm not too sure what it would be.
Also, if you want your computer to surprise you with new content and you're not afraid of complex config files, give FlexGet a try.
Finding time to watch all of it.... that's the real kicker
Boot Windows, Linux, and ESX over the network for free.