Slashdot Mirror
A/V Data Collection Using Linux?
Simon D. Levy asks: "I am consulting in a biology lab that collects data on fruit-fly mating behavior, and we would like to migrate our data collection to a Linux box. Our primary concern is being able to digitize incoming audio signals (at 8kHz sampling rate), but we would also ideally like to be able to monitor the flies' behavior using a digital camera connected directly to the computer. Crucially, we need to be able to isolate the audio component of the signal, as well as having access to an API (C/C++ would be nice) that allowed us to start and stop the recording. Any experience that anyone has had with this sort of problem would be much appreciated. We haven't bought anything yet, and are looking to build this system (CPU, video camera, A/D cards) from the bottom up.
Thanks!"
Did you know?
You want us to do your job for free? I doubt you are paid to pick your nose all day. Get the job done on your own. Faggot!
As much as it pains me to say it, I think a quality WINDOWS XP system may be more up to the job. Don't get me wrong - I love LINUX - but this is just one (of many) areas that could do with improvement.
Greetings, for free software!
If you're part of a university, this project sounds tailor-made for a senior project by some EE whizkid. Just draft some geek and bribe him with promises of interships, and give him an unrealistically short deadline.
If you're in the private sector, it's a totally different story. You must summon the civic-minded core of your being and seize the opportunity to help the next generation. Give some deserving, hardworking American student the real-world experience that will provide them with an edge in the competitive job market of tomorrow. In return for the design and construction of your whole system, you will provide an invaluable internship opportunity that will give a real shot in the arm to their resume! And you'll hardly charge them anything.
Either way, you get your gadgetry, and everyone's happy.
Perfectly Normal Industries
SON of the GOAT, HUGE ASS WIDENER, This is a massive, massive ass attack from the Minister of Goat, Ayatollah man-meat.
Dilated Meat Pie. Most suppressed people really like seeing this. It gives them new masturbatory fodder.
Two cucumbers, better than one. This is to show that the giver is really smaller than what is needed to fill GOATSE man. He east Cheerioatse brand O's
A Disney product right where it belongs. Up a goat's ass. Death to Mike Eisner, the butt buddy of Commander Tak0.
Raw and dilated man-pussy. Put back the trouser snake, Tako. You dick is way too small for this man's ass.
A Prolapsed rectum is sure to whet even the most jaded flaming fuck's appetite. Tak0, your penis is regrettably way too small, even for your "Fiancée's" unfettered anus. She doesn't want to dirty her ass with the likes of your pathetic member.
GOAT KORAN
Classic HIT ME IN THE SHITTER BABY, UNGH HUH
Classic Oh yeah, in the shitter some more, in the shitter.
Classic More ass stretching goodness.
Female Goater My pussy is too small for this APPLE.
Goatse Grandpas - GRANPA GOAT S3X0R5
Son of a Goat - Holy fucking son of a goat. Kind of looks like Tako from behind, but to be sure I'd have to ask CowGryl Kneel
1 Oh, pardon me sir, would you happen to have any ANAL LUBE?
2 UNGH FART, pssssbt, ungh, tweeep, squeaaaaaak ungh
3 PFFFFFFFFFFT AHH pffft
4 FOOOOOOOOOOOOF blud dribble dribble
Prime Number Shitting Goatse Man See The Prime numbers flow like the river SHIT
Goatse Returns! Fuck yeah, the goat man is a coming back to Trollaxor
I summon the powers of HUGE GAPING ASS!
These liberals scare you in today's world from saying the "N" word.
These liberals tell you race mixing is ok.
These same liberals say pledge of allegiance to the flag is wrong in school.
These same liberals say gays are ok in boy scouts, since when is a thirteen year old gay?
These same liberals say no to guns.
These same liberals smoke 3 packs a day and then sue the tobacco companies.
These same liberals increase your taxes and then spend it overseas while taking vacations on their own islands.
These same liberals give the "minorities" legalized racism.
To hell with all of you.
HAVE PRIDE in YOUR CULTURE - Be a WESTERNER. Fuck Islam, fuck China, fuck all the other Eastern backward assholes. They live in a pit of shit.
"There is a class of colored people who make a business of keeping the troubles, the wrongs, and the hardships of the negro race before the public. Some of these people do not want the negro to lose his grievances, because they do not want to lose their jobs. There is a certain class of race-problem solvers who don't want the patient to get well. - Booker T. Washington, 1911
SHEOCRACY - KLINTON KOOL-AID - CLITLER - HIJACK-SON
CLIPPED HAIR, MEAN-FACED - LEXUS LIBERALS
NATIONAL ORGANIZATION OF WITCHES
9TH JERK-IT COURT OF SCHLAMIELS
TRICKLE DOWN IMMORALITY - SECRETARY OF HATE (Ashcroft)
WHEEL CHAIR MAFIA (For all the whiney cripple shits)
KLIN-TONGS - FA-TASSES (A play on fucker Yasser's FATAH)
SHEEPLE - THE LAST LADY (Death to Hillary CLINTOON)
TURD-WORLD (The shit holes that are not America)
GOVERNMENT-MEDIA-COMPLEX (Fuck Disney, Fuck Eisner, Fuck them ALL)
FEMI-FASCISTS - DEMN-CATS - DUNGISM - YAGS
WOOLY-HAIR LIBERAL - ANAL RIGHTS (For all the fags who want the public to pay for their AIDS medications - FUCK OFF)
AND Blacks with self respect, THROW OUT YOUR HORRIBLE LEADERSHIP.
Jesse Jackson a confirmed dirty foul thief, adulterer, lied about having college degree, was never ordained as a minister. Extortionist.
Michael Jackson, pedophile.
OJ Simpson, murderer.
Michael Jordan, adulterer.
Rap Stars, categorically, murdering, drug pushing, anti society homicidal maniacs show project a most disgusting but exceedingly popular image of ghetto violence and culture.
Magic Johnson, adulterous AIDS infested person, almost infected his wife with AIDS that he got off someone else while cheating on his wife.
Halle Berry's mother is white, her father is black. Her black father beat her mother and abandoned them.
Farrakhan - anti Semitic elitist foul violence mongering horrible person. Should be in prison.
Mike Tyson, rapist, convicted and chronic.
Don King - convicted murderer, high roller promoter. Convicted murders should not be popular negro role models.
Ike Turner, beat his wife Tina.
Bobby Brown, beat the shit out of Whitney Houston. (Also sentenced to 75 days in Jail for driving while drunk, in addition to beating Whitney)
And Condy Rice, Clarence Thomas and Colin Powell are traitors? This is what kills me the most about liberals. Some good conservative hard working people like Rice and Powell get themselves out of the fucking gutter, and their own fucking people stab them in the back.
Get some real leadership, or face doom. You liberal fucking scum, you are a disgrace to yourselves.
I used to work for a firm that made medical software. They had a system where the signals of a bunch of brainprobes *shrudder* and high-quality video were streamed to a central server. It was quite impressive. I remember they used MPEG-2 hardware compression and a custom driver. Maybe you can find an MPEG-encoder with Linux support? I think the vendor of the encoder provided some C++ code to make the thing work.
History matters..
When it tells the truth.
An XP machine would actually have better support available for all the types of devices and functionality that you need for your data collection.
"I am consulting in a biology lab that collects data on fruit..." Well, you've come to the right place! There are lots of old fruits here. For data, try the following LINK Enjoy!
Once, just once, I would like to see a fruit fly turn to the camera and say, "Can't you see we need some privacy?"
This stuff is pretty trivial under linux with even the most budget hardware.
Take a bt848 card and a camera and you have good quality video in, easily accessible via Video4Linux with a large base of existing video manipulation tools that let you pipe the video data around, manipulate it in realtime, compress/decompress in realtime etc. etc.
OSS/ALSA make it easy to record sound, and again there is a huge range of open source projects that should be either directly applicable or easily modifiable for your purposes.
There is some specialised hardware for hardware compression, though depending on your needs an Iomega Buz or similar can be had for very few dollars and provides hardware MJPEG compression, and is well supported under Linux.
Its not hard to do this stuff under Windows either, but for the sort of project you have, Linux is ideal. You should be able to get something up and working in a couple of days.
I gots ta ding a ding dang my dang a long ling long
Search the yahoo groups for OpenCV.
Instead of using a usb based webcam, I'd go with a video capture card personally.
Under every OS, webcams suck...period. If this is something where your going to take the MPEG stream and make a VCD archive out of it, your going to want something that creates a quality MPEG stream.
For apps for video check out http://www.exploits.org/v4l/
As for the sound, "try dspspy".
Hope that helps!
Yes Francis, the world has gone crazy.
http://www.netjunki.org/articles/makingmovieswithl inux.html
I think this may be able to help you out.
Hey, 'bout time we saw some insect action on the Spice Channel!
Push the envelope. Watch it bend.
You might start here for equipment.
CEE5210S The signal SIGHUP was received.
LabVIEW a little pricy, true. But the lab will be able to change their software and analysis on a whim. It is a very powerful programming suite and well suited for this type of application. If you ask, you will probably find that they already have copies of it around, or that half the labs in the building do.
Beware sounds cards, 8KHz is often not quite 8KHz and it might matter; esp if you wish to correlate recordings made simulaneously from two cards, or from a sound card to a video card.
You may find that 30 mins of recordings from each card are not the same length.
You may prefer to take continuous small blocks of samples and timestamp them yourself, but I don't really know if this would help.
For a real sound card expect to pay over a hundred dollars; but you may find it cheaper to add a trimmer capacitor to the crystal oscillator circuit on the sound card and calibrate yourself.
blog.sam.liddicott.com
"Hi, we do something. We're probably already doing it. We've made a decision to switch platforms. Now that we've decided to do that, we should figure out if the platform we've chosen can actually do what we need it to do."
Vintage computer games and RPG books available. Email me if you're interested.
I have a bt848 card and have found it easy to use, and Video 4 linux has a solid base of excellent user supported applications, http://www.exploits.org/v4l/ has a lot of good information. If you cant find everything you need in the C++ libraries to build a simple program, try scripting a command line video capture program. One thing to consider is you will need a computer with at least 800 megahertz and a good amount of ram to get full frame captures, and a fast hard drive. And of course bribing a geek with toys and soda will ALWAYS be your best option!
OpenCV is Intel's Open Source Computer Vison Library. It's a decent-sized library that helps out with image processing tasks. It's for image processing though - you still have to work out how to capture the video yourself. For that, use V4L (see other comments). One of the included example apps ('CAMSHIFT') includes code to do video capture, but only works under DirectShow on Windows.
If you want to do stuff like extract image features or track moving objects in the video stream, it'll be perfect.
The code is available from the 'opencvlibrary' SourceForge project under a BSD-style license.
The audio aspects are fairly easy. Any decent sound card will suffice. The Audio API permits you to buffer input/output... But you probably want to use a pre-allocated non-swappable memory block to make sure nothing is lost when transferring to disk. Also, I'd suggest going with a multi-threaded approach.
Be aware that specific sound cards may limit your audio frequency sampling rates. Furthermore, these sampling rates may not be too accurate, and may vary somewhat based on the characteristics of the card, the manufacturer, the current temperature, the phase of the moon, etc.
The Linux kernel runs at 100 Hz. So you are looking at 10ms slices, which may impact your temporal resolution issues.
For video, webcams are useless. (Low resolution, low frame rates, painful interfaces.) If you want still pictures, try gphoto. For motion pictures, you will need some sort of NTSC (American TV standard) video capture, from a video camera. Given the extreme bulk of this video data, you will need some form of compression during the capture operation: JPEG, MPEG2, etc. There are a number of Linux based solutions. The matrox marvel G200/G400 (NOT the G450, NOT the Millennium) is one that I've played with, and has fairly good Linux support.
Be aware that these forms of compression (JPEG, MPEG) will limit your visual frequency range in the frame (field). Rapidly changing data will be lost. (For example, alternating dark/light bars every other pixel.) In practice, this means that minor-ghosting is filtered out. But for your experiments, working with fruit-flies, this may have negative consequences.
Your simplest solution might be to obtain a Replay or TiVo unit, or even a VCR, and use that for the video recording. Possibly interfacing the remote-control into a Linux-based software application.
Drop me a line if I can be of further help... (da0g@yahoo.com)
well, two basic parts: hardware and software
first of the hardware is pretty independant of the os, just pick the highest quality capture card you can afford that is supported in linux, add a reasonable camera, sound card, and a nice modern machine of any kind. I use a bttv card, which works well for me, but of course it depends on your exact needs, and the camera that you hook up to it. As to software:
SDL, mostly used for game programming, but has some of the capabilites needed for capturing, sound recording, etc.
v4l the basic component of all video type stuff under linux-you can see the list of crap it supports there, but it doesn't really have facilities for actually capturing to something like mpeg.
avifile everything you want in a capture API, will let you output to all kinds of formats.
mplayer I have heard that they support capturing now, but haven't used them for that, but is what you will be using for playing back the files you capture.
My recommendation would be to use the VCR project, and one of these for audio. VCR uses avifile to record the video in your chosen format, and will record the audio also, but if you want seperate files for audio and video, it is simplest just to use the mic in with another program.
Let me know if you have problems--it's remarakably similar to what is already done to record television programming, with higher quality requirements, so you should be able to take advantage of all the PVR projects out there.
Or you can let me do it-send me the requirements, 1500$, and I'll send the box back a week later
;-}
Slackware: old school feel, new school gear.
(shamless plug warning). If you're looking for a multithreaded C++ API for video capture and display (along with hooks for Intel's Image Processing Library or IPL), check out SPU-Toolbox. (http://www.spu-toolbox.org).
get a cheap test bed together.
a video card with a tv tuner and inputs
a sound card. a fairly heavy install of your fav distribution and start tring what you need todo.
you can talk about it til your blue in the face.
you can think about it until your head expoldes.
or you can do it and see what you come up with on your own and then migrate over to it once its done.
you can do anything with linux. its just how much time do you have to write the code you need to make it do it... and linux has lots of audio tools. linux has lots of and lots of programing tools. linux has some video tools too. i dont see whats slowing you down.