Virtual Astronomy
DarkKnightRadick writes: "In this day and age, data sharing, data mining and distributed computing are words most of us know well enough, but until recently, those phrases were connected with such projects as DNET, and more recently with SETI@Home. Now we should all welcome the newcomer, Virtual Astronomy. With the framework being developed by three different groups (one in the UK, one in the US, and one in Australia), one would expect this to be a very competitive field, but alas, this is not the case. The three groups are working together so that they can have it all up in running the in the projected 15 years that it will take to put all this data into an electronic format."
It was a lot of fun to participate in the Seti@home project and a worthy cause for spare cpu cycles. Sign me up Scotty.
Kevin
Kevin
"It's not the cough that carries you off, it's the coffin they carry you off in" O. Nash
As a NASA employee, I have seen a pronounced shift in the focus of the organization, from data collection to data distillation and mining. As it turns out, we have tens of years of work ahead of us in processing the data that we collected from space in the 1980s and 1990s alone. In fact, we have not yet developed software to mine the information out of this data that we need - the bottleneck is 95% manpower and 5% CPU cycles. And that is in spite of the budget shifting substantially toward processing and away from missions (which are expensive, misunderstood, and often goofed up).
I fully expect that by 2010 or so, we probably will not be doing launches more than once every few years. Indeed, it is rumored that the recent space shuttle launch was intended only to intimidate third-world nations in the Middle East and make them realize our superior technology - not for any scientific purpose. I do not believe that that launch would have taken place in the absence of the 9/11 events. When I checked the calendar several months ago, it did not show any major launches until late 2002.
~wally
As long as your data can be parsed with a single fscanf statement in a for loop, there will be someone interested in using your data.
It amazes me that so many allegedly "educated" people have fallen so quickly and so hard for a fraudulent fabrication of such laughable proportions. The very idea that a gigantic ball of rock happens to orbit our planet, showing itself in neat, four-week cycles -- with the same side facing us all the time -- is ludicrous. Furthermore, it is an insult to common sense and a damnable affront to intellectual honesty and integrity. That people actually believe it is evidence that the liberals have wrested the last vestiges of control of our public school system from decent, God-fearing Americans (as if any further evidence was needed! Daddy's Roommate? God Almighty!)
.. the next time you're out in the backyard exercising your Second Amendment rights, the liberals will see it! These satellites are sensitive enough to tell the difference between a Colt .45 and a .38 Special! And when they detect you with a firearm, their computers cross-reference the address to figure out your name, and then an enormous database housed at Berkeley is updated with information about you.
Documentaries such as Enemy of the State have accurately portrayed the elaborate, byzantine network of surveillance satellites that the liberals have sent into space to spy on law-abiding Americans. Equipped with technology developed by Handgun Control, Inc., these satellites have the ability to detect firearms from hundreds of kilometers up. That's right, neighbors
Of course, this all works fine during the day, but what about at night? Even the liberals can't control the rotation of the Earth to prevent nightfall from setting in (only Joshua was able to ask for that particular favor!) That's where the "moon" comes in. Powered by nuclear reactors, the "moon" is nothing more than an enormous balloon, emitting trillions of candlepower of gun-revealing light. Piloted by key members of the liberal community, the "moon" is strategically moved across the country, pointing out those who dare to make use of their God-given rights at night!
Yes, I know this probably sounds paranoid and preposterous, but consider this. Despite what the revisionist historians tell you, there is no mention of the "moon" anywhere in literature or historical documents -- anywhere -- before 1950 . That is when it was initially launched. When President Josef Kennedy, at the State of the Union address, proclaimed "We choose to go to the moon", he may as well have said "We choose to go to the weather balloon." The subsequent faking of a "moon" landing on national TV was the first step in a long history of the erosion of our constitutional rights by leftists in this country. No longer can we hide from our government when the sun goes down.
Am I blind, or is there no information whatsoever on where I can be part of this. From what I could tell in the article, this is a project in which 3 labs are cooperating to make a lot of data available to researchers, but nowhere it says that it is a cooperative effort at all similar to SETI, at least, not in 15 years. . .
So I have to say the concept and application of distributed computing has really opened the door to many research facilities and other projects to get off the ground and produce results. And the application of distributed computing for the crunching and modelling of data that is just "sitting around" to discover new astromical bodies or refine what has already been discovered is a very good idea. But what does this provide the end-user? From the article, it sounds as if this is aimed at the average Internet user who has a net connection:
...instead with little more than a laptop computer, an Internet connection and a learned and persistent amateur...
So my comment is really this: Examples used to "sell" distributed computing before were pretty much aimed more at a larger group of people. D.NET had RSA sponsoring the RC5/64 competition with a cash prize. Also the bragging rights of how many Gigakeys you pumped out in a day was worth it to some. Also, with the Cure for Cancer project, this is something that people will see having a very positive impact to each and every one of us. But, with this, where is the incentive? What will it matter to the end-user (who will be donating his/her spare CPU cycles) what a space rock orbiting Pluto's diameter is? I see the concept will be very powerful if applied to this scenario, but I don't see it really catching on with people. Maybe those who are/have participated in Seti@Home can comment, since this seems to be a similar project?
They plan on opening this one in early 2002, to aid combating genetic deseases in a distributed way. Quite helpful, I think...!
b.
what would a virtual blackhole look like rendered in OpenGL ?
This story may have "star-reaching-implications", but their website has the same old banner ads...
"liberty and justice for all those who can afford it"
The way I read the article, it doen't seem to be dealing with the issue as a burner of spare CPU cycles (as with seti@home), but more as a big resource for people who actually have some expertise in the field of astronomy.
With the framework being developed by three different groups (one in the UK, one in the US, and one in Australia), one would expect this to be a very competitive field, but alas, this is not the case. The three groups are working together so that they can have it all up in running the in the projected 15 years that it will take to put all this data into an electronic format.
Our village needs a new town hall. Because we're modern progressive thinkers, rather than build one, we've decided that we're going to divide the village into three teams, and then compete to see which team can build a town hall first. Each team will get a grant from tax-payers money to build their hall. Obviously this will give us the best and most efficient result.
The paper and more can be found here
The goal of this project isn't to recreate SETI@Home but to give astronomers all over the place access to data collected by instruments in places where they aren't. We've got thousands of instruments gulping down data but most of it doesn't ever get processed, just stored for later. Like the article says, anybody can have access to massive amounts of raw data. A grad student in the UK can download data gathered from telescopes in Hawai'i and write his or her own program to process them looking for the data they want. A group of amateur astronomers could request a bunch of wide field images and scavange through them looking for comets or asteroids.
I'm a loner Dottie, a Rebel.
Works even better if you run Linux and can get IRAS running and have a good display, especially if you want to fool around with the Hubble archives. Professional astronomers have been doing their research on unixes for 20 plus years. Tools are available for the asking and most professionals and grad students are willing to help out an amateur who is serious. Linux brings, to an amateur, the same desktop power, but at a very low cost.
Astronomy is one of the few hard sciences where an amateur can contribute serious work, either with nothing more than a telescope and a webcam to digging into the very numerous digital archives that are available for free.
And to add to that, there is a long, long, tradition of amateurs and professional astronomers working together. For a great example see theAmerican Assoc. of Variable Star Observers.
Most posters here haven't seem to have grasped the fact that these projects aren't dealing with letting the public access data in a Seti@home manner. That's not the aim at all. What they're trying to do is consolidate all the data that they do have available, and make that accessible to researchers. That way, you don't have to bid for expensive telescope time, you just make a requisition for the data, which would just get squirted at you over the net.
Want a particular portion of the sky at a particular wavelength? Just check the database for it. Simple as that. With the amount of machine-controlled telescopes and the new arrays developed, sucking in all this data, managing it, consolidating it and allowing people to access it in an easy way is a great move forward.
http://danhon.com/
Astronomy is a field where non-professionals still make significant discoveries. Virtual astronomy will further facilitate this. Any high school student with enough patience an accumen could learn something significant.
Details at: http://setiathome.berkeley.edu/newsletters/newslet ter10.html
- Matt Lebofsky - SETI@home
This initiative started when the Decadal Survey was released about 2 years ago now. At the moment all the "publicly" available data is spread across multiple depositories, one major one in France and then the NASA Hubble/Chandra/everything else depository and then the individual surveys (2MASS, Sloan, NOAO Deep Wide, etc. . .) are archived but can prove to be a pain to obtain. More than anything whomever does all this archiving must have a bunch of hard drive space. . . .for the NOAO Deep Wide Field we've got something like a terrabytes worth of data and we're still getting more. . . .to heck with travel expenses when you have to pay for new 100 gig hard drives every other month. . . .
Perhaps this is off-topic, but the link to distributed.net is broken in the story paragraph. The 'p' in 'http:' is missing.
From their web pages:
I have the feeling that some may be confused about what virtual astronomy is. So perhaps I can try to clear up a little bit.
Much of astronomy now is done by individual astronomers going to telescopes and pointing to interesting objects in the sky. Each researcher has lists of several objects they'd like to observe, and on their night at the telescope, they skip from object to object. This is good for the individual astronomer, but unfortunately, wastes a lot of time, because a lot of the time must be spent on finding the object, moving the telescope, etc. Because observing time is so precious, a new way has been discovered to make it more efficient -- virtual observing.
Virtual observing mas made possible by the great advances in database technology and hardware storage technology. It works by having a telescope (which used to be used by astronomers for individual objects, for example) survey broad areas of sky, subsequently storing that data on disk. Efficiency is increased, because you essentially put the telescope in one position and let the sky move over it, instead of having to point from object to object. Also, setting the telescope up for one survey run is much better than setting it up for the 2 or 3 observers each night, who may have different requirements.
Then, when an "observer" wants to look at an object, instead of asking the telescope to point there specially for him/her, now he/she just goes to the database and retrieves the image. It's better for the astronomer too -- quicker, no need to wait for a clear night, or your time to observer, and no need to fly out to the observatory. There are also lots of gains to be had in the science, too, because some experiments require large swaths of continuous sky to analyze, instead of just individual objects. Much of the work demonstrating the expansion of the universe relies on having such data, and it's only been possible recently with the first virtual observing projects.
The challenges are, as stated in previous posts, compiling all the data so that it can be accessible in an easy way by observers around the world, storage, and data processing. It's going to be an exciting time for astronomy, and I think that our knowledge is going to increase rapidly!
Xephem (a planetarium and analysis program for linux) is very cool because it can both pull the sky from your LX200 telescope or by replacing the telescope driver with a perl script, it can download part of the sky from an online database, after which you can do realtime image processing on it.
It can also match stars in the sky to stars in the database. So far I have only been able to pull down large segments of the sky at once, but as soon as I can clear the disk space I'll be trying some other pieces of software to try and download smaller pieces of the sky. Starry Night also downloads DSS (Digital Sky Survey) images I believe.
NASA Skyview service
Multimission Archive
StarView
Software for different platforms (or check freshmeat.net)
Serious scientific platforms/data
Skyview (available at IPAC) is available as linux binary and installs quickly at 10mb. It lets you do image analysis with text commands. I have not used it a lot myself.
AstroWeb