Slashdot Mirror


Software Telescope

An anonymous reader writes "The BBC News is running the story 'Pyramid power' probes universe which is about LOFAR's software telescope for radio astronomy. The heart of the system is a IBM Blue Gene which processes data from an array of simple pyramidal radio antennae. The array of antennae are also multitasking in the fields of geophysics and agriculture."

62 comments

  1. Why can't we distribute this work? by jarich · · Score: 5, Interesting
    Why do projects like this have to be done on supercomputers? Wouldn't it be a cool to be involved with this, in a distributed.net style.

    If you participate, you get free access to all the high res graphics!

    1. Re:Why can't we distribute this work? by AndroidCat · · Score: 5, Funny
      If you participate, you get free access to all the high res graphics!

      And if you help out with the potato farm project, can you get an order of fries with that?

      --
      One line blog. I hear that they're called Twitters now.
    2. Re:Why can't we distribute this work? by karvind · · Score: 5, Informative
      From LOFAR website:

      The bandwidth of the connection between each Remote Stations and the Central Processing Systems will be ~10 Gbit/s, of which ~ 2.5 Gbit/s will be occupied by the sustained datarate resulting from the sensors.

      LOFAR produces very large data streams, especially for the astronomy application (e.g. 6 TB of raw visibility data for an 8 beam, 4 hour synthesis observation, after integration for 1 sec and over 10kHz).

      They mention that final post-processing can be done at a central processing station (I am guessing the Blue Gene one) or locally by the users. Only bottlenecks seems to be the bandwidth.

      LOFAR post-processing can take place either at the Central Processor or locally with the users (in particular at Science Centers). If the available Internet capacity is sufficient, intermediate dataproducts can be transported to the user, and local processing can be done. Otherwise processing resources at the Central Processor are available for further data reduction (within the limits of the Central Processor processing budget).

    3. Re:Why can't we distribute this work? by bryan8m · · Score: 1

      My computer can hardly handle running SETI, and I don't think it would be that much cooler to be involved in this.

    4. Re:Why can't we distribute this work? by IWannaBeAnAC · · Score: 4, Informative
      For this project, it is the huge rate of incoming data that is the problem. They must process it immedately, as it would take a huge amount of storage to keep even a few hours worth of data. Anyway, the processing will involve determining the correlations between data from different sensors, which probably requires lots of communication. Both these points are big negatives for a distributed.net computation.

      Of course, you would know this if you had RTFA before you posted...

    5. Re:Why can't we distribute this work? by timeOday · · Score: 1

      There you go, just string up a 10Gbit/s fiber to my house and I guarantee unfettered access to my PeoplePC!

    6. Re:Why can't we distribute this work? by inKubus · · Score: 1

      Terabytes are about 400-500 bucks for cheap drives.... I don't think it's storage that's really the problem.

      --
      Cool! Amazing Toys.
    7. Re:Why can't we distribute this work? by IWannaBeAnAC · · Score: 3, Interesting

      With data incoming at 50GB/s, even terabytes don't help much.

    8. Re:Why can't we distribute this work? by Anonymous Coward · · Score: 0

      So a whole bunch of gmail accounts wouldn't do it. Poot!

  2. Pyramid Power? by TripMaster+Monkey · · Score: 2, Funny


    I hope the people over at LOFAR have considered all the ramifications of Pyramid Power... ^_^

    --
    ____

    ~ |rip/\/\aster /\/\onkey

    1. Re:Pyramid Power? by fgl · · Score: 1

      In todays political climate, they probably didnt consider the ramifications of calling it "Pyramid" Anything...

      --
      Go Away! Not for Sale
    2. Re:Pyramid Power? by Anonymous Coward · · Score: 0

      This article brought back memories of old Popular Science ads -- "Amazing power of the Ancients: the Pyramid has been found to preserve fresh fruits and vegetables, as well as keeping razor blades sharp..."

      Now also, "Pyramids can peer into the vast reaches of the space-time continuum back to the beginning of time itself!"

      So, is the company that makes these Pyramids (Patent Pending) selling stock or (even better yet ) offering franchises? Inquiring minds want to know!

    3. Re:Pyramid Power? by dasdrewid · · Score: 1

      The Mythbusters did an investigation of Pyramid power the other day. It was pretty entertaining. They actually found, in one case, that an apple half placed under the pyramid survived much better than its counterpart a foot away. Turns out it was cause they cut the apple with their woodshop's circular saw (in other words, majorly un-sterilized...)

      --
      No trespassing. Violators will be shot. Survivors will be shot again.
  3. Re:Software Telescope? by Anonymous Coward · · Score: 0, Interesting

    Um....no...that's not even remotely/i. what it does....thanks for playing though...

    In regards to the 'Slow Down Cowboy', thing, though, I've noticed this too...what's up with that?

  4. The real question is.... by Anonymous Coward · · Score: 3, Funny

    The real question is who designed these "pyramids"? It's obvious that our current society is not advanced enough for such a feat, so that leaves us three possibilities.

    A) A past civilization capable of such feats.
    B) A future version of our civilization with time travel.
    C) Otherworldly visitors with hyperadvanced technology.

    I fear we'll never quite understand this mystery.

    ---
    News for real nerds, stuff that actually matters.

    1. Re:The real question is.... by Ingolfke · · Score: 3, Funny

      Maybe no one designed them at all you idiot. Just because something exists and seems to have some purpose or logical structure doesn't mean it was created. I doubt they were created at all, they probably just came into existence or are the result of metal deposits that have, over time, formed into shapes that appear to be, and are suitable for us as, antennae.

    2. Re:The real question is.... by $RANDOMLUSER · · Score: 4, Funny

      I assert, without proof, that they are obviously Irreducably Complex, and therefore must have been created.
      So there.

      --
      No folly is more costly than the folly of intolerant idealism. - Winston Churchill
    3. Re:The real question is.... by Charles+W+Griswold · · Score: 1

      The pyramids ("which pyramids" you ask? The pyramids, you insensitive clod!) were obviously made by the same people who created the face on mars.

      The whole "probing the universe" line is a ruse. "Probing" my as . . . err . . . foot. The antennas are there in order to harness the universal power of the pyramids. Anyone with half a brain could see that! *

      So there. :-P

      _____

      * People with whole brains, on the other hand, frequently have trouble seeing things of that sort.

      --
      "Those who are too smart to engage in politics are punished by being governed by those who are dumber" -- Plato
    4. Re:The real question is.... by Anonymous Coward · · Score: 0

      I am certain there is too much certainy in the world. ;-)

    5. Re:The real question is.... by AndroidCat · · Score: 1
      Just because something is Irreducably Complex, it doesn't mean that it was designed. Look at Windows...

      (Arguments that the complexity could be reduced by switching OS is beyond the scope of this discussion, stamped it!)

      --
      One line blog. I hear that they're called Twitters now.
  5. LOFAR is going to be exciting by karvind · · Score: 5, Informative
    Our earlier Slashdat stories on LOFAR: a consortium between ASTRON (The Netherlands), NRL (USA) and MIT/Haystack (USA).:

    When Lofar Meets Stella

    350 KM Diameter Radio Telescope Array

    I was talking to a professor in astronomy here and he mentioned about some of the conflicts between US and Europe regarding the plan. That is one of the reasons why US is also working on Square Kilometer Array. LOFAR imaging telescope are designed for the 10-240 MHz frequency range where as SKA will cover 0.15-20GHz or higher. Hopefully the two efforts will complement each other.

    1. Re:LOFAR is going to be exciting by steve_vmwx · · Score: 5, Informative

      Hmmm. Wasn't Euro v's USA. It was the Dutch v's everyone else.

      LOFAR was supposed to be the international forerunner to SKA for a lot of the tech.

      Western Australia won the site selection. Dutch government said "if you build it here we'll throw in a bucket load of cash". Dutch reps took the bird in the hand (kind of understandable given the global spending habits of governments on peaceful science).

      Everyone else in the original LOFAR weren't (and still aren't) too happy.

      Still... it's a nice piece of kit.

      SKA development continues. WA is again up for site selection. Speaking as an Oz astronomer I'm hopefull. It's a great site for radio astronomy.

      For the person who asked, the antenna design is a folded dipole. Google it :)

      Cheers
      Stevo

      --
      Forget the truth. Science is fact.
    2. Re:LOFAR is going to be exciting by zoefff · · Score: 1

      Everyone else in the original LOFAR weren't (and still aren't) too happy.

      Can understand that. If you look at the distribution of the antenna's, some are drowned in the North Sea.

    3. Re:LOFAR is going to be exciting by Anonymous Coward · · Score: 0

      Speaking as an Oz astronomer I'm hopefull. It's a great site for radio astronomy.

      Yeah, the Netherlands seems like a strange place to put a large array of instruments, at least when compared to the wide open spaces in Australia, western part of US, western part of China, etc.

      I suppose it could help them politically. If you pay your farmers to keep these antennas in their fields, this could act like an agricultural subsidy, even though it comes under the head of scientific research so far as the budget is concerned. But maybe I am just too cynical.

  6. Where's Da Plans...? by __aaclcg7560 · · Score: 4, Funny

    So where is the link to build my own radio telescope and supercomputer? Or do I have to wait until the next issue of Make comes out?

  7. Might not be as useful as first thought... by xquark · · Score: 3, Funny

    "It is also possible that weather monitoring will become so localised
    and instantaneous that weather forecasting will become "now-casting".

    I'm sorry but I don't need some remote sensor device using wi-fi telling
    me that it is raining hail stones, the pain from the fractures to my
    cranium will be more than enough.

    Arash Partow
    __________________________________________ ________ ______
    Be one who knows what they don't know,
    Instead of being one who knows not what they don't know,
    Thinking they know everything about all things.
    http://www.partow.net/

    --
    Arash Partow's Philosophy: Be a person who knows what they don't know, and not a person who doesn't know.
    1. Re:Might not be as useful as first thought... by Directrix1 · · Score: 1

      Um, this now-casting he speaks of has existed for many many years here in Oklahoma.

      --
      Occam's razor is the blind faith in the natural selection of least resistance and in universal oversimplification. -- EF
  8. Amazing infrastructure by Sv-Manowar · · Score: 3, Interesting

    The article states that individual pyramidal radio antennae are all connected back over fiber to the main Blue Gene supercomputer (Stella). As the antennae are spread over 350km, I think this represents a pretty serious amount of infrastructure development. Making the data collected available for local commercial use seems to have been of real use to the local community, and I wonder if there are a lot more situations where remote sensor networks could be of aid.

    1. Re:Amazing infrastructure by Anonymous Coward · · Score: 0

      Karma whore for your shitty porn site. How quaint. Completely safe for work if someone accidentally clicks the link next to your name.

      Mods, mod this person down until he removes the porn link from his profile.

  9. Re:Software Telescope? by Anonymous Coward · · Score: 1, Interesting

    I believe that the time between posts has been raised for anonymous posting to 10 minutes. Probably much longer due to some alogarithm inside slashcode that taco would never want us to see.

    It's been 18 minutes since you last successfully posted a comment

  10. Depends who owns data bits by helioquake · · Score: 2, Insightful

    Why do projects like this have to be done on supercomputers?

    Technical points aside, one political reason for not going to distributed processing is this: some want their data bits to be strictly proprietary.

    By distributing, there will be a chance that the distributed data bits would be compromised and captured by someone else (e.g., leading to scooping the cheif investigator). It's a long shot, I know, but that is something that the organization like this need to take into account.

  11. Radio Technology Is Still Untapped.. by Halvy · · Score: 0

    Because of things like this, along with future applications like TCP/IP (InterNet) over Shortwave Radio http://www.patmedia.net/ralphmilnes/soundcardpacke t/6tor.htm .

    The next big apps will not only be the ones which give *officials* and CEO's their wish list of projects, but ones that will help empower the individual so that even more great things like the SoftWare Telescope can be developed. :)

    --
    I will gladly loose all of life's battles.. in order to win the war..
  12. damn... by bad_outlook · · Score: 1

    time to upgrade the video card again! damn horse nebula in all it's beauty and colours...

  13. Rise of software-embodied functionality by G4from128k · · Score: 4, Interesting

    This development highlights the ongoing replacement of specialized, engineered devices with general purpose CPU + software. So many things (car's carburetors, motor speed controls, printers, appliance controls, radios, etc.) were formerly designed using mechanical and electrical circuits that implemented the needed functionality. Now they do it with a CPU such as an embedded controller and a bit of code in flash-RAM.

    The shift from hardware-embodied functionality to software-embodied functionality is very profound because of the differences in cost structures. The cost of complexity for software is far lower than the corresponding cost of complexity for hardware. The cost of manufacturing for software is lower than the cost of manufacturing for hardware. The cost of modifying or upgrading software is far lower than the cost of replacing or upgrading hardware. Products with software-embodied functionality can be designed at low cost, made in volume at lost cost and changed at will after sale. The result is greater variety and faster development of new products.

    The effects go much farther than cost and variety. Perhaps the most interesting effect is that caused by Moore's law. Whereas mechanical and electronic system have not improved much in the last few decades, CPUs have. Creating software-embodied systems means that the device's performance can become slaved to Moore's law -- a software-embodied product gets a free performance boost with every doubling of transistor count/clockspeed.

    I apologize for using this /. cliche, but I, for one, welcome our new software-embodied overlords.

    --
    Two wrongs don't make a right, but three lefts do.
    1. Re:Rise of software-embodied functionality by Anonymous Coward · · Score: 0



      Wow, it sounds like you were waiting a long time to get that off your chest.

    2. Re:Rise of software-embodied functionality by pe1chl · · Score: 4, Insightful

      Unfortunately it has also increased (in my perception at least) the number of products that go to market before being well developed and tested.

      In the old style development, you had to make sure you had it right before starting production, or else it would cost you a lot of money for retooling and fixing already produced items. Today, you develop a working microcontroller solution (hopefully without hardware bugs), quickly hack together some firmware, and start production and sale.

      The consumer will come back with numerous complaints and then is the time to look at the software and maybe release some updates.

      Some manufacturers even don't fix software for existing products but just do that in the next model. Early adopters pay the price for a crippled product.

  14. Rarely do I see "potato watch" in a "pyramid power" story.

    Lovin it.

  15. Why isn't there any tech info on the antenna? by Anonymous Coward · · Score: 1, Interesting

    Why are they "pyramid" shaped?

    Is it a simple dipole? Is one leg just for support? How far down does the wires inside the pipes go (if that's how it works)?
    Do they have a box right there at the antenna or do cables run over to a small building where all the other processing stuff is?

    If you had a big enough back yard and a 3 Ghz system (with Linux of course) what could you get? (1 acre, 5 acres?)

    1. Re:Why isn't there any tech info on the antenna? by Anonymous Coward · · Score: 1, Informative

      antennae are pyramid shaped to take advantage of multiple dipole lengths, and higher bandwidth receivers.

    2. Re:Why isn't there any tech info on the antenna? by Cheapy · · Score: 1

      "...3 Ghz system (with Linux of course)..."

      Why not Windows? How do you know they don't want it to crash?

      --
      Would you kindly mod me +1 insightful?
    3. Re:Why isn't there any tech info on the antenna? by reddish · · Score: 4, Informative

      The antennas are pyramid shaped because each of those pyramids actually contains two dipole antennas, to capture the EM field in two perpendicular polarisations. (I am involved in the project so trust me on this one ;-))

  16. Software Telescope by PigIronBob · · Score: 3, Informative

    To bad that the author didn't use a dutch spell checker; Gonungen should be Groningen, a university that has an produced impressive array of Astronomers such as Maarten Schmidt (identified the first Quasar), Bart Bok (established Siding Springs in Australia), Jan Oort (Proposed the 'Oort Cloud' of comets),All of these were tought by Jacobus Cornelius Capteyn, whole calculated the mass of the Milky Way Galaxy.

    --
    You never catch me alive
  17. Software Telescope by $RANDOMLUSER · · Score: 1

    When I saw the headline "Software Telescope", I thought maybe someone had invented a device which would let us see Longhorn going GA.

    --
    No folly is more costly than the folly of intolerant idealism. - Winston Churchill
  18. Europe's most powerful supercomputer by kenodi · · Score: 1

    I believe the most powerful supercomputer in Europe is in Spain rather than the Netherlands as mentioned on th BBC website.

    1. Re:Europe's most powerful supercomputer by Da+Fokka · · Score: 2, Informative

      I believe the most powerful supercomputer in Europe is in Spain rather than the Netherlands as mentioned on th BBC website.

      You are right, according to this list the Barcelona Supercomputer is slightly faster. This hurts my dutch pride.

    2. Re:Europe's most powerful supercomputer by kenodi · · Score: 1

      It seems that even the University in Groningen claims that Stella is the fastest in Europe, which is not the case if you see top500.org (the link in the post above).

    3. Re:Europe's most powerful supercomputer by bothide · · Score: 1

      Actually, the LOFAR IBM BlueGene "Stella" IS faster thanthe "Mare Nostrum", the IBM JS20 cluster in Barcelona.

      I know. I have seen the numbers since I am the
      intitiator of and project leader for LOIS (LOFAR Outrigger in Scandinavia; www.lois-space.net), a space physics supplement to LOFAR proper and
      where we also have a JS20 cluster.

      Bo

    4. Re:Europe's most powerful supercomputer by kenodi · · Score: 1

      Are you saying that top500.org is not reliable? That would be a rather bold statement.

  19. People wanting to participate by Quiberon · · Score: 3, Informative
    Of course you can participate. The Dutch Education Ministry has just run a competition; prize of 3 laptop computers for the school with the most creative idea of how to use radiotelescope and attached supercomputer in a school classroom.

    And for the winner, IBM drops in a team to make it happen.

    So, what do you want to do, and how do you propose to do it ?

    1. Re:People wanting to participate by Anonymous Coward · · Score: 0

      The school than won proposed a sensor network for the earth's magnetic field.

  20. Interesting Approach by mbrother · · Score: 2, Interesting

    One of my friends/acquaintances, Heino Falcke, works for LOFAR. I was with him at a meeting in Italy in May and got the inside scoop on a lot of things...but it was so far out I'm afraid I didn't assimilate a whole lot of the details. I've used the VLA and published a few radio-based papers, but I'm far from an expert. Definiately a revolutionary, technology-pushing system sure to produce some great science.

    --
    Professor of Astronomy, Author of Spider Star & Star Dragon (Tor)
  21. Decode atlantic newtalk by Anonymous Coward · · Score: 0

    >The array of antennae are also multitasking
    >in the fields of geophysics and agriculture.

    Decode DoD/NATO newtalk:

    >field of geophysics

    We need to know where have the russkies and the yellows buried their new command and communications bunkers!

    >field of agriculture

    Trying to predict what the harvest will be like in the USSR and China. If they are going to be short on crop this year, we can tell them to shut up and go fuck their mothers. It is so nice when Uncle Sam can control international politics via wheat export.

  22. The processing box by Man+in+the+Box · · Score: 2, Informative

    There is indeed a box for gathering all the data and sending it over to Groningen. It's basically a EM shielded container (see http://www.otvi.nl/gallery/plantdag_1/img_0124 )

  23. Some info by odourpreventer · · Score: 4, Interesting

    I did my Master Thesis work at IRFU (Institute for Space Physics in Uppsala) with LOIS (LOFAR Outrigger in Scandinavia) and may be able to shed some light.

    The antennas (or aerials) need not necessarily be pyramid shaped. A multitude of shapes exist. The two antenna elements are mounted orthogonally and allow two vector components of the signal to be retrieved. The LOIS antennas go a step further and have three elements, also mounted orthogonally. This means that not only can it decode AM and FM signals, but also phase and polarisation modulated signals. The last one is specially interesting, since polarisation modulation isn't bandwidth limited.

    What's even more cool with the system is that it's entirely digital; the signals are demodulated using folding distortion. This means that there isn't any (theoretical) lower limit to the carrier wave frequency, which opens up new possibilities for studying background radiation.

    The 10 Gb lines are not just for show. The output from each antenna system can easily use up all that bandwidth, and presently does so. And since the resolution of a cluster depends on the number of antennas, it's all about computing power.

  24. Aliens will finally be heard! by Anonymous Coward · · Score: 0
    {tinfoilhat

    look out seti....if the data collected by arrays at a distance is analysed. Then patterns of signals might be found. The reason for this is that any signal coming from an advanced civilization will be extreemly long wave length carriers traveling at speeds >C.

    }tinfoilhat

  25. Blind Lake by Moses_Gunn · · Score: 1

    Interesting...Robert Charles Wilson wrote "Blind Lake" which was essentially about a software telescope powered by quantum computers. It was a fairly interesting read. Once again, reality imitates fiction. ;)

  26. Re:Software Telescope? by imsabbel · · Score: 1

    And posts like the greatparente make me feel that maybe a week between AC postings would be a good lower limit.

    --
    HI O WISE PRINCE. WHT TOOK U SO DAM LONG?