Slashdot Mirror


New Zealand Joins Aussie Bid For Vast Radio Telescope Array

schliz writes "A radio telescope in New Zealand has joined five in Australia to challenge Southern Africa to host the international Square Kilometer Array (SKA) in 2012. The newly connected telescope in Warkworth, New Zealand (PDF), is connected to an Australian data processing facility via a 1 Gbps network. Each telescope reportedly produces up to 1 Tb of data per hour of observation. IBM expects the whole of the SKA to produce an exabyte of data per day."

60 comments

  1. Mmmm .... by Anonymous Coward · · Score: 0

    Mmmmm .... VLBA sexy. Exabytes, *arghghgh*

  2. mmm exabytes..... by Anonymous Coward · · Score: 0

    said in the voice of a hungry Homer Simpson

    1. Re:mmm exabytes..... by kirill.s · · Score: 1

      When Homer says that, he means -bites.

  3. Did you mean SKA or Ska? by Anonymous Coward · · Score: 0

    I can imagine the total lack of confusion when absolutely no one mistakes the SKA with the music genre Ska.

  4. Backup Officer by Anonymous Coward · · Score: 0

    I really don't envy the guys in charge of backups...

    1. Re:Backup Officer by Shakrai · · Score: 2, Funny

      It's probably a cloud solution involving a few million g-mail accounts ;)

      --
      I want peace on earth and goodwill toward man.
      We are the United States Government! We don't do that sort of thing.
  5. "Square Kilometer Array" by ScaryMonkey · · Score: 5, Funny

    Gotta love the creativity that goes into these names. Too bad they stopped with the previous naming pattern, I was waiting for the "Fucking Enormously Huge Array".

    1. Re:"Square Kilometer Array" by Shakrai · · Score: 5, Informative

      I'd like a Beowulf cluster of those ;)

      Already, the telescope network has been used to image the heart of a galaxy called Centaurus A, which is 14 million light-years away and contains a supermassive black hole.

      Observing the galaxy for ten hours, each of the six telescopes recorded up to 10 Tb of data. This was transmitted to Perth's Curtin University of Technology via KAREN and the 10 Gbps AARNET.

      At Curtin, the data was processed on a local 160-core Beowulf cluster comprising a 100 Tb spinning disk and supported by petabyte storage at the iVEC supercomputing centre.

      The cluster consolidated and processed the data into a final data set a "few" gigabytes in size, according to Curtin professor Steven Tingay.

      --
      I want peace on earth and goodwill toward man.
      We are the United States Government! We don't do that sort of thing.
    2. Re:"Square Kilometer Array" by Anonymous Coward · · Score: 0

      That's a silly name, I'd have called it a Chazwazer.

    3. Re:"Square Kilometer Array" by Anonymous Coward · · Score: 0

      Optical astronomers are still using the old naming pattern: they've proposed the Overwhelmingly Large Telescope.

  6. translation by Shakrai · · Score: 1

    The newly connected telescope in Warkworth, New Zealand (PDF), is connected to an Australian data processing facility via a 0.000048828125 LOC/s network. Each telescope reportedly produces up to 0.05 LOC of data per hour of observation. IBM expects the whole of the SKA to produce 52428.8 LOC of data per day.

    --
    I want peace on earth and goodwill toward man.
    We are the United States Government! We don't do that sort of thing.
    1. Re:translation by MichaelSmith · · Score: 2, Insightful

      But I thought LOC was a measure of information not data.

    2. Re:translation by rossdee · · Score: 1

      "0.000048828125 LOC/s"

      You can't use that sort of precision with the Library-Of-Congress unit, since its not a static amount - it keeps growing.

  7. So, what? by Frans+Faase · · Score: 3, Insightful

    I do not understand what is so interesting about this. Another dish added to various international VLBI networks. There is also one such dish near Urumqi in China in a very remote area. There are so many of these kind of dishes around the world. Even here in the Netherlands we have one. But we also have LOFAR, which is also capable of producing large amounts of data everyday. This kind of systems usually only operate for short periodes and the data produced are immediately processed and only the results are stored.

    1. Re:So, what? by DuQax · · Score: 1
    2. Re:So, what? by Anonymous Coward · · Score: 0

      Well If they put a 1 sq km array in New Zealand there would be not room left for anything else. At least in Australia we have some spare space lying around. Note : If you are not from New Zealand or Australia you probably don't see the point of this remark. I thought someone should uphold the honour or the Trans Tasman sort of pointless rivalry.

    3. Re:So, what? by pinkstuff · · Score: 1

      I'll bite. Although New Zealand may seem small next to Australia, it is actually slightly larger than the whole of the UK.

    4. Re:So, what? by buchner.johannes · · Score: 1

      I do not understand what is so interesting about this ... This kind of systems usually only operate for short periodes and the data produced are immediately processed and only the results are stored.

      That is the difference. SKA will not store the data, because it is unfeasible. A lot of effort goes into the processing pipeline and enabling it to handle the throughput.

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    5. Re:So, what? by Frans+Faase · · Score: 3, Informative

      For your information, the LOFAR system also processes data immediately. All the stations are connected with 10Gbit networks to the central processing system in Groningen.

      Each LOFAR antenna produces 0.8 Gbyte of data per second. When finallized, the system will consist of about 7000 antenna spread out over about 40 field most of which are in the Netherlands, but about ten of them will be abroad. I understand that each field will perform some preprocessing before the data is send to the central processing unit where it is correlated and further reduced before it being stored and made available for off-line processing. See here for a detailed description.

    6. Re:So, what? by RogerWilco · · Score: 4, Informative

      Well, that's partially true. The online/realtime processing doesn't store the data. We have the data coming in at about 150 Gbit/s into the BlueGene supercomputer (34 TFlop), which does initial realtime processing and writes resulting files at about 50 Gbit/s on a roughly 1 Petabyte intermediate storage system for offline processing. From there it gets initial processing/calibration and a factor of 16 to 64 reduction in size on the offline processing cluster (about 200 8core machines). Also some inspection of the data is done for quality assessment, and sky images are made. If the quality is good, the resulting data and images are moved to out 4+ Petabyte long term archive, where further processing can also be done to achieve publication ready results.
      On average we are expected to be producing about 20 TB/hour raw data, and about 700 GB/hour data that gets archived (life time of more than a week).

      As I speak we are 2 weeks away from the system being opened by the Dutch Queen, and we are operating on about half the above numbers with about 25 antenna fields online. By the end of 2010 we should be operating at full strength. Also, those numbers are from the top of my head, so I might be off a bit here and there.

      LOFAR is seen as a precursor to SKA, the first of a new generation of telescopes based much more on software and firmware and cheap off the shelve instead of expensive dishes and custom DSP hardware. After the various VLBI efforts (Including JIVE, which is housed in the same building as ASTRON and LOFAR), LOFAR now is the biggest telescope on Earth.
      http://www.astron.nl/dailyimage/main.php?date=20100421
      http://www.astron.nl/dailyimage/main.php?date=20100125

      There are some rather nice images starting to come out of the system, if you're a radioastronomer, but most are under embargo until the opening. I can show you this older image:
      http://www.astron.nl/dailyimage/main.php?date=20100208

      When mentioning SKA precursors, it's also noteworthy to mention that the 14 25meter dish WSRT array will be upgraded with focal plane arrays over the next two years, and the EMBRACE test bed has almost finished building it's first three stations.
      http://www.astron.nl/dailyimage/main.php?date=20070801
      http://www.astron.nl/dailyimage/main.php?date=20091012

      --
      RogerWilco the Adventurous Janitor
  8. It's nice to have a real time link for this work by NixieBunny · · Score: 4, Interesting

    I work on millimeter- and submillmeter-wave frequency radio telescopes in Arizona that occasionally do VLBI runs at 1.3mm (230 GHz). We don't have anything like a 1Gbps data link; it's more like 10 Mbps. It's hard to get the phone company to install a fiber cable run up a mountain.

    Our VLBI data are stored on hard disks at a rate of ~1 Gbps, then correlated later on some big computer back east. We have to wait days to learn if interference fringes were detected!

    --
    The determined Real Programmer can write Fortran programs in any language.
  9. So slow... by Thanshin · · Score: 2, Interesting

    When I imagine a future civilization, I always think of the technology they have and the consequences of that technology. I never took into account the large buffer between both.

    What stops humans from launching telescopes to Lagrangian points all around us?

    Sometimes I think we should create an outside enemy, just to regroup the entire species in a single entity, able to attack bigger problems than our tiny local quarrels.

    1. Re:So slow... by anarche · · Score: 1

      Sometimes I think we should create an outside enemy, just to regroup the entire species in a single entity, able to attack bigger problems than our tiny local quarrels.

      Robot overlords!

      --
      Wait! Whats a sig?
  10. Re:New Zealand Story by Anonymous Coward · · Score: 0

    That story should have ended with the man blowing his brains out. Chicken shit.

  11. Three Cheers for the SKA by BrightSpark · · Score: 1

    Australia has more square kilometres than most. Hip Hip Array!!

    1. Re:Three Cheers for the SKA by MichaelSmith · · Score: 1

      Australia has more square kilometres than most. Hip Hip Array!!

      Which is why I am surprised the array is in NZ. I suppose it is okay to allow sheep to graze under the receiver dishes.

    2. Re:Three Cheers for the SKA by Anonymous Coward · · Score: 1, Interesting

      I drive past the warkworth telescope a few times a month. Rest assured, there are no sheep grazing beneath it. There are, however, cows in the paddocks surrounding the 'telescope patch' :)

    3. Re:Three Cheers for the SKA by buchner.johannes · · Score: 2, Insightful

      In arrays, you want _many baselines_ (telescope to telescope distances) and you want them to be _long_, because that will make your image better. It shouldn't be as large as the earth-radius though, otherwise you can only observe a few hours per day.

      The SKA is being built in South Africa or Australia, and New Zealand would like to provide an "addon" to the SKA -- if it is going to be built in Australia --, that will provide a *huge* improve on the baselines involved. Tests have shown that the imaging capability drastically improves, so it would be well worth it.

      Disclaimer: I am researching in the NZ institute mentioned.

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    4. Re:Three Cheers for the SKA by John+Hasler · · Score: 1

      It shouldn't be as large as the earth-radius though, otherwise you can only observe a few hours per day.

      I'd think you'd want a baseline nearly as long as an Earth diameter, as long as you can switch elements in and out of the array as they come into view of the target. With a ring all the way around the planet and the ability to continuously reconfigure the array in real time you could keep equatorial objects under continuous observation. Resolution would vary throughout the day, though, as it is not (yet) practical to place elements at sea.

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
    5. Re:Three Cheers for the SKA by thogard · · Score: 1

      The power is much cheaper in NZ.

    6. Re:Three Cheers for the SKA by RogerWilco · · Score: 1

      While you are correct, long baselines come with a couple big drawbacks:
      - You need higher time resolution to prevent bandwidth smearing.
      - You need intermediate length baselines as well, or your uv coverage will be poor.
      - To grid your data in the uv plane becomes very hard as the grid becomes very large.

      This means that the size of the data you need to manipulate and processing requirements go up very quickly with longer baselines. For LOFAR we now have baselines of about 1000km and we will go even longer to 2-3000km. processing requirements for observations that contain all our stations, both short and long baselines are huge. I'm talking PFlops if you want to do it real time.
      Partially you can get around this by using only long baselines, like in VLBI, and just imaging small things, but for SKA you'll have many short baselines as well.

      Disclaimer: I work for ASTRON operating the 14 25m dish 3km WSRT, 7000 antenna 44 station 3000km LOFAR and the 3 station EMBRACE SKA demonstrator project. Although I'm not an astronomer. ;-)
      I just visited a friend of mine at the University of Canterbury in ChristChurch, working with the MOA, astrophysics is a small world in NZ, good luck getting involved in SKA!

      --
      RogerWilco the Adventurous Janitor
    7. Re:Three Cheers for the SKA by buchner.johannes · · Score: 1

      Disclaimer: I work for ASTRON operating the 14 25m dish 3km WSRT, 7000 antenna 44 station 3000km LOFAR and the 3 station EMBRACE SKA demonstrator project. Although I'm not an astronomer. ;-)
      I just visited a friend of mine at the University of Canterbury in ChristChurch, working with the MOA, astrophysics is a small world in NZ, good luck getting involved in SKA!

      I will contact you guys soon with some software system questions re EMBRACE ... if you could leave your email address in a comment on my blog that'd be great. I'm researching scheduling systems (and probably simulators as well) for the SKA. Cheers

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    8. Re:Three Cheers for the SKA by darkknigh152 · · Score: 1

      I live in Warkworth, at one point there actually were sheep grazing very near it but they got moved a while back. I did on one occasion go for a night time bush exploration on the hills surrounding the telescope. The dishes look very cool at night.

  12. Re:It's nice to have a real time link for this wor by MichaelSmith · · Score: 2, Interesting

    On a distantly related note I once worked with a guy who was doing synthetic aperture radar from a sled on the antarctic ice cap. On his return he planned to spend weeks manually reducing the data so I wrote a fortran program for him which did the whole job in three hours on VAX 11/730.

  13. Re:It's nice to have a real time link for this wor by Thanshin · · Score: 2, Insightful

    It's hard to get the phone company to install a fiber cable run up a mountain.

    How expensive would it be to lay out the fiber yourselves? About $5k per mile to the closes phone company supported location? How far would it be?

    Just asking.

  14. Re:It's nice to have a real time link for this wor by NixieBunny · · Score: 3, Interesting

    It's all politics. There's the environmental impact problem. The folks who arranged for our underground power line really screwed up by not putting a fiber in the same trench; now it's virtually impossible to get the Forest Service to permit additional work. Four words: Mount Graham Red Squirrels!

    --
    The determined Real Programmer can write Fortran programs in any language.
  15. Is this really a good idea? by CuteSteveJobs · · Score: 4, Insightful

    Think twice, New Zealand. If the aliens start beaming you back porn, then Australia will have to filter your radio telescopes.

    1. Re:Is this really a good idea? by Anonymous Coward · · Score: 0

      Unnecessary
       
      Typical. First pavlova, now censorship.

    2. Re:Is this really a good idea? by martin-boundary · · Score: 1

      Not so. The scientists have agreed to share it. On even weekends, the dish gets dismantled and flown to New Zealand to be installed there, while on odd weekends, they air mail it back to Australia.

    3. Re:Is this really a good idea? by anarche · · Score: 1

      Actually Australia is bringing New Zealand in on this proposal just in case of the threat of aliens

      --
      Wait! Whats a sig?
    4. Re:Is this really a good idea? by seanvaandering · · Score: 3, Funny

      Just as long as the porn is not of women with small tits... that would be illegal

  16. Re:It's nice to have a real time link for this wor by Thanshin · · Score: 3, Funny

    now it's virtually impossible to get the Forest Service to permit additional work.

    - Buy the fiber roll.
      - Throw some green and brown paing buckets over it.
      - Before it dries, throw in little branches, leaves, and red squirrels.
      - Buy a ninja costume, a shovel and a pair of night vision goggles.
      - Every night, go to the forest, lay out some meters of underground fiber and hide the camo roll.

    If someone finds you, dressed as a splinter cell ninja, carrying a shovel and an oversized rotten donut, you can make a deal: if he finds out what's your PhD on, you give him $5k, if he doesn't, he leaves you alone.

  17. Re:It's nice to have a real time link for this wor by DNS-and-BIND · · Score: 1

    What's more important? You can have internet or the endangered Mount Graham Red Squirrels can have an environment free of redneck construction workers fucking everything up? You think maybe those laws exist for a reason?

    --
    Shutting down free speech with violence isn't fighting fascism. It IS fascism!
  18. Re:New Zealand Story by master5o1 · · Score: 1

    Actually, to classify as a New Zealand story, it would have to be about a guy in the South Island and his flock of sheep... In particularly the favouritism towards at least one particular sheep.

    --
    signature is pants
  19. Well that's Australia out by Swampash · · Score: 1

    The latency will be a killer when all that data has to get processed by the Great Firewall.

  20. This is about Slashdot's story quota. by Anonymous Coward · · Score: 0

    Or more accurately that of certain editors to promote their favourite and/or home nations: namely Australia, and to a lesser extent New Zealand.

    Just search to see the hugely disproportionate number of "stories" from-or-about Australia on this site.

  21. Will it fit in NZ? by Anonymous Coward · · Score: 0

    Will the vast array fit in narrow New Zealand?

  22. Fucking Awesome Radio Telescope by Shivetya · · Score: 2, Funny

    I assume that name would not pass?

    --
    * Winners compare their achievements to their goals, losers compare theirs to that of others.
  23. Re:New Zealand Story by Anonymous Coward · · Score: 1, Funny

    We don't shear our sheep down south, we keep them for ourselves!

  24. South Africa by Anonymous Coward · · Score: 1

    It's South Africa. Not Southern Africa. South Africa.

    Which is the name of a country by the way, not a region.

    1. Re:South Africa by TheDayOfMe · · Score: 1
      Yeah, but they are talking about the region.

      "With the central core of the SKA located in this south-western part of the country the remote antenna stations would be located on easterly and northerly log spirals up to 3000 km away (Namibia, Botswana, Mozambique, Madagascar Mauritius, Kenya and Ghana)." skatelescope.org

      --

      One Man's Trash Is Another Man's Treasure.

  25. South Africa still has the advantage by Siener · · Score: 2, Interesting

    I've been following the bid process for SKA for quite a few years. As far as I can tell South Africa (together with its other Southern African partners) have a clear advantage over Australia (now together with NZ)

    There are a few reasons for this:

    1. The passing of the South Africa's Astronomy Geographic Advantage Act in 2007 declares almost the whole of the Northern Cape province (an area about 1.5 times that of the UK) into an astronomy advantage area. Amongst other things it means that light pollution will be limited and that the whole area will eventually be turned into a radio quiet zone.

    2. Much of the technology used in South Africa's pilot program (MeerKAT) will be directly useable in SKA. By comparison, the Australian Square Kilometre Array Pathfinder project has much less tech that will be useable in SKA without major redesign and modification.

    3. Price. From the start keeping the price down was a very high priority goal for the SA bid. E.g. they developed a new process to manufacture the dishes that is much cheaper than conventional methods. Now, after the credit crunch where many scientific budgets are getting cut, this strategy is paying off.

    Disclaimer 1: I am a South African and therefore far from neutral
    Disclaimer 2: The last time I read extensively on this is more than six months ago, so if there were significant developments recently then I might not be aware of them

    1. Re:South Africa still has the advantage by buchner.johannes · · Score: 2, Informative

      1. The passing of the South Africa's Astronomy Geographic Advantage Act in 2007 declares almost the whole of the Northern Cape province (an area about 1.5 times that of the UK) into an astronomy advantage area. Amongst other things it means that light pollution will be limited and that the whole area will eventually be turned into a radio quiet zone.

      The Australian desert is an empty, extremely radio quiet right now, and has also been declared as a no-building zone. In comparison, the million cell towers make South Africa is extremely noisy.

      2. Much of the technology used in South Africa's pilot program (MeerKAT) will be directly useable in SKA. By comparison, the Australian Square Kilometre Array Pathfinder project has much less tech that will be useable in SKA without major redesign and modification.

      I'd be interested in hearing more about that. Why is the one more directly reuseable?

      3. Price. From the start keeping the price down was a very high priority goal for the SA bid. E.g. they developed a new process to manufacture the dishes that is much cheaper than conventional methods. Now, after the credit crunch where many scientific budgets are getting cut, this strategy is paying off.

      Disclaimer 1: I am a South African and therefore far from neutral
      Disclaimer 2: The last time I read extensively on this is more than six months ago, so if there were significant developments recently then I might not be aware of them

      Interesting.

      4. Baselines: The NZ-AUS baseline is going to be extremely long.

      There is also a "5. Politics & political stability", which is a bit more complex and probably has some FUD.

      Cheers

      --
      NB: The message above might reflect my opinion right now, but not necessarily tomorrow or next year.
    2. Re:South Africa still has the advantage by RogerWilco · · Score: 1

      The last word definitely hasn't been said about this yet, but I tend to agree that Australia slightly edges out SA at the moment. As for the technology, there are a few more options than only MeerKAT or ASKAP technology. Here at ASTRON we work on EMBRACE and LOFAR.

      --
      RogerWilco the Adventurous Janitor
  26. Locating SKA? by RevWaldo · · Score: 1

    Jamaica was an obvious choice but they have other problems to deal with at the moment.

    England also put in their bid but unfortunately all the images would only come back in 2-tone.

    Of course, they're still considering putting up SKAtelies instead.

    .

  27. Re:It's nice to have a real time link for this wor by John+Hasler · · Score: 2, Insightful

    > What's more important?

    Astronomy. Fuck the squirrels. They'll survive a little construction work.

    > ...redneck construction workers fucking everything up?

    Bigot.

    > You think maybe those laws exist for a reason?

    All laws exist for a reason. It usually isn't a good one. In this case it is because reactionary ecofreaks have better political connections than do astronomers.

    Add some windmills to yout installation and come up with a plausible reason why they need fiber. The permits will slide right through.

    --
    Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  28. Crocodile Dunedin says... by Dogtanian · · Score: 1

    "That's not a telescope array..... *that's* a telescope array."

    --
    "Slashdot - News and Chat Sites Deviant". (Click "homepage" link above for details).
  29. Re:It's nice to have a real time link for this wor by RogerWilco · · Score: 1

    One of the stories I heard, about another VLBI telescope, was that getting to within about 15km was easy, but the last stretch costed about 400,000 euro. These telescopes tend to be in rather inaccessible terrain.

    --
    RogerWilco the Adventurous Janitor
  30. Re:It's nice to have a real time link for this wor by thogard · · Score: 1

    When I was 16, it involved two minimum wage guys who were 16 and a device a bit bigger than a roto-tiller and a spool of cable.