Slashdot Mirror
Weather Data Available in XML
wombatmobile writes "Wired reports the National Oceanic and Atmospheric Administration this week began providing weather data in an open access XML format. Previously, the data was technically available to the public, but in a format that's not easily deciphered. How will the free and easy availability of valuable data like this in XML affect the development of the web? One example is Tom Groves SVG weather. This type of visualization of XML data is about to fall within easy reach with nothing more than a text editor required as an authoring tool. From March 2005 SVG becomes part of the standard Mozilla/FireFox build. As an example of how web standards are supposed to work, what more could you hope to find?" We mentioned the policy change a few days ago.
Do we get the blue sky of death?
All misspellings and grammatical errors in the above post are intentional and part of my artistic expression.
Can't the XML files just be fetched by HTTP ? Why introduce that SOAP layer? I mean, can't I just wget .../BOS.xml or something?
weather or not I'll use it.....
I'm sorry, I'm sorry....it's another bad pun....I seriously need to talk to a psychologist about my BPS (Bad Pun Syndrome or Backup Power Supply, which ever you prefer).
http://www.zipinfo.com/search/zipcode.htm
http://almostsmart.com
Click on a city in your area on this site: http://www.timeanddate.com/worldclock/custom.html? continent=namerica The page for each city lists the coordinates.
Don't miss out the wonderful WeatherFox extension for Firefox... crafteh coded this marvel after a suggestion of mine on Mozillazine Forums. International Forecast in your statusbar. Can't beat that!
Eureka Science News - automatically updated
Finally, a *AA action we can be happy about!
Who doesn't like free music?
Yeah, you are right... that's the only information I need to chunk out a quick program running off the feed.
Speaking of the feed...here's the URL that contains the actual XML information:
http://www.nws.noaa.gov/forecasts/xml/
I guess they didn't post it on the front page to decrease the slash effect.
Engineering is the art of compromise.
old people in Korea will make use of it is the only real question here.
In Korea only old people know thier latitude and longitude.
It'll be easier to parse, but it won't be any more accurate.
EricThis leads to two perverse situations:
Follow these directions: http://plugindoc.mozdev.org/windows1.html
So far all it's managed to do is make Firefox use 100% CPU, and not much else. Let me know if you have better luck.
IE just crashes.
I want to see independent organizations datamining the NOAA weather data, running their own models, and making competing predictions. Then I want to see metaminers generating comparative "batting averages", keyed to current conditions, and get my weather forecasts from a client which knows which service is better at predicting the next few days/weeks/months starting with current conditions. That will give weather stenographers like the Weather Channel, and their TV news echo chamber, a real run for their money. Forecast@Home, anyone?
--
make install -not war
Not that I have anything to do with a geolocation project, you understand [grin]
:-) to see patterns of hot and cold move around the country over time...
I did a pilot test for the Weather Xchange folks a couple of years back, and was monitoring the temperatures around the UK and making mpeg movies of location-averaged temperature snapshots - a bit like time-lapse photography. I've just moved to the US and the computer with the movies is on a ship somewhere, but it did look pretty cool (no pun intended
Simon.
Physicists get Hadrons!
http://weather.gov/data/current_obs/seek.php
The URL points to the RSS versions of the XML feeds. These have actually been available for quite some time.
bash: rtfm: command not found
This makes me think, there must be piles of academic and government-funded data out there free for the taking. Sure would be nice if there was some central listing of sources of free data. Anyone ever come across anything like that?
You need to recompile Firefox yourself or download the older 0.8 release from Mozilla.org which has SVG enabled.
/progra~1/common files/adobe/adobe viewer 6/plugins/np* to the plugins dir from firefox (ofcourse only on windows).
http://mozilla.org/projects/svg/
another solution is to install svgview from adobe, like the 6.0 beta 1 and coppy the plugin files found in
if you want to use the mozilla implementation of SVG, recompile is the only solution for now. is there someone out there who would be willing to create this so-called 'patch'?
F/OSS & IT Consultant
http://www.weather.com/services/xmloap.html?
sorry about the atrocious formating - slashcode made me take out whitespace (what is the fricking point of an ecode tag supported if you can't post a small snippet like this without removing all the whitespace!?)
There is much cruelty in the universe, John.
Yeah, we seem to have the tour map.
You can also get XML feeds from specific weather stations at http://www.nws.noaa.gov/data/current_obs/ (Not lat and long required; just the station name) Now to wait until the Canadian government does the same thing...
Previously, the data was technically available to the public, but in a format that's not easily deciphered.
... neat. :)
Presuming that this is a METAR replacement, then the format that was "not easily deciphered" is not really that bad at all. For the stuff that anyone reading Slashdot from under FL180 cares about, it's downright human-readable.
Of course, if my presumption is wrong (the article didn't appear clear at first glance) and this is for predictions of future weather rather than reports of current weather, then
I don't want my damn weather information in XML format. I want it in Microsoft Word format. That is an open format with lots of documentation, and it will never go out of style. XML is complicated, proprietary, and secret, and if you put your data into this format, chances are that you will be locked in to a particular vendor, and if your vendor goes out of business, you will have essentially lost all of your valuable data.
I think it depends on your definition of accuracy. For me at least, I don't usually bother with the specific predictions for anything more than this afternoon, and then usually only having checked what that forecast is based on. I think specific predictions are only provided to satisfy the people who demand definite and specific information without detail and regardless of accuracy, anyway. If you don't judge weather reports by the exact timing of events, and instead utilise the information they can provide about what's actually going on in the weather system, you might find them to be much more trustworthy and useful.
I think the most useful part of weather reports is the contextual information provided with satellite pictures and diagrams about where all of the fronts, high and low pressure zones, and so on, happen to be. It's not always possible to predict when a particular front will roll over causing a thunderstorm, but it's often possible to predict that it'll happen at about the time a high pressure zone has moved out of the way to let it through, which might be quite likely to happen "within a day", for instance.
Changeability of weather varies in different parts of the world, and perhaps we get a lot more of this information here than is handed out in other parts of the world. (New Zealand is apparently one of the more volatile areas in terms of changing weather.) Unfortunately the only overseas weather reports I'm familiar with are global reports on international TV channels like CNN, and they give virtually no contextual information besides current weather and temperature.
Are local reports in other places much more detailed about the actual weather system, or do they just dish out specifics without context day after day?
I don't get it. I've been using this service for MONTHS now.
Mine: http://www.nws.noaa.gov/data/current_obs/KBWG.rss
This info has been available since earlie this year. I have been running programs taking advantage of both the NDFD's 7 day forecast available via soap and NWS's current obs available by regular xml over http. NOAA really does alot of neat things and works hard to make them publically usable. Glad this came up.
Nothing of importance to add, just that NOAA is working to make this stuff work for everyone (hence see the wed story about noaa going vendor non-specific).
Quoth the Wired article:
Weather-industry companies were promoting the idea that the government restrict special interests that have the ability to pay for the data -- like Major League Baseball teams or citrus growers -- from acquiring it for free, [Barry Myers, Exec VP of AccuWeather] said.
But isn't fair and equal access to information something the government *should be* supporting? Who cares if MLB or the citrus industry get weather info for free? If, as a side effect of providing weather info to the general public, MLB is able to improve their entertainment value and US citrus farmers are able to improve their crop, isn't that a bonus? It's virtually impossible to subsidize industry in this WTO day and age, so indirect (and free!) benefits like this are a good thing.
This is exactly what NOAA did with their weather data. It is a common misconception that the Semantic Web is supposed to be some gigantic cross-reference, or that AI weenies think it will solve all of our problems. Imagine a web where everyone publishes data in a common format, and everything can be re-used. Want to drop weather data into your app? Just add a few lines of code. Now that's powerful.
For the last 25 months, TWC has produced its own forecasts by doing pretty much what the parent suggests: using its own computers to compare the current forecasts of the 'first principal' weather simulations produced by government supercomputers. The GFC then weights the forecast of each model by its historical accuracy for the weather situation it is modeling at each location, and produces a 'meta-forecast' for that loc.
Dicast was produced largely through US Government funding, but TWC has also spent very large sums of its own money to finish it up. I beleive TWC is the only private company to help fund Dicast development.
TWC first implemented Dicast for on-air / web forecasts when you saw the new "Global Forecast Center" background on their studio TV set. That moniker was not some puffed-up marketing. The GFC (using Dicast) is a very big deal, and nobody else supplies forecasts from it. The shift from NWS forecasts to GFC forecasts took years to implement, and impacted dozens of TWC internal systems. Here is the offical realese from 11/11/2002:
GFC Now Generating 36-hr. Text Forecasts
Early last week, we successfully executed a switch from a National Weather Service (NWS) generated 36-Hour Forecast to one prepared by the Global Forecast Center (GFC) on all legacy Star platforms of the core network. With the replacement of the NWS text forecast on the WEATHER STAR® III, 4000, and Jr., the entire suite of local weather forecast products is now prepared by the meteorological staff here at The Weather Channel. The official NWS watches, warnings, and advisories of all types will continue to display on all WEATHER STAR® units.
One additional change that has been implemented since that announcement is the deployment of the new IntelliStar® real-time television rendering systems in more than 1,000 locations around the USA. The IntelliStar uses heuristics to adapt the Local Forecast at each individual location to the actual weather situation. For example, the Radar loop is abbreviated if there is no rain to show. (TWC uses a variety of WeatherStar devices at almost 10,000 locations to produce the Local. No other television network does anything even remotely comparable. Developing, deploying, and maintaining 10,000 TV rendering systems scattered around the US ain't cheap!!)
TWC has roughly one hundred staff meteorologists that manually review and adjust the Dicast output, particularly when the 'first principal' models are prone to miss some physical discontinuity. (for example, most models can't simulate hurricanes at all)
The NWS has far more meteorogical staff in its field offices, and they continue to provide an invaluable service for the nation. Computers and private companies can't replace the expertise of the NWS Field Office meteorologists and their $820M budget(FY2004).
My point is that it is unfair and inaccurate to lump TWC in with 'the weather stenographers'. TWC really does spend a lot of effort and money to produce a value-added weather product. The folks here are more serious about accurate weather prediction than most outsiders would believe.
(This post is my personal understanding and view, not an official TWC release.)