Slashdot Mirror


A British Supercomputer Can Predict Winter Weather a Year In Advance (thestack.com)

The national weather service of the U.K. claims it can now predict the weather up to a year in advance. An anonymous reader quotes The Stack: The development has been made possible thanks to supercomputer technology granted by the UK Government in 2014. The £97 million high-performance computing facility has allowed researchers to increase the resolution of climate models and to test the retrospective skill of forecasts over a 35-year period starting from 1980... The forecasters claim that new supercomputer-powered techniques have helped them develop a system to accurately predict North Atlantic Oscillation -- the climatic phenomenon which heavily impacts winters in the U.K.
The researchers apparently tested their supercomputer on 36 years worth of data, and reported proudly that they could predict winter weather a year in advance -- with 62% accuracy.

107 of 177 comments (clear)

  1. No it can't by Mr+D+from+63 · · Score: 4, Insightful

    I call BS on the headline. Let the damn thing prove it can do it before we claim it can. And doing regression model tweaking doesn't prove anything.

    1. Re:No it can't by AmiMoJo · · Score: 2

      They have made similar claims in the past. Back in the 90s I seem to recall that their fancy new computer would make predictions super accurate. In practice the Met Office seems to be one of the worst, far inferior to AccuWeather and the like.

      In fact, the BBC recently ditched them, although I think it was mostly due to the cost rather than them being inaccurate.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    2. Re:No it can't by michelcolman · · Score: 5, Funny

      Hey, but 62% accuracy... that's 12% better than me!

    3. Re:No it can't by Mr+D+from+63 · · Score: 3, Insightful

      I wonder if they did better than the Farmers Almanac?

    4. Re:No it can't by OneHundredAndTen · · Score: 2

      Indeed. They have been able to postdict with 62% accuracy - a very different thing. And hardly earth-shattering. I agree, it is mostly BS.

    5. Re:No it can't by Rei · · Score: 1

      Should be well worth it in terms of things like planning for agricultural products, natural gas supplies, etc.

      The real issue however is that they've validated it with hindcasting. Which is certainly something, but isn't as ideal as you'd want. It's trivially easy to fit any arbitrary past dataset to a statistical model if you have enough parameters that can be tweaked, but that doesn't mean that you're actually capturing the underlying dynamics. That said, from the sound of it it's built around a physical model, so that increases the odds that it actually is, rather than just fitting to some arbitrary curve.

      --
      "99 dead duelists of Dios on the wall. 99 dead duelists of Dios! Take one's ring, pass it around..."
    6. Re:No it can't by Anonymous Coward · · Score: 5, Funny

      I call BS on the headline. Let the damn thing prove it can do it before we claim it can. And doing regression model tweaking doesn't prove anything.

      Why? Predicting the winter weather in Britain is pretty simple. This little program will get it right about 90% of the time:

      #include <stdio.h>
      #include <string.h>
      #include <time.h>
      #include <unistd.h>

      int main()
      {
      char date[32];
      time_t rawtime;

      time (&rawtime);
      struct tm *timeinfo = localtime (&rawtime);
      strftime(date, sizeof(date)-1, "%d.%m.%y_%H:%M:%S", timeinfo);

      printf("[%s] Weather prediction: Precipitation\n", date);
      sleep(86400);
      }

    7. Re:No it can't by TechyImmigrant · · Score: 1

      >The real issue however is that they've validated it with hindcasting.

      I suppose you do it right and compare against the future.
      Could you send me the S&P max and min valuation for 2017, 2018 and 2019 please?

      --
      I should use this sig to advertise my book ISBN-13 : 978-1501515132.
    8. Re: No it can't by Anonymous Coward · · Score: 2, Interesting

      It's NOT a statistical model, at least not in the sense you're likely thinking. Although the actual scientific article is ridiculously paywalled, it's definitely a dynamical model that numerically integrates partial differential equations (like the Navier-Stokes equations) forward to produce a solution. They are using an ensemble of the dynamical model solutions to create their forecast. Similar models already exist, such as NOAA's CFS, which are ensembles that make predictions several months in advance. No, you can't predict the weather on a given day months in advance (the limit is believed to be around 21 days) because the atmosphere is a chaotic system and small errors grow too large to make predictions useful. However, certain large scale phenomena such as El Nino have exhibited some predictability well beyond that time frame. Although there is no skill in predicting weather on a single day, statistical quantities like the mean have greater predictability. Using an ensemble, with each member initialized from different initial conditions, means that the predictability can be quantified in spite of the errors in the initial state. If you started the ensemble with 60 members using initial conditions from 60 days and integrated it forward a year, you'd expect to find even chances of the negatice phase and the positive phase of the NAO if there is no predictability. If a significant majority of the solutions show one phase instead of the other, it suggests that there is some predictability of the feature (in this case, the NAO) despite the uncertainty and errors from the initial conditions. The full ensemble is a stochastic model, but that's not statistical in the sense you were probably suggesting.

    9. Re:No it can't by rubycodez · · Score: 2

      I can do it with 100% accuracy, for the american midwest. My winter forecast calls for snow and cold, with periods of total darkness between sunset and sunrise. Crystallized hydrous precipitation will at times accumulate and form drifts, and will under certain conditions be made into snowballs and snowmen.

    10. Re:No it can't by drewsup · · Score: 1

      Why? Predicting the winter weather in Britain is pretty simple

      Uhhmm, wrong, predicting British weather is a PITA,( some might say a ROYAL PITA), the meandering jet stream and retrograde systems that come off the continent are a bitch to figure, Its not at all like the USA where you can watch storms march across 3000 miles and rightly predict rain on Tuesday.

    11. Re:No it can't by binarylarry · · Score: 2

      62% of the time... it works EVERY time.

      --
      Mod me down, my New Earth Global Warmingist friends!
    12. Re:No it can't by AchilleTalon · · Score: 2

      Yep, 62% is not impressive neither per see. How does this forecasting system is better than the Old Farmer's Almanac ? It is unclear to me.

      --
      Achille Talon
      Hop!
    13. Re:No it can't by vtcodger · · Score: 2

      As William Shakespeare might have said "Computers can predict weather a year ahead. So can I. So can any other man. But will the weather come when I summon it?" See Henry IV Part 1: Act 3, Scene 1, Page 3 nfs.sparknotes.com/henry4pt1/page_133.html for details.

      --
      You can't see ANYTHING from a car, You've got to get out of the goddamned contraption and walk...Edward Abbey
    14. Re: No it can't by vtcodger · · Score: 1

      "If a significant majority of the solutions show one phase instead of the other, it suggests that there is some predictability of the feature (in this case, the NAO) despite the uncertainty and errors from the initial conditions."

      There is, however, some chance that the models share some common incorrect assumption. They don't agree because they are correct, but because they are similar to each other. The Literary Digest effect -- sort of.

      Or they may simply agree by chance.

      --
      You can't see ANYTHING from a car, You've got to get out of the goddamned contraption and walk...Edward Abbey
    15. Re:No it can't by vtcodger · · Score: 1

      If nothing else, a good demonstration of the popularity of Python when C is overkill

      #!/bin/env python
      print "Weather prediction: Precipitation"

      Or bash
      echo "Weather prediction: Precipitation"

      --
      You can't see ANYTHING from a car, You've got to get out of the goddamned contraption and walk...Edward Abbey
    16. Re:No it can't by mrbester · · Score: 1

      Yes you can. It *will* rain on Tuesday in UK. You just didn't specifically ask how much and where...

      --
      "Wait. Something's happening. It's opening up! My God, it's full of apricots!"
    17. Re:No it can't by pr0fessor · · Score: 1

      That plus a constant wind chill in the plains... I live in Kansas.

    18. Re:No it can't by hambone142 · · Score: 1

      It is definitely BS.

      NOAA can't even predict weather one day in advance in many cases.

      I've seen them issue heavy storm alerts when it doesn't even rain

    19. Re:No it can't by rubycodez · · Score: 1

      Oh I have much more specific forecast for Kansas. This winter's forecast also calls for flat, flatter than a pancake

    20. Re: No it can't by Pseudonym · · Score: 1

      No, you can't predict the weather on a given day months in advance (the limit is believed to be around 21 days) because the atmosphere is a chaotic system and small errors grow too large to make predictions useful.

      Less than that if there's a volcanic or solar event.

      --
      sub f{($f)=@_;print"$f(q{$f});";}f(q{sub f{($f)=@_;print"$f(q{$f});";}f});
    21. Re:No it can't by Computershack · · Score: 1

      The Met Office are extremely good at 1/2/3 day forecasts. It was the Met Office that correctly predicted the path of Katrina, not any of the US weather agencies.

      --
      I only please one person per day. Today is not your day. Tomorrow isn't looking good either. - Scott Adams
    22. Re:No it can't by TheRaven64 · · Score: 1

      You get better than 62% accuracy a year in advance by predicting that the weather will be exactly the same as a year ago.

      --
      I am TheRaven on Soylent News
    23. Re:No it can't by Jon+Peterson · · Score: 1

      If I could be right about a coin toss 62% of the time, I could get very rich, very easily.

      Since the weather has a huge impact on the economy (not least because heating/cooling costs) if this model is as accurate as claimed, that's pretty useful.

      --
      ----- .sig: file not found
    24. Re:No it can't by smallfries · · Score: 2

      I don't see any stylish manipulation of timestamps into a correct imperial format in your code.

      --
      Slashdot: where don knuth is an idiot because he cant grasp the awesome power of php
    25. Re:No it can't by Anonymous Coward · · Score: 1

      Pfft! It's the UK. You can get 70% accuracy by predicting rain every day.

    26. Re:No it can't by michelcolman · · Score: 1

      Wow, you're good!

    27. Re:No it can't by Big+Hairy+Ian · · Score: 1

      It's going to be cold and wet and there will definitely be some snow WTF else do you need to know a year in advance

      --

      Build a Man a Fire, and He'll Be Warm for a Day. Set a Man on Fire, and He'll Be Warm for the Rest of His Life.

    28. Re:No it can't by JasterBobaMereel · · Score: 1

      They can predict climate that far ahead

      They can only predict weather up to 7 days ahead ....

      The title is bogus, the artical is correct ...

      --
      Puteulanus fenestra mortis
    29. Re:No it can't by pr0fessor · · Score: 1

      I always find the Hollywood portrayal of Kansas funny because I live in the flint hills on the east side of the state which are not flat and also where the majority of the states population lives. It's only the western two thirds of the state that is actually flat with fields as far as you can see and no people or towns.

    30. Re:No it can't by michael_wojcik · · Score: 1

      It's either 12 percentage points better than you, or 24% better than you.

      Because pedantry makes jokes funnier.

    31. Re:No it can't by michael_wojcik · · Score: 1

      And not all of western Kansas is particularly flat, for that matter. Much of the high plains is rolling. Try driving down, say, US 40 after it splits off from I-70 - it's much less flat than those final miles of I-70 on the western end of Kansas. Nebraska's probably flatter overall than Kansas is, since in the former the rolling plains end further east.

      On the other hand, continue west on I-70 into Colorado, and you have maybe a hundred miles of flat flat flat. (Less so to the south - it's pretty hilly around Rocky Ford and La Junta, for example.) But all that figures in the popular imagination is mountains.

      But then it's hardly news that US mass culture hasn't been hugely interested in accurate portrayals of most of the country.

    32. Re:No it can't by pr0fessor · · Score: 1

      On i70 it's really flat from Hayes all the way past the Colorado boarder and then you find yourself asking where are the mountains... That stretch always makes me extra sleepy and if I don't have the cruise control set I'll be doing 90-100mph with out realizing it.

      After 40 splits off from i70 it's only about 70-80 miles to the border but yeah there are more things than the flint hills and rolling hills that people don't expect like a 33,000 acres of lake and damn on the republican river.

    33. Re:No it can't by lsatenstein · · Score: 1

      I call BS on the headline. Let the damn thing prove it can do it before we claim it can. And doing regression model tweaking doesn't prove anything.

      The farmer's almanac does as as good a job of prediction as will any mega or super computer.

      --
      Leslie Satenstein Montreal Quebec Canada
    34. Re:No it can't by Chalnoth · · Score: 1

      If you look into it in a bit more detail, the actual claims made are much less ridiculous than the headline makes them sound.

      They're basically claiming to be able to predict (with lots of uncertainty) whether or not next year's winter will be particularly severe. This is useful, but not nearly as precise as the headline makes it seem.

  2. fallacy by rubycodez · · Score: 1

    using historical data, that's just as silly as "cooking the books". There is one and only one way to test the validity of such a system, and that will take over a year....

    1. Re:fallacy by Calydor · · Score: 5, Interesting

      No, what they mean is they test it by feeding it the data from 1995, then comparing its predictions to what the weather was actually like in 1996. They are doing exactly what you say is the only way to test the validity of the data - they just started collecting data long ago.

      THAT SAID, 62% correct doesn't seem all that awesome unless they use very tight margins. Does the computer say it'll be -10C and then count it as a fail if it's actually -11C? -15C? Does it say 'Good enough' if it says "Rain and 5C" and instead we get "Snow and -2C"?

      --
      -=This sig has nothing to do with my comment. Move along now=-
    2. Re:fallacy by colinrichardday · · Score: 1

      Did they access to the 1996 data when they developed the model?

    3. Re:fallacy by Orgasmatron · · Score: 1

      If the model only uses constants found in this list, the data from the past is already cooked into the algorithms it uses. It really needs to do better than 62% verifying (not predicting) itself using the past.

      Or, possibly, past data was funny in some way and the model is superior, in which case call me in 2 years to tell me that it is off to a good start.

      --
      See that "Preview" button?
    4. Re:fallacy by WhiplashII · · Score: 3, Insightful

      The problem with that approach is that you will tweak the algorithm until it works in 1996.

      In other words, you will incorporate 1996 into the test set.

      This is the big problem with almost all climate studies, and the reason why people that understand statistics really hate the current climate "science" as it is done. You really do need to make a prediction, and then test the prediction. If you get it wrong, you cannot re-try against the same data set until it works.

      --
      while (sig==sig) sig=!sig;
    5. Re:fallacy by rubycodez · · Score: 3, Insightful

      There are an infinite number of functions that can go through the data points of the past. I could make you 1,000 perfect stock predictors for past data.

      Ask yourself, how did they refine and improve this model over time? It's nothing but a pile of cooked books

    6. Re:fallacy by Calydor · · Score: 1

      But if they manage to tweak the model so it fits the data set of 1980, 1981, 1982 etc. all the way up to now, isn't that essentially the same as starting today and predicting 2017, then tweaking the model a bit and using that to predict 2018, then tweaking it a bit because you missed something and so on?

      --
      -=This sig has nothing to do with my comment. Move along now=-
    7. Re:fallacy by Rei · · Score: 1

      Gee, if only there were statisticians involved in climate research. Too bad nobody ever thought of that one.

      --
      "99 dead duelists of Dios on the wall. 99 dead duelists of Dios! Take one's ring, pass it around..."
    8. Re:fallacy by Anonymous Coward · · Score: 1

      So in short they are feeding it the Farmers Almanac.

    9. Re:fallacy by ClickOnThis · · Score: 2

      Did they access to the 1996 data when they developed the model?

      Well of course they did. How else could they test the 1996 predictions the model made from the 1995 (and earlier) data?

      You build models by using prior data to adjust the model's parameters to "predict" new data, until the accuracy of the prediction is optimal.

      You seem to imply that they cheated somehow. Generally, scientists are honest, with the exception of a small minority who are discovered by their peers and vilified.

      --
      If it weren't for deadlines, nothing would be late.
    10. Re:fallacy by phantomfive · · Score: 4, Insightful

      No, not at all, because doing what you described is incorporating brand new data every year.

      They kept adjusting the algorithm over and over until they got the right answer from 1980 onwards. The huge risk with that method is overfitting, and if you develop an algorithm this way, it's important to also show that you've managed to avoid overfitting.

      You can do the same thing with stock market data: adjust it until you get nearly 90% correct returns on a test interval, then you will find that the next year, the model is completely wrong because of overfit. Even if you incorporate the next years data, you will still get incorrect results because the nature of the stock market is chaotic and also random.

      --
      "First they came for the slanderers and i said nothing."
    11. Re:fallacy by stabiesoft · · Score: 1

      I need to introduce you to my broker. He always tells me to get into the stocks and indexes that just did well. Of course he also always says past performance is no guarantee of future results. All these models (climate, stock, economic etc) are great until they don't work.

    12. Re:fallacy by Bongo · · Score: 2

      Because the human mind is incapable of bias and groups of minds are incapable of systematic bias?! There's a reason we say a real test of a prediction requires waiting for the real future. And this should be obvious to everyone. And before anyone tells "troll", smart intelligent honest people are as subject to bias as anyone, except because they know they are smart and honest, they are also subject to what's called "expert bias". It's just one more thing to be aware of as we pursue greater knowledge and insight. And it is unfortunate that many will dismiss experts purely because the experts say something inconvenient to various selfish interests and ignorance, but that's also just one more thing to bear in mind. Gaining knowledge is hard.

    13. Re:fallacy by ChrisMaple · · Score: 1

      You can do the same thing with the stock market, and many people do. It works until it stops working.

      Then a new system is announced, to great fanfare. Lather, rinse, repeat endlessly.

      --
      Contribute to civilization: ari.aynrand.org/donate
    14. Re:fallacy by ShanghaiBill · · Score: 1

      No, what they mean is they test it by feeding it the data from 1995, then comparing its predictions to what the weather was actually like in 1996.

      Sure, and when one algorithm doesn't work, you try another, and another, and another. Then after 19 failures, you find an algorithm that works on the data from 1995 to predict 1996 weather with a 95% confidence level.

      You can do the same thing with jelly beans.

    15. Re:fallacy by Anonymous Coward · · Score: 1

      You can do the same thing with the stock market, and many people do. It works until it stops working.

      Then a new system is announced, to great fanfare. Lather, rinse, repeat endlessly.

      To be fair, the stock market is responsive to predictions - all market movements are based on the actions of humans and of programmed systems, both of which will change if you provide people with a way to predict the outcome (since acting differently to how they would otherwise have done is precisely how they will profit from the predictions) - whereas the weather mostly isn't affected by those sort of factors.

    16. Re:fallacy by vtcodger · · Score: 1

      IIRC, the Farmer's Almanac claims to have a method for making predictions. Could be. AFAIK, their method is proprietary.

      I've long suspected their editorial staff assembles in a Pub a few weeks before the printer's deadline and throws darts while the soberist attendee takes notes. But they could have more rigor. Or maybe throwing darts works.

      --
      You can't see ANYTHING from a car, You've got to get out of the goddamned contraption and walk...Edward Abbey
    17. Re: fallacy by Anonymous Coward · · Score: 5, Insightful

      And more ignorant nonsense gets modded Informative. The anti-science here is getting worse. Posters like you not only drastically overestimate your own knowledge of unfamiliar fields, you then insist to others it must all be a scam.

      Weather and climate models aren't some arbitrary curve-fitting; they're physically based using ridiculously detailed physical simulations of air movements and ocean currents, starting from an observed state and running the simulation forward. Read up a little, and maybe you'll learn how to learn again.

    18. Re: fallacy by Anonymous Coward · · Score: 2, Insightful

      Your claims of overfitting would mean something if they used a purely statistical model, but it's not - it's a physical simulation, constrained by laws of thermodynamics.

      It amazes me that people say how trivial it is to fit statistical models perfectly to any random data (the stock market always gets mentioned here), yet don't think to wonder why they "only" got 62% accuracy. You'd think that this would be a huge red flag that your assumptions are wrong, but instead it's waved away as them all being dumber than a high school stats student - or more commonly a scam, with the researchers clearly hoping that no meddling high school stats students would notice.

    19. Re:fallacy by colinrichardday · · Score: 1

      Using 1996 data to construct a model that conforms to 1996 data is cheating.

    20. Re: fallacy by Captain+Scurvy · · Score: 1

      Weather and climate models aren't some arbitrary curve-fitting; they're physically based using ridiculously detailed physical simulations of air movements and ocean currents, starting from an observed state and running the simulation forward.

      Just because a set of predictions is based on a physical model does not necessarily make it a better set of predictions. Physical models are still hypotheses, in that the basic premises behind the model and even the construction of the model itself have not been demonstrated as an accurate representation of reality. It is not until the model turns out accurate predictions that are significantly better than random that the hypothesis stands a chance of being correct.

      I'm a reservoir engineer for a large oil and gas company, and we actually avoid using physical models/simulations like these to book reserves because of how horribly they perform. Third-party reserves auditors also make this recommendation. And it's not like the oil and gas industry hasn't invested a tremendous amount of money into the best-performing forecasting methodologies available. But they are held to a much stricter standard of performance simply by way of return on investment.

    21. Re:fallacy by david_thornley · · Score: 1

      A test of predictions doesn't necessarily mean waiting. If you use the data available at the nominal time of prediction, and haven't used this particular prediction in your training data, it's perfectly valid.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    22. Re: fallacy by rubycodez · · Score: 1

      You are the ignorant one, thousands of models are made and then they are culled. They most certainly are a type of "arbitrary curve fitting"

  3. bullshit by nitehawk214 · · Score: 2, Interesting

    It is predicting climate, not weather.

    --
    I'm a good cook. I'm a fantastic eater. - Steven Brust
    1. Re:bullshit by K.+S.+Kyosuke · · Score: 1

      Predicting Britain's winter temperature is still not the same as predicting world's average temperature for a decade. The Britain thing is probably still "weathery" enough to be less predictable.

      --
      Ezekiel 23:20
    2. Re:bullshit by Dutch+Gun · · Score: 2

      So the best modeling offered can predict next years climate with 62% accuracy. That says a lot about climate modeling over the next century.

      Keep in mind that while short term predictions can be chaotic, it's sometimes easier to see long-term patterns emerge, and to extrapolate data from those trends, like trending lines through a scatter plot. I agree that anything looking a century out is guesswork at best, but I'm not sure I'd say the same looking a decade out.

      Historically, many climate-related doomsday predictions have been laughably innacurate. It's for this reason that I continue to be somewhat skeptical about current doomsday or long term projections, because so far *no one* has had much success with those sorts of predictions. Even so, as we have better instrumentation and more historical data with which to create models, it's all but inevitable that our climate prediction models become more accurate as well, certainly for shorter to medium length predictions, and maybe someday, even longer term.

      --
      Irony: Agile development has too much intertia to be abandoned now.
    3. Re:bullshit by mrbester · · Score: 1

      UK doesn't have a climate. Even "temperate" isn't accurate, though that is the closest.

      --
      "Wait. Something's happening. It's opening up! My God, it's full of apricots!"
  4. So can I by blogagog · · Score: 5, Insightful

    66% of the days in London contain some form of precipitation. So, I predict rain every day. I'm right 66% of the time. Wow, I'm smarter than a supercomputer!

    1. Re:So can I by beh · · Score: 2

      So, you think that supercomputer will only figure out whether it rains on the day?

      Or do you think it might forecast a little more information about the day as well? (air pressure, wind, temperature, ...)

      I laud the attempt to improve the models behind the forecasts - though, I don't think I'd buy options on winter fuel for 2017/2018 yet, simply because of that computer.

      On the other hand - if you know the average chance of precipitation for a given day in the American midwest - I don't think it would help you predict in which area the next tornado might strike. Or whether the next hurricane makes landfall, where it will make it and at what strength...

      Any advance on increasing the predictions here has the potential to save lives and livelihoods -- even if it might not be enough to save someone's house in the path of the storm.

    2. Re:So can I by Anonymous Coward · · Score: 1

      Now follow that out to its logical conclusion. Your statistical model is easy to conceive and pretty accurate. Using more advanced statistical methods should yield a more accurate estimation. Clearly that's not what they did.

      This is not a statistical model. It works because physics. Get a clue

  5. I'mt still sticking with ... by PPH · · Score: 2

    ... the Farmer's Almanac.

    Or just ask an indian. When asked how he could tell how cold the winters would be, one old chief just said, "I watch how much firewood the white man splits."

    --
    Have gnu, will travel.
    1. Re:I'mt still sticking with ... by Anonymous Coward · · Score: 2, Interesting

      When asked how he could tell how cold the winters would be, one old chief just said, "I watch how much firewood the white man splits."

      That only sounds silly to people who don't consider humans to be animals.

      If the chief would have answered that he looked at how much food beavers stockpiled then no-one would have found it funny.
      White mans gut feeling works just as well as any other animals gut feeling and is a hell of a lot better than flipping a coin.

  6. With 62% accuracy by Anonymous Coward · · Score: 1

    it's not much more than a coin-toss, though.

  7. No historical data by kbg · · Score: 1

    This is only impressive if they didn't use any historical data at all to create the new super computer. If they did use historical data then the answer would be correct by definition. The way to test this is to use historical data make a prediction and then wait a year then compare to the real data only then you have any valid comparison.

    1. Re:No historical data by Psiren · · Score: 1

      This is only impressive if they didn't use any historical data at all to create the new super computer. If they did use historical data then the answer would be correct by definition. The way to test this is to use historical data make a prediction and then wait a year then compare to the real data only then you have any valid comparison.

      That's really dumb. Why would you wait a year, when you have 35 years of data? You test the model on 1980's data, and see how accurate it was by checking with 1981's data, and so on. They can do that 35 times, if they're looking a year ahead. If they're only looking a month ahead, they can do it 12 x 35 times.

    2. Re:No historical data by kbg · · Score: 1

      Yes that is ok if you don't alter or fix the model based on the result of the historical data. But if your modal is based on or altered to fit the historical data, then what you got is just a model that can predict historical data very well. You have no way to know if that model can actually predict the future in any way unless you actually test it.

  8. Yes but can it... by thegarbz · · Score: 1

    Predict the weather next week?

  9. Weather by ledow · · Score: 1

    Little better than random chance, then.

    Pisses me off that the biggest IT investments and supercomputers exist for meteorogical purposes that perform little better than chance.

    Though important, for shipping, air travel, etc. it's not THAT important to get a tiny little percentage over just looking around and thinking it's going to piss down in a moment, or sticking a box in the North that lets you guess how long until the same weather hits the South.

    Just seems one enormous waste of money to me. And who exactly PAYS for their weather forecasts? Are airlines really paying millions of pounds a year to find out if the skies are going to be a bit rough?

    1. Re:Weather by serviscope_minor · · Score: 1, Insightful

      Little better than random chance, then.

      Chance only gives you 50/50 for a coin flip. The weather has many more states, so chance will give you something much worse than 50/50.

      --
      SJW n. One who posts facts.
    2. Re:Weather by guruevi · · Score: 1

      Weather in the UK is pretty simple to predict: foggy or rain

      --
      Custom electronics and digital signage for your business: www.evcircuits.com
  10. Is this computer by any chance by overshoot · · Score: 1

    named 'Glendower?'

    --
    Lacking <sarcasm> tags, /. substitutes moderation as "Troll."
  11. 62% is fail by Joviex · · Score: 1

    62% accuracy is now the new 95%.

    Is this part of the "everyone wins" generation come to life in practical science now? lel

    1. Re:62% is fail by nitehawk214 · · Score: 1

      So, 12% better than a coin flip.

      Great, really, just great.

      --
      I'm a good cook. I'm a fantastic eater. - Steven Brust
    2. Re:62% is fail by religionofpeas · · Score: 3, Insightful

      That's only true if there are two types of weather to choose from.

  12. Re:67% is not that good by Rei · · Score: 1

    It's good for the NAO. When you're pushing the boundaries, anything over 50% is good.

    For long-term climate models, things like the NAO average out across many years. For short-term weather forecasting, you have a week or more before the system diverges enough to cease to be useful. But it's tougher working on those in-between scales.

    --
    "99 dead duelists of Dios on the wall. 99 dead duelists of Dios! Take one's ring, pass it around..."
  13. yes but can it also predict numbers? by nimbius · · Score: 1

    can it or can it not predict, say, numberwang?
    https://www.youtube.com/watch?...

    --
    Good people go to bed earlier.
  14. It's not very difficult by inking · · Score: 2

    to predict British weather.

  15. Really ? by ctrl-alt-canc · · Score: 3, Informative

    Arnold in one of his textbooxs demonstrated that, to make a weather prediction one month in advance, you need to measure pressure, temperature, wind speed and humidity with at least five significative decimals. He used sound mathematical methods based upon a theorem by Poincaré. With all the respect for technical skills and competence of people at Met Office, I trust more what Arnold demonstrated using nothing but paper and pencil. Good math is never overcome by brute force computation.

    1. Re:Really ? by ctrl-alt-canc · · Score: 3, Informative

      When quoting Arnold I have been a little incorrect, since five figures of precision in the measurement of physical variables actually give you a two months forecast. But I studied this about thirty years ago...
      If you want to estimate the error, if n is the number of months of the forecast and eps is the measurement precision, the error is given by:
      10^(2.5n) times epsilon. As you can see the error rapidly increases, although the formula I transcribed from Arnold's textbook is quite rough (toroidal Earth, steady flux and negligible viscosity). Not a bad approximation for estimating trade winds flux, however.
      People at MET probably took care of the propagation of numerical errors in the calculation, by increasing the grid density and maybe setting up a system capable of working with quadruple precision. However the problem again is the needed precision of input data, that increases exponentially with the time forecasted.

    2. Re:Really ? by NickFortune · · Score: 1

      Arnold in one of his textbooxs demonstrated that, to make a weather prediction one month in advance ...

      In his textbooks, does he end each chapter with the words "I'll be back!" by any chance?

      --
      Don't let THEM immanentize the Eschaton!
  16. I can probably do better than 62% accuracy by Streetlight · · Score: 1

    I predict that the temperatures in London, England, will be lower in December, 2018 than the temperature in July, 2018.

    --
    In a time of universal deceit, telling the truth is a revolutionary act. George Orwell
  17. North Atlantic Oscillation by QuietLagoon · · Score: 2

    ... a system to accurately predict North Atlantic Oscillation -- the climatic phenomenon which heavily impacts winters in the U.K. ...

    ... and also impacts winters in the northeast USA.

  18. Re:I live in the Uk and call BS by beh · · Score: 1

    I can somewhat attest to that - having lived in the UK from 2004 to 2009... In 2008 I tried taking some photos from our offices in Canary Wharf. I looked at the whether forecast every day before deciding whether to take camera+lenses+tripod to work that day. ...and for many of those days, the "visibility" forecast of the MET was pretty much the opposite of what happened -- hardly any visibility on days when it said "good" visibility -- and clear views on many days where the forecast was for poor visibility. In the end, I lugged the stuff around most days, waiting for days of good whether with low winds (no access to balcony if winds were more than 10 miles per hour (average)...

  19. So Can I by sudon't · · Score: 1

    A British Supercomputer Can Predict Winter Weather a Year In Advance

    Yeah, so can I: cold, with occasional snow and sleet.

    --
    -- sudon't

    Air-ride Equipped

  20. My 100 year calendar can do it as well by nospam007 · · Score: 1

    It says: The weather will get better or worse or it will stay as it is.

  21. So what? by argStyopa · · Score: 1

    I live in MN.
    I can predict "winter weather" - whatever the hell that means, precisely - to the same degree of accuracy 10 YEARS in advance.

    "In 2026, we will see 'winter weather' in Nov, Dec, Jan, Feb and well into March".

    If at least 2/3 of the years follow the normal weather patterns, I've just beaten their supercomputer.

    --
    -Styopa
  22. predicting weather is one thing by eneville · · Score: 1

    ... but does it run Linux?

    1. Re:predicting weather is one thing by Thong · · Score: 1

      Yes. It's called CLE or "Cray Linux Environment".

  23. CRAP Reporting by Anonymous Coward · · Score: 1

    Wow. The reporting in this is just CRAP. I didn't read the scientific paper but the abstract (summary) and even the anouncement from the MET (both of which u can only find by first browsing to the link in the summary) makes it clear they are talking about CLIMATE not weather. And it's only about 1 major phenomenon that has a heavy influence on UK climate.

    So this isn't about predicting the daily weather but rather general predictions about whether or not there will be general periods of "wet, stormy and warmer" vs "cold and dry". OK that may be helpful from a "general outlook" point of view, and nothing wrong with that.

    It's the reporting on this though that is real CRAP as it makes it sound like the MET is saying they can tell you what the actual daily weather (temp, amount of precip, wind strength and direction etc.) will be.

    Don't blame the MET for this blame the asshole reporter that has no clue about what he/she is writing about or is simply using click-bait reporting techniques to sensationalized the article.

    The Slashdot editors perpetuate this by incorrectly summarizing the "news wothiness" of the article. The news worthiness or "summary" here should have been something like "News article sensationalizes report from the MET on climate predictions. Purposely confuses weather with climate." or some such thing.

    And why even link to the sensationalized article rather than the MET's posted article itself? Just because some idiot Slashdot poster sent the link to the sensationalized reporting? Seriously the MET posted a relevant article summarizing the results of the scientific paper in a manner easily consumable by lay people (eg. you don't need to read the scientific paper in depth to get the gyst of what it says). Summarizing the MET article with a link to it would have been FAR more helpful and correct. It's one thing if the only article "reporting" on the paper appears on some website that did interviews with the scientists and summarized the interviews, it's just "click bait" to link to an article that simply references an actual article posted by the MET and in doing so gets it ENTIRELY wrong. That's not reporting that's sensationalism.

  24. Operating system and hardware? by khz6955 · · Score: 1

    What was the name of the Operating System and what kind of hardware did this supercomputer run on?

  25. Weather != Climate by TapeCutter · · Score: 2

    And you would know, being so obviously well-informed about weather simulations.

    If the person who wrote the summary knew anything about "weather simulations" they would be aware that climate is not weather!!!

    --
    And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
  26. Re:67% is not that good by AthanasiusKircher · · Score: 2

    When you're pushing the boundaries, anything over 50% is good.

    Is it? It depends on the data, the model, the thresholds for "correct forecast," etc. There are lots of places in the world where a "persistence" forecast (i.e., today will be the same as yesterday) will net you a greater than 50% accuracy within a reasonable margin of error. And one should also always consider forecasting models against general predicted climate averages. Again, taking those into account, a forecast system just using climate averages might do pretty well too.

    It really depends on what the percentage "accuracy" means in this case and how it was measured. I'm guessing they wouldn't bother reporting it if it weren't significant, but just how significant is difficult to tell without the details (and it seems the full research paper is behind a paywall).

    Otherwise citing a number like "62% accuracy" is utterly meaningless. If you had a task like, "Guess how tall the next person to walk into the building will be," and I achieved 62% accuracy, that could be remarkable and improbable if the margin of error was 1/8 of an inch. But if I instead was guessing "Taller than 1 foot or shorter than 1 foot," then 62% accuracy might mean I'm mentally retarded.

  27. No, it can't. by Fragnet · · Score: 1

    This is just plain bollocks. Its inaccurate forecasting now goes out to a year, whereas before they'd stop the inaccurate forecast after a few weeks. This is simple institutional bullshit publicity campaign to justify the £250,000,000 a year the British government gives this ridiculous organisation.

  28. Re:62% by Fragnet · · Score: 1

    Basically, it's the same forecast you'd get if you sat down with a bunch of weather records and chose the average weather for any given day based on them. i.e. yes, there's a greater chance it'll rain in April than December. 62% is laughable.

  29. Miyagi on Latin by Hognoxious · · Score: 1

    62% is not impressive neither per see.

    What have bishops got to do with it?

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  30. Re:Predicting the past is easy... by Hognoxious · · Score: 2

    You're talking about overfitting.

    The thing is they aren't doing that regression-and- frigging-the-coefficients thing. It's a physics based, bottom up, method.

    Nice armchair.

    --
    Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  31. I call Bullshit. by bloodhawk · · Score: 1

    So somehow they are miraculously going from not being able to accurately predict a week in advance to being able to do a year? So how did they solve the current problem that makes it so unpredictable of not having sufficient information points from various areas of the world that severely affect weather long term? Is this super computer an amazing guesser or have they deployed 10's of thousands of weather stations around the world to gather that missing data?

  32. 5 years wrong in a row.... by SkunkPussy · · Score: 1

    62% accuracy is only a bit better than a coinflip. you will relatively often see it predict incorrectly 5 years in a row.

    --
    SURELY NOT!!!!!
  33. bollocks by epine · · Score: 1

    Bollocks on their predication rate. Real forecasters report skill. By contrast, actual progress on predicting the North Atlantic Oscillation, perhaps an achievable goal, would be huge.

    Both of these issues are covered in Judith Curry on Climate Change, a podcast from 2013 which, as it happens, I consumed yesterday.

    Concerning the rush to embarrass themselves by reporting their weather prediction rate, it's because of the taxonomic land grab.

    Host: I wonder how you feel about how your particular field has changed as you've grown up in it and been out for 25 years. ... Do you feel that we are making progress in the scientific world on this particular topic? Or are we in trouble?

    Guest: I think we're in big trouble. When I left graduate school, nobody called themselves a climate scientist. They were an atmospheric dynamicist or a geochemist or a physical oceanographer or things like that. And we were all focused on increasing fundamental understanding. And that was the focus. It was the breakthrough in understanding, changing the way people think, was what mattered. And somebody who published too many papers was probably looked at with suspicion--they are doing the quick and easy stuff; they are not really digging in. It was potentially superficial.

    The other thing that was looked down upon, say in the 1980s, was doing something that was too applied, working to deal with regional problems or something like that. That was viewed as soft core; it was what the people did who couldn't really make fundamental contributions to understanding, so they moved on to some of these applied topics, which were useful in some way to regional decision-makers.

    I would say in 2000--it was a gradual transition, but I think circa 2000 there was a switch to people finding it beneficial to self-label them as a climate scientist. There was a lot of money, research dollars in this area; there was a lot of influence to be had, in terms of sitting on panels and boards and committees and being interviewed by journalists and being invited to testify in front of Congress. And so the value and the influence of the scientist sort of switched into that dimension where your measure of influence was not so much how you increased our fundamental understanding of how the oceans worked, but it was really to what boards and committees you sat on, your press, and your influence in policy, being invited to testify in front of Congress, and whatever. So I've seen that switch.

    The problem is, the concern that I have for the health of our field, is that there's still a lot of fundamental things that we don't understand. The climate models aren't good enough. We need to go back to basics, increase our understanding about the non-linear dynamics of all these ocean oscillations and complexity of the system and things like that.

    There are a lot of fundamental things that are getting short shrift, that the sex appeal in our field right now and a lot of funding is to do what I call mock 'climate model taxonomy', where people are analyzing the output of climate models and finding something interesting, alarming, or using them to infer that we won't be able to grow grapes in California in 2100 or something like this. This is the stuff that gets published in Nature and Science and PNAS. People get a press release.

    Note that the word "useful" as I chose to hear it, is entirely confined to the domain of career advancement and the writing of committee-room position papers.

    Two things about Russ.

    One is that he doesn't connect as much as he should. He's (since) done other podcasts which talk about how the regional nature of congressional representation makes politics in America intensely regional. This is

  34. Headline is bullshit by ricky-road-flats · · Score: 2

    The headline is completely wrong. They can predict the NAO with much more accuracy, and as that has such a big effect on the winter weather in the UK, that lets them say (with only 62% accuracy) whether it'll be mild winter or a cold one. That's all. They can NOT, of course, predict the weather anything like that in advance. They didn't claim to, either - lazy new editors and "journalists" have mangled it into the bullshit we read here.

  35. I too am above 50% by Herve5 · · Score: 1

    Michel, if you are disappointed then try my own algorithm : "weather tomorrow will be the same as today" -I guarantee the accuracy is higher than 50%.
    We are running just behind them indeed -maybe they have a similar predictor!

    --
    Herve S.
  36. Predicting winter isn't that hard. by nachtelfjeiu · · Score: 1

    Since the Brexit that's easy. Winter is coming, UK.