SoylentNews

Arthur T Knackerbracket [soylentnews.org] writes:

--- --- --- --- Entire Story Below - Must Be Edited --- --- --- --- --- --- ---

Arthur T Knackerbracket has processed the following story [newscientist.com]:

The latest weather forecasting AI model from Google DeepMind can beat the leading providers more than 97 per cent of the time, and it is quicker and cheaper to run

Google DeepMind claims its latest weather forecasting AI can make predictions faster and more accurately than existing physics-based simulations.

GenCast is the latest in DeepMind’s ongoing research project to use artificial intelligence to improve weather forecasting. The model was trained on four decades of historical data from the European Centre for Medium-Range Weather Forecasts’s (ECMWF) ERA5 archive [ecmwf.int], which includes regular measurements of temperature, wind speed and pressure at various altitudes around the globe.

Data up to 2018 was used to train the model and then data from 2019 was used to test its predictions against known weather. The company found that it beat ECMWF’s industry-standard ENS forecast 97.4 per cent of the time in total, and 99.8 per cent of the time when looking ahead more than 36 hours.

Last year, DeepMind worked with ECMWF to create an AI that beat the “gold-standard” high-resolution HRES 10-day forecast more than 90 per cent of the time [newscientist.com]. Prior to that, it had developed “nowcasting” models that predicted the chance of rain [newscientist.com] in a given 1-square-kilometre area from 5 to 90 minutes ahead using 5 minutes of radar data. And Google is also working on ways of using AI to replace small parts of deterministic models [newscientist.com] to speed up computation while retaining accuracy.

Existing weather forecasts are based on physics simulations run on powerful supercomputers that deterministically model and extrapolate weather patterns as accurately as possible. Forecasters usually run dozens of simulations with slightly different inputs in groups called ensembles to better capture a range of possible outcomes. These increasingly complex and numerous simulations are extremely computationally intensive and require ever more powerful and energy-hungry machines to operate.

The latest science news delivered to your inbox, every day.

AI could offer a less costly solution. For instance, GenCast creates forecasts with an ensemble of 50 possible futures, each taking just 8 minutes on a custom-made and AI-focused Google Cloud TPU v5 chip.

GenCast operates with a resolution of cells around 28 square kilometres at the equator. Since the data used in this research was collected, ECMWF’s ENS has been upgraded to a resolution of just 9 kilometres.

But for now, GenCast does offer a way to run forecasts at lower computation cost, and more quickly. Kieran Hunt [reading.ac.uk] at the University of Reading, UK, says just as a collection of physics-based forecasts can generate better results than a single forecast, he believes ensembles will boost the accuracy of AI forecasts.

Hunt points to the record 40°C (104°F) temperatures [newscientist.com] seen in the UK in 2022 as an example. A week or two earlier, there were lone members of ensembles predicting it, but they were considered anomalous. Then, as we drew nearer to the heatwave, more and more forecasts fell in line, allowing early warning that something unusual was coming.

“It does allow you to hedge a little if there is one member that shows something really extreme; it might happen, but it probably won’t,” says Hunt. “I wouldn’t view it as necessarily a step change.  It’s combining the tools that we’ve been using in weather forecasting for a while with the new AI approach in a way that will certainly work to improve the quality of AI weather forecasts. I’ve no doubt this will do better than the kind of first wave of AI weather forecasts.”

Journal Reference:> Nature DOI: 10.1038/s41586-024-08252-9 [nature.com]

Original Submission