There’s a difference between the real-ish-time weather data continuously fed in to output predictions, and the decades of weather data used to build the model. The continuous feed of data is more than likely part of what Google alleges is saving significant energy.
Its the training on decades of information, and occasional updates to those trained models that take a significant amount of resources, but hopefully for relatively short bursts.
It would be amazing if it could have a significant impact on spatial and temporal accuracy of things like rain. I feel like for me the existing weather report is good enough for “it will probably rain tomorrow” but it’s really hit-or-miss when you get to hourly resolution. A good model may be able to go so far as to say “it will probably rain between 3-4pm on the east side of town tomorrow, and 2-3pm on the west side”
That’s the dream at least. With enough data and a sophisticated enough model it feels like it could be possible.