Forecasting

Why?

Solar Photovoltaics (PV) is one of the most significant sources of uncertainty in the UK’s power forecasts. To mitigate against the risk of a large cloud sweeping across the country (and hence the grid losing gigawatts of PV generation), the Electricity System Operator (National Grid) keeps lots of natural gas generators operating at less than full capacity, so they have headroom to ramp up quickly (spinning reserve).

The physics of the grid dictate that - at every instant - supply must precisely match demand. So, any loss in PV supply must be immediately replaced. These gas turbines are kept idling because they take several hours to start up from cold, but they can be ramped up very quickly from idle. Spinning reserve costs a lot of money and pumps out a lot of CO2.

If National Grid had better PV forecasts, even for the next few hours, they could reduce the amount of spinning reserve required, and hence reduce emissions (by about 100,000 tonnes per year for the UK [Details]) and reduce costs.

Electricity traders and PV farm owners will be able to use better short-term PV forecasts to optimise trading decisions in intra-day markets.

Further, this unpredictability of PV power inhibits the investment and onboarding of new PV generation farms, as the local and national system operators are concerned about these unexpected weather events destabilising the grid. By providing greater predictability of PV power output, we can make PV power investments lower risk for all stakeholders.

What?

Nowcasting is a bit of an odd term. It means "forecasting for the next few hours". In general, nowcasting doesn't use the hugely complex and computationally-expensive numerical weather models that run on supercomputers and constitute the bread-and-butter for most forecasting agencies. Instead, nowcasting usually uses statistical or machine learning techniques to take recent observations and roll them forwards.

How?

It turns out that most nowcasting research up until now has been done on rainfall (because predicting floods saves lives and property). Relatively little research has been done on nowcasting sunlight.

Our main interest is in trying to build machine learning models to forecast solar PV (which basically boils down to trying to predict the movement and evolution of clouds). We will spend the majority of the next year or two writing code to experiment with new ways to predict sunlight for the next few hours. Inputs to the model may include satellite images of clouds, numerical weather predictions, vertical cloud profiles, and geographical information. We will utilize the team’s experience in Machine Learning as well as contributors from the open source community to accelerate progress.

As quickly as possible, we'd like to get early-stage prototype PV forecasts used displayed in the National Grid control room, to validate our model’s effectiveness and so we can start measuring the impact on emissions and cost. Beyond that we will release a nowcasting product for general market consumption.

We are a successful applicant to the Google.org Impact Challenge on Climate. The Google.org Impact Challenge on Climate commits €10M to fund bold ideas that aim to use technology to accelerate Europe’s progress toward a greener, more resilient future. Selected organisations may receive up to €2M in funding and possible customised post-grant support from the Google for Startups Accelerator to help bring their ideas to life.

ESA Business Applications awarded us an AI Kick-Start co-funding for six months. Kick-Start activities are compact Feasibility Studies to explore new service concepts that use space tech. We asked potential users of forecasting what they need; and how best to serve those needs.