How dispatch works … it’s much more than just a bid stack

The power system is transitioning from traditional large thermal generators located in strong parts of the transmission network to a generation mix largely made up of smaller, dispersed wind and solar generators.  As this transition proceeds, it is becoming increasingly important to understand the impact of constraints on dispatch.

The NEM dispatch engine (NEMDE) runs a ‘Security-Constrained Economic Dispatch’, a complex linear optimisation which seeks to:

  • find the ‘least cost’ way to match supply and demand
  • whilst maintaining a secure and reliable power system.

To achieve this, NEMDE includes thousands of constraints which represent the underlying physical limitations of the system.  For a detailed explanation of how these constraints are represented and why they are important for dispatch:

Understanding how different constraints can impact on dispatch prices, quantities and flows is critical for market participants, investors and regulators to understand. For example, Dylan McConnell recently tweeted about the persistent $50/MWh price difference between the north and south regions of the NEM:

2023-003-30-tweet-DylanMcConnell-NorthsouthDivide

In this article we explain how various constraints can impact upon modelled dispatch quantities, prices and flows across the power system.

We begin by introducing the concept of a merit order which most readers will be familiar with. We then go through a NEMDE ‘re-run’ case study, in which we strip back NEMDE to a model without constraints and progressively add sets of constraints back into an optimisation model to compare dispatch outcomes across the different scenarios.

 

The ‘Merit Order’ model

Dispatch is often explained with reference to a simplified merit order (or bid stack) model. Consider the following merit order example:

Electricity demand in this dispatch interval is 250 MW.

Generator A offers 100 MW of capacity at $50/MWh

Generator B offers 100 MW of capacity at $80/MWh

Generator C offers 100 MW of capacity at $100/MWh

Generator D offers 100 MW of capacity at $150/MWh

This example is shown in Figure 1.

Figure 1: Merit order example

2023-05-11-WattClarity-Endgame-Fig01-MeritOrder

In this simplistic example, the outcomes are as follows:

Generator A is dispatched for its full 100 MW

Generator B is dispatched for its full 100 MW

Generator C is dispatched for 50 MW of its 100 MW bid

Generator D is not dispatched at all.

The the market clearing price is $100/MWh which is received by all dispatched generators.

Editor’s Note: Some readers might appreciate understanding the difference between two approaches for pricing:

1) The marginally-priced dispatch model used in the NEM (and which is the reason why all generators who supply are paid $100/MWh in this example); and

2) An alternative ‘pay as bid’ model that is sometimes suggested as an different approach.

However, suppose in this example there were transmission constraints preventing 60 MW from Generator B from reaching the load centre. In this case, 10 MW of Generator D would be required and the price would be set at $150/MWh.

This simple example shows how constraints can drive differences in dispatch and pool price outcomes. We can scale this up to look at how applying constraints to NEMDE’s optimisation affect outcomes for the entire NEM, starting with a ‘copper plate’ model.

 

Varying levels of precision, in Electricity Market Models

Electricity market models can vary in the level of detail they include to represent the real-world power system.  A ‘copper plate’ model is an electricity market model that simplifies the representation of the transmission system by assuming that the entire network has unlimited transmission capacity and that electricity can be transmitted anywhere in the network without any losses.

1)   A copper plate model can be thought of as a system-wide version of the merit order example above.

2)  The advantage of a copper plate model is that it is computationally less demanding and can therefore be run more quickly. However, the downside is that the results will generally be less reflective of actual dispatch outcomes, particularly when the missing constraints would have been binding.

A model that incorporates constraints, by taking into account transmission network limitations and security constraints, is more complex and takes greater resources to solve but is likely to more accurately reflect actual dispatch outcomes.

It is becoming increasingly important to represent constraints in electricity market models.

The power system is transitioning from traditional large thermal generators located in strong parts of the transmission network to a generation mix largely made up of smaller, dispersed wind and solar generators. The technical characteristics of these resources and the correlated nature of their output means that constraints are increasingly binding in different parts of the network (see the recent article ‘Bye X5, Hi X5’ by Allan O’Neil).

 

NEMDE re-run

To illustrate the impact of incorporating constraints in dispatch we re-ran NEMDE using an in-house model inspired by Nick Gorman’s excellent nempy (you can find out more about the package here).

We re-ran dispatch for the period April 2021 – March 2022 under multiple scenarios with progressively more constraint sets (this is sometimes called ‘back-casting’):

Increasing level of precision Description

Scenario 1.

Copper plate model:

  • with min and max generation constraints
  • and ramp rate constraints
  • but no network constraints

Scenario 2.

Copper plate + interconnector constraints

Scenario 3.

Copper plate + interconnector constraints + generic constraints (e.g. voltage and other stability constraints)

Scenario 4.

Copper plate + interconnector constraints + generic constraints + FCAS

Actual Dispatch.

Actual dispatch outcomes including the full set of constraints invoked by NEMDE

 

Comparing these scenarios allows us to see the impact of introducing various constraints on dispatch outcomes such as dispatch prices, quantities and interregional flows.

Impacts on Price Outcomes

As you introduce more constraints, the least-cost solution for the entire NEM increases. This is because the optimisation must find the least cost solution while satisfying the set of constraints. The resulting dispatch mix is economically suboptimal relative to an unconstrained system with no losses.

1)  However, some constraints more significantly impact the dispatch outcomes than others.

2)  The inclusion of interconnector constraints (Scenario 2) does not make a significant difference to NEM-wide prices across this period.  However, the inclusion of generic constraints (Scenario 3) drives a much larger increase in prices, particularly in June 2021.

However, we can see that while constraints lead to higher prices overall, this is not the case for all regions. In some cases, increasing the number of constraints can lower prices in some regions. The divergence of prices between the two regions is caused by restrictions on the volume of energy a region can import or export by interconnector constraints. When constraints bind, the importing region is forced to dispatch a higher-cost generator and thus prices increase in this region. Conversely, the exporting region’s price is set by a lower-cost generator than otherwise would be if unconstrained, therefore reducing pool prices.

Figure 2 shows that actual dispatch prices are lower than Scenario 3 and 4 in Victoria and Tasmania across April 2021 – March 2022.

Figure 2: Average price by region

2023-05-11-WattClarity-Endgame-Fig02-AveragePrice

Impacts on Inter-Regional Flows

Different constraints also impact upon interconnector flows.

In Figure 3 we see some differences in average flows between Scenario 2 and the other scenarios that include the generic constraints. Actual flows were quite close to Scenario 3 and 4 on average, except for Basslink flows between Victoria and Tasmania which diverged significantly from the other scenarios. Basslink operations are complex and are not well represented by the pared-back modelling scenarios.

Figure 3: Average interconnector flows (excluding Scenario 1)

2023-05-11-WattClarity-Endgame-Fig03-Flows

Impacts on Generation Dispatch

Turning to dispatch quantities by technology type, we generally see that additional constraints have a negative impact on dispatch outcomes for wind and solar which implies a degree of curtailment, largely due to generic constraints which includes intra-regional transmission congestion. This is due to the tendency of these variable renewable energy (VRE) generators to be located in areas with abundant renewable resources, but generally more remote, lower voltage areas of the network.

This is in combination with the correlation between the generation output of these generators which leads to congestion on transmission lines, exacerbating the problem.

Editor’s Note: Coincidentally, Allan’s article on Tuesday – which itself follows Tristan’s article on 2nd May – both speak to the outcomes two significant factors reducing the output of wind and solar plant.   Allan called them:

1)  ‘forced curtailment’ , due to network constraints; and

2)  ‘economic offloading’, due to prices below ‘negative LGC’.

Figure 4 shows monthly wind dispatch for South Australia. We see here that wind dispatch is significantly lower if generic constraints are invoked.

Figure 4: Average dispatch for wind generation in South Australia (MW)

2023-05-11-WattClarity-Endgame-Fig04-SAwind

  We see here that wind dispatch is significantly lower if generic constraints are invoked.

The opposite is the case for hydro where more constraints lead to greater hydro dispatch. Figure 5 shows the average dispatch for hydro in NSW across each scenario.

Figure 5: Average dispatch for hydro in NSW (MW)

2023-05-11-WattClarity-Endgame-Fig05-NSWhydro

In South Australia, applying more constraints generally lead to greater dispatch of gas-fired generation.   Similarly, constraints tend to increase the dispatch of coal generation, particularly in Queensland.

Binding transmission constraints result in the curtailment of lower-cost generation which is replaced by higher-cost generation located in less congested and stronger areas of the network. To meet demand under scenarios where transmission constraints are in effect, higher volumes of coal and gas are dispatched to replace curtailed renewable generation or lower-cost interregional generation.

 

Conclusion

As the power system transitions it is becoming increasingly important to understand and accurately model the impact of constraints on dispatch outcomes.   Investors and developers should be well-informed about how constraints can impact the profitability of a project.   Similarly, regulators and policymakers must carefully consider the implications for matters such as the economic benefits of transmission projects and how to design transmission access regimes.

The stylised bid stack, whilst elegant, masks the complexity of the market.

 


About our Guest Author

RyanEsplin Ryan Esplin is a Principal at Endgame Economics.

Endgame Economics is a firm focused on providing mathematical modelling and economic advice in the energy sector.

Ryan has worked with Endgame from February 2023, and prior to working with Endgame worked with the AEMC and Frontier Economics.  Ryan is an economist working in the energy sector, and this is his first article on WattClarity.  Stay tuned for more.

You can find Ryan on LinkedIn.


 

PS on Friday 12th May 2023: Readers here might appreciate knowing that there is a conversation proceeding on LinkedIn here related to this article.


2 Comments on "How dispatch works … it’s much more than just a bid stack"

  1. Great article along with Allan’s and others but it gets to the same point. There are too many constraints. Better modelling might lead to better price forecasts but the actual outcomes for consumers won’t change until some of the constraints are alleviated.

  2. Good thought David. The upside of good models is the ability to prioritise which constraints should be removed and the economic benefit of such a project. Similarly the benefits of DR can be better identified.

Leave a comment

Your email address will not be published.


*