On 17th March 2023 the NSW region was suspended because of a glitch in SCADA data delivery (prompting some discussion on LinkedIn amongst other places) – this afternoon, Saturday 22nd April 2023 a similar event has happened in the Victorian region.
Firstly at 16:00 the AEMO issued Market Notice 107544 informing of the SCADA issues:
——————————————————————-
MARKET NOTICE
——————————————————————-
From : AEMO
To : NEMITWEB1
Creation Date : 22/04/2023 16:00:18
——————————————————————-
Notice ID : 107544
Notice Type ID : GENERAL NOTICE
Notice Type Description : Subjects not covered in specific notices
Issue Date : 22/04/2023
External Reference : AEMO is experiencing a service interruption relating to all Victoria SCADA.
——————————————————————-
Reason :
AEMO ELECTRICITY MARKET NOTICE
SERVICE INTERRUPTION
AEMO is experiencing a service interruption relating to all Victoria SCADA.
AEMO will provide updates as more information becomes available.
Manager NEM Real Time Operations
——————————————————————-
END OF REPORT
——————————————————————-
… this was followed at 16:17 with Market Notice 107545 informing the market of Market Suspension:
——————————————————————-
MARKET NOTICE
——————————————————————-
From : AEMO
To : NEMITWEB1
Creation Date : 22/04/2023 16:17:38
——————————————————————-
Notice ID : 107545
Notice Type ID : MARKET SUSPENSION
Notice Type Description : Market suspended in region(s).
Issue Date : 22/04/2023
External Reference : Declaration of electricity market suspension
——————————————————————-
Reason :
AEMO ELECTRICITY MARKET NOTICE
Declaration of electricity market suspension
AEMO declares the spot market suspended in Victoria with Market Suspension Schedule Pricing (refer NER clause 3.14.5(b)) from Trading Interval 1620 hrs on 22 April 2023 until further notice.
Dispatch prices for the first one or two dispatch intervals of this market suspension will be reviewed manually.
Refer market notice 107544
Manager NEM Real Time Operation
——————————————————————-
END OF REPORT
——————————————————————-
(A) What was happening at the time?
Using Time-Travel and ez2view, this snapshot shows some of what was happening in the Victorian region of the NEM at the 15:55 dispatch interval (i.e. potentially the last one before the SCADA disruption affected supply of ‘InitialMW’ data amongst other things, depending on precisely when the outage started):
Remember that (in Time-Travel), the widgets shown revert to showing ‘FinalMW’ to be better aligned with dispatch price and interconnector target outcomes and so on.
In the ‘Victorian Schematic’ widget, we see eight of ten coal units operating, and production at solar farms strong for late afternoon – but not much wind across the region.
(B) AEMO declares a ‘major incident’
Via email at 18:34 (ref INC0112299) the AEMO has noted:
‘Dear Users,
The AEMO IT Duty Manager has declared a major incident for the Energy Management System service. This incident investigation is still ongoing.
…
It is highly recommended that business support groups use any corrective actions to work around the current service impact.’
(C) Market Suspension continues into Sunday 23rd April 2023
At 02:33 Sunday morning the AEMO published an update via Market Notice 107550:
‘——————————————————————-
MARKET NOTICE
——————————————————————-
From : AEMO
To : NEMITWEB1
Creation Date : 23/04/2023 02:33:09
——————————————————————-
Notice ID : 107550
Notice Type ID : MARKET SUSPENSION
Notice Type Description : Market suspended in region(s).
Issue Date : 23/04/2023
External Reference : Electricity market suspension change of pricing regime
——————————————————————-
Reason :
AEMO ELECTRICITY MARKET NOTICE
Electricity market suspension change of pricing regime
Refer initial AEMO Electricity Market Notice 107545
The Spot Market remains suspended in the following regions with the following pricing regimes from Trading Interval 0435 hrs on 23 April 2023 until further notice:
Victoria from Market Suspension Schedule Pricing to Dispatch Pricing (refer NER clause 3.14.5(d))
The cause of the original issue which affected all Victoria SCADA has not yet been resolved and may still influence market processes, hence, the Spot Market suspension will continue at this stage. However, AEMO has determined it is practicable to dispatch and price the suspended region in accordance with NER clauses 3.8 and 3.9.
Relevant Market Notices issued under this suspension:
107545
Manager NEM Real Time Operation
——————————————————————-
END OF REPORT
——————————————————————-‘
(D) SCADA Resolved Sunday morning, but Suspension to continue
Via another email at 08:08 Sunday 23rd April (ref INC0112299) the AEMO has noted:
‘Dear Users,
NEM SCADA links for Victoria has now been restored
… however the email also says…
The root cause of the original issue which affected all Victoria SCADA is still under investigation and may still influence market processes, hence, the Spot Market suspension for VIC region will continue at this stage. The pricing regime in Victoria changed from Market Suspension Schedule Pricing to Dispatch Pricing from Trading Interval 0435 hrs on 23 April 2023 as per NER clause 3.14.5(d)).’
(E) Resumption of VIC Region Market
At 16:09 Sunday afternoon the AEMO published an update via Market Notice 107556:
‘——————————————————————-
MARKET NOTICE
——————————————————————-
From : AEMO
To : NEMITWEB1
Creation Date : 23/04/2023 16:09:49
——————————————————————-
Notice ID : 107556
Notice Type ID : MARKET SUSPENSION
Notice Type Description : Market suspended in region(s).
Issue Date : 23/04/2023
External Reference : Declaration of electricity market resumption
——————————————————————-
Reason :
AEMO ELECTRICITY MARKET NOTICE
Declaration of electricity market resumption
Refer initial AEMO Electricity Market Notice 107545
AEMO declares that the suspension of the spot market in Victoria will end at 1700 hrs on 23 April 2023.
The TNSP has taken sufficient steps to exclude the original event having influence on market processes and AEMO assesses that the possibility of suspending the spot market within the next 24 hours due to the same cause is minimal. AEMO also determines that it can operate the market in accordance with the provisions of the NER.
Relevant Market Notices issued under this suspension:
107545 and 107550
Manager NEM Real Time Operations
——————————————————————-
END OF REPORT
——————————————————————-‘
With the suspension lasting from 16:20 Saturday 22nd April to 17:00 Sunday 23rd April, that’s slightly longer than 24 hours.
More to come…
Leave a comment