This comment form is no longer interactive because the comment period is closed.

2018 Periodic Review Standing Review Team - Standards Grading

Description:

Start Date: 05/14/2018
End Date: 06/28/2018

Associated Ballots:

Ballot Name Project Standard Pool Open Pool Close Voting Start Voting End

Filter:

Hot Answers

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Exelon agrees that R.1 could be clarified regarding the required dates for the assessments. We disagree that the applicable entities are mis-identified and that the TO may not have the required expertise to perform the assessment.

RE’s comments for R2 that there is no way to ensure the “quality” of the review is addressed in R2.1.  Also, the discussion regarding the same entity was extensively discussed during the drafting of the standard and the SDT agreed with this provision. See also R6.

R4 Comment by the RE would open the requirement to an endless, everchanging assessment of emerging threats. The requirement as written is comprehensive in that it requires monitoring of unique characteristics, prior history and warnings as provided by qualified organizations.

R5 . Similar to above, these points were raised when the standard was written. There is no extant evidence that entities have failed to develop “adequate deterrence and detection” causing a threat to the reliability of the BES or that entities are failing to implement security plans in a reasonable time period.

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

City Light supports the findings.

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

The matrix used to assess the CIP standards do not ask relevant questions indicative of the intent and purpose of the CIP family of standards. The CIP standards are directed and intended to be around physical and logical security of the electronic devices which manage the data movement and calculations for the overall grid management, performance, and availability.  The questions are not suited to measuring the performance or controls of the standards that provide the criteria to establishing these types of security. We believe the grading tool and the use of it should be reviewed and reconsidered in light of ongoing NERC activities.  Details provided in our response to Q12.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

CIP-014-2 R1: (1) The 60 calendar months requirement for subsequent risk assessments is sufficient, no additional clarity is needed.  (2) The partnership agreement or co-ownership agreement between the two parties at a co-owned facility should determine/govern how the required risk assessment is performed.  (3) The specific assessment methodology should be left to the discretion of the Transmission Owner and should not be prescribed because all systems are not the same. R2 clearly leaves the third party verifier with the responsibility to question the analysis, methodology, and findings of the Transmission Owner and to request changes.

CIP-014-2 R2: The current language in the requirement is very clear that the “Transmission Owner shall have an unaffiliated third party verify the risk assessment.”  If the Transmission Owner used a third party to perform the initial risk assessment, then that third party would not be “unaffiliated” with the Transmission Owner.  In accordance with R2.1 the unaffiliated third party is required to meet predefined qualification criteria.  R2 clearly leaves the third party verifier with the responsibility to question the analysis, methodology, and findings of the Transmission Owner and to request changes.

CIP-014-2 R3: The current language in the requirement is clear and there is no need to combine with a different requirement. 

CIP-014-2 R4: Additional non-binding resource information in a guidance document could be beneficial.

CIP-014-2 R5: The timeline to implement the physical security enhancements and modifications in the physical security plans are Transmission Owner specific and situation specific.  Artificially developing a uniform timeline for the implementation of security plans that are unique to each individual Transmission Owner would be very difficult to implement and could be counterproductive to the objective of greater physical security.

CIP-014-2 R6: The current language in the requirement is clear that the Transmission Owner shall have an unaffiliated third party review.  We agree that adding clarification that if the Transmission Owner used a third party to perform the R4 risk and vulnerability evaluation or the R5 development of the physical security plans, then that same third party entity might not be able to perform an objective unaffiliated third party review of the plans they developed for the Transmission Owner.

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy disagrees with making changes to the standard at this time.

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The SPP Standards Review Group (SSRG) is neutral with regards to grading this standard.  

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

(C1) (Q10) Reclamation asserts the standard is clear that the entity conducting the verification is not the same entity that conducted the risk assessment.

(Q1/Q8) Reclamation does not support a prescriptive methodology for the third-party verification of the risk assessment or for adequate deterrence, detection, and response.  

(Q1) Reclamation supports consolidation opportunities to avoid duplication and overlap with other standards.

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

BPA supports moving these requirements to a PER standard.  This comment does not apply to a specific tool question as the scoring varied so widely.

 

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

R1 –       Q1: In regards to NERC’s comment; we disagree that R2-R7 create protocols and believe that R1 should continue to stand alone.

Q6: In regards to the PC’s comments, R5, R6, and R7 is equivalent to the intent of “Directive” language and thus re-introducing “Directive” risks additional confusion.

 

R2-         Q1: In regards to the OC’s comment, we disagree with combining this requirement with PER-005. In regards to the RE comments; R4 provides guidance for corrective actions (i.e. remedial training) as written.

 

R3-         C2: In regards to NERC’s comment, we do not agree with including TO and GO as “operating personnel”. If clarification is needed, NERC and Industry should renew the effort to define “operating personnel” as part of the NERC Glossary of Terms.

 

R4 -        C2, Q1, Q2, Q5, Q11: we believe the requirement meets the task and purpose as written.

 

R5-         Q1: R5 is specific to issuance of Operating Instructions during an Emergency (analogous to previous “directive” language). Combining with R1 would “dilute” the intent of the requirement.

 

R6-         Q1: R6 is specific to receipt of Operating Instructions during an Emergency (analogous to previous “directive” language). Combining with R1 would “dilute” the intent of the requirement.

 

R7-         Q1: R7 is specific to issuance of single party to multiple-party burst Operating Instructions during an Emergency (analogous to previous “directive” language). Combining with R1 would “dilute” the intent of the requirement.

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Exelon Generation comment: Exelon does not agree with PC C2 comment that the GOP should be included in the scope of R4.  The GOP typically does not own the recorded lines and therefore has no ability to monitor the three-way communication from all parties in a consistent manner unless the discussion is broadcast or additional personnel are on the line to monitor the communication.  Without ownership of the recorded line there is no way to provide effective, consistent feedback as expected in Measure M4.  If a GOP failed to meet the requirements of three-way communications associated with issuance of an Operating Instruction during an emergency, that would fall within the scope of Requirement R6 which is currently applicable to the GOP.

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The Standards Efficiency Review is considering this standard for retirement and the SRT may want to delay determination regarding this standard until that process is completed. 

The SSRG does not support the comment under Q6 that the term “Directives” should be reintroduced in this specific standard. As written, COM-002-4 is intended to be applied to Operating Instructions only; and to add an additional type of instruction for a more critical reliability related instruction may create unintended consequences or ambiguity that may conflict with or diminish the intended purposes.  Additionally, do not agree with the proposal to combine R5 with R1 because the specificity of R5 language pertaining to “Operating Instructions during an Emergency” is appropriate for a stand-alone requirement.

However, the SSRG does agree:

  • Identified ambiguities should be cleaned-up (e.g., NERC comments Q10: 1.1)

  • It’s appropriate to move the R2 training requirement to Reliability Standard PER-005. All training requirements should be comprised in one standard (See OC comment for COM-002-4).

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

1.)    On the grading sheet, some of the questions need to be re-written or separated to provide clarity in the response.  Several of the questions listed actually contain two questions and only have one response.  Example:  Q1. Should the requirement stand alone as is (or should it be consolidated with other standards)?  Only one response was given.

2.)    LCRA feels that initial training is adequate and does not require subsequent training on the communications protocols since the purpose of R4 to assess the adherence and effectiveness of the protocols also addresses providing feedback and taking corrective actions if protocols are not followed. LCRA also agrees with transferring all training related requirements within existing Reliability Standards into one training based Reliability Standard.  

3.)    The purpose of R5 isn’t clear.  R5 basically re-states requirements listed in the communication protocol, but explicitly states during an emergency.  The communications protocol requirements in R1 state they must be used when issuing an Operating Instruction, it doesn’t matter if there is an Emergency or not, the protocols must be followed.  R5 could just simply state the communications protocols established in R1 must be followed and that would include issuing and receiving during normal and Emergency situations.

4.)    Distribution Providers and Generator Operators are not required in R1 to develop communications protocols. If they will not be included in R1, LCRA feels that the requirement for Balancing Authorities and Transmission Operators in R6 can be removed since that would be required under the re-written R5, and just leave the requirement as-is for Distribution Providers and Generator Operators.   

5.)    Please define "burst Operating Instruction" for those in the industry not familiar with the term.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

(C1) (Q6) Reclamation supports reintroduction of the term Directive to further distinguish situations that are a higher level of importance.

(Q1) Reclamation supports consolidating and streamlining the requirements within COM-002-4.

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Regarding the NERC C3 response, “potential to consider vegetation outside the right-of-way”, caution should be given as to this consideration seeing the regulator cannot require entities to maintain where no legal rights exist.  Thus, Southern Company recommends adjusting the scoring higher for FAC-003-4 R1 & R2 where the above subject is in question.

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

R1: Duke Energy disagrees with considering vegetation outside the right-of way. Events that occur outside the right of way are random, not sequential in nature, and do not lead to cascading outages. Also, potential legal rights and siting issues could arise if outside of right of way is considered.

R1: Duke Energy agrees with the RE rep’s comment regarding the need to revisit the issue of IROL(s) in light of the proposed changes to FAC-014 and the fact that the RC function can also declare IROL(s).

R2: Disagree with the assertion that Sustained Outage is unclear. We believe the term is clear and specific to how the system is operated currently.

R4: We disagree with consolidating with R1. R4 is a procedural based requirement as opposed to the other requirements which are performance based. Also, we are unsure that there is a reasonable alternative to the phrase “without any intentional time delay”.

R5: Disagree with the idea of consolidating with other Requirements. This requirement could be moved to guideline, as we believe that the guidance is still valuable to industry.

R6: Duke Energy believes this requirement could be moved to a guideline.

R7: Duke Energy believes this requirement could be moved to a guideline. This is still needed for guidance for industry. This is also used by industry for consistency in non-NERC programs.  

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The SSRG is neutral with regards to grading this standard.  However, the Standards Efficiency Review is considering this standard for retirement and the SRT may want to delay determination regarding this standard until that process is completed.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

(Q1) Reclamation supports consolidating and streamlining the requirements within FAC-003-4.

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

M28 - BPA agrees with the NERC OC's assertion that the intent of FAC-013 is met by TPL-001.

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Grading Standards Form - Question C2: The City Light SME does not believe this standard should be applicable to every Planning Coordinator.  PCs that are not also TSPs do not have any ATC paths to study, which makes it less clear what transfers could be usefully studied.

Grading Standards Form - Questions Q1 & Q13: City Light agrees with the OC’s comments that this standard is mostly redundant with TPL-001-4.  We can’t speak for utilities that are TSPs and have clear transfer paths, but for SCL this standard provides no clear reliability benefit beyond the TPL-001-4 standard.  The ability to define your own methodology (per FAC-013 R1) has the potential benefit of allowing utilities to study something useful, but is more likely to result in doing the bare minimum to meet the standard while providing little if any reliability benefit because the studies are redundant to TPL.

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The SSRG agrees with the Standard Efficiency Review recommendation to retire standard based on the justification that this standard is primarily administrative in nature and does not require specific performance metrics or coordination among functional entities or provide reliability benefits not captured by other standards (See Combined_SER_SAR_final_06072018).

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

Not applicable to LCRA.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

N/A

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

J30 - NERC states the standard could use more specific terminology. The PC agrees, and specifically recommends deletion of “in another interconnection” from R1. BPA agrees with the PC for deletion of "in another interconnection" from R1. The plain reading of current R1 applies only to TLR requests from responsible entities (RC, BA, TOP) in another Interconnection to RCs or BAs in a different interconnection, and only requires curtailments of those "transactions that cross an Interconnection boundary."

This language was a turning point for the IRO-006-WECC X 5 year review team.  The team felt, at best the IRO-006-5 standard applied between RCs because of the focus is on entities “in another interconnection” and “transactions that cross an interconnection boundary.” 

If the suggested language is removed, then the remaining language continues to be focused on only "transactions that cross an interconnection boundary." This still keeps the focus of the standard to be applied between RCs. BPA is not sure that is the result that the PC wanted – that the standard "should apply to all TLRs regardless of interconnection boundaries."

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

The language of requirement R1, IRO-006-5, is properly limited to cross-Interconnection transactions.  This is because other standards – the regional standards, IRO-006-EAST-2, IRO-006-TRE-1 and IRO-006-WECC-2 – apply to transactions within each of those Interconnections.  If the PC’s recommended revision was adopted, the language of requirement R1, IRO-006-5 would overlap and duplicate the regional requirements for following relief procedures within the Interconnections. As a result, NERC should not pursue the PC’s recommended revision.

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The SSRG doesn’t see a need to revise this standard given it specifically applies to interchange events across Interconnection boundaries. The PC response for Q10 is confusing because TLR only exists in the East Interconnection, and where ERCOT and the West Interconnection use different vernacular and processes for interchange events.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

N/A

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The SSRG agrees with the Standard Efficiency Review recommendation to retire standard based on the justification that this standard is duplicative of the data provision requirements included in Reliability Standards MOD-31-2 and IRO-010-2 (See Combined_SER_SAR_final_06072018).

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

N/A

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

BPA believes MOD-025-R3 Should have guidelines to ensure GO's provide more detailed P-Q curves with accurate points showing the formulaic equations used on the OEL and UEL segments of which Pmax is held constant. Furthermore, doing so would allow TPs to derive the steady-state Q versus P relationship for the OEL and UEL portions of the curve based on the equations provided. In so doing, TPs will then have a proper use for the MOD-025 reports which they could then enter into the models.

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

 

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The SSRG is neutral with regards to grading this standard. However, the Standards Efficiency Review is considering this standard for modification or consolidation with another standard under Phase 2 of the Standards Efficiency Review project and the SRT may want to delay determination regarding this standard until that process is completed.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

None

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Comments:  MOD-026 and MOD-027 are formatted similarly, so Exelon agrees that the comment from the RE that the timeframe to submit a verified model is not clear in the Requirement language and that this applies to both MOD-026 and MOD-027. 

 

Related to MOD-027, NERC comments that MOD-027 does not include a “go and fix it requirement” like MOD-026 R5.  However, Exelon argues that MOD-026 R5 is somewhat redundant and conflicts with MOD-026 R3.  Requirement R3 requires the GO to provide a written response to its Transmission Planner within 90 calendar days of receiving one of the listed items, which includes written comments from the TP that the model response did not match the recorded response to a transmission system event.  R5 requires the GO to respond to the TP within 90 calendar days following receipt of a technically justified unit request.  “Technically justified” is defined as the TP demonstrating that the simulated unit or plant response does not match the measured unit or plant response.  We think the standard requirements conflict with each other because R3 allows the GO an option to respond to the TP with a technical basis for maintaining the submitted model.  However, R5 does not allow the GO the option to maintain the original model parameters and requires the GO to either submit a verification plan or revised model parameters within the 90 calendar days. Exelon believes Requirements R3 and R5 for MOD-026 should be consolidated into one requirement. 

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Our City Light SME agrees with the scoring and findings of the SRT. There are some good comments on the unnecessary differences between 026 and 027.

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

MOD-026-1 R3, R4, R5

Southern Company believes Attachment 1 adequately addresses the time frame. Consequently, we do not agree with the RE’s scoring since guidance is provided in the Attachment.  

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

R2: Duke Energy disagrees that there is a gap in the standard by leaving out SVCs and STACOMs, and does not believe these should be in the standard as they are not susceptible to the same level of degradation.

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The Standards Efficiency Review is considering this standard for modification or consolidation with another standard under Phase 2 of the Standards Efficiency Review project and the SRT may want to delay determination regarding this standard until that process is completed.  Additionally, with regards to Q10, it would be helpful to clarify in unambiguous terms that the NERC List of Acceptable Models should be utilized by GOs and TPs when responding to information requests.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

(C3) Reclamation supports the addition of a schedule (instead of a plan) within which to submit a revised and/or verified model to the TP. Reclamation recommends the new language follow the pattern stated in R4 for providing a written response.

Reclamation also supports moving timeframe requirements from Attachment 1 into the requirement language of the standard.

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

BPA believes having GO’s required to perform a model review upon receiving a technically justified request from their TP was never addressed in this requirement. Also, there is a lack of mention of inverter controls, which may lead to the controls not being verified.

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

See MOD-026

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Our City Light SME agrees with the scoring and findings of the SRT. There are some good comments on the unnecessary differences between 026 and 027.

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

MOD-027-1 R3, R4

Southern Company believes Attachment 1 adequately addresses the time frame. Consequently, we do not agree with the RE’s scoring since guidance is provided in the Attachment.  

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The Standards Efficiency Review is considering this standard for modification or consolidation with another standard under Phase 2 of the Standards Efficiency Review project and the SRT may want to delay determination regarding this standard until that process is completed.  Additionally, with regards to Q10, it would be helpful to clarify in unambiguous terms that the NERC List of Acceptable Models should be utilized by GOs and TPs when responding to information requests.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

(C3) Reclamation supports the addition of a schedule (instead of a plan) within which to submit a revised and/or verified model to the TP. Reclamation recommends the new language follow the pattern stated in R4 for providing a written response.

(Q4) Reclamation also supports moving timeframe requirements from Attachment 1 into the requirement language of the standard.

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

BPA agrees with the NERC OC comments on MOD-028-2.

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

See our comments on the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

The SPP Standards Review Group is neutral with regards to grading this standard.  However, the Standards Efficiency Review is considering this standard for retirement and the SRT may want to delay determination regarding this standard until that process is completed.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

No comment.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

N/A

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

IRO-006-5 - BPA agrees with the PC for deletion of "in another interconnection" from R1. The plain reading of current R1 applies only to TLR requests from responsible entities (RC, BA, TOP) in another Interconnection to RCs or BAs in a different interconnection, and only requires curtailments of those "transactions that cross an Interconnection boundary."

If the suggested language is removed, then the remaining language continues to be focused on only "transactions that cross an interconnection boundary." This still keeps the focus of the standard to be applied between RCs. BPA is not sure that is the result that the PC wanted – that the standard "should apply to all TLRs regardless of interconnection boundaries."

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

COM-002-4

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

MOD  26, 27. See above comments.

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

The NSRF recommends that the SRT’s review be based on: 1) risk to reliability [or emerging risk]; 2) risk of not understanding a (new) Standard; and 3) risk of non-compliance to an Applicable Entity.  We make the following recommendations:

1.  CIP-014-2 (1)

2.  MOD-026-1 (1, 2)

3.  MOD-027-1 (1, 2)

4.  MOD-025-2 (1, 2)

5.  FAC-013-2 (1)

6.  COM-002-4, FAC-003-4, IRO-006-5 MOD-020-0 and MOD-028-2 (3)

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

City Light believes the SRT should focus on any standards not part of the Standards Efficiency Review Project and should coordinate with the SER teams on those standards that  they are also reviewing and planning to revise/retire to optimize industry efforts.

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

SRC chose not to respond to this question.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

None.  See our answer to the last question.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company (LG&E/KU) recommend 2018-eligible Reliability Standards FAC-013-2 and MOD-020-0 for a periodic review in 2019.

FAC-013-2

LG&E/KU believes Reliability Standard FAC-013-2 should have the highest priority for a periodic review in 2019 and supports the Standards Efficiency Review (SER) Team’s justification to retire FAC-013-2.  LG&E/KU agrees with the SER Team’s comment that in general FAC-013-2 “fails to meet System reliability objectives”.  In this regard, the SER Team noted, among other things, that:

“The standard does not specify performance metrics or define what acceptable system performance is.

Assessing transfer capability above the ‘known commitments for Firm Transmission Service and Interchange’ required by TPL-001-4 (R1.1.5), serves a market function as opposed to securing System reliability.”

As the SER Team pointed out, most of the standard has already been recommended for retirement - the 2013 NERC Independent Experts Review Project identified R2 and R3 as administrative and recommended them for retirement, and R3 was approved for retirement by FERC in 2014.

LGE/KU additionally recommends FAC-013-2 for reevaluation because the Transmission Planning required for FERC Order 1000 replaces the need for FAC-013 requirements. The performance of the assessment and methodology provides no reliability benefit to the BES. The reporting requirements entailed by the standard – an annual assessment and responses to regular data requests – provides no reliability benefit while creating a high degree of regulatory burden.

MOD-020-0

LG&E/KU also recommends Reliability Standard MOD-020-0 for review in 2019 and supports the Standards Efficiency Review (SER) Team’s justification for retiring MOD-020-0: “This requirement is duplicative of the data provision requirements included in Reliability Standards MOD-031-2 and IRO-010-2.”

As further explained by the SERT Team:

“MOD-020-0 R1 requires the Load-Serving Entity, Transmission Planner, and Resource Planner to provide Interruptible Demand and Direct Control Load Management upon requests by the Transmission Operators, Balancing Authorities, and Reliability Coordinators.

In MOD-031-2 R1.4.5 requires the Planning Coordinator or Balancing Authority to request, as necessary, total available peak hour forecast of controllable and dispatchable Demand Side Management from the applicable entities.  R2 then requires each applicable entity identified in the data request to provide the requested data to the PC or BA.

In IRO-010-2 R1 requires the Reliability Coordinator to list necessary data and information needed to perform its Operating Planning Analyses and Real-Time Assessments, and R2 requires the RC to distribute its data specifications to all applicable entities.  R3 then requires each applicable entity to respond to the request as specified.”

Additionally, the premise of MOD-020-0 R1 is that the BES can be protected through load reduction through interruption of demands or direct control load management (DCLM).  While general reliability can be and is enhanced through the Resource Planner’s consideration of interruptible demands, real time reliability is not affected since TOPs, BAs and RCs do not have direct authority to interrupt load, and the tools to effectuate an interruption through other functional entities take too long to respond to real time events.  With respect to DCLM, a load control program covers loads spread across a broad area and is not concentrated in specific areas that would help in real time.  Since TOPs, BAs and RCs have no ability to reduce loads through interruption or DCLM, having information about the amount of interruptible demands and DCLM is of no value and the requirement to provide such information adds unwarranted burden.

 

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

Based on the list contained in the question, the order of highest priority should be CIP, COM, IRO, FAC, and MOD families. For the 2019 reviews, it may be more efficient to forego grading standards that are, or are expected, to be retired or modified pursuant to the Standards Efficient Review project.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

LCRA would like to see a higher priority placed on the MOD suite of standards as these are newer standards and are not as “mature” as other standards.  Ensuring accurate models and model validity is also of great importance in the area of system modeling.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

Reclamation recommends MOD-026-1 and MOD-027-1 should have the highest priority for review in 2019.

(Q4) Reclamation supports clarifying the timeframes expected in these standards by moving language from Attachment 1 into the requirements.

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0

Hot Answers

Andrea Jessup, On Behalf of: Bonneville Power Administration, WECC, Segments 1, 3, 5, 6

- 0 - 0

Rick Applegate, On Behalf of: Rick Applegate, , Segments 1, 3, 4, 5, 6

- 0 - 0

Other Answers

Daniel Gacek, On Behalf of: Exelon, , Segments 1, 3, 5, 6

- 0 - 0

Below, are noted issues that the NSRF has experienced within this current set of Standards and recommend they be added to the PR list.  The NSRF believes this is one method for industry to comment on issues experienced while employing the PR group of Standards.  We also recommend that the questions to industry (this form) does not ask if we agree with the comments (PC, OC, NERC, RE) but rather are there any additional issues that Entities have experienced with the Standards relating to whether individual standards are necessary, clear, and efficient in addressing identified reliability risks.

The NSRF request revising the “within 90 calendar days” obligation in MOD-026, R6 and MOD-027-1, R5 because it may take more than 90 days for a power flow application software developer to conclude that a model is unusable or modify its application to make a model usable. We suggest revising the wording to “within 90 calendar days or a mutually agreed timeframe”.

The NSRF does not disagree with any comment as we do not want to suppress any views and inputs from any review group.  Since the gathered information (score) will be used in the prioritization of the 2019-2020 RSDP.

The NSRF recommends that there needs to be a balance between the amount of resources (time, personnel hours, cost, etc.) put into the standards grading process and the benefit that our industry will receive from the review.  As stated in the preamble, The primary focus of standards development activity has shifted to Periodic Reviews (PRs) to determine whether individual standards are necessary, clear, and efficient in addressing identified reliability risks.”   Then there must be continuous action after the grading is completed as there are valid comments by the review groups that need to be addressed.  Our industry needs well-worded Standards by which the intent is accomplished for the reliability of the BPS.  Not an audit “got cha” due to the ambiguous wording of the Standard or auditor’s view that is different from an Entity’s view.  We, the industry have put a great amount of resources into this project and want to see it succeed starting in 2019.

MRO NSRF, Segment(s) 3, 4, 5, 6, 1, 2, 7/19/2017

- 0 - 0

Seattle City Light Ballot Body, Segment(s) 1, 4, 6, 5, 3, 12/2/2016

- 0 - 0

The California ISO supports the comments of the ISO/RTO Council Standards Review Committee

Richard Vine, On Behalf of: Richard Vine, , Segments 2

- 0 - 0

Although a grading scale can be a means to monitor the standards, the parameters used in the process alone cannot truly tell the story of how each standard is performing.  Because the standards grading parameters are designed to be applicable across all standards and not directed to measure the intent and effectiveness of each unique standard, the results tend to generalize too much.  This generalization is reflected in the high correlation of the average scores. At a minimum, it is apparent that there is questionable value in having four independent technical committees responding to the questions for each standard. The high correlation in the average scores indicates the standards either have reached “steady state” and needs no review – or if that is not the expected result, then the process needs to be changed. We believe it is a clear indication that the process and the grading category/criteria need to be reviewed and updated.

 

Timing of Reviews

Our understanding of the purpose of Standards Grading is to use technical committee input to determine whether the set of standards are of good quality, effective and efficient.   The IRC SRC supports the concept, but not on which standards they have been applied.

Given that NERC employs a stakeholder process to develop and approve its standards which include subject matter experts, there should not be a need to make incremental improvements early in a standard’s lifecycle.  If standards have a significant number of self-reports or violations after a few years then a standards grading team could analyze if the violations were interpretation or poor standard design and then they should be put on the list for grading and review. 

At that point, grading can be done as part of the periodic review.  Additionally, the industry should be given a chance to voice their opinion on whether the review team’s recommendations merit officially opening the standard for changes.

 

Reviewers

The NERC Standard Process is built on some several built-in concepts. One concept is that proposed standards are filtered by the Industry and that Industry-supported standards are reviewed by the FERC. Therefore, there seems to be little value in asking (as does the Grading Process) if an approved mandatory standard “supports a Reliability Principle”, or if “the correct entities are identified”. 

 

Additional Considerations

The grading and monitoring of the effectiveness of standards must be revised to include the concept of the effectiveness of the standard to support reliability with less subjective and more quantitative measures.  We understand that the Standards Committee and the technical committee attempted to create just such a grading mechanism prior to proposing the present grading tool.  More work should be done to explore ways to quantitatively measure standards performance as they pertain to their reliability purpose.  Such work should could be done during the standards drafting phase.  Given the historical evolution of the changes to NERC standards, putting the standards drafting teams accountable to creating quantitative reliability measures is consistent with efforts which try to “clean-up” standards like Paragraph 81, Standards Efficiency Review, and even Reliability Based Compliance which are intended to focus resources on those requirements which have the greatest impact on reliability. Quantiative measures associated with proposed standards would focus the standards drafting teams and industry review and understanding towards what requirements are truly focused on reliability.

SRC, Segment(s) 2, 1, 3/2/2018

- 0 - 0

Our understanding of the purpose of Standards Grading is to use technical committee input to determine whether the set of standards are effective and efficient.   We support this concept, but not how the process has been applied.

Assuming NERC is following sound quality practices to create standards, there should not be a need to make incremental changes or  improvements early in the standards lifecycle.  Unless there is a fatal flaw with a standard, there should be no periodic review  or other changes under a different initiative until a standard has undergone two audit cycles (been effective for at least 7 years).   There is only one standard in this grading set that fist this criterion.

Grading should be done as a first step in the periodic review process and then only after the suggested 7 year point.  Additionally, the industry should be given a chance to voice their opinion on whether the review team’s recommendations merit officially opening the standard for changes.

Finally, this grading effort seems duplicative of the SER and any changes to standards (other than FERC-directed standards) should wait until the SER effort is complete.

Terry BIlke, On Behalf of: Terry BIlke, , Segments 2

- 0 - 0

Southern Company, Segment(s) 1, 6, 3, 5, 9/1/2016

- 0 - 0

Louisville Gas and Electric Company and Kentucky Utilities Company, Segment(s) 3, 5, 6, 4/13/2017

- 0 - 0

Duke Energy , Segment(s) 1, 5, 6, 4/10/2014

- 0 - 0

Allie Gavin, On Behalf of: International Transmission Company Holdings Corporation - MRO, RF - Segments 1

- 0 - 0

Given the multiple and diverging opinions and comments contained in the 2018 Grading Tool Master spreadsheet, it may be too generalized to ask whether the reviewing entity agrees with the findings with merely a “yes” or “no”.  Additionally, the 2018 Grading project includes standards that are being reviewed and proposed for retirement pursuant to the Standards Efficiency Review, and to the extent Standards Grading runs parallel with the work of the Standards Efficiency Review team, structuring the grading so that it does not contain duplicative or conflicting recommendations would be a more efficient use of resources.

SPP Standards Review Group, Segment(s) 2, 4, 1, 6, 6/28/2018

- 0 - 0

LCRA appreciates the opportunity to comment and review from an industry perspective.

LCRA Compliance, Segment(s) 6, 5, 1, 5/11/2015

- 0 - 0

None

Richard Jackson, On Behalf of: U.S. Bureau of Reclamation, , Segments 1, 5

- 0 - 0