A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis

• Main Authors: Anderson, A. (Author), Baweja, J. (Author), Ciesielski, D. (Author), Fallon, C. (Author), Jefferson, B. (Author), Wenskovitch, J. (Author)
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2022
• Subjects: cognitive load; contingency analysis; human-machine teaming; power grid; trust evaluation
• Online Access: View Fulltext in Publisher
• ISBN: 2624909X (ISSN)
• ISSN: 2624909X (ISSN)
• DOI: 10.3389/fdata.2022.897295

This work presents the application of a methodology to measure domain expert trust and workload, elicit feedback, and understand the technological usability and impact when a machine learning assistant is introduced into contingency analysis for real-time power grid simulation. The goal of this framework is to rapidly collect and analyze a broad variety of human factors data in order to accelerate the development and evaluation loop for deploying machine learning applications. We describe our methodology and analysis, and we discuss insights gained from a pilot participant about the current usability state of an early technology readiness level (TRL) artificial neural network (ANN) recommender. Copyright © 2022 Wenskovitch, Jefferson, Anderson, Baweja, Ciesielski and Fallon.