A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis

This work presents the application of a methodology to measure domain expert trust and workload, elicit feedback, and understand the technological usability and impact when a machine learning assistant is introduced into contingency analysis for real-time power grid simulation. The goal of this fram...

Full description

Bibliographic Details
Main Authors: Anderson, A. (Author), Baweja, J. (Author), Ciesielski, D. (Author), Fallon, C. (Author), Jefferson, B. (Author), Wenskovitch, J. (Author)
Format: Article
Language:English
Published: Frontiers Media S.A. 2022
Subjects:
Online Access:View Fulltext in Publisher
LEADER 01661nam a2200253Ia 4500
001 10.3389-fdata.2022.897295
008 220718s2022 CNT 000 0 und d
020 |a 2624909X (ISSN) 
245 1 0 |a A Methodology for Evaluating Operator Usage of Machine Learning Recommendations for Power Grid Contingency Analysis 
260 0 |b Frontiers Media S.A.  |c 2022 
856 |z View Fulltext in Publisher  |u https://doi.org/10.3389/fdata.2022.897295 
520 3 |a This work presents the application of a methodology to measure domain expert trust and workload, elicit feedback, and understand the technological usability and impact when a machine learning assistant is introduced into contingency analysis for real-time power grid simulation. The goal of this framework is to rapidly collect and analyze a broad variety of human factors data in order to accelerate the development and evaluation loop for deploying machine learning applications. We describe our methodology and analysis, and we discuss insights gained from a pilot participant about the current usability state of an early technology readiness level (TRL) artificial neural network (ANN) recommender. Copyright © 2022 Wenskovitch, Jefferson, Anderson, Baweja, Ciesielski and Fallon. 
650 0 4 |a cognitive load 
650 0 4 |a contingency analysis 
650 0 4 |a human-machine teaming 
650 0 4 |a power grid 
650 0 4 |a trust evaluation 
700 1 |a Anderson, A.  |e author 
700 1 |a Baweja, J.  |e author 
700 1 |a Ciesielski, D.  |e author 
700 1 |a Fallon, C.  |e author 
700 1 |a Jefferson, B.  |e author 
700 1 |a Wenskovitch, J.  |e author 
773 |t Frontiers in Big Data  |x 2624909X (ISSN)  |g 5