Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study
BackgroundDiagnostic decision making, especially in emergency departments, is a highly complex cognitive process that involves uncertainty and susceptibility to errors. A combination of factors, including patient factors (eg, history, behaviors, complexity, and comorbidity),...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
JMIR Publications
2021-06-01
|
Series: | JMIR Research Protocols |
Online Access: | https://www.researchprotocols.org/2021/6/e24642 |
id |
doaj-c25303da24ad4b22b140a94f1a7c1d40 |
---|---|
record_format |
Article |
spelling |
doaj-c25303da24ad4b22b140a94f1a7c1d402021-06-14T12:31:09ZengJMIR PublicationsJMIR Research Protocols1929-07482021-06-01106e2464210.2196/24642Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning StudyEnayati, MoeinSir, MustafaZhang, XingyuParker, Sarah JDuffy, ElizabethSingh, HardeepMahajan, PrashantPasupathy, Kalyan S BackgroundDiagnostic decision making, especially in emergency departments, is a highly complex cognitive process that involves uncertainty and susceptibility to errors. A combination of factors, including patient factors (eg, history, behaviors, complexity, and comorbidity), provider-care team factors (eg, cognitive load and information gathering and synthesis), and system factors (eg, health information technology, crowding, shift-based work, and interruptions) may contribute to diagnostic errors. Using electronic triggers to identify records of patients with certain patterns of care, such as escalation of care, has been useful to screen for diagnostic errors. Once errors are identified, sophisticated data analytics and machine learning techniques can be applied to existing electronic health record (EHR) data sets to shed light on potential risk factors influencing diagnostic decision making. ObjectiveThis study aims to identify variables associated with diagnostic errors in emergency departments using large-scale EHR data and machine learning techniques. MethodsThis study plans to use trigger algorithms within EHR data repositories to generate a large data set of records that are labeled trigger-positive or trigger-negative, depending on whether they meet certain criteria. Samples from both data sets will be validated using medical record reviews, upon which we expect to find a higher number of diagnostic safety events in the trigger-positive subset. Machine learning will be used to evaluate relationships between certain patient factors, provider-care team factors, and system-level risk factors and diagnostic safety signals in the statistically matched groups of trigger-positive and trigger-negative charts. ResultsThis federally funded study was approved by the institutional review board of 2 academic medical centers with affiliated community hospitals. Trigger queries are being developed at both organizations, and sample cohorts will be labeled using the triggers. Machine learning techniques such as association rule mining, chi-square automated interaction detection, and classification and regression trees will be used to discover important variables that could be incorporated within future clinical decision support systems to help identify and reduce risks that contribute to diagnostic errors. ConclusionsThe use of large EHR data sets and machine learning to investigate risk factors (related to the patient, provider-care team, and system-level) in the diagnostic process may help create future mechanisms for monitoring diagnostic safety. International Registered Report Identifier (IRRID)DERR1-10.2196/24642https://www.researchprotocols.org/2021/6/e24642 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Enayati, Moein Sir, Mustafa Zhang, Xingyu Parker, Sarah J Duffy, Elizabeth Singh, Hardeep Mahajan, Prashant Pasupathy, Kalyan S |
spellingShingle |
Enayati, Moein Sir, Mustafa Zhang, Xingyu Parker, Sarah J Duffy, Elizabeth Singh, Hardeep Mahajan, Prashant Pasupathy, Kalyan S Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study JMIR Research Protocols |
author_facet |
Enayati, Moein Sir, Mustafa Zhang, Xingyu Parker, Sarah J Duffy, Elizabeth Singh, Hardeep Mahajan, Prashant Pasupathy, Kalyan S |
author_sort |
Enayati, Moein |
title |
Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study |
title_short |
Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study |
title_full |
Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study |
title_fullStr |
Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study |
title_full_unstemmed |
Monitoring Diagnostic Safety Risks in Emergency Departments: Protocol for a Machine Learning Study |
title_sort |
monitoring diagnostic safety risks in emergency departments: protocol for a machine learning study |
publisher |
JMIR Publications |
series |
JMIR Research Protocols |
issn |
1929-0748 |
publishDate |
2021-06-01 |
description |
BackgroundDiagnostic decision making, especially in emergency departments, is a highly complex cognitive process that involves uncertainty and susceptibility to errors. A combination of factors, including patient factors (eg, history, behaviors, complexity, and comorbidity), provider-care team factors (eg, cognitive load and information gathering and synthesis), and system factors (eg, health information technology, crowding, shift-based work, and interruptions) may contribute to diagnostic errors. Using electronic triggers to identify records of patients with certain patterns of care, such as escalation of care, has been useful to screen for diagnostic errors. Once errors are identified, sophisticated data analytics and machine learning techniques can be applied to existing electronic health record (EHR) data sets to shed light on potential risk factors influencing diagnostic decision making.
ObjectiveThis study aims to identify variables associated with diagnostic errors in emergency departments using large-scale EHR data and machine learning techniques.
MethodsThis study plans to use trigger algorithms within EHR data repositories to generate a large data set of records that are labeled trigger-positive or trigger-negative, depending on whether they meet certain criteria. Samples from both data sets will be validated using medical record reviews, upon which we expect to find a higher number of diagnostic safety events in the trigger-positive subset. Machine learning will be used to evaluate relationships between certain patient factors, provider-care team factors, and system-level risk factors and diagnostic safety signals in the statistically matched groups of trigger-positive and trigger-negative charts.
ResultsThis federally funded study was approved by the institutional review board of 2 academic medical centers with affiliated community hospitals. Trigger queries are being developed at both organizations, and sample cohorts will be labeled using the triggers. Machine learning techniques such as association rule mining, chi-square automated interaction detection, and classification and regression trees will be used to discover important variables that could be incorporated within future clinical decision support systems to help identify and reduce risks that contribute to diagnostic errors.
ConclusionsThe use of large EHR data sets and machine learning to investigate risk factors (related to the patient, provider-care team, and system-level) in the diagnostic process may help create future mechanisms for monitoring diagnostic safety.
International Registered Report Identifier (IRRID)DERR1-10.2196/24642 |
url |
https://www.researchprotocols.org/2021/6/e24642 |
work_keys_str_mv |
AT enayatimoein monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy AT sirmustafa monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy AT zhangxingyu monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy AT parkersarahj monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy AT duffyelizabeth monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy AT singhhardeep monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy AT mahajanprashant monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy AT pasupathykalyans monitoringdiagnosticsafetyrisksinemergencydepartmentsprotocolforamachinelearningstudy |
_version_ |
1721378509660618752 |