A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data Modeling

Data-driven approaches, when tasked with situation awareness, are suitable for complex grids with massive datasets. It is a challenge, however, to efficiently turn these massive datasets into useful big data analytics. To address such a challenge, this paper, based on random matrix theory, proposes...

Full description

Bibliographic Details
Main Authors: Xing He, Lei Chu, Robert Caiming Qiu, Qian Ai, Zenan Ling
Format: Article
Language:English
Published: IEEE 2018-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8319485/
id doaj-a1fae2f2a348426092906f78b3f38ac7
record_format Article
spelling doaj-a1fae2f2a348426092906f78b3f38ac72021-03-29T21:01:21ZengIEEEIEEE Access2169-35362018-01-016138551386510.1109/ACCESS.2018.28058158319485A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data ModelingXing He0https://orcid.org/0000-0002-2527-7423Lei Chu1Robert Caiming Qiu2https://orcid.org/0000-0002-0988-5525Qian Ai3Zenan Ling4Department of Electrical Engineering, Research Center for Big Data and Artificial Intelligence Engineering and Technologies, State Energy Smart Grid R&D Center, Shanghai Jiaotong University, Shanghai, ChinaDepartment of Electrical Engineering, Research Center for Big Data and Artificial Intelligence Engineering and Technologies, State Energy Smart Grid R&D Center, Shanghai Jiaotong University, Shanghai, ChinaDepartment of Electrical Engineering, Research Center for Big Data and Artificial Intelligence Engineering and Technologies, State Energy Smart Grid R&D Center, Shanghai Jiaotong University, Shanghai, ChinaDepartment of Electrical Engineering, Shanghai Jiao Tong University, Shanghai, ChinaDepartment of Electrical Engineering, Research Center for Big Data and Artificial Intelligence Engineering and Technologies, State Energy Smart Grid R&D Center, Shanghai Jiaotong University, Shanghai, ChinaData-driven approaches, when tasked with situation awareness, are suitable for complex grids with massive datasets. It is a challenge, however, to efficiently turn these massive datasets into useful big data analytics. To address such a challenge, this paper, based on random matrix theory, proposes a data-driven approach. The approach models massive datasets as large random matrices; it is model-free and requires no knowledge about physical model parameters. In particular, the large data dimension N and the large time span T, from the spatial aspect and the temporal aspect, respectively, lead to favorable results. The beautiful thing lies in that these linear eigenvalue statistics (LESs) are built from data matrices to follow Gaussian distributions for very general conditions, due to the latest breakthroughs in probability on the central limit theorems of those LESs. Numerous case studies, with both simulated data and field data, are given to validate the proposed new algorithms.https://ieeexplore.ieee.org/document/8319485/Big data analyticslinear eigenvalue statisticsrandom matrix theorysituation awarenessstatistical indicator
collection DOAJ
language English
format Article
sources DOAJ
author Xing He
Lei Chu
Robert Caiming Qiu
Qian Ai
Zenan Ling
spellingShingle Xing He
Lei Chu
Robert Caiming Qiu
Qian Ai
Zenan Ling
A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data Modeling
IEEE Access
Big data analytics
linear eigenvalue statistics
random matrix theory
situation awareness
statistical indicator
author_facet Xing He
Lei Chu
Robert Caiming Qiu
Qian Ai
Zenan Ling
author_sort Xing He
title A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data Modeling
title_short A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data Modeling
title_full A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data Modeling
title_fullStr A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data Modeling
title_full_unstemmed A Novel Data-Driven Situation Awareness Approach for Future Grids—Using Large Random Matrices for Big Data Modeling
title_sort novel data-driven situation awareness approach for future grids—using large random matrices for big data modeling
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2018-01-01
description Data-driven approaches, when tasked with situation awareness, are suitable for complex grids with massive datasets. It is a challenge, however, to efficiently turn these massive datasets into useful big data analytics. To address such a challenge, this paper, based on random matrix theory, proposes a data-driven approach. The approach models massive datasets as large random matrices; it is model-free and requires no knowledge about physical model parameters. In particular, the large data dimension N and the large time span T, from the spatial aspect and the temporal aspect, respectively, lead to favorable results. The beautiful thing lies in that these linear eigenvalue statistics (LESs) are built from data matrices to follow Gaussian distributions for very general conditions, due to the latest breakthroughs in probability on the central limit theorems of those LESs. Numerous case studies, with both simulated data and field data, are given to validate the proposed new algorithms.
topic Big data analytics
linear eigenvalue statistics
random matrix theory
situation awareness
statistical indicator
url https://ieeexplore.ieee.org/document/8319485/
work_keys_str_mv AT xinghe anoveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT leichu anoveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT robertcaimingqiu anoveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT qianai anoveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT zenanling anoveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT xinghe noveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT leichu noveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT robertcaimingqiu noveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT qianai noveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
AT zenanling noveldatadrivensituationawarenessapproachforfuturegridsx2014usinglargerandommatricesforbigdatamodeling
_version_ 1724193651646529536