ELECTRIcity: An Efficient Transformer for Non-Intrusive Load Monitoring

• Main Authors: Doulamis, A. (Author), Doulamis, N. (Author), Kaselimi, M. (Author), Sykiotis, S. (Author)
• Format: Article
• Language: English
• Published: MDPI 2022
• Subjects: Consumption patterns; deep learning; Deep learning; Disaggregation; Domestic appliances; Electric load management; Energy; energy disaggregation; Energy disaggregation; imbalanced data; Imbalanced data; NILM; non-intrusive load monitoring; Nonintrusive load monitoring; Power signals; Transformer; transformers
• Online Access: View Fulltext in Publisher

 Non-Intrusive Load Monitoring (NILM) describes the process of inferring the consumption pattern of appliances by only having access to the aggregated household signal. Sequence-tosequence deep learning models have been firmly established as state-of-the-art approaches for NILM, in an attempt to identify the pattern of the appliance power consumption signal into the aggregated power signal. Exceeding the limitations of recurrent models that have been widely used in sequential modeling, this paper proposes a transformer-based architecture for NILM. Our approach, called ELECTRIcity, utilizes transformer layers to accurately estimate the power signal of domestic appliances by relying entirely on attention mechanisms to extract global dependencies between the aggregate and the domestic appliance signals. Another additive value of the proposed model is that ELECTRIcity works with minimal dataset pre-processing and without requiring data balancing. Furthermore, ELECTRIcity introduces an efficient training routine compared to other traditional transformer-based architectures. According to this routine, ELECTRIcity splits model training into unsupervised pre-training and downstream task fine-tuning, which yields performance increases in both predictive accuracy and training time decrease. Experimental results indicate ELECTRIcity’s superiority compared to several state-of-the-art methods. © 2022 by the authors. Licensee MDPI, Basel, Switzerland.