Intelligent Electromagnetic Sensing with Learnable Data Acquisition and Processing
Summary: Electromagnetic (EM) sensing is a widespread contactless examination technique with applications in areas such as health care and the internet of things. Most conventional sensing systems lack intelligence, which not only results in expensive hardware and complicated computational algorithm...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Elsevier
2020-04-01
|
Series: | Patterns |
Subjects: | |
Online Access: | http://www.sciencedirect.com/science/article/pii/S2666389920300064 |
id |
doaj-703bbbb56fb44fafa3af096a81ecd73d |
---|---|
record_format |
Article |
spelling |
doaj-703bbbb56fb44fafa3af096a81ecd73d2020-11-25T04:06:45ZengElsevierPatterns2666-38992020-04-0111100006Intelligent Electromagnetic Sensing with Learnable Data Acquisition and ProcessingHao-Yang Li0Han-Ting Zhao1Meng-Lin Wei2Heng-Xin Ruan3Ya Shuang4Tie Jun Cui5Philipp del Hougne6Lianlin Li7State Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronics, Peking University, Beijing 100871, ChinaState Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronics, Peking University, Beijing 100871, ChinaState Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronics, Peking University, Beijing 100871, ChinaState Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronics, Peking University, Beijing 100871, ChinaState Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronics, Peking University, Beijing 100871, ChinaState Key Laboratory of Millimeter Waves, Southeast University, Nanjing 210096, China; Corresponding authorInstitut de Physique de Nice, CNRS UMR 7010, Université Côte d’Azur, Nice 06108, France; Corresponding authorState Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronics, Peking University, Beijing 100871, China; Corresponding authorSummary: Electromagnetic (EM) sensing is a widespread contactless examination technique with applications in areas such as health care and the internet of things. Most conventional sensing systems lack intelligence, which not only results in expensive hardware and complicated computational algorithms but also poses important challenges for real-time in situ sensing. To address this shortcoming, we propose the concept of intelligent sensing by designing a programmable metasurface for data-driven learnable data acquisition and integrating it into a data-driven learnable data-processing pipeline. Thereby, a measurement strategy can be learned jointly with a matching data post-processing scheme, optimally tailored to the specific sensing hardware, task, and scene, allowing us to perform high-quality imaging and high-accuracy recognition with a remarkably reduced number of measurements. We report the first experimental demonstration of “learned sensing” applied to microwave imaging and gesture recognition. Our results pave the way for learned EM sensing with low latency and computational burden. The Bigger Picture: Many futuristic “intelligent” concepts that will affect our society, from ambient-assisted health care via autonomous vehicles to touchless human-computer interaction, necessitate sensors that can monitor a device's surroundings fast and without extensive computational effort. To date, sensors indiscriminately acquire all information and only select relevant details during data processing, thereby wasting time, energy, and computational resources. We demonstrate intelligent electromagnetic sensing that uses learned illumination patterns to already select relevant details during the measurement process. Our experiments use a home-made programmable metasurface to generate the learned microwave patterns that enable a remarkable reduction in the number of necessary measurements. Our demonstration addresses a widespread need for high-quality contactless electromagnetic sensing under strict time, energy, and computation constraints.http://www.sciencedirect.com/science/article/pii/S2666389920300064programmable metamaterialsartificial neural networkintelligent electromagnetic |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hao-Yang Li Han-Ting Zhao Meng-Lin Wei Heng-Xin Ruan Ya Shuang Tie Jun Cui Philipp del Hougne Lianlin Li |
spellingShingle |
Hao-Yang Li Han-Ting Zhao Meng-Lin Wei Heng-Xin Ruan Ya Shuang Tie Jun Cui Philipp del Hougne Lianlin Li Intelligent Electromagnetic Sensing with Learnable Data Acquisition and Processing Patterns programmable metamaterials artificial neural network intelligent electromagnetic |
author_facet |
Hao-Yang Li Han-Ting Zhao Meng-Lin Wei Heng-Xin Ruan Ya Shuang Tie Jun Cui Philipp del Hougne Lianlin Li |
author_sort |
Hao-Yang Li |
title |
Intelligent Electromagnetic Sensing with Learnable Data Acquisition and Processing |
title_short |
Intelligent Electromagnetic Sensing with Learnable Data Acquisition and Processing |
title_full |
Intelligent Electromagnetic Sensing with Learnable Data Acquisition and Processing |
title_fullStr |
Intelligent Electromagnetic Sensing with Learnable Data Acquisition and Processing |
title_full_unstemmed |
Intelligent Electromagnetic Sensing with Learnable Data Acquisition and Processing |
title_sort |
intelligent electromagnetic sensing with learnable data acquisition and processing |
publisher |
Elsevier |
series |
Patterns |
issn |
2666-3899 |
publishDate |
2020-04-01 |
description |
Summary: Electromagnetic (EM) sensing is a widespread contactless examination technique with applications in areas such as health care and the internet of things. Most conventional sensing systems lack intelligence, which not only results in expensive hardware and complicated computational algorithms but also poses important challenges for real-time in situ sensing. To address this shortcoming, we propose the concept of intelligent sensing by designing a programmable metasurface for data-driven learnable data acquisition and integrating it into a data-driven learnable data-processing pipeline. Thereby, a measurement strategy can be learned jointly with a matching data post-processing scheme, optimally tailored to the specific sensing hardware, task, and scene, allowing us to perform high-quality imaging and high-accuracy recognition with a remarkably reduced number of measurements. We report the first experimental demonstration of “learned sensing” applied to microwave imaging and gesture recognition. Our results pave the way for learned EM sensing with low latency and computational burden. The Bigger Picture: Many futuristic “intelligent” concepts that will affect our society, from ambient-assisted health care via autonomous vehicles to touchless human-computer interaction, necessitate sensors that can monitor a device's surroundings fast and without extensive computational effort. To date, sensors indiscriminately acquire all information and only select relevant details during data processing, thereby wasting time, energy, and computational resources. We demonstrate intelligent electromagnetic sensing that uses learned illumination patterns to already select relevant details during the measurement process. Our experiments use a home-made programmable metasurface to generate the learned microwave patterns that enable a remarkable reduction in the number of necessary measurements. Our demonstration addresses a widespread need for high-quality contactless electromagnetic sensing under strict time, energy, and computation constraints. |
topic |
programmable metamaterials artificial neural network intelligent electromagnetic |
url |
http://www.sciencedirect.com/science/article/pii/S2666389920300064 |
work_keys_str_mv |
AT haoyangli intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing AT hantingzhao intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing AT menglinwei intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing AT hengxinruan intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing AT yashuang intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing AT tiejuncui intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing AT philippdelhougne intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing AT lianlinli intelligentelectromagneticsensingwithlearnabledataacquisitionandprocessing |
_version_ |
1724430739586416640 |