Deep Learning-Based Target Tracking and Classification for Low Quality Videos Using Coded Aperture Cameras

Compressive sensing has seen many applications in recent years. One type of compressive sensing device is the Pixel-wise Code Exposure (PCE) camera, which has low power consumption and individual control of pixel exposure time. In order to use PCE cameras for practical applications, a time consuming...

وصف كامل

التفاصيل البيبلوغرافية
الحاوية / القاعدة:Sensors
المؤلفون الرئيسيون: Chiman Kwan, Bryan Chou, Jonathan Yang, Akshay Rangamani, Trac Tran, Jack Zhang, Ralph Etienne-Cummings
التنسيق: مقال
اللغة:الإنجليزية
منشور في: MDPI AG 2019-08-01
الموضوعات:
الوصول للمادة أونلاين:https://www.mdpi.com/1424-8220/19/17/3702
الوصف
الملخص:Compressive sensing has seen many applications in recent years. One type of compressive sensing device is the Pixel-wise Code Exposure (PCE) camera, which has low power consumption and individual control of pixel exposure time. In order to use PCE cameras for practical applications, a time consuming and lossy process is needed to reconstruct the original frames. In this paper, we present a deep learning approach that directly performs target tracking and classification in the compressive measurement domain without any frame reconstruction. In particular, we propose to apply You Only Look Once (YOLO) to detect and track targets in the frames and we propose to apply Residual Network (ResNet) for classification. Extensive simulations using low quality optical and mid-wave infrared (MWIR) videos in the SENSIAC database demonstrated the efficacy of our proposed approach.
تدمد:1424-8220