Deep Enhancement-Object Features Fusion for Low-Light Object Detection


Lim, Wan Teng and Ang, Kelvin and Loh, Yuen Peng (2022) Deep Enhancement-Object Features Fusion for Low-Light Object Detection. In: 4th ACM International Conference on Multimedia in Asia, 13-16 Dec 2022, Tokyo, Japan.

[img] Text
3551626.3564947.pdf - Published Version
Restricted to Repository staff only

Download (915kB)


With the robust development of deep learning, object detection has gained much attention for practical use cases such as in autonomous driving and surveillance. However, the task is still challenging to the state-of-the-arts in low-light. Consequently, image enhancement has become a common pre-processing step in the pipeline for object detection in low-light environments. Nonetheless, such two-step approach hinges on the reconstruction of the enhanced image which could introduce unseen artifacts and distortion that deteriorates the detection performance instead. Thus, this work proposes a deep enhancement-object features fusion approach to alleviate the problem by infusing deep features extracted from low-light image enhancement with the deep object features of a detection model. It is postulated that features learned by enhancement models emphasizes visual details which were otherwise disregarded by detection models that focus on the abstract appearance of objects. Hence, the fusion of such complementary features would compensate for the details lost due to low-visibility as well as circumvent the reconstruction error for better detection. Specifically, this work performs a study on fusing deep enhancement features from the state-of-the-art Deep Lightening Network (DLN) with the Yolov5 object detection model at various stages. Experiments on the ExDARK dataset showed that such fusion can improve the precision of object detection in various low-light image conditions and outperforms the conventional two-step pre-process-then-detect approach.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Artificial intelligence, Computer graphics
Subjects: Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions: Faculty of Computing and Informatics (FCI)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 07 Mar 2023 01:56
Last Modified: 07 Mar 2023 01:56


Downloads per month over past year

View ItemEdit (login required)