Abstract:
Unmanned Aerial Vehicle (UAV) detection for public safety protection is becoming a critical issue in non-fly zones. There are plenty of attempts of the UAV detection usin...Show MoreMetadata
Abstract:
Unmanned Aerial Vehicle (UAV) detection for public safety protection is becoming a critical issue in non-fly zones. There are plenty of attempts of the UAV detection using single stream (day or night vision). In this paper, we propose a new hybrid deep learning model to detect the UAV s in day and night visions with a high detection precision and accurate bounding box localization. The proposed hybrid deep learning model is developed with cosine annealing and re-thinking transformation to improve the detection precision and accelerate the training convergence. To validate the hybrid deep learning model, real-world experiments are conducted outdoor in daytime and nighttime, where a surveillance video camera on the ground is set up for capturing the UAV. In addition, the UAV-Catch open database is adopted for offline training of the proposed hybrid model, which enriches training datasets and improves the detection precision. The experimental results show that the proposed hybrid deep learning model achieves 65 % in terms of the mean average detection precision given the input videos in day and night visions.
Date of Conference: 13-15 December 2021
Date Added to IEEE Xplore: 13 April 2022
ISBN Information:
Funding Agency:
References is not available for this document.
Select All
1.
P. Molchanov, K. Egiazarian, J. Astola, R. I. A. Harmanny and J. J. M. De Wit, Classification of small UAVs and birds by micro-Doppler signatures 2013 European Radar Conference, pp. 172-175, 2013.
2.
J. Baek, S. Hong, J. Kim and E. Kim, "Efficient Pedestrian Detection at Nighttime Using a Thermal Camera", Sensors, vol. 17, no. 1850, 2017.
3.
P. Dollar, R. Appel, S. Belongie and P. Perona, "Fast Feature Pyramids for Object Detection", IEEE Transactions on Pat-tern Analysis and Machine Intelligence, vol. 36, no. 8, pp. 1532-1545, Aug. 2014.
4.
W. Wang, J. Zhang and C. Shen, "Improved human detection and classification in thermal images", 2010 IEEE International Conference on Image Processing, pp. 2313-2316, 2010.
5.
D. Guan, Y. Cao, J. Yang, Y. Cao and M. Y. Yang, "Fusion of multispectral data through illumination-aware deep neural networks for pedestrian detection", Information Fusion, vol. 50, pp. 148-157, 2019.
6.
W. J. Davis and V. Sharma, "Background-subtraction using contour-based fusion of thermal and visible imagery", Computer Vision and Image Understanding, vol. 106, no. 2–3, pp. 162-182, 2007.
7.
A. Leykin, Y. Ran and R. Hammoud, "Thermal- Visible Video Fusion for Moving Target Tracking and Pedestrian Classification", 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2007.
8.
B. Chen, W. Wang and Q. Qin, "Robust multi-stage approach for the detection of moving target from infrared imagery", Opt. Eng., vol. 51, no. 6, pp. 067006, June 2012.
9.
L. Shi, I. Ahmad, Y. He and K. Chang, "Hidden Markov model based drone sound recognition using MFCC technique in practical noisy environments", Journal of Communications and Networks, vol. 20, no. 5, pp. 509-518, Oct 2018.
10.
W. Li, D. Zheng, T. Zhao and M. Yang, "An ef-fective approach to pedestrian detection in thermal imagery", 2012 8th International Conference on Natural Computation, pp. 325-329, 2012.
11.
M. Teutsch, T. Mueller, M. Huber and J. Beyerer, "Low Resolution Person Detection with a Moving Thermal Infrared Camera by Hot Spot Classification", 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 209-216, 2014.
12.
G. LoweDavid, "Distinctive Image Features from Scale-Invariant Keypoints", International Journal of Computer Vision, vol. 60, pp. 91-110, 2004.
13.
N. Dalal and B. Triggs, "Histograms of oriented gradients for human", 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR05), vol. 1, pp. 886-893, 2005.
14.
H. Bay, A. Ess, T. Tuytelaars and L. V. Gool, "Speeded-Up Robust Features (SURF)", Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008.
15.
M. Jahangir and C. Baker, "Robust Detection of Micro-UAS Drones with L-Band 3-D Holographic Rada", 2016 Sensor Signal Processing for Defence (SSPD) Edinburgh, pp. 1-5, 2016.
16.
M. Jahangir and C. Baker, "Extended dwell Doppler char-acteristics of birds and micro- UAS at l-band", 2017 18th International Radar Symposium (IRS), pp. 1-10, 2017.
17.
M. Jahangir, C. J. Baker and G. A. Oswald, "Doppler charac-teristics of micro-drones with L-Band multibeam staring rada", 2017 IEEE Radar Conference (RadarConf), pp. 1052-1057, 2017.
18.
J. Drozdowicz et al., "35 GHz FMCW drone detection system", 2016 17th International Radar Symposium (IRS), pp. 1-4, 2016.
19.
F. Fioranelli, M. Ritchie, H. Griffiths and H. Borrion, "Classification of loaded/unloaded micro-drones using multi-static radar", Electronics Letters, vol. 51, no. 22, pp. 1813-1815, Sep 2015.
20.
J. A. Nanzer and V. C. Chen, "Microwave interferometric and Doppler radar measurements of a UAV", 2017 IEEE Radar Conference (RadarConf), pp. 1628-1633, 2017.
21.
M. U. De Haag, C. G. Bartone and M. S. Braasch, "Flight-test evaluation of small form-factor LiDAR and radar sensors for sUAS detect-and-avoid applications", 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC), pp. 1-11, 2016.
22.
M. Saqib, S. D. Khan, N. Sharma and M. Blumenstein, "A study on detecting drones using deep convolutional neural net-works", 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1-5, 2017.
23.
S. Al-Emadi, A. Al-Ali, A. Mohammad and A. Al-Ali, "Audio Based Drone Detection and Identification using Deep Learning", 2019 15th International Wireless Communications Mobile Computing Conference (IWCMC), pp. 459-464, 2019.
24.
J. Park, D. H. Kim, Y. S. Shin and S. Lee, "A comparison of convolutional object detectors for real-time drone tracking using a PTZ camera", 2017 17th International Conference on Control Automation and Systems (ICCAS), pp. 696-699, 2017.
25.
S. Ren, K. He, R. Girshick and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137-1149, June 2017.
26.
R. Girshick, "Fast R-CNN", 2015 IEEE International Conference on Computer Vision (ICCV), pp. 1440-1448, 2015.
27.
R. Girshick, J. Donahue, T. Darrell and J. Malik, "Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation", 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 580-587, 2014.
28.
M. Tan and Q. V. Le, "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks", International conference on machine learning ICLR, pp. 6105-6114, 2019.
29.
M. Tan, R. Pang and Q. V. Le, "EfficientDet: Scalable and Efficient Object Detection", 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10778-10787, 2020.
30.
B. Jansen, "Drone Crash at White House Re-veals Security Risks", USA Today, January 2015, [online] Available: https://www.usatoday.com/story/news/2015/01/26/drone-crash-secret-service-faa/22352857/.