Loading [MathJax]/extensions/MathZoom.js
LocateUAV: Unmanned Aerial Vehicle Location Estimation via Contextual Analysis in an IoT Environment | IEEE Journals & Magazine | IEEE Xplore

LocateUAV: Unmanned Aerial Vehicle Location Estimation via Contextual Analysis in an IoT Environment


Abstract:

Object detection supported by unmanned aerial vehicles (UAVs) has generated significant interest in recent years including applications, such as surveillance, search for ...Show More

Abstract:

Object detection supported by unmanned aerial vehicles (UAVs) has generated significant interest in recent years including applications, such as surveillance, search for missing persons, traffic, and disaster management. Location awareness is a challenging task, particularly, the deployment of UAVs in a global positioning system (GPS) restricted environment or GPS sensor failure. To mitigate this problem, we propose LocateUAV, a novel location awareness framework, to detect UAV’s location by processing the data from the visual sensor in real time using a lightweight convolutional neural network (CNN). Assuming that the drone is in an IoT environment, first, the object detection technique is applied to detect the object of interest (OOI), namely, signboard. Subsequently, optical character recognition (OCR) is applied to extract useful contextual information. In the final step, the extracted information is forwarded to the map application programming interface (API) to locate the UAV. We also present a newly created data set for LocateUAV, which comprises challenging scenarios for context analysis. Moreover, we also compress an existing lightweight model up to 45 MB for efficient processing over UAV, which is 19.5% when compared with the size of the original model. Finally, an in-depth comparison of various trained and efficient object detection and OCR techniques is presented to facilitate future research on the development of flex drone that can extract information from the surroundings of a location in a GPS-restricted environment.
Published in: IEEE Internet of Things Journal ( Volume: 10, Issue: 5, 01 March 2023)
Page(s): 4021 - 4033
Date of Publication: 25 March 2022

ISSN Information:

Funding Agency:

Author image of Naqqash Dilshad
Sejong University, Seoul, South Korea
Naqqash Dilshad received the bachelor’s degree in computer sciences from Abdul Wali Khan University, Mardan, Pakistan, in 2014, and the master’s degree in computer sciences from COMSATS University, Islamabad, Pakistan, in 2018.
He is currently enrolled in a Ph.D. program with Sejong University, Seoul, South Korea, and serving as a Research Assistant with the Software Engineering and Security Laboratory. His major research ...Show More
Naqqash Dilshad received the bachelor’s degree in computer sciences from Abdul Wali Khan University, Mardan, Pakistan, in 2014, and the master’s degree in computer sciences from COMSATS University, Islamabad, Pakistan, in 2018.
He is currently enrolled in a Ph.D. program with Sejong University, Seoul, South Korea, and serving as a Research Assistant with the Software Engineering and Security Laboratory. His major research ...View more
Author image of Amin Ullah
CORIS Institute, Oregon State University, Corvallis, OR, USA
Amin Ullah (Member, IEEE) received the Ph.D. degree in digital contents from Sejong University, Seoul, South Korea, in 2020.
He is currently working as a Postdoctoral Researcher with the CoRIS Institute, Oregon State University, Corvallis, OR, USA. His major research focus is on human action and activity recognition, sequence learning, image and video analytics, content-based indexing and retrieval, 3-D point clouds, IoT a...Show More
Amin Ullah (Member, IEEE) received the Ph.D. degree in digital contents from Sejong University, Seoul, South Korea, in 2020.
He is currently working as a Postdoctoral Researcher with the CoRIS Institute, Oregon State University, Corvallis, OR, USA. His major research focus is on human action and activity recognition, sequence learning, image and video analytics, content-based indexing and retrieval, 3-D point clouds, IoT a...View more
Author image of Jaeho Kim
Sejong University, Seoul, South Korea
Jaeho Kim (Member, IEEE) received the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2017.
He is a Professor with the Department of Electric Engineering, Sejong University, Seoul, also leading the Research Center for AutoTwin Technology in Metaverse. He served as the Director of the Autonomous IoT Research Center, Korea Electronics Technology Institute, Seongnam, South ...Show More
Jaeho Kim (Member, IEEE) received the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2017.
He is a Professor with the Department of Electric Engineering, Sejong University, Seoul, also leading the Research Center for AutoTwin Technology in Metaverse. He served as the Director of the Autonomous IoT Research Center, Korea Electronics Technology Institute, Seongnam, South ...View more
Author image of Jeongwook Seo
Department of IT Transmedia Contents, Hanshin University, Osan, South Korea
Jeongwook Seo received the B.S. and M.S. degrees in telecommunication and information engineering from Korea Aerospace University, Goyang, South Korea, in 1999 and 2001, respectively, and the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2010.
He was with the Smart Network Research Center, Korea Electronics Technology Institute, Seongnam, South Korea, from 2001 to 2014...Show More
Jeongwook Seo received the B.S. and M.S. degrees in telecommunication and information engineering from Korea Aerospace University, Goyang, South Korea, in 1999 and 2001, respectively, and the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2010.
He was with the Smart Network Research Center, Korea Electronics Technology Institute, Seongnam, South Korea, from 2001 to 2014...View more

I. Introduction

Unmanned aerial vehicle (UAV) is a well-known and convenient system for collecting pictures from an incredibly low elevation. In comparison to their smaller sizes, UAVs have a high level of flexibility and thus, provide aerial applications in various domains, such as fire detection, traffic congestion or accidents, search, and rescue operations according to user requirements. Owing to recent innovations in deep neural networks (DNNs), particularly, convolutional neural networks (CNNs), the performance of CNN-based detectors has increased dramatically [1], [2]. Most deep learning (DL) models not only defeat human-centered visual systems in occluded environments and accurate object detection but also surpass conventional algorithms in detection accuracy.

Author image of Naqqash Dilshad
Sejong University, Seoul, South Korea
Naqqash Dilshad received the bachelor’s degree in computer sciences from Abdul Wali Khan University, Mardan, Pakistan, in 2014, and the master’s degree in computer sciences from COMSATS University, Islamabad, Pakistan, in 2018.
He is currently enrolled in a Ph.D. program with Sejong University, Seoul, South Korea, and serving as a Research Assistant with the Software Engineering and Security Laboratory. His major research domains are video analytics, image processing, pattern recognition, object detection, scene understanding, deep learning for multimedia data understanding, IoT, IIoT, and resource-constrained programming. He has published several articles in peer-reviewed journals and conferences in reputed venues, including Journal of Networks and Computer Applications (Elsevier), IEEE International Conference on Information and Communication Technology Convergence, and IEEE International Conference on Smart Internet of Things.
Naqqash Dilshad received the bachelor’s degree in computer sciences from Abdul Wali Khan University, Mardan, Pakistan, in 2014, and the master’s degree in computer sciences from COMSATS University, Islamabad, Pakistan, in 2018.
He is currently enrolled in a Ph.D. program with Sejong University, Seoul, South Korea, and serving as a Research Assistant with the Software Engineering and Security Laboratory. His major research domains are video analytics, image processing, pattern recognition, object detection, scene understanding, deep learning for multimedia data understanding, IoT, IIoT, and resource-constrained programming. He has published several articles in peer-reviewed journals and conferences in reputed venues, including Journal of Networks and Computer Applications (Elsevier), IEEE International Conference on Information and Communication Technology Convergence, and IEEE International Conference on Smart Internet of Things.View more
Author image of Amin Ullah
CORIS Institute, Oregon State University, Corvallis, OR, USA
Amin Ullah (Member, IEEE) received the Ph.D. degree in digital contents from Sejong University, Seoul, South Korea, in 2020.
He is currently working as a Postdoctoral Researcher with the CoRIS Institute, Oregon State University, Corvallis, OR, USA. His major research focus is on human action and activity recognition, sequence learning, image and video analytics, content-based indexing and retrieval, 3-D point clouds, IoT and smart cities, and deep learning for multimedia understanding. He has published over 40 scientific articles in reputed peer-reviewed international journals and conferences, including IEEE Transactions on Industrial Electronics, IEEE Transactions on Industrial Informatics, IEEE Transactions on Intelligent Transportation Systems, IEEE Internet of Things Journal, IEEE Access, Future Generation Computer Systems (Elsevier), Applied Soft Computing (Elsevier), International Journal of Intelligent Systems, Multimedia Tools and Applications (Springer), Mobile Networks and Applications (Springer), and IEEE Joint Conference on Neural Networks. Furthermore, he has five registered patents.
Dr. Ullah served as a reviewer in over 170 articles for peer-reviewed journals and conferences.
Amin Ullah (Member, IEEE) received the Ph.D. degree in digital contents from Sejong University, Seoul, South Korea, in 2020.
He is currently working as a Postdoctoral Researcher with the CoRIS Institute, Oregon State University, Corvallis, OR, USA. His major research focus is on human action and activity recognition, sequence learning, image and video analytics, content-based indexing and retrieval, 3-D point clouds, IoT and smart cities, and deep learning for multimedia understanding. He has published over 40 scientific articles in reputed peer-reviewed international journals and conferences, including IEEE Transactions on Industrial Electronics, IEEE Transactions on Industrial Informatics, IEEE Transactions on Intelligent Transportation Systems, IEEE Internet of Things Journal, IEEE Access, Future Generation Computer Systems (Elsevier), Applied Soft Computing (Elsevier), International Journal of Intelligent Systems, Multimedia Tools and Applications (Springer), Mobile Networks and Applications (Springer), and IEEE Joint Conference on Neural Networks. Furthermore, he has five registered patents.
Dr. Ullah served as a reviewer in over 170 articles for peer-reviewed journals and conferences.View more
Author image of Jaeho Kim
Sejong University, Seoul, South Korea
Jaeho Kim (Member, IEEE) received the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2017.
He is a Professor with the Department of Electric Engineering, Sejong University, Seoul, also leading the Research Center for AutoTwin Technology in Metaverse. He served as the Director of the Autonomous IoT Research Center, Korea Electronics Technology Institute, Seongnam, South Korea. He has recently led research projects for IoT platform, smart city data hub, unmanned aerial vehicle platform, and epidemic investigation support system for COVID-19. His expertise covers IoT platforms, intelligent systems, and networks. He is currently serving as the IoT and Smart City Platform Project Group Chair of Telecommunications Technology Association. His research interests are in the areas of autonomous things, smart city, digital twin, and metaverse.
Jaeho Kim (Member, IEEE) received the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2017.
He is a Professor with the Department of Electric Engineering, Sejong University, Seoul, also leading the Research Center for AutoTwin Technology in Metaverse. He served as the Director of the Autonomous IoT Research Center, Korea Electronics Technology Institute, Seongnam, South Korea. He has recently led research projects for IoT platform, smart city data hub, unmanned aerial vehicle platform, and epidemic investigation support system for COVID-19. His expertise covers IoT platforms, intelligent systems, and networks. He is currently serving as the IoT and Smart City Platform Project Group Chair of Telecommunications Technology Association. His research interests are in the areas of autonomous things, smart city, digital twin, and metaverse.View more
Author image of Jeongwook Seo
Department of IT Transmedia Contents, Hanshin University, Osan, South Korea
Jeongwook Seo received the B.S. and M.S. degrees in telecommunication and information engineering from Korea Aerospace University, Goyang, South Korea, in 1999 and 2001, respectively, and the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2010.
He was with the Smart Network Research Center, Korea Electronics Technology Institute, Seongnam, South Korea, from 2001 to 2014, and the Department of Intelligent Information and Communication Engineering, Namseoul University, Cheonan, South Korea, from 2014 to 2020. He is currently an Associate Professor with the Department of IT Transmedia Contents, Hanshin University, Osan-si, South Korea. His research interests include statistical signal processing, Internet of Things, data science, and machine learning.
Jeongwook Seo received the B.S. and M.S. degrees in telecommunication and information engineering from Korea Aerospace University, Goyang, South Korea, in 1999 and 2001, respectively, and the Ph.D. degree in electrical and electronic engineering from Yonsei University, Seoul, South Korea, in 2010.
He was with the Smart Network Research Center, Korea Electronics Technology Institute, Seongnam, South Korea, from 2001 to 2014, and the Department of Intelligent Information and Communication Engineering, Namseoul University, Cheonan, South Korea, from 2014 to 2020. He is currently an Associate Professor with the Department of IT Transmedia Contents, Hanshin University, Osan-si, South Korea. His research interests include statistical signal processing, Internet of Things, data science, and machine learning.View more
Contact IEEE to Subscribe

References

References is not available for this document.