Introduction
There has been a massive introduction of UAV-based systems for remote sensing applications in the last decade [1], thanks to the improvements in technical features such as avionics and propulsion systems, capacity of batteries, autonomous navigation capabilities, and ease of sensor integration, together with a significant reduction in their cost. These achievements have fostered the use of UAVs in fields such as precision agriculture and forestry monitoring [2], [3], and in glaciology [4], where factors such as remoteness and severe weather conditions limit the extent of human-assisted measurement campaigns.
Small, lightweight UAVs (less than 3 kg) are being introduced for airborne Synthetic Aperture Radar (SAR)-based terrain observation, avoiding the need of large aircrafts (especially for monitoring small size areas). For example, in [5] a polarimetric radar mounted on a UAV for SAR imaging applications is described. Similar to other UAV-based SAR imaging systems [6], [7], it has a Global Navigation Satellite System (GNSS) receiver and an Inertial Measurement Unit (IMU) which provide in-flight guidance and positioning information. While range resolution is given by the radar bandwidth, ranging from few cm [6], [7] to 1–2 m [5], cross-range resolution is limited by measurement geo-referring uncertainty. In the case of conventional GNSS receivers, typical uncertainty ranges from 1 to 3 m.
UAVs have been also proved to be of great help for electromagnetic compatibility and antenna measurements [8], [9]. In this case, the use of positioning and geo-referring systems capable of providing cm-level accuracy enabled working at higher frequency bands, as long as the wavelength is larger than the positioning and geo-referring uncertainty [8], [9]. Finally, UAV-assisted applications in the area of communications, mainly devoted to improve connectivity in remote areas, are being developed [10], [11].
A. Landmine Detection: Systems and Methods
Detection of concealed objects in an opaque medium using Non-Destructive Testing (NDT) techniques has been of great interest in sectors such as mining and geology, civil engineering and civil works, and archaeology [12]. These NDT techniques allow to detect, locate, and, eventually, obtain an image of the concealed object, avoiding the interaction with both the object and the surrounding medium [13]. The main advantages are scanning time and cost savings, as invasive excavations in the area of interest to search for the objects are not required, also preventing accidental damaging. Among the aforementioned fields of application, there are some scenarios where the concealed objects are a threat in case of accidental contact, such as weapons or explosives. In these cases, detection and location have to be carried out under safe conditions for both the scanning device and the operators. One of the scenarios of interest is landmine detection. Landmines cause about 4000 deaths and injuries every year, 90 per cent corresponds to civilians, happening in those 60 countries where part of their territory is affected by the deployment of this kind of countermeasure. The number of landmines worldwide is estimated between 60 and 70 million. Only in 2016 the total global clearance of landmines was about 170 km2, with at least 232000 landmines destroyed [14].
Landmine detection methods can be classified in two main groups: invasive and non-invasive techniques. Invasive techniques are based on a contact device capable of detonating the mines [15]. The main disadvantage of these systems is their impact in the scanned area, as they plow the terrain while scanning, as well as their limited lifespan. The advantage is their fast scanning speed, up to 1 square meter per 0.73 seconds. On the other hand, non-invasive techniques allow to detect the presence of concealed objects thanks to an adequate processing of the received signals. These non-invasive techniques can be sorted according to the physical principle in which the detection method is based [16].
Electromagnetic induction: based on inducing an electric current in the concealed metallic objects using a transmitting coil. The induced current re-radiates an electric field which is detected by a receiving coil. The main advantage of this system is its low cost and simplicity. However, it suffers from a high false-alarm rate when several metallic objects are also in the scenario under test (shrapnel, bolts, etc.).
Nuclear Quadrupole Resonance (NQR): based on the detection of the radiofrequency signals emitted by certain substances that are likely to be in explosive materials. This technique has high probability of detection, but it involves the use of complex devices.
Thermal imaging: infrarred sensors are capable of detecting the different thermal behavior of landmines with respect to the surrounding medium. In particular, thermal image time series acquisition is proposed in [17], using thermal response analysis in the time domain to detect landmines. The main weakness of this methodology is the dependence with weather conditions that affect soil thermal conductivity, and thus the thermal contrast between soil and buried landmines.
Ground Penetrating Radar (GPR): it has been considered as one of the best techniques for underground imaging thanks to the capability of creating images of the soil and the objects buried in it [13]. In consequence, GPR has been widely used for landmine detection [18]–[21]. GPR is based on emitting electromagnetic waves to the soil, whose reflection at the soil and at potential concealed objects allows to recover a radar image where these concealed objects can be identified. It must be remarked that GPR is quite sensitive to the soil composition and the air-soil interface roughness, requiring additional signal processing techniques for image artifacts and clutter removal.
Regardless the operating principle, the application of non-invasive techniques for landmine detection requires the scanning system to be placed at a safety distance with respect to the potential placement of the landmine, typically 3–5 m, to avoid the accidental detonation of the landmine by the scanning device. To achieve this goal there are several possibilities:
Forward-looking radar systems, where the transmitting antenna illuminates the soil under an angle of incidence such as the injected power in the soil is maximized [22], [23]. In this case, due to the angle between the radar and the soil, only part of the reflected energy is backscattered towards the radar, thus requiring higher dynamic range in the receiver to detect the buried targets.
Downward-looking systems, where the incident wave direction is perpendicular to the soil surface [22], [24]. In this case, the fact that the transmitted power is not maximized is partially compensated thanks to the shorter distance between the radar and the soil; and also the backscattered power is directed towards the radar (although it also depends on the geometry of the buried target). In this kind of systems, the challenge is to achieve normal incidence while keeping the security distance of 3–5 m. One solution is based on small lightweight unmanned autonomous robots, capable of performing detection with a minimum landmine detonation risk [25], [26]. In these systems, transmitting and receiving antennas are placed in the air-soil interface at different positions separated half wavelength, so that the coherent combination of the received signal at each position results in a bi-dimensional radar image (in range or depth, and cross-range or movement direction of the robot). However, the main limitations are the slow scanning speed (around 5 cm per second) and the maximum weight of the entire robot to avoid accidental detonation.
An alternative to the use of terrestrial detection vehicles and their limitations in terms of scanning speed (and risk of detonation as they are in touch with the soil) is given by airborne devices. Among them, Unmanned Aerial Vehicles (UAVs) or commonly drones have been considered of great relevance in multiple fields thanks to their versatility and low cost.
B. Unmanned Aerial Systems for Landmine Detection
Improvements in UAV technology have made possible the development of UAV-assisted landmine detection systems, as they exhibit disruptive advantages such as: i) higher scanning speed compared to existing solutions in the market based on autonomous robots; ii) possibility of inspection of remote areas, unaccessible with other systems; and iii) higher safety throughout the scanning process, especially when looking for explosives, since contact with soil is avoided.
A prototype consisting of a metal detector onboard a UAV that also includes a robotic arm capable of placing a remotely controlled detonator to blow out the landmine is described in [27]. This system provides contactless (and thus safe) and fast scanning capabilities. However, metal detectors cannot distinguish between different kinds of metallic targets. Furthermore, non-metallic buried explosives cannot be detected.
Latest advances for landmine detection are based on placing a GPR on board a UAV [28]–[32]. The implemented prototypes are mostly based on a compact GPR unit that forwards geo-referred measurements to a ground station for post-processing and results displaying. Again, cross-range (horizontal) resolution is limited by positioning and geo-referring accuracy, mostly relying on GNSS receivers integrated within the UAV controller. In consequence, these state-of-the-art systems have been proved to be effective for detecting buried targets larger than 25–30 cm, and/or exhibiting significant contrast with the medium (e.g. metallic targets buried in clay or sand).
However, existing UAV-based GPR systems do not provide high resolution subsurface images as they do not support SAR imaging capabilities, that is, GPR measurements collected at each position of the flying path cannot be coherently combined. This is because positioning and geo-referring accuracy using GNSS-based techniques is in the order of 50–60 cm in the best case. Thus, enabling SAR imaging techniques (i.e. coherent combination of measurements) requires the use of cm- or mm- level accuracy geo-referring and positioning techniques.
C. Aim and Scope of This Contribution
Aiming to overcome the limitations in terms of detection capabilities of current UAV-based GPR imaging system, this contribution introduces a system and method for high accuracy underground SAR imaging, conceptually depicted in Fig. 1. The developed technology allows the UAV to autonomously explore a particular area using GNSS coordinates, while transmitting and receiving radio signals using a radar module. The collected data includes timestamps to enable synchronization and is sent in real time to a computer, where it is processed to generate SAR images of the subsurface with a resolution of centimetres. In addition, algorithms for proper characterization of the soil and clutter removal have been implemented.
The main innovation of this contribution is the capability of using SAR-based techniques for subsurface imaging with range and cross-range resolution of a few cm, overcoming the limitation of current UAV-based GPR systems where coherent combination of measurements taken at different positions (i.e. creating a synthetic aperture) is not possible.
Methodology
As opposed to conventional SAR imaging, where targets are above the ground, the main purpose of Underground-SAR [33], [34] is to reconstruct images of underground targets, taking into account the different wave velocity in the air and in the soil. Microwave imaging of the ground and the objects buried in it can be performed by means of SAR-based algorithms such as migration techniques [35], Delay-And-Sum (DAS) [36], or Wiener filter-based SAR [37], among others. In all these cases, soil wave velocity has to be properly estimated in order to provide a well-focused image and to reduce false alarms. From the knowledge of the soil constitutive parameters, namely conductivity and permittivity, soil wave velocity can be estimated.
Assuming a multiple quasi-monostatic configuration (i.e. the transmitting and receiving antennas are almost at the same location), the basic principle of underground SAR imaging is as follows: given a set of scattered field measurements collected on \begin{equation*} \rho (r') = \sum _{m=1}^{M} \sum _{n=1}^{N} E_{scatt}(r_{m},f_{n}) e^{+j 2 (\phi _{0} + \phi _{1}) } \tag{1}\end{equation*}
\begin{align*} \phi _{0}=&~k_{0,n} || r_{i} - r_{m} ||_{2} \tag{2}\\ \phi _{1}=&~k_{0,n} \sqrt {\varepsilon _{r}} ~|| r' - r_{i} ||_{2} \tag{3}\end{align*}
This simple Delay-And-Sum (DAS) formulation is based on a coherent combination of the measurements taken at different
With respect to conventional point-to-point SAR backpropagation, coherent combination of multiple measurements improves cross-range resolution. Free-space range \begin{align*} \Delta r=&~\frac {c}{2(f_{N}-f_{1})} \tag{4}\\ \Delta l=&~\frac {R\lambda _{c}}{2L_{ap}} \tag{5}\end{align*}
As mentioned before, soil characterization is required to get an estimate of \begin{equation*} \varepsilon _{r} = (d_{echo} / d_{target})^{2} \tag{6}\end{equation*}
If the soil permittivity cannot be estimated, it can be assumed
The strong clutter produced by the specular reflection from the ground surface (i.e. air-soil interface) is one of the main issues for accurate detection of buried objects using GPR imaging. Several clutter removal techniques have been proposed, such as time-gating [42], average substraction, and subspace projection methods [43].
In this contribution, time-gating and average subtraction techniques are used to improve the quality in the reconstructed SAR image. Both techniques are applied to the measurements in the distance domain (which is equivalent to the time domain, taking into account the relationship between the two-way distance and the time \begin{equation*} \widetilde {E}_{scatt}(r_{m}, r) = E_{scatt}(r_{m}, r) - \frac {1}{M}\sum _{m=1}^{M} E_{scatt}(r_{m},r) \tag{7}\end{equation*}
A flowchart of the methodology is shown in Fig. 3, where it has been assumed that the radar signal is acquired in the time domain (as in the presented prototype). First, time gating is applied to each measurement. Then, once all the measurements have been acquired, their average is computed and subtracted from each measurement. It must be noticed that the average is also a time domain signal. Finally, the Fourier Transform is applied before performing the underground SAR (U-SAR) processing.
UAV-Based Underground SAR Imaging System Implementation
The proposed airborne-based GPR imaging system for detection of buried objects is composed by the following devices, represented in Fig. 4 scheme (grouped by subsystems):
Flight control subsystem, which consists of a micro-computer (Raspberry Pi), a UAV flight controller and common positioning sensors (IMU, barometer, GNSS).
Communication subsystem.
Accurate positioning subsystem to provide cm-level accuracy. It includes a Real Time Kinematic (RTK) system and a LIDAR (Light Detection And Ranging) altimeter. There are two RTK beacons: one on the UAV and another on the ground at a fixed position.
Radar subsystem.
A ground station (e.g. a laptop), which receives radar measurements and positioning and geo-referring information, and processes it to map radar measurements with centimeter-level accuracy. Geo-referred measurements are processed together with the underground SAR imaging algorithm to create radar images of the soil and objects buried in it.
Scheme describing the implementation of the airborne-based GPR. Description of the connection between different subsystems and devices of the prototypes.
A UAV model with a payload up to 5 kg has been acquired [44] to have enough capacity for further improvements of the prototype with additional sensors or devices. This UAV provides around 15 min flight with a 2–3 kg payload, which is enough for initial validation flight tests.
A lightweight, compact impulse radar working in the 3.1 to 5.1 GHz frequency band [45] has been selected, aiming to obtain a trade-off between range resolution (
Communication between UAV, RTK beacons, and the ground station is managed through a Wireless Local Area Network (WLAN), deploying a wireless router close to the area to be scanned to provide coverage to the ground station, the UAV, and the RTK ground beacon. WLAN operating frequency can be set to 2.4 GHz or 5.8 GHz as those frequencies do not interfere with the radar frequency band. In any case, radar antennas are directive and always pointing towards the ground so, even in the case of sharing the same frequency band, co-channel interference would be negligible. Also, aiming to minimize interference, UAV transmitter and receiver modules are set to work at 433 MHz.
Concerning UAV positioning and geo-referring system, RTK [46] has been selected as it provides cm-level accuracy and ease of deployment and integration within the UAV controller. RTK ground beacon forwards the corrections that must be applied to the GNSS signal to the RTK beacon placed in the UAV (rover beacon) in real time. The latter uses these corrections to improve the position accuracy down to cm-level.
RTK positioning uncertainty indicated by the manufacturer [46] is
As the positioning uncertainty is twice in the vertical axis, a more accurate height measurement sensor is required. Among different possibilities, a LIDAR altimeter [47] has been chosen, as it is more robust and accurate than an ultrasound sensor of similar size and cost. The selected LIDAR altimeter has
A picture of the UAV with all the devices and modules integrated (ready-for-operation configuration) is shown in Fig. 5. In-flight operation mode of the system can be watched at
System Validation
For a proper validation of the airborne-based GPR system, validation and testing has been divided into several stages:
Validation in a controlled environment of the radar module [45]: measurements have been conducted using a planar measurement range [48]. Different kinds of soils (sand, loam, mixed) have been evaluated aiming to determine the capability of recovering constitutive parameters of the medium as well as testing the performance of the radar for detecting buried objects. Methodology and results have been presented in [34].
On-ground validation: once the radar module has been tested in a controlled environment, validation in a realistic scenario has been carried out. In this stage, the main goal is to evaluate the capability of the system to create underground SAR images using geo-referring information provided by the positioning systems onboard the UAV.
In-flight tests: last step is the integration of the payload (namely the radar module and some of the sensors of the positioning subsystem) into the UAV. An extensive validation campaign for different scenarios has been conducted to ensure proper functionality of the implemented system.
For this first prototype of airborne-based GPR the selected frequency band (3.1 – 5.1 GHz) limits its range of application to low loss soils. Thus, the results presented in this contribution will be devoted to sandy soils, with permittivity (
A. On-Ground Testing
For the validation of the radar module in a realistic scenario (sandy beach, coordinates 43.533, −5.383), a homemade portable linear scanner has been used. The radar module [45] and the helix antennas are mounted on a portable platform that can be manually displaced along two parallel plastic bars placed 50 cm above ground and parallel to it. Measurements were taken along 1 m distance, geo-referring them by means of the RTK system. The RTK rover beacon was placed on the portable platform, and the RTK ground beacon around 20 m away. Measurements and RTK coordinates were sent to the ground station using a wireless link. A general overview of the setup is depicted in Fig. 6.
Setup for on-ground validation and testing of the GPR. RTK is used for geo-referring the measurements.
To test the detection capability of the radar, a metallic disc (of 9 cm radius and 1 cm thickness) was buried at
Underground SAR imaging of a buried metallic target. (a) Picture of the metallic disc buried
First, imaging results were obtained by just representing the envelope of the collected measurements (obtained using the Hilbert transform). This will be called point-to-point backpropagation, since the measurements are not combined to improve the resolution of the image. Imaging results are shown in Fig. 7 (c) and (d), without performing average subtraction and performing it. In both cases, a buried target is observed, although its depth and size do not match the true ones. As expected, the average subtraction helps to improve the quality of the imaging results. Next, measurements were processed with the underground SAR imaging algorithm and assuming
Underground SAR imaging results considering
B. In-Flight Tests and Results
Once the payload was properly tested, it was mounted onboard the UAV for in-flight tests. Positioning subsystem then comprises RTK [46], LIDAR altimeter [47], and default UAV positioning systems (inertial sensors, barometer, and standard GNSS receiver). Combination of the positioning information provided by these sensors resulted in an accuracy better than 1.5 cm in x, y, and z axes.
Radar measurements are provided at a rate of 50 samples/s, whereas positioning information is obtained at a rate of 10 Hz. This value determines the fastest scanning speed of the UAV, which for the flight test presented in this section is kept below 30 cm/s (1.1 km/h). At that speed, UAV position information is updated, on average, every time the UAV moves 3 cm in the horizontal plane (that is
UAV can be operated manually (GNSS-assisted flight mode), where the operator controls UAV yaw, pitch, and roll axes. Another possible operation mode is based on waypoints: a flight path covering the area to be scanned is created, then uploaded into the UAV controller, so the UAV operator is just in charge of take off and landing operations. For the sake of simplicity, in-flight tests presented in this contribution were done in manual operation mode. Besides, in the case of straight line flight paths, no significant differences in the flight path were found between manual and waypoint-based flight operation.
In-flight tests were done at the airfield for UAVs of the University of Oviedo, located at (43.522, −5.624). Before taking off, it was verified that all the systems and subsystems worked properly. This verification was performed again after taking off. Measurement acquisition starts when taking off and finishes when landing. Furthermore, the acquisition can be remotely controlled from the ground station. To verify the capability of the system for in-flight SAR imaging (as done in [5], [6]), a 1-m long and 6 cm wide metallic bar was placed on the ground, perpendicular to the UAV flight path, as depicted in Fig. 8 (a). Several forward and backward flights following a straight path have been done, keeping a flight altitude of approximately 75 cm above ground (not too low to avoid turbulences due to the ground effect).
(a) Picture of the prototype at the airfield and the metallic bar on the ground. (b) Imaging results applying point-to-point backpropagation. (c) Imaging results applying SAR (coherent combination of the measurements).
First, point-to-point backpropagation results are depicted in Fig. 8 (b), where it can be observed that the air - ground interface is fairly noticeable: again, the roughness of the ground and the grass create non-specular reflections. The metallic bar is clearly visible as it exhibits higher reflectivity than the ground, apart from the fact that the flat face of the metallic bar is parallel to the UAV flight path. The width of the metallic bar observed in Fig. 8 (b) clearly exceeds the true 6 cm width. Next, SAR imaging is applied to process the measurements, combining them coherently according to the coordinates provided by the positioning subsystem. Results depicted in Fig. 8 (c) show that, when applying SAR imaging techniques, the detected metallic plate is narrower, in agreement with the true width of 6 cm, proving the feasibility of performing SAR imaging with the implemented airborne-based radar system.
Assuming that cumulative geo-referring uncertainty still allows coherent combination of measurements along
Next, the airborne GPR system was tested for detecting buried objects. A 78 cm
Measurement setup for evaluating detection capabilities of targets buried in sand. (a) Sandbox filled with sand and canvas supporting frame. (b) Sandbox covered with the canvas.
The first in-flight test for buried objects detection was devoted to evaluate the capability of detecting the
Metallic disk buried 12 cm deep in the sandbox. (a) Picture of the target. (b) Imaging results applying point-to-point backpropagation. (c)-(e) Imaging results applying underground SAR: (c) considering
Underground SAR imaging improvement over point-to-point backpropagation results is more noticeable in this example (Fig. 10) than in Section IV-A (Fig. 7). The reasons are: i) in Section IV-A, the radar was moved manually in the horizontal plane, keeping constant the height. Thus, positioning and geo-referring uncertainty are smaller than UAV-based measurements. ii) A sandbox is used for in-flight tests, that is, a finite domain. The fact of using a finite domain introduces reflections and echoes that eventually degrade the quality of the point-to-point backpropagation results in the case of complex geometry scenarios.
SAR imaging also provides a substantial improvement over metal detector-based techniques [27], as non-metallic objects can be detected as well. To prove this feature, a plastic (foam) disk having the same radius as the metallic one, Fig. 11 (a), has been buried 10 cm deep. SAR image from coherent combination of the geo-referred GPR measurements collected during an overflight, considering
Plastic disk buried 10 cm deep in the sandbox. (a) Picture of the target. Imaging results applying underground SAR, removing the average of the measurements. First overflight results: (b) considering
A synthetic aperture of
In order to verify repeatability and reproducibility, SAR imaging result corresponding to measurements taken in another overflight over the sandbox is shown in Fig. 11 (d). The main features observed in Fig. 11 (b) are present, thus confirming that even manual flight operation mode is capable of providing highly-accurate SAR images along the vertical plane containing the flight path.
When the estimated permittivity of the sand (
Last result presented in this contribution is devoted to prove the capability of the airborne-based GPR to detect two buried objects. For this experiment, a cylindrical metallic bar (of 2.5 cm radius) was buried 12 cm deep in one side of the sandbox (perpendicular to the UAV flight path), and a plastic box (with 8.5 cm
SAR imaging of two objects (a plastic box and a metallic bar) buried in the sanbox. (a) Imaging results applying point-to-point backpropagation. (b)-(c) Imaging results appyling SAR, removing the average of the measurements: (b) considering
Conclusions
A UAV-based underground SAR imaging system for the detection of buried objects has been presented. It aims primarily at detecting explosives such as antipersonnel landmines, but it can also be used for any other application where detection and identification of hidden objects is necessary. Results presented in this contribution have proved: i) that the radar range and cross-range resolution are
The prototype and developed algorithms could be of interest in sectors where the detection of buried objects is essential, as the aforementioned detection of landmines, pipeline inspection, or archaeology work. The system can also be used in the detection of infrastructure defects, walls, roofs and road inspection. The added value, when compared with similar systems for non-destructive testing, comes from the fact that the GPR is mounted on a UAV, which prevents physical contact with the ground during scanning. With respect to similar airborne GPR prototypes, this system is capable of creating SAR images with a few cm resolution, enabling detection of small metallic and dielectric objects buried in the ground. The system has been licensed under the patent [49].
ACKNOWLEDGMENT
This work has been developed under the framework of the Universidad de Oviedo postdoctoral degree Expert in Remotely Piloted and Autonomous Flight Aircrafts. A. Arboleya was with the Universidad de Oviedo when the measurement campaign was done.
The authors would like to thank Mr. Salvador Ballesteros Duque for his help concerning drone flight tests, as well as Mr. Guillermo Álvarez Narciandi, Mr. Marcos González Díaz, Prof. Samuel Ver-Hoeye, and Mrs. Janet Pagnozzi for their help with the setup of the sandbox in the airfield.