Detection of Inflatable Boats and People in Thermal Infrared with Deep Learning Methods.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

Smuggling of drugs and cigarettes in small inflatable boats across border rivers is a serious threat to the EU's financial interests. Early detection of such threats is challenging due to difficult and changing environmental conditions. This study reports on the automatic detection of small inflatable boats and people in a rough wild terrain in the infrared thermal domain. Three acquisition campaigns were carried out during spring, summer, and fall under various weather conditions. Three deep learning algorithms, namely, YOLOv2, YOLOv3, and Faster R-CNN working with six different feature extraction neural networks were trained and evaluated in terms of performance and processing time. The best performance was achieved with Faster R-CNN with ResNet101, however, processing requires a long time and a powerful graphics processing unit.

Authors

  • Marcin Łukasz Kowalski
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Norbert Pałka
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Jarosław Młyńczak
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Mateusz Karol
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Elżbieta Czerwińska
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Marek Życzkowski
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Wiesław Ciurapiński
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Zbigniew Zawadzki
    Institute of Optoelectronics, Military University of Technology, 2 Gen. S. Kaliskiego St., 00-908 Warsaw, Poland.
  • Sebastian Brawata
    Vortex Sp. z o.o., 28/6. Grunwaldzka Ave., 80-229 Gdańsk, Poland.