Pixel-level image classification for detecting beach litter using a deep learning approach.

Journal: Marine pollution bulletin
PMID:

Abstract

Mitigating and preventing beach litter from entering the ocean is urgently required. Monitoring beach litter solely through human effort is cumbersome, with respect to both time and cost. To address this problem, an artificial intelligence technique that can automatically identify different-sized beach litter is proposed. The technique was established by training a deep learning model that enables pixel-wise classification (semantic segmentation) using beach images taken by an observer on the beach. Eight segmentation classes that include two beach litter classes were defined, and the results were qualitatively and quantitatively verified. Segmentation performance was adequately high based on three metrics: Intersection over Union (IoU), precision, and recall, although there is room for further improvement. The potency of the method was demonstrated when it was applied to images taken in different places from training data images, and the coverage of artificial litter calculated and discussed using drone images provided ground truth.

Authors

  • Mitsuko Hidaka
    Research Institute for Value-Added-Information Generation (VAiG), Japan Agency for Marine-Earth Science and Technology (JAMSTEC), 3173-25 Showa-machi, Kanazawa-ku, Yokohama, Kanagawa 236-0001, Japan. Electronic address: mitsukou@jamstec.go.jp.
  • Daisuke Matsuoka
    Research Institute for Value-Added-Information Generation (VAiG), Japan Agency for Marine-Earth Science and Technology (JAMSTEC), 3173-25 Showa-machi, Kanazawa-ku, Yokohama, Kanagawa 236-0001, Japan. Electronic address: daisuke@jamstec.go.jp.
  • Daisuke Sugiyama
    Research Institute for Value-Added-Information Generation (VAiG), Japan Agency for Marine-Earth Science and Technology (JAMSTEC), 3173-25 Showa-machi, Kanazawa-ku, Yokohama, Kanagawa 236-0001, Japan. Electronic address: sugiyamad@jamstec.go.jp.
  • Koshiro Murakami
    Research Institute for Value-Added-Information Generation (VAiG), Japan Agency for Marine-Earth Science and Technology (JAMSTEC), 3173-25 Showa-machi, Kanazawa-ku, Yokohama, Kanagawa 236-0001, Japan.
  • Shin'ichiro Kako
    Ocean Civil Engineering Program, Department of Engineering, Graduate School of Science and Engineering, Kagoshima University, 1-21-40 Korimoto, kagoshima-city, Kagoshima 890-0065, Japan. Electronic address: kako@oce.kagoshima-u.ac.jp.