Smartphone region-wise image indoor localization using deep learning for indoor tourist attraction.

Journal: PloS one
PMID:

Abstract

Smart indoor tourist attractions, such as smart museums and aquariums, require a significant investment in indoor localization devices. The use of Global Positioning Systems on smartphones is unsuitable for scenarios where dense materials such as concrete and metal blocks weaken GPS signals, which is most often the case in indoor tourist attractions. With the help of deep learning, indoor localization can be done region by region using smartphone images. This approach requires no investment in infrastructure and reduces the cost and time needed to turn museums and aquariums into smart museums or smart aquariums. In this paper, we propose using deep learning algorithms to classify locations based on smartphone camera images for indoor tourist attractions. We evaluate our proposal in a real-world scenario in Brazil. We extensively collect images from ten different smartphones to classify biome-themed fish tanks in the Pantanal Biopark, creating a new dataset of 3654 images. We tested seven state-of-the-art neural networks, three of them based on transformers. On average, we achieved a precision of about 90% and a recall and f-score of about 89%. The results show that the proposal is suitable for most indoor tourist attractions.

Authors

  • Gabriel Toshio Hirokawa Higa
    Dom Bosco Catholic University, Campo Grande, MS, Brazil.
  • Rodrigo Stuqui Monzani
    Federal University of Mato Grosso do Sul, Campo Grande, MS, Brazil.
  • Jorge Fernando da Silva Cecatto
    Federal University of Mato Grosso do Sul, Campo Grande, MS, Brazil.
  • Maria Fernanda Balestieri Mariano de Souza
    Pantanal Biopark, Campo Grande, MS, Brazil.
  • Vanessa Aparecida de Moraes Weber
    State University of Mato Grosso do Sul, Campo Grande, MS, Brazil.
  • Hemerson Pistori
    Department of Biotechnology, INOVISAO, Dom Bosco Catholic University, Campo Grande, Mato Grosso do Sul, Brazil.
  • Edson Takashi Matsubara
    Faculty of Computer Science, Federal University of Mato Grosso do Sul, Campo Grande 79070-900, Brazil.