Hyperlocal disaster damage assessment using bi-temporal street-view imagery and pre-trained vision models
Journal:
arXiv
Published Date:
Apr 12, 2025
Abstract
Street-view images offer unique advantages for disaster damage estimation as
they capture impacts from a visual perspective and provide detailed,
on-the-ground insights. Despite several investigations attempting to analyze
street-view images for damage estimation, they mainly focus on post-disaster
images. The potential of time-series street-view images remains underexplored.
Pre-disaster images provide valuable benchmarks for accurate damage estimations
at building and street levels. These images could aid annotators in objectively
labeling post-disaster impacts, improving the reliability of labeled data sets
for model training, and potentially enhancing the model performance in damage
evaluation. The goal of this study is to estimate hyperlocal, on-the-ground
disaster damages using bi-temporal street-view images and advanced pre-trained
vision models. Street-view images before and after 2024 Hurricane Milton in
Horseshoe Beach, Florida, were collected for experiments. The objectives are:
(1) to assess the performance gains of incorporating pre-disaster street-view
images as a no-damage category in fine-tuning pre-trained models, including
Swin Transformer and ConvNeXt, for damage level classification; (2) to design
and evaluate a dual-channel algorithm that reads pair-wise pre- and
post-disaster street-view images for hyperlocal damage assessment. The results
indicate that incorporating pre-disaster street-view images and employing a
dual-channel processing framework can significantly enhance damage assessment
accuracy. The accuracy improves from 66.14% with the Swin Transformer baseline
to 77.11% with the dual-channel Feature-Fusion ConvNeXt model. This research
enables rapid, operational damage assessments at hyperlocal spatial
resolutions, providing valuable insights to support effective decision-making
in disaster management and resilience planning.
