WaveGNN: Modeling Irregular Multivariate Time Series for Accurate Predictions
Journal:
arXiv
Published Date:
Dec 14, 2024
Abstract
Accurately modeling and analyzing time series data is crucial for downstream
applications across various fields, including healthcare, finance, astronomy,
and epidemiology. However, real-world time series often exhibit irregularities
such as misaligned timestamps, missing entries, and variable sampling rates,
complicating their analysis. Existing approaches often rely on imputation,
which can introduce biases. A few approaches that directly model irregularity
tend to focus exclusively on either capturing intra-series patterns or
inter-series relationships, missing the benefits of integrating both. To this
end, we present WaveGNN, a novel framework designed to directly (i.e., no
imputation) embed irregularly sampled multivariate time series data for
accurate predictions. WaveGNN utilizes a Transformer-based encoder to capture
intra-series patterns by directly encoding the temporal dynamics of each time
series. To capture inter-series relationships, WaveGNN uses a dynamic graph
neural network model, where each node represents a sensor, and the edges
capture the long- and short-term relationships between them. Our experimental
results on real-world healthcare datasets demonstrate that WaveGNN consistently
outperforms existing state-of-the-art methods, with an average relative
improvement of 14.7% in F1-score when compared to the second-best baseline in
cases with extreme sparsity. Our ablation studies reveal that both intra-series
and inter-series modeling significantly contribute to this notable improvement.