Self-Supervised Temporal Pattern Mining for coastal climate resilience planning for extreme data sparsity scenarios

说明与用途

构建了自监督管道，用于从稀疏的沿海气候数据中挖掘时间模式，重建缺失的物理信号并改进风暴潮预测。

问题

Coastal resilience projects in developing regions lack continuous in‑situ sensor data, leading to sparse, noisy time‑series that hinder supervised forecasting models.

结果

The self‑supervised pipeline learns meaningful climate signals from sparse, noisy data, enabling reconstruction of missing physics and improving forecasting for coastal resilience in data‑scarce regions.

工作流

• 1. Treat sparse time‑series as a partially observed dynamical system. 2. Use Contrastive Predictive Coding (CPC) with InfoNCE loss to learn representations that distinguish true future states from negative samples. 3. Adapt Masked Autoencoders (MAE) to spatiotemporal climate data by masking entire time steps. 4. Combine a Temporal Convolutional Network (TCN) for local feature extraction with a Transformer for long‑range dependencies. 5. Implement Time‑Aware Positional Encoding using a Gaussian kernel to handle irregular timestamps. 6. Simulate sparsity with block masking (contiguous months) to train the model on realistic gaps. 7. Train the Masked Temporal Autoencoder on satellite imagery and sparse buoy data. 8. Evaluate reconstruction quality and downstream forecasting performance.

证据

Traditional Recurrent Neural Networks (RNNs) and even Transformers struggle here. They tend to overfit to the noise or fail to converge due to the lack of continuous sequences.

来源

In my experimentation with CPC, I realized that the "InfoNCE" loss function is particularly powerful for sparse data.

来源

While learning about Vision Transformers, I observed that the MAE architecture (masking 75% of patches) could be adapted for spatiotemporal climate data.

来源

To train the self-supervised model, I artificially created sparsity. During my investigation of data augmentation for climate data, I found that block masking (masking contiguous months) was more effective than random masking for learning seasonal patterns.

来源