SatFusion: A Unified Framework for Enhancing Satellite IoT Images via Multi-Temporal and Multi-Source Data Fusion
2510.07905v1
eess.IV, cs.CV, cs.MM
2025-10-11
Авторы:
Yufei Tong, Guanjie Cheng, Peihan Wu, Yicheng Zhu, Kexu Lu, Feiyi Chen, Meng Xi, Junqin Huang, Shuiguang Deng
Abstract
With the rapid advancement of the digital society, the proliferation of
satellites in the Satellite Internet of Things (Sat-IoT) has led to the
continuous accumulation of large-scale multi-temporal and multi-source images
across diverse application scenarios. However, existing methods fail to fully
exploit the complementary information embedded in both temporal and source
dimensions. For example, Multi-Image Super-Resolution (MISR) enhances
reconstruction quality by leveraging temporal complementarity across multiple
observations, yet the limited fine-grained texture details in input images
constrain its performance. Conversely, pansharpening integrates multi-source
images by injecting high-frequency spatial information from panchromatic data,
but typically relies on pre-interpolated low-resolution inputs and assumes
noise-free alignment, making it highly sensitive to noise and misregistration.
To address these issues, we propose SatFusion: A Unified Framework for
Enhancing Satellite IoT Images via Multi-Temporal and Multi-Source Data Fusion.
Specifically, SatFusion first employs a Multi-Temporal Image Fusion (MTIF)
module to achieve deep feature alignment with the panchromatic image. Then, a
Multi-Source Image Fusion (MSIF) module injects fine-grained texture
information from the panchromatic data. Finally, a Fusion Composition module
adaptively integrates the complementary advantages of both modalities while
dynamically refining spectral consistency, supervised by a weighted combination
of multiple loss functions. Extensive experiments on the WorldStrat, WV3, QB,
and GF2 datasets demonstrate that SatFusion significantly improves fusion
quality, robustness under challenging conditions, and generalizability to
real-world Sat-IoT scenarios. The code is available at:
https://github.com/dllgyufei/SatFusion.git.
Ссылки и действия
Дополнительные ресурсы: