PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
February 26, 2026Atmosphere0 citationsOpen Access

Self-Supervised 3D Cloud Motion Inversion from Ground-Based Binocular All-Sky Images

View Full Paper
SJShan JiangCZChen ZhangXFXu Fu

Key Points

  • The research aims to improve cloud velocity field estimation using ground-based binocular all-sky images under complex sky conditions.
  • Developed a self-supervised feature detection model specific to cloud images.
  • Incorporated homography adaptation using physical priors for feature robustness.
  • Utilized a Transformer-based graph neural network for feature matching.
  • Calibrated fisheye cameras for deriving cloud base height.
  • Constructed 3D velocity inversion equations for motion estimation.
  • The new method extracts 4.5 times more feature points than the traditional SIFT method.
  • Achieved a Pearson correlation coefficient of 0.662 for cloud motion trends relative to baseline models.
  • Demonstrated high precision in estimating cloud velocities across different cloud types.

Abstract

Addressing the challenge of stable cloud velocity field estimation under complex sky conditions in ground-based cloud imaging, this paper proposes a comprehensive 3D cloud velocity calculation framework. The methodology integrates binocular stereo vision geometry, self-supervised deep feature learning, and graph attention-based matching. First, a self-supervised feature detection and description model tailored to the radiometric characteristics of cloud images is developed. By incorporating a homography adaptation strategy constrained by physical priors, the model acquires robust feature representations for weakly textured and highly deformable cloud masses without requiring labeled datasets. Subsequently, a Transformer-based graph neural network matcher is employed to establish global feature correspondences across both cross-view and cross-temporal dimensions, thereby substantially augmenting matching robustness. On this basis, the framework establishes a rigorous calibration model for fisheye cameras to derive cloud base height (CBH) via binocular geometry. These geometric constraints are then coupled with sequential feature tracking results to construct 3D velocity inversion equations, enabling an end-to-end mapping from 2D pixel coordinates to 3D physical space and providing direct estimation of physical cloud motion velocity in meters per second (m/s). The experimental results show that the proposed method extracts 4.5 times more feature points than the traditional SIFT method. Furthermore, the Pearson correlation coefficient for cloud motion trends in continuous sequences reaches 0.662 relative to baseline models, indicating good relative consistency in motion estimation. The framework achieves high-precision and stable velocity estimation across diverse cloud types, including cirrus, cumulus, stratus, and mixed clouds.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Jiang et al. (2026) studied this question.

synapsesocial.com/papers/699fe3f995ddcd3a253e8180https://doi.org/10.3390/atmos17030236
Ask AI
Helpful
Bookmark
Share
View Full Paper