PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
April 5, 20260 citationsOpen Access

Sensor array and camera fusion via unbalanced optimal transport for 3D source localization

IJIlyes JaouediGCGilles ChardonJPJosé Picheral

Key Points

  • The research aims to improve 3D localization of multiple sources by fusing sensor array and camera data.
  • Developed a fusion framework using covariance matrix fitting and unbalanced optimal transport.
  • Implemented a greedy coordinate descent algorithm for efficient transport plan updates.
  • Validated the framework on acoustic arrays while ensuring generalizability to other sensor types.
  • The approach significantly improved localization accuracy compared to using only sensor data.
  • Demonstrated computational efficiency, enabling practical application for full 3D localization.

Abstract

We address the problem of localizing multiple sources in 3D by combining sensor array measurements with camera observations. We propose a fusion framework extending the covariance matrix fitting method with an unbalanced optimal transport regularization term that softly aligns sensor array responses with visual priors while allowing flexibility in mass allocation. To solve the resulting largescale problem, we adopt a greedy coordinate descent algorithm that efficiently updates the transport plan. Its computational efficiency makes full 3D localization feasible in practice. The proposed framework is modular and does not rely on labeled data or training, in contrast with deep learning-based fusion approaches. Although validated here on acoustic arrays, the method is general to arbitrary sensor arrays. Experiments on real data show that the proposed approach improves localization accuracy compared to sensor-only baselines.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Jaouedi et al. (2026) studied this question.

synapsesocial.com/papers/69d1fb20a79560c99a0a17eehttps://doi.org/10.48550/arxiv.2603.29940
Ask AI
Helpful
Bookmark
Share
View Full Paper