AGCNeRF: Air–Ground Collaborative Visual Mapping and Navigation via Landmark-Enhanced Neural Radiance Fields

Unmanned vehicles are becoming increasingly essential in executing high-risk missions in unknown environments such as search and rescue. As the complexity of operational environments escalates, carrying out unmanned tasks becomes cumbersome or even infeasible for a single vehicle, hampered by limited perception and operational constraints. Aiming at enhancing the flexibility of unmanned operations under complicated scenarios, this study introduces AGC-NeRF, an innovative air–ground collaborative exploration framework that harnesses the functional complementarity of UAVs and UGVs—enabling a UGV to navigate through a complex scenario with the assistance of a UAV via referencing a neural radiance map. First, a UAV is employed to collect aerial images for reconstructing the environment to be explored by a UGV, leveraging its aerial perspective to achieve wide-area coverage and global environmental perception that is unattainable for a single UGV. Concurrently, an innovative image saliency evaluation approach is introduced to meticulously select landmarks that are contributive to the UGV’s navigation system, yielding a pre-trained NeRF model of the operation scene. Then, a landmark-aware 6-DOF ego-motion estimator and collision-free trajectory optimizer are designed for the UGV based on the NeRF map. Finally, an online replanning architecture is established which relies on a ground station for NeRF training and state optimization by synergizing the trajectory planner and the state estimator, which forms a dual-agent vision-only navigation pipeline. Simulations and experiments validate that AGC-NeRF enables reliable UGV trajectory planning and state estimation in unknown environments, demonstrating superior efficacy and robustness of the air–ground collaborative paradigm.