OptiNeRF: A Spatially Optimized Neural Rendering Framework for Complex Scene Reconstruction

Neural rendering techniques aim to generate photorealistic images and accurate 3D geometries from multi-view images but often struggle with efficiency and geometric consistency in complex or dynamic scenes. Optimized Neural Radiance Fields (OptiNeRF) addresses these challenges through several innovations. It uses spatially optimized sampling to focus on points near object surfaces, reducing computation while improving precision. Leveraging the pre-trained Marigold model, it generates depth and normal maps as geometric priors. Sampled points are processed through a hybrid network combining an MLP and a multi-resolution feature grid (MRF), capturing fine details and large-scale structures. To handle varying illumination and complex materials, OptiNeRF introduces adaptive volume rendering (AVR), dynamically adjusting light transparency and scattering. A progressive sampling strategy further focuses computation on regions with high geometric complexity. The loss function incorporates RGB, normal, depth, boundary, and lighting optimization losses, with adaptive weight modulation for geometric priors, ensuring both visual fidelity and geometric consistency even with inaccurate depth/normal estimates. Experiments on dynamic scenes show strong performance, with a PSNR of 32.10 dB, SSIM of 0.936, Chamfer distance of 1.28×10−3, training time of 12 h, and rendering speed of 25 FPS, demonstrating high geometric accuracy, realistic rendering, and computational efficiency over conventional methods.