Abstract Realistically inserting virtual 3D objects into real‐world images requires perceptually coherent shadowing of the object and background scene. Achieving this in single‐view indoor scenes with sunlight is challenging due to complex, partially visible occluders and indirect lighting. Environment maps alone cannot produce realistic shadows on virtual objects, and any representation (scene parameters) used for rendering must be practically estimable. We introduce ProjectiveShading, the first automatic method for inverse‐ and re‐rendering that handles bi‐directional shadow interactions for realistic object composition. Our key innovation is the sunlight map, a 2D image encoding direct sunlight and arbitrary occlusions. It is generated from single‐view estimations using off‐the‐shelf models and is compatible with standard rendering engines. We also propose algorithms to estimate sunlight direction and to blend virtual and real shadows while preserving background textures. Experiments on synthetic and in‐the‐wild images show our method outperforms previous approaches.
Building similarity graph...
Analyzing shared references across papers
Loading...
J. Luo†
X. Wu
Nanxuan Zhao
Computer Graphics Forum
University of Bath
Shandong University
Adobe Systems (United States)
Building similarity graph...
Analyzing shared references across papers
Loading...
Luo† et al. (Wed,) studied this question.
www.synapsesocial.com/papers/69d896566c1944d70ce07c05 — DOI: https://doi.org/10.1111/cgf.70320