我们在场自动地从一个录像恢复景色几何学和照明的一个系统,为各种各样的应用提供一个基础。基于的照明评价方法要求的以前的图象在一个数据库形式的用户相互作用或外部信息。我们为起始的景色重建采用 structure-from-motion 和多看法立体声,然后估计环境球形的泛音代表的地图(同样这些比的更好表现另外的底) 。我们也表明编辑利用恢复几何学和照明的应用的几个录像,包括反对插入(例如,为扩充现实) ,阴影察觉,和录像 relighting。
We present a system that automatically recovers scene geometry and illumination from a video, providing a basis for various applications. Previous image based illumination estimation methods require either user interaction or external information in the form of a database. We adopt structure-from-motion and multi-view stereo for initial scene reconstruction, and then estimate an environment map represented by spherical harmonics (as these perform better than other bases). We also demonstrate several video editing applications that exploit the recovered geometry and illumination, including object insertion (e.g., for augmented reality), shadow detection, and video relighting.