CVSL Logo
FrancaisHome
AboutPeopleResearchPublicationsEventsProfile
About
Publications

 

 

 

CERVIM

REPARTI

MIVIM

Learning to Predict Indoor Illumination from a Single Image


Marc-André Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Christian Gagné and Jean-François Lalonde

More on this project...

Abstract - In this work, we propose a method to infer high dynamic range illumination from a single, limited field-of-view, low dynamic range photograph of an indoor scene. Inferring scene illumination from a single photograph is a challenging problem. The pixel intensities observed in a photograph are a complex function of scene geometry, reflectance properties, and illumination. We introduce an end-to-end solution to this problem and propose a deep neural network that takes the limited field-of-view photo as input and produces an environment map as a panorama and a light mask prediction over the panorama as the output. Our technique does not require special image capture or user input. We preprocess standard low dynamic range panoramas by introducing novel light source detection and warping methods on the panorama, and use the results with corresponding limited field-of-view crops as training data. Our method does not rely on any assumptions on scene appearance, geometry, material properties, or lighting. This allows us to automatically recover high-quality illumination estimates that significantly outperform previous state-of-the-art methods. Consequently, using our illumination estimates for applications like 3D object insertion lead to results that are photo-realistic, which we demonstrate over a large set of examples and via a user study.

download documentdownload document

Bibtex:

@article{Gardner1156,
    author    = { Marc-André Gardner and Kalyan Sunkavalli and Ersin Yumer and Xiaohui Shen and Emiliano Gambaretto and Christian Gagné and Jean-François Lalonde },
    title     = { Learning to Predict Indoor Illumination from a Single Image },
    volume    = { 9 },
    number    = { 4 },
    year      = { 2017 },
    month     = { 11 },
    journal   = { ACM Transactions on Graphics (SIGGRAPH Asia) },
    web       = { http://vision.gel.ulaval.ca/~jflalonde/projects/deepIndoorLight/index.html }
}

Last modification: 2017/04/03 by cgagne

     
   
   

©2002-. Computer Vision and Systems Laboratory. All rights reserved