publications
Also see Google scholar and/or semantic scholar.
2025
-
Learning-based wide-angle optical design distortion optimization for improved monocular depth estimation Optical Engineering, 2025
-
ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusion In IEEE/CVF Winter Conference on Applications of Computer Vision, 2025 Project page / arXiv
-
DarSwin-Unet: Distortion Aware Encoder-Decoder Architecture In IEEE/CVF Winter Conference on Applications of Computer Vision, 2025 arXiv
2024
-
Artificial intelligence techniques for extrapolating hdr panoramas from ldr low fov images (Patent) 2024
-
Immersive representation for visualizing surface temperature and integrative lighting in architecture Building and Environment, 262, 2024 Project page
-
A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesis Computer Graphics Forum (Eurographics Symposium on Rendering), 43(4), 2024 Project page Code, interactive viewer, datasets available!
-
Reproducibility Study on Adversarial Attacks Against Robust Transformer Trackers Transactions on Machine Learning Research, 2024 Project page / arXiv Code available
-
Towards a Perceptual Evaluation Framework for Lighting Estimation In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024 Project page / arXiv Dataset and code available
-
Systems and Methods for Compositing a Virtual Object in a Background Image (Patent) 2024
-
Generating light-source-specific parameters for digital images using a neural network (Patent) 2024
-
A hypothetical comparative evaluation system for arctic indoors Frontiers of Architectural Research, 2024 Project page
2023
-
Extrapolating panoramas from images using a generative model (Patent) 2023
-
Shadow Harmonization for Realistic Compositing In ACM SIGGRAPH Asia, 2023 Project page Code available
-
EverLight: Indoor-Outdoor Editable HDR Lighting Estimation In IEEE/CVF International Conference on Computer Vision, 2023 Project page / arXiv
-
Beyond the Pixel: a Photometrically Calibrated HDR Dataset for Luminance and Color Temperature Prediction In IEEE/CVF International Conference on Computer Vision, 2023 Project page / arXiv Oral presentation! Dataset and code available
-
DarSwin: Distortion Aware Radial Swin Transformer In IEEE/CVF International Conference on Computer Vision, 2023 Project page / arXiv Code available
-
Lens Parameter Estimation for Realistic Depth of Field Modeling In IEEE/CVF International Conference on Computer Vision, 2023 Project page Demo available
-
Learning-based Model for Spot Size Estimation using Wide-angle Design Radial Distortion Optical Engineering, 62(6), 2023
-
Representing the photobiological dimension of light in northern architecture Indoor and Built Environment, 27(6), 2023 Project page
-
Exploring View Access for Biophilic Arctic Architecture through Immersive Visualization of Integrative Lighting Journal of Building Engineering, 69(15), 2023 Project page
-
LM-GAN: A Photorealistic All-Weather Parametric Sky Model arXiv preprint arXiv:2302.00087, 2023 arXiv
-
Robust Unsupervised StyleGAN Image Restoration In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023 Project page / arXiv Code available
-
The Differentiable Lens: Compound Lens Search over Glass Surfaces and Materials for Object Detection In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023 Project page / arXiv Code available
-
A Perceptual Measure for Deep Single Image Camera and Lens Calibration IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(9), 2023 Project page / arXiv Demo available
-
Systems and Methods for Rendering Virtual Objects using Editable Light-Source Parameter Estimation (Patent) 2023
-
Exploring light and colour patterns for remote biophilic northern architecture Indoor and Built Environment, 2023 Project page
2022
-
Dynamically Estimating Light-source-specific Parameters for Digital Images using a Neural Network (Patent) 2022
-
ManiFest: Manifold Deformation for Few-shot Image Translation In European Conference on Computer Vision, 2022 Project page Code available
-
Robust Scene Inference under Noise-Blur Dual Corruptions In International Conference on Computational Photography, 2022 Project page
-
Overparameterization Improves StyleGAN Inversion In CVPR AI for Content Creation Workshop, 2022 Project page Best (Remote) Poster Prize
-
Matching Feature Sets for Few-Shot Image Classification In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022 Project page Code available
-
Inferring the Solution Space of Microscope Objective Lenses using Deep Learning Optics Express, 30(5), 2022 Project page
-
Casual Indoor HDR Radiance Capture from Omnidirectional Images In British Machine Vision Conference, 2022 Project page / arXiv Spotlight presentation
-
AdaWCT: Adaptive Whitening and Coloring Style Injection arXiv preprint arXiv:2208.00921, 2022 Project page / arXiv
-
Guided Co-Modulated GAN for 360° Field of View Extrapolation In International Conference on 3D Vision, 2022 Project page Oral presentation, featured at Adobe Max Sneaks 2022!
2021
-
Learning from Estimated High-dynamic Range All Weather Lighting Parameters (Patent) 2021
-
Persistent Mixture Model Networks for Few-Shot Image Classification In IEEE/CVF International Conference on Computer Vision, 2021 Project page Code available
-
Evaluating the Impact of Wide-Angle Lens Distortion on Learning-based Depth Estimation In CVPR Workshop on Omnidirectional Computer Vision, 2021 Project page
-
Differentiable Compound Optics and Processing Pipeline Optimization for End-to-end Camera Design ACM Transactions on Graphics, 2021 Project page
-
Deep learning-enabled framework for automatic lens design starting point generation Optics Express, 29(3), 2021 Project page Demo available: link to LensNet
-
Rain Rendering for Evaluating and Improving Robustness to Bad Weather International Journal of Computer Vision, 129, 2021 Project page Code available!
-
Deep Template-based Object Instance Detection In IEEE Winter Conference on Applications of Computer Vision, 2021 Project page Code available
-
Single Day Outdoor Photometric Stereo IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(6), 2021 Project page
-
Method and System for Dynamically Estimating Light-Source Parameters from Multiple Images (Patent) 2021
-
Window View Access in Architecture: Spatial Visualization and Probability Evaluations Based on Human Vision Fields and Biophilia Buildings, 11(12), 2021
2020
-
Dynamically Estimating Lighting Parameters for Positions Within Augmented-reality Scenes based on Global and Local Features (Patent) 2020
-
RGB-D-E: Event Camera Calibration for Fast 6-DOF Object Tracking In International Symposium on Mixed and Augmented Reality, 2020 Project page Code and data available
-
Spatial representations of melanopic light in architecture Architectural Science Review, 2020 Project page
-
Associative Alignment for Few-shot Image Classification In European Conference on Computer Vision, 2020 Project page Spotlight presentation! Code available
-
Input Dropout for Spatially Aligned Modalities In IEEE International Conference on Image Processing, 2020 Project page / arXiv
-
Learning Physics-guided Face Relighting Under Directional Light In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020 Project page Oral presentation!
-
Biophilic, Photobiological And Energy-efficient Design Framework Of Adaptive Building Façades For Northern Canada Indoor and Built Environment, 2020 Project page
-
Deep SVBRDF Estimation on Real Materials In International Conference on 3D Vision, 2020 Project page Code and data available
2019
-
Deep Sky Modeling for Single Image Outdoor Lighting Estimation In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019 Project page Oral presentation!
-
Introducing a Dynamic Deep Neural Network to Infer Lens Design Starting Points In Current Developments in Lens Design and Optical Engineering XX, 2019
-
Deep Parametric Indoor Lighting Estimation In IEEE/CVF International Conference on Computer Vision, 2019 Project page
-
Physics-based Rain Rendering for Studying and Improving Robustness to Rain In IEEE/CVF International Conference on Computer Vision, 2019 Project page
-
Depth Texture Synthesis for High Resolution Reconstruction of Large Scenes Machine Vision and Applications, 30(4), 2019 Project page
-
Hyperparameter Optimization in Black-box Image Processing using Differentiable Proxies ACM Transactions on Graphics (SIGGRAPH), 38(4), 2019 Project page
-
A Photobiological Approach to Biophilic Design in Extreme Climates Building and Environment, 154, 2019 Project page
-
Fast Spatially-varying Indoor Lighting Estimation In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019 Project page Oral presentation!
-
All-weather Deep Outdoor Lighting Estimation In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019 Project page
-
Extrapolating from Lens Design Databases Using Deep Learning Optics Express, 27(20), 2019 Project page
2018
-
Systems and Methods for Estimating Sky Light Probes for Outdoor Images (Patent) 2018
-
Deep Learning for Augmented Reality In Workshop on Information Optics, 2018 Best paper award!
-
Toward Training a Deep Neural Network to Optimize Lens Designs In Frontiers in Optics, 2018
-
Learning to Estimate Indoor Lighting from 3D Objects In International Conference on 3D Vision, 2018 Project page
-
Domain Adaptation through Synthesis for Unsupervised Person Re-identification In European Conference on Computer Vision, 2018 arXiv
-
A Framework for Evaluating 6-DOF Object Trackers In European Conference on Computer Vision, 2018 Project page
-
A Perceptual Measure for Deep Single Image Camera Calibration In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018 Project page Demo available
-
From Faces to Outdoor Light Probes Computer Graphics Forum (Eurographics 2018), 37(2), 2018 Project page
-
A Perceptual Measure for Deep Single Image Camera Calibration In IEEE International Conference on Computational Photography, 2018 Project page
-
Deep Photovoltaic Nowcasting Solar Energy, 176, 2018 Project page Oral presentation at the 2018 Montreal AI Symposium
2017
-
Deep Uncertainty Interpretation in Dyadic Human Activity Prediction In IEEE International Conference on Machine Learning and Applications, 2017
-
Learning to Predict Indoor Illumination from a Single Image ACM Transactions on Graphics (SIGGRAPH Asia), 9(4), 2017 Project page Demo available
-
Learning High Dynamic Range from Outdoor Panoramas In IEEE/CVF International Conference on Computer Vision, 2017 Project page Oral presentation!
-
Deep 6-DOF Tracking IEEE Transactions on Visualization and Computer Graphics, 23(11), 2017 Project page Oral presentation at the 2018 Montreal AI Symposium
-
Deep Outdoor Illumination Estimation In IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2017 Project page Oral presentation, demo available!
-
Predicting a Light Probe from an Outdoor Image (Patent) 2017
2016
-
Real-time High Resolution 3D Data on the HoloLens In International Symposium on Mixed and Augmented Reality, 2016 Project page
-
x-hour Outdoor Photometric Stereo In International Conference on Computational Photography, 2016 Project page
-
Depth Texture Synthesis for Realistic Architectural Modeling In Computer and Robot Vision Conference (CRV), 2016 Project page
-
High Dynamic Range and Tone Mapping Imaging Techniques (Patent) 2016
2015
-
Oriented, Spatio-spectral Illumination Constraints for use in an Image Process (Patent) 2015
-
x-hour Outdoor Photometric Stereo In International Conference on 3D Vision, 2015 Project page Best paper award (runner up)!
-
Towards Characterizing the Behavior of Lidars in Snowy Conditions In IROS Workshop on Planning, Perception and Navigation for Intelligent Vehicles, 2015 Project page
-
What is a Good Day for Outdoor Photometric Stereo? In IEEE International Conference on Computational Photography, 2015 Project page
-
Contrast Use Metrics for Tone Mapping Images In IEEE International Conference on Computational Photography, 2015
-
The Perception of Lighting Inconsistencies in Composite Outdoor Scenes In ACM Symposium on Applied Perception, 2015
-
The Perception of Lighting Inconsistencies in Composite Outdoor Scenes ACM Transactions on Applied Perception, 12(4), 2015 Made it to the front page! Dataset available
-
HDR Image Noise Calibration for Denoising Tone Mapped Images In European Conference on Visual Media and Production (CVMP), 2015 Project page
2014
-
Lighting Estimation in Outdoor Image Collections In International Conference on 3D Vision, 2014 Project page
-
Spatially-varying Log-chromaticity Normals for use in an Image Process (Patent) 2014
-
Weighted Entropy Minimization for Optimizing a Log-chromaticity Normal for use in an Image Process (Patent) 2014
-
Log-chromaticity Clustering Pipeline for use in an Image Process (Patent) 2014
2012
-
Estimating the Natural Illumination Conditions from a Single Outdoor Image International Journal of Computer Vision, 98(2), 2012 Project page
2011
-
Estimating the Natural Illumination Conditions from a Single Outdoor Image In International Conference on Computational Photography, 2011
2010
-
Scale Selection for Geometric Fitting in Noisy Point Clouds International Journal of Computational Geometry & Applications, 20(5), 2010 Project page
-
Detecting Ground Shadows in Outdoor Consumer Photographs In European Conference on Computer Vision, 2010 Project page
-
Synthesizing Environment Maps from a Single Image Technical report CMU-RI-TR-10-24, Carnegie Mellon University, 2010 Project page
-
What do the Sun and the Sky Tell us about the Camera? International Journal of Computer Vision, 88(1), 2010 Project page
2009
-
Webcam Clip Art: Appearance and Illuminant Transfer from Time-lapse Sequences ACM Transactions on Graphics (SIGGRAPH Asia 2009), 28(5), 2009 Project page
-
Estimating Natural Illumination from a Single Outdoor Image In IEEE/CVF International Conference on Computer Vision, 2009 Project page Oral presentation!
2008
-
What Does the Sky Tell us about the Camera? In European Conference on Computer Vision (ECCV), 2008 Project page
2007
-
Data Structures for Efficient Dynamic Processing in 3D International Journal of Robotics Research, 26(8), 2007 Project page
-
Potential Negative Obstacle Detection by Occlusion Labeling In IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007
-
Using Color Compatibility for Assessing Image Realism In IEEE/CVF International Conference on Computer Vision, 2007 Project page
2006
-
Natural Terrain Classification using Three-dimensional Ladar Data for Ground Robot Mobility Journal of Field Robotics, 23(10), 2006
-
Mobile Robot Programming in Education In IEEE International Conference on Robotics and Automation (ICRA), 2006 Project page
-
Scale Selection for the Analysis of Point-sampled Curves In International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), 2006 Project page
2005
-
Scale Selection for Classification of Point-sampled 3D Surfaces In International Conference on 3D Digital Imaging and Modeling (3DIM), 2005 Project page
2004
-
Dual-resolution Stereoscopic Display with Scene-adaptive Fovea Boundaries In International Immersive Projection Technology Workshop, 2004 Project page