Physically-Based Rendering

Publications

Rendering Iridescent Rock Dove Neck Feathers

Weizhen Huang, Sebastian Merzbach, Clara Callenberg, Doekele G. Stavenga, Matthias B. Hullin
In Proceedings of SIGGRAPH 2022 (Conference Papers), 2022.

A practical appearance model for iridescent feathers.

A Microfacet-based Hair Scattering Model

Weizhen Huang, Matthias B. Hullin, Johannes Hanika
Computer Graphics Forum 41 (4) (Proc. EGSR 2022), 2022.

The first fiber scattering model based on physically plausible macro-, meso-, and microgeometry.

Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion

Clara Callenberg, Ashley Lyons, Dennis den Brok, Areeba Fatima, Alejandro Turpin, Vytautas Zickus, Laura M. Machesky, Jamie A. Whitelaw, Daniele Faccio, Matthias B. Hullin
Scientific Reports (Nature Publishing Group) 11, 1689 (2021), https://doi.org/10.1038/s41598-021-81159-x, 2021. Super-Resolution Time-Resolved Imaging Using Computational Sensor Fusion

Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging

Clara Callenberg, Zheng Shi, Felix Heide, Matthias B. Hullin
ACM Transactions on Graphics 40 (4), Article 61 (Proc. SIGGRAPH 2021), 2021. Low-Cost SPAD Sensing for Non-Line-Of-Sight Tracking, Material Classification and Depth Imaging

Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

Julian Iseringhausen, Matthias B. Hullin
ACM Transactions on Graphics 39 (1), 2020. Non-Line-of-Sight Reconstruction using Efficient Transient Rendering

In this paper, we present an efficient renderer for three-bounce indirect transient light transport, and use it to reconstruct objects around corners to unprecedented accuracy.

Computational Parquetry: Fabricated Style Transfer with Wood Pixels

Julian Iseringhausen, Michael Weinmann, Weizhen Huang, Matthias B. Hullin
ACM Transactions on Graphics 39 (2), 2020. Computational Parquetry: Fabricated Style Transfer with Wood Pixels

A new computational woodworking technique enabled by analysis of features found in natural materials.

Deep Non-Line-of-Sight Reconstruction

Javier Grau Chopite, Matthias B. Hullin, Michael Wand, Julian Iseringhausen
Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020. Deep Non-Line-of-Sight Reconstruction

The first deep-learning framework for reconstructing object shapes around a corner.

Chemomechanical Simulation of Soap Film Flow on Spherical Bubbles

Weizhen Huang, Julian Iseringhausen, Tom Kneiphof, Ziyin Qu, Chenfanfu Jiang, Matthias B. Hullin
ACM Transactions on Graphics 39 (4) (Proc. SIGGRAPH), 2020. Chemomechanical Simulation of Soap Film Flow on Spherical Bubbles

A framework for simulating the intricate flow within spherical soap films.

Trigonometric moments for editable structured light range finding

Sebastian Werner, Julian Iseringhausen, Clara Callenberg, Matthias B. Hullin
Proc. Vision, Modeling and Visualization, Rostock, Germany , 2019. Trigonometric moments for editable structured light range finding

We enhance existing structured light phase shifting methods by using trigonometric moments.

Real-Time Rendering of Wave-Optical Effects on Scratched Surfaces

Zdravko Velinov*, Sebastian Werner*, Matthias B. Hullin (* joint first authors)
Computer Graphics Forum 37 (2) (Proc. EUROGRAPHICS), 2018. Real-Time Rendering of Wave-Optical Effects on Scratched Surfaces

In this paper, we develop closed-form solutions for illuminating our iridescent scratch model with spherical and polygonal area light sources, bringing this effect within reach of real-time applications for the first time.

Neural network identification of people hidden from view with a single-pixel, single-photon detector

Piergiorgio Caramazza, Alessandro Boccolini, Daniel Buschek, Matthias Hullin, Catherine F. Higham, Robert Henderson, Roderick Murray-Smith, Daniele Faccio
Scientific Reports (Nature Publishing Group), 8, 11945; doi: 10.1038/s41598-018-30390-0, 2018. Neural network identification of people hidden from view with a single-pixel, single-photon detector

We demonstrate a machine learning approach that can locate and identify people from time-resolved single-pixel measurements.

A Quantitative Platform for Non-Line-of-Sight Imaging Problems

Jonathan Klein, Martin Laurenzis, Dominik L. Michels, Matthias B. Hullin
In Proceedings of British Machine Vision Conference (BMVC 2018), Northumbria University, Newcastle, UK, September 3-6, 2018, 2018. A Quantitative Platform for Non-Line-of-Sight Imaging Problems

In this paper, we present a reference database of time-resolved light echoes for non-line-of-sight sensing.

4D Imaging through Spray-On Optics

Julian Iseringhausen, Bastian Goldlücke, Nina Pesheva, Stanimir Iliev, Alexander Wender, Martin Fuchs, Matthias B. Hullin
ACM Transactions on Graphics 36(4) (Proc. SIGGRAPH), 35:1--35:11, 2017. 4D Imaging through Spray-On Optics

Raindrops on a window heavily distort the view of the scene. We show that a fully calibrated 4D light field can be recovered from a single photograph taken under such adverse conditions.

Digital Transmission of Subjective Material Appearance

Rodrigo Martín, Michael Weinmann, Matthias B. Hullin
Proc. WSCG, 2017. Digital Transmission of Subjective Material Appearance

How well do various digital appearance representations perform at communicating the "touch and feel" of materials?

Snapshot Difference Imaging using Correlation Time-of-Flight Sensors

Clara Callenberg, Felix Heide, Gordon Wetzstein, Matthias Hullin
ACM Transactions on Graphics 36(6) (Proc. SIGGRAPH Asia), 220:1--220:10, 2017. Snapshot Difference Imaging using Correlation Time-of-Flight Sensors

Computation of image differences is a key operation in computational imaging. We use time-of-flight sensors to perform this operation in a single shot, and discover some remarkable features.

Scratch Iridescence: Wave-Optical Rendering of Diffractive Surface Structure

Sebastian Werner*, Zdravko Velinov*, Wenzel Jakob, Matthias B. Hullin (* joint first authors)
ACM Transactions on Graphics 36(6) (Proc. SIGGRAPH Asia), 207:1--207:14, 2017. Scratch Iridescence: Wave-Optical Rendering of Diffractive Surface Structure

Many real-world surfaces are covered in fine scratches that diffract light in colorful ways. Our model seamlessly transitions between ray optics and wave optics to recreate this intricate effect.

Machine Learning Assisted Identification of People Hidden Behind a Corner

Piergiorgio Caramazza, Alessandro Boccolini, Gabriella Musarra, Matthias Hullin, Roderick Murray-Smith, Daniele Faccio
Computational Optical Sensing and Imaging, 2017.

We demonstrate the use of machine learning to classify temporal histograms of the light-echoes backscattered from bodies hidden from view around a corner, captured by a SPAD camera.

Material Classification using Raw Time-of-Flight Measurements

Shuochen Su, Felix Heide, Robin Swanson, Jonathan Klein, Clara Callenberg, Matthias B. Hullin, Wolfgang Heidrich
Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. Material Classification using Raw Time-of-Flight Measurements

We show that using multi-frequency time-of-flight measurements, five different white materials can be distinguished on a per-pixel basis.

Tracking Objects Outside the Line of Sight using 2D Intensity Images

Jonathan Klein, Christoph Peters, Jaime Martín, Martin Laurenzis, Matthias B. Hullin
Scientific Reports (Nature Publishing Group), 6, 32491; doi: 10.1038/srep32491, 2016. Tracking Objects Outside the Line of Sight using 2D Intensity Images

We demonstrate the tracking of objects outside the line of sight from 3rd-order indirect diffuse reflections, captured using a regular laser pointer and a 2D camera.

An Interactive Appearance Model for Microscopic Fiber Surfaces

Zdravko Velinov and Matthias Hullin
Proc. Vision, Modeling and Visualization, Bayreuth, Germany, 2016. An Interactive Appearance Model for Microscopic Fiber Surfaces

A reflectance model for pile fabrics that you can "draw on" using your fingers, like velvet or Alcantara.

Doppler Time-of-Flight Imaging

Felix Heide, Wolfgang Heidrich, Matthias B. Hullin, Gordon Wetzstein
ACM Transactions on Graphics (Proc. SIGGRAPH), 34 (4), 2015. Doppler Time-of-Flight Imaging

A new computational imaging system that captures metric radial velocity information per pixel -- think of a huge array of traffic speed guns that use light instead of radar.

Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination using Inexpensive Time-of-Flight Sensors

Felix Heide, Lei Xiao, Wolfgang Heidrich and Matthias B. Hullin
Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination using Inexpensive Time-of-Flight Sensors

How to look around a corner using echoes of light, using low-end devices that can't even properly measure such data.

Low-Budget Transient Imaging using Photonic Mixer Devices

Felix Heide*, Matthias B. Hullin*, James Gregson, Wolfgang Heidrich (* joint first authors)
ACM Transactions on Graphics (Proc. SIGGRAPH), 32 (4), 2013. Low-Budget Transient Imaging using Photonic Mixer Devices

A computational method for capturing videos of light in flight using consumer-grade imaging hardware.

Dynamic Display of BRDFs

Matthias B. Hullin, Hendrik P. A. Lensch, Ramesh Raskar, Hans-Peter Seidel, Ivo Ihrke
Computer Graphics Forum (Proc. EUROGRAPHICS), 2011. Dynamic Display of BRDFs

We define the problem of physically displaying material appearance, and demonstrate a conceptual device that exhibits precisely controllable reflectance distributions by generating waves on a water surface.

Physically-Based Real-Time Lens Flare Rendering

Matthias B. Hullin, Elmar Eisemann, Hans-Peter Seidel, Sungkil Lee
ACM Transactions on Graphics 30 (4) (Proc. SIGGRAPH), 2011. Physically-Based Real-Time Lens Flare Rendering

Our take on this popular effect; to our knowledge, the most complete and most efficient model to date.