Tutorials & Demos

Visual computing is a fast evolving field with a lot of real-world use cases. Especially, the synthesis of photo-realistic content and the modelling of digital humans raised a lot of attention. It is important for us to teach the broad public and to sensitize the people to possible image and video manipulations. We showed demonstrations of our methods at countless exhibitions and conferences, and also in TV reports and shows. Besides the demonstrations, we are also giving tutorials in our research field.

2020

Justus Thies  Ayush Tewari  Ohad Fried  Vincent Sitzmann    Kalyan Sunkavalli  Ricardo Martin-Brualla  Tomas Simon  Jason Saragih  Matthias Nießner  Rohit K Pandey  Sean Fanello  Gordon Wetzstein  Jun-Yan Zhu  Christian Theobalt  Maneesh Agrawala  Eli Shechtman  Dan B Goldman  Michael Zollhöfer 

CVPR 2020 - Tutorial on Neural Rendering

Neural rendering is a new and rapidly emerging field that combines generative machine learning techniques with physical knowledge from computer graphics, e.g., by the integration of differentiable rendering into network training. This state-of-the-art report summarizes the recent trends and applications of neural rendering.

2020, Apr 08   —  1 minute read     [Paper]  [Video]  [Bibtex] 
Cristian Canton  Sam Gregory  Laura Leal-Taixé  Christoph Bregler  Hany Farid  Matthias Nießner  Sergio Escalera  Edward Delp  Scott McCloskey  Isabelle Guyon  Arslan Basharat  Justus Thies  Luisa Verdoilva  Hugo Jair Escalante  Christa Scharfenberg  Andreas Rössler  Jun Wan  Davide Cozzolino  Guo Guodong 

CVPR 2020 - Workshop on Media Forensics

This CVPR workshop covers the advances on all fronts of media forensics: from detection of manipulations, biometric implications, misrepresentation/spoofing, etc.

2020, Apr 08   —  1 minute read    

2019


2018

Matthias Nießner  Justus Thies 

EU Commission: Live Demo of Face2Face

Invited by the EU Commission, we showed a demo for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The topic of the conference was how to protect the election process (EU elections 2019) against interference from outside (cyber crime, fake news).

2018, Oct 02   —  1 minute read     [Paper]  [Video]  [Bibtex] 
Michael Zollhöfer  Justus Thies  Derek Bradley  Pablo Garrido  Thabo Beeler  Patrick Perez  Marc Stamminger  Matthias Nießner  Christian Theobalt 

Eurographics 2018: State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications

This state-of-the-art report session summarizes recent trends in monocular facial performance capture and discusses its applications, which range from performance-based animation to real-time facial reenactment. We focus on methods where the central task is to recover and track a three dimensional model of the human face using optimization-based reconstruction algorithms.

2018, Apr 24   —  1 minute read     [Paper]  [Bibtex] 

2017

Justus Thies  Michael Zollhöfer  Marc Stamminger  Christian Theobalt  Matthias Nießner 

SIGGRAPH Emerging Technologies: Demo of FaceVR

We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB‐D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high‐quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm.

2017, Aug 03   —  1 minute read     [Paper]  [Video]  [Bibtex] 

2016

Justus Thies  Michael Zollhöfer  Marc Stamminger  Christian Theobalt  Matthias Nießner 

SIGGRAPH Emerging Technologies: Real-time Face Capture and Reenactment of RGB Videos

We show a demo for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). Our goal is to animate the facial expressions of a target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.

2016, Jul 28   —  1 minute read     [Paper]  [Video]  [Bibtex]