Tutorials & Demos
2023
Cyber and the City
Synthetic Media can be an opportunity, but also a thread. In an exhibition at the Schloss Museum in Tübingen, vistors were able to try out recent facial reenactment methods and learn more about spotting manipulated media.
2023, May 12 — [Video]2022
CLIPme if you can!
CLIP is a powerful tool to match images to text descriptions. It can be used for classification of ImageNet classes as shown in the original paper, but it can also be used to assign names of (famous) people to images.
2022, May 12 —2021
3DV 2021 - Tutorial on the Advances in Neural Rendering
In this tutorial, we will talk about the advances in neural rendering, especially the underlying 2D and 3D representations that allow for novel viewpoint synthesis, controllability and editability. Specifically, we will discuss neural rendering methods based on 2D GANs, techniques using 3D Neural Radiance Fields or learnable sphere proxies. Besides methods that handle static content, we will talk about dynamic content as well.
2021, Nov 29 — [Video]Expert Interview on DeepFakes
Expert interview for the European Parliamentary Research Service report on 'Tackling DeepFakes in European Policy'.
2021, Aug 10 — [Paper]SIGGRAPH 2021 - Course on the Advances in Neural Rendering
This course covers the advances in neural rendering over the years 2020-2021.
2021, Aug 08 — [Video] [Bibtex]2020
BIDT: Echt oder?
What is the impact of DeepFakes on our society? How does it change our view on digital media? Is the technology a danger or a chance?
2020, Oct 20 —WIPO: Artifical Intelligence and Intellectual Property
This virtual exhibition presents current approaches of AI-driven media creation. It raises interesting questions regarding intellectual property.
2020, Sep 18 —CVPR 2020 - Tutorial on Neural Rendering
Neural rendering is a new and rapidly emerging field that combines generative machine learning techniques with physical knowledge from computer graphics, e.g., by the integration of differentiable rendering into network training. This state-of-the-art report summarizes the recent trends and applications of neural rendering.
2020, Apr 08 — [Paper] [Video] [Bibtex]CVPR 2020 - Workshop on Media Forensics
This CVPR workshop covers the advances on all fronts of media forensics: from detection of manipulations, biometric implications, misrepresentation/spoofing, etc.
2020, Apr 08 —2019
Cabinet Meeting: Synthetic Media - Danger or Opportunity?
In this session we showed several demonstrations of our current projects, to inform the Cabinet of Germany about the risks and the opportunities of synthetic media.
2019, Nov 18 —2018
EU Commission: Information Manipulation
Invited by the EU Commission, we showed a demo for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The topic of the conference was how to protect the election process (EU elections 2019) against interference from outside (cyber crime, fake news).
2018, Oct 02 — [Paper] [Video] [Bibtex]ECCV 2018: Tutorial on Face Tracking and its Applications
This invited tutorial is about monocular face tracking techniques and also discusses the possible applications. It is based on our Eurographics state-of-the-art report.
2018, Sep 08 — [Paper] [Bibtex]Eurographics 2018: State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications
This state-of-the-art report session summarizes recent trends in monocular facial performance capture and discusses its applications, which range from performance-based animation to real-time facial reenactment. We focus on methods where the central task is to recover and track a three dimensional model of the human face using optimization-based reconstruction algorithms.
2018, Apr 24 — [Paper] [Bibtex]2017
SIGGRAPH Emerging Technologies: Demo of FaceVR
We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB‐D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high‐quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm.
2017, Aug 03 — [Paper] [Video] [Bibtex]2016
FaceInCar Demo at the National IT Summit 2016
We demonstrate the capabilities of the dense face fitting proposed in Face2Face in the challenging scenario of face tracking in a car including occlusions and strong varying light situations.
2016, Nov 17 —SIGGRAPH Emerging Technologies: Real-time Face Capture and Reenactment of RGB Videos
We show a demo for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). Our goal is to animate the facial expressions of a target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.
2016, Jul 28 — [Paper] [Video] [Bibtex]Live-demo of Face2Face in the Jimmy Kimmel Show
We also showed a live demo of our Face2Face approach in the Jimmy Kimmel Show. Using a standard webcam, Jimmy Kimmel reenacts a video of Mike Tyson and others.
2016, Apr 28 — [Paper] [Bibtex]GPU Technology Conference: Interactive Demo of Face2Face
Nvidia invited us to show a demo for our real-time facial reenactment system (Face2Face). Our goal is to animate the facial expressions of a target video by a source actor and re-render the manipulated output video in a photo-realistic fashion.
2016, Apr 07 — [Paper] [Video] [Bibtex]