Logos of the MPI Informatik and the Graphics, Vision and Video group

Computer Vision and Machine Learning
for Computer Graphics

Seminar – Summer Semester 2020

Organizers: Christian Theobalt, Mohamed Elgharib, Vladislav Golyanik

Organisation | Topics | Format | Format (Detail) | Resources


Online Generative Model Personalization for Hand Tracking (SIGGRAPH ASIA, 2017)	SFV: Reinforcement Learning of Physical Skills from Videos (SIGGRAPH ASIA, 2018)

Overview

Computer Vision strives to develop algorithms for understanding, interpreting and reconstructing information about real-world scenes from image and video data.

Computer Graphics focuses on image synthesis – algorithms to build and edit static and dynamic virtual worlds and to display them in photorealistic or stylised ways.

In recent years, these fields have converged more and more since both disciplines create and exploit models describing the visual appearance of objects and scenes. In this seminar series, we will cover advanced research topics that cross the boundaries between the fields of computer vision and computer graphics. We will concentrate on recent research results that were published at top-tier conferences and journals. This seminar will cover research papers from the following topics:

video generation and manipulation,
multi-view geometry and reconstruction,
computational photography and videography,
deep learning for computer vision and computer graphics,
multimodal video processing,
hands, body and faces: a computer perspective.

Topics

The following table lists more topics than available weeks – this is to allow some flexibility for the interests of the group to change the course structure. Once every participant has submitted their choice of topics, this list will be updated to show the presenter of each topic.

Click on each topic to show the papers to be discussed or show all papers hide all papers.

Topic and Papers	Presentation
Human Pose Estimation with Rigid Dynamics DReCon: Data-Driven Responsive Control of Physics-Based Characters Bergamin et al. SIGGRAPH ASIA, 2019 SFV: Reinforcement Learning of Physical Skills from Videos Peng et al. SIGGRAPH ASIA, 2018	7 May 2020 Presenter: Erik Johnson Supervisor: Soshi Shimada
Hand-Object Interactions Learning Joint Reconstruction of Hands and Manipulated Objects Hasson et al. CVPR 2019 H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions Tekin et al. CVPR 2019	14 May 2020 Presenter: Kaustubh Sakhalkar Supervisor: Franziska Mueller
Monocular Character Creation and Tracking Learning to Reconstruct People in Clothing from a Single RGB Camera Alldieck et al. CVPR 2019 LiveCap: Real-time Human Performance Capture from Monocular Video Habermann et al. SIGGRAPH, 2019	28 May 2020 Presenter: Danish Shahzad Supervisor: Marc Habermann
Noise-based Fake Detection Noiseprint: A CNN-Based Camera Model Fingerprint Cozzolino et al. IEEE Transactions on Information Forensics and Security, 2020 Face X-ray for More General Face Forgery Detection Li et al. ArXiv, 2019	4 June 2020 Presenter: Aditya Dhall Supervisor: Gereon Fox
Learning Implicit 3D Representations without 3D Supervision Neural Volumes: Learning Dynamic Renderable Volumes from Images Lombardi et al. SIGGRAPH 2019 Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision Niemeyer et al. CVPR 2020	15 June 2020 Presenter: Linjie Lyu Supervisor: Lingjie Liu
Face Reflectance Fields Deep Single-Image Portrait Relighting Zhou et al. ICCV 2019 Single Image Portrait Relighting Sun et al. SIGGRAPH 2019	18 June 2020 Presenter: Pramod Rao Supervisor: Ikhsanul Habibie
Learning Neural Scene Representations for Novel View Synthesis Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations Sitzmann et al. NeurIPS 2019 NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis Mildenhall et al. arXiv.prg 2020	25 June 2020 Presenter: Viktor Rudnev Supervisor: Lingjie Liu
Photorealistic Neural Face Reenactment Neural Style-Preserving Visual Dubbing Kim et al. SIGGRAPH ASIA, 2019 Neural Voice Puppetry: Audio-driven Facial Reenactment Thies et al. arxiv, 2020	2 July 2020 Presenter: Julian Hahnel Supervisor: Mohamed Elgharib
Representation and Reconstruction Mesh R-CNN Gkioxari et al. ICCV 2019 Learning Shape Templates with Structured Implicit Functions Genova et al. ICCV 2019	9 July 2020 Presenter: Yogesh Singh Supervisor: Mallikarjun B R
Neural Alternatives to Classic Geometry Representations DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation Park et al. CVPR 2019 AtlasNetV2: Learning Elementary Structures for 3D Shape Generation and Matching Taylor et al. NeurIPS 2019	16 July 2020 Presenter: Navami Kairanda Supervisor: Edgar Tretschk
Real-time General Non-rigid 3D Reconstruction DynamicFusion: Reconstruction and Tracking of Non-rigid Scenes in Real-Time Newcombe et al. CVPR 2015 Fusion4D: Real-time Performance Capture of Challenging Scenes Dou et al. SIGGRAPH 2016	-
Human motion generation and control Motion Graphs Kovar et al. SIGGRAPH, 2002 Phase-Functioned Neural Networks for Character Control Holden et al. SIGGRAPH, 2017	-
Human motion stylization Realtime Style Transfer for Unlabeled Heterogeneous Human Motion Xia et al. SIGGRAPH 2015 Spectral Style Transfer for Human Motion between Independent Actions Yumer and Mitra SIGGRAPH 2016	-
Utilizing Hand Synthesizer Aligning Latent Spaces for 3D Hand Pose Estimation Yang et al. ICCV 2019 Disentangling Latent Hands for Image Synthesis and Pose Estimation Yang et al. CVPR 2019	-
Leveraging Pose Uncertainty Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network Ye and Kim ECCV 2018 Online Generative Model Personalization for Hand Tracking Tkach et al. SIGGRAPH ASIA 2017	-
Human Re-rendering Dense Pose Transfer Neverova et al. ECCV 2018 Liquid Warping GAN Liu et al. ICCV 2019	-
Structured Matrix Factorization for Point-Cloud Denoising Structured Low-Rank Matrix Factorization: Optimality, Algorithm, and Applications to Image Processing Haeffele et al. ICML 2014 Structured Low-Rank Matrix Factorization for Point-Cloud Denoising Sarkar et al. 3DV 2018	-

Computer Vision and Machine Learning for Computer Graphics