Logos of the MPI Informatik and the Graphics, Vision and Video group

Computer Vision and Machine Learning
for Computer Graphics

Seminar – Summer Semester 2019

Organizers: Christian Theobalt, Mohamed Elgharib, Vladislav Golyanik

Organisation | Topics | Format | Format (Detail) | Resources


Painting Style Transfer for Head Portraits (SIGGRAPH 2016)	Neural Animation of Human Body (SIGGRAPH 2019)

Overview

Computer Vision strives to develop algorithms for understanding, interpreting and reconstructing information about real-world scenes from image and video data.

Computer Graphics focuses on image synthesis – algorithms to build and edit static and dynamic virtual worlds and to display them in photorealistic or stylised ways.

In recent years, these fields have converged more and more since both disciplines create and exploit models describing the visual appearance of objects and scenes. In this seminar series, we will cover advanced research topics that cross the boundaries between the fields of computer vision and computer graphics. We will concentrate on recent research results that were published at top-tier conferences and journals. This seminar will cover research papers from the following topics:

video generation and manipulation,
multi-view geometry and reconstruction,
computational photography and videography,
deep learning for computer vision and computer graphics,
multimodal video processing,
hands, body and faces: a computer perspective.

Topics

The following table lists more topics than available weeks – this is to allow some flexibility for the interests of the group to change the course structure. Once every participant has submitted their choice of topics, this list will be updated to show the presenter of each topic.

Click on each topic to show the papers to be discussed or show all papers hide all papers.

Topic and Papers	Presentation
Cleaning Sketches StrokeAggregator: Consolidating Raw Sketches into Artist-Intended Curve Drawings Liu et al. SIGGRAPH 2018 Mastering Sketching: Adversarial Augmentation for Structured Prediction Simo-Serra et al. TOG 2018	2 May 2019 Presenter: Ziqian Chen Supervisor: Dushyant Mehta
Body and Clothing: Modeling & Tracking SMPL: A Skinned Multi-Person Linear Model Loper et al. TOG 2015 ClothCap: Seamless 4D Clothing Capture and Retargeting Pons-Moll et al. TOG 2017	9 May 2019 Presenter: Olha Sokol Supervisor: Marc Habermann
Real-time Non-rigid General Reconstruction VolumeDeform: Real-time Volumetric Non-rigid Reconstruction Innman et al. ECCV 2016 KillingFusion - Non-Rigid 3D Reconstruction Without Correspondences Slavcheva et al. CVPR 2017	16 May 2019 Presenter: Amr Amer Supervisor: Edgar Tretschk
Learning to Match by Differentiable Programming Learning Latent Permutations with Gumbel-Sinkhorn Networks Mena et al. ICLR 2018 Deep Learning of Graph Matching Zanfir et al. CVPR 2018	23 May 2019 Presenter: Duy Nguyen Supervisor: Florian Bernard
Graph Convolutions in Neural Networks Geometric deep learning on graphs and manifolds using mixture model CNNs Monti et al. CVPR 2017 Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering Defferrard et al. NIPS 2016	6 June 2019 Presenter: Mohit Mendiratta Supervisor: Ayush Tewari
Invited Talk Details to be announced	13 June 2019 Presenter: TBA
Deep Face Forensics FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces Rossler et al. arxiv 2018 FaceForensics++: Learning to Detect Manipulated Facial Images Rossler et al. arxiv 2019	27 June 2019 Presenter: Vinit Hegiste Supervisor: Gereon Fox
General Mesh Reconstruction from Single Images Learning Category-Specific Mesh Reconstruction from Image Collections Kanazawa et al. ECCV 2018 Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images Wang et al. ECCV 2018	4 July 2019 Presenter: Arsen Tabaku Supervisor: Vladislav Golyanik
Hand Pose Estimation from Monocular RGB Videos Cross-modal Deep Variational Hand Pose Estimation Spurr et al. CVPR 2018 GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB Mueller et al. CVPR 2018	11 July 2019 Presenter: Beste Ekmen Supervisor: Franziska Mueller
Object Pose Estimation with Neural Networks SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again Wei et al. ICCV 2017 BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depth Huang et al. ICCV 2017	18 July 2019 Presenter: Erild Balla Supervisor: Edgar Tretschk
Human Motion Generation and Control Motion Graphs Kovar et al. SIGGRAPH 2002 Phase-Functioned Neural Networks for Character Control Holden et al. SIGGRAPH 2017	–
Monocular Non-rigid 3D Reconstruction Scalable Dense Non-rigid Structure-from-Motion: A Grassmannian Perspective Kumar et al. CVPR 2018 Deep Shape-from-Template: Wide-Baseline, Dense and Fast Registration and Deformable Reconstruction from a Single Image Fuentes-Jimenez et al. arxiv 2018	–
Style Transfer for Human Motion Realtime Style Transfer for Unlabeled Heterogeneous Human Motion Xia et al. SIGGRAPH 2015 Spectral Style Transfer for Human Motion between Independent Actions Yumer and Mitra SIGGRAPH 2016	–
Motion Magnification Eulerian Video Magnification for Revealing Subtle Changes in the World Wu et al. SIGGRAPH 2012 Phase-Based Video Motion Processing Wadhwa et al. SIGGRAPH 2013	–
Motion Utilization for Computational Videography Video Magnification in Presence of Large Motions Elgharib et al. CVPR 2015 Video Reflection Removal Through Spatio-Temporal Optimization Nandoriya et al. ICCV 2017	–
Generative Adversarial Networks and Their Application for Video Face Manipulation Generative Adversarial Nets Goodfellow et al. NIPS 2014 Deep Video Portraits Kim et al. SIGGRAPH 2018	–
Learning Lighting and Appearance Learning Intrinsic Image Decomposition from Watching the World Li et al. CVPR 2018 InverseRenderNet: Learning single image inverse rendering Yu et al. CVPR 2019	–
Reconstruction of Two Interacting Hands Articulated Distance Fields for Ultra-Fast Tracking of Hands Interacting Taylor et al. SIGGRAPH-Asia 2017 Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera Mueller et al. SIGGRAPH 2019	–
How People Move Deep Motifs and Motion Signatures Aristidou et al. SIGGRAPH-Asia 2018 Spectral Style Transfer for Human Motion between Independent Actions Yumer et al. SIGGRAPH 2016	–
Non-rigid Deformations: Constraints & Tracking Embedded Deformation for Shape Manipulation Summer et al. SIGGRAPH 2007 Direct, Dense, and Deformable: Template-Based Non-Rigid 3D Reconstruction from RGB Video Yu et al. ICCV 2015	–
Transformation Synchronization A Solution for Multi-Alignment by Transformation Synchronisation Bernard et al. CVPR 2015 Learning Transformation Synchronization Huang et al. CVPR 2019	–
Utilizing Hand Synthesizers Generalized Feedback Loop for Joint Hand-Object Pose Estimation Oberweger et al. TPAMI 2019 Augmented Skeleton Space Transfer for Depth-based Hand Pose Estimation Baek et al. CVPR 2018	–
Leveraging Pose Uncertainty Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network Ye et al. ECCV 2018 Online Generative Model Personalization for Hand Tracking Tkach et al. SIGGRAPH-Asia 2017	–
Deep Feature Invariance Spatial Transformer Networks Jaderberg et al. NIPS 2015 Deformable Convolutional Networks Dai et al. ICCV 2017	–
Latent Feature Interpretation and Modification DeepVoxels: Learning Persistent 3D Feature Embeddings Sitzmann et al. CVPR 2019 Interpretable Transformations with Encoder-Decoder Networks Worall et al. ICCV 2017	–
Differential Rendering Soft Rasterizer: Differentiable Rendering for Unsupervised Single-View Mesh Reconstruction Liu et al. arxiv 2019 Differentiable Monte Carlo Ray Tracing through Edge Sampling Li et al. SIGGRAPH-Asia 2018	–
3D Surface Representation AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation Groueix et al. CVPR 2018 DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation Park et al. CVPR 2019	–

Computer Vision and Machine Learning for Computer Graphics