Visual Computing and Artificial Intelligence Department

Classical Concepts of Computer Vision and
Computer Graphics in the Neural Age

Seminar – Summer Semester 2024

Organizers: Christian Theobalt, Marc Habermann, Thomas Leimkühler, Rishabh Dabral

Organization | Content | Format | Resources


Fast Articulated Motion Tracking using a Sums of Gaussians Body Model, ICCV, 2011	3D Gaussian Splatting for Real-time Radiance Field Rendering, SIGGRAPH, 2023

Overview

Computer Vision strives to develop algorithms for understanding, interpreting and reconstructing information about real-world scenes from image and video data.

Computer Graphics focuses on image synthesis: algorithms to build and edit static and dynamic virtual worlds and to display them in photorealistic or stylized ways.

Both fields have witnessed the transformative effects of deep learning and neural networks, thus ushering the so-called Neural Age.

In this seminar, we will explore how the classical concepts in Computer Vision and Computer Graphics have manifested in the Neural Age. We will seek to understand if and how the new neural methods have changed the way we think about these problems, and how they have improved the state-of-the-art. For each topic that we cover, we will discuss a seminal paper that has shaped the field and also discuss a recent paper that has further developed that idea in a modern context. This seminar will cover research papers from the following topics:

image and video generation, manipulation, and analysis,
multi-view geometry and reconstruction,
computational photography and videography,
shape matching,
pose estimation, tracking, and character animation,
deep learning for computer vision and computer graphics.

Topics

The following table lists more topics than available weeks – this is to allow some flexibility for the interests of the group to change the course structure. Once every participant has submitted their choice of topics, this list will be updated to show the presenter of each topic. Send us an email if you cannot access a paper for some reason.

Click on each topic to show the papers to be discussed or show all papers hide all papers.

Topic and Papers	Presentation
Surface Reconstruction Poisson Surface Reconstruction Kazhdan et al. SGP 2006 Neural Stochastic Screened Poisson Reconstruction Sellán et al. SIGGRAPH Asia 2023	2 May Presenter: Monseej Purkayastha Supervisor: Viktor Rudnev
Volume Rendering Ray tracing volume densities Kajiya et al. Computer Graphics 1984 Nerf: Representing scenes as neural radiance fields for view synthesis Mldenhall, Srinivasan, Tancik et al. ECCV 2020	16 May Presenter: Raja Parikshat Supervisor: Hamza Pehlivan
Gaussians in Graphics Fast Articulated Motion Tracking using a Sums of Gaussians Body Model Stoll et al. ICCV 2011 3D Gaussian Splatting for Real-Time Radiance Field Rendering Kerbl and Kopanas et al. SIGGRAPH 2023	23 May Presenter: Kshitijkumar Sunil Kumar Supervisor: Navami Kairanda
Warp Fields and Fusion DynamicFusion: Reconstruction and Tracking of Non-rigid Scenes in Real-Time Newcombe et al. CVPR 2015 Nerfies: Deformable neural radiance fields Park et al. ICCV 2021	6 June Presenter: Yiming Zhou Supervisor: Jian Wang
From Convolutional Pyramids to UNet Convolution Pyramids Farbman et al. SIGGRAPH Asia 2021 U-Net: Convolutional Networks for Biomedical Image Segmentation Ronnenberger et al. MICCAI 2015	13 June Presenter: Hevra Petekkaya Supervisor: Andrea Boscolo Camiletto
Generative Adversarial Nets Generative Adversarial Nets Goodfellow et al. NeurIPS 2014 A Style-Based Generator Architecture for Generative Adversarial Networks Karras et al. CVPR 2019	20 June Presenter: Ismail Shah Supervisor: Anton Zubekhin
Performance Capture Performance Capture from Sparse Multi-view Video de Aguilar et al. SIGGRAPH 2008 PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization Saito et al. CVPR 2020	27 June Presenter: Kunwar Maheep Singh Supervisor: Hiroyasu Akada
Physics-based Motion modeling Spacetime Constraints Witkin and Kass SIGGRAPH 1988 AMP: Adversarial Motion Priors Peng et al. SIGGRAPH 2021	4 July Presenter: Sidharth Suresh Nair Supervisor: Noshaba Cheema
Spherical Harmonics Lighting Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments Sloan et al. ToG 2002 A Neural Rendering Framework for Free-Viewpoint Relighting Chen et al. CVPR 202	- Presenter: - Supervisor: Pulkit Gera
Spatial Regularization Laplacian Surface Editing Sorkine et al. SGP 2004 Critical Regularizations for Neural Surface Reconstruction in the Wild Zhang et al. CVPR 2022	- Presenter: - Supervisor: Mohit Mendiratta
Deformation Representations and Parameterization Embedded Deformation for Shape Manipulation Sumner et al. ToG 2022 Deforming Radiance Fields with Cages Xu and Harada ECCV 2022	- Presenter: - Supervisor: Guoxing Sun
Lightfields Light Field Rendering Levoy et al. SIGGRAPH 1996 Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering Sitzmann et al. NeurIPS 2021	- Presenter: Supervisor: Jianchun Chen
Reflectence Field Recovery Acquiring the Reflectance Field of a Human Face Devebec et al. SIGGRAPH 2000 Practical Dynamic Facial Appearance Modeling and Acquisition Gotardo et al. SIGGRAPH 2018	- Presenter: Supervisor: Pramod Rao
Residuals and ODEs Deep Residual Learning for Image Recognition He et al. CVPR 2016 Neural Ordinary Differential Equations Chen et al. NeurIPS 2018	- Presenter: Supervisor: Olaf Dünkel
Filtering by Repeated Integration Filtering by Repeated Integration Hcekbert SIGGRAPH 1986 Neural Field Convolutions by Repeated Differentiation Nsampi et al. ToG 2023	- Presenter: Supervisor: Ntumba Elie Nsampi
Animation Motion Graphs Kovar et al. SIGGRAPH 2002 Learned Motion Matching Holden et al. SIGGRAPH 2017	- Presenter: Supervisor: Wanyue Zhang
Uncertainty Modeling What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? Kendal and Gal NeurIPS 2017 Bayes' Rays: Uncertainty Quantification for Neural Radiance Fields Goli et al. CVPR 2024	- Presenter: Supervisor: Linjie Liyu
Clothing Simulation Large Steps in Cloth Simulation Baraff and Witkin SIGGRAPH 1998 HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics Grigorev et al. CVPR 2023	- Presenter: Supervisor: Heming Zhu
Face Modeling A Morphable Model for the Synthesis of 3D Faces Blanz and Vetter SIGGRAPH 1999 Authentic Volumetric Avatars Cao et al. SIGGRAPH 2022	- Presenter: Supervisor: Kartik Teotia
Interval Arithmetic Interval Arithmetic and Recursive Subdivision for Implicit Functions and Constructive Solid Geometry Duff SIGGRAPH 1992 Spelunking the Deep: Guaranteed Queries on General Neural Implicit Surfaces via Range Analysis Sharp and Jacobson SIGGRAPH 2022	- Presenter: Supervisor: Gereon Fox