2024
EgoAvatar: Egocentric View-Driven and Photorealistic Full-body Avatars
SIGGRAPH Asia Conference Papers, 2024
[project page] [paper]
GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representations
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2024
[Project page]
Manifold Sampling for Differentiable Uncertainty in Radiance Fields
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2024
[paper]
TriHuman: A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2024
[project page] [paper]
OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024.
[project page] [paper] [dataset]
ImageNet3D: Towards General-Purpose Object-Level 3D Understanding
Neural Information Processing Systems (NeurIPS), 2024, Dataset and Benchmark Track
[paper] [project page] [Dataset]
NeuralClothSim: Neural Deformation Fields Meet the Thin Shell Theory
Neural Information Processing Systems (NeurIPS), 2024
[project page] [paper] [code] [video]
Who Did It? How User Agency is Influenced by Visual Properties of Generated Images
User Interface Software and Technology (UIST), 2024
[paper]
Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field
Pacific Graphics, 2024
[paper]
Projected Stochastic Gradient Descent with Quantum Annealed Binary Gradients
British Machine Vision Conference (BMVC), 2024
[paper]
Learning Images Across Scales Using Adversarial Training
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2024
[paper]
Neural Gaussian Scale-Space Fields
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2024
[paper]
Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2024
[paper] [project page]
HQ3DAvatar: High-quality Implicit 3D Head Avatar
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2024
[project page] [paper]
Blue noise for diffusion models
ACM SIGGRAPH Conference Proceedings, 2024
[project page] [paper] [code]
Lite2Relight: 3D-aware Single Image Portrait Relighting
ACM SIGGRAPH Conference Proceedings, 2024
[project page] [paper]
iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning
European Conference on Computer Vision (ECCV), 2024
[paper] [code]
DatasetNeRF: Efficient 3D-aware Data Factory with Generative Radiance Fields
European Conference on Computer Vision (ECCV), 2024
[paper] [project page] [code]
NOVUM: Neural Object Volumes for Robust Object Classification
European Conference on Computer Vision (ECCV), 2024
[paper] [code]
Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models
European Conference on Computer Vision (ECCV), 2024
[paper] [project page] [code]
MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Rendering
European Conference on Computer Vision (ECCV), 2024
[paper] [project page] [code] [data]
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions
European Conference on Computer Vision (ECCV), 2024
[paper] [project page]
Relightable Neural Actor with Intrinsic Decomposition and Pose Control
European Conference on Computer Vision (ECCV), 2024
[paper] [project page] [code]
A Latent Implicit 3D Shape Model for Multiple Levels of Detail
German Conference on Pattern Recognition (GCPR), 2024
[paper]
Adaptive Grids for Neural Scene Representation
Symposium on Vision, Modeling, and Visualization (VMV), 2024
[paper]
Fast Non-Rigid Radiance Fields from Monocularized Data
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2024
[project page] [paper]
State of the Art on Diffusion Models for Visual Computing
Eurographics STAR, 2024
[project page] [paper]
Recent Trends in 3D Reconstruction of General Non-Rigid Scenes
Eurographics STAR, 2024
[paper]
Computer Vision and Pattern Recognition (CVPR), 2024
[paper] [code]
A Bayesian Approach to OOD Robustness in Image Classification
Computer Vision and Pattern Recognition (CVPR), 2024
[paper]
Unsupervised Learning of Category-Level 3D Pose from Object-Centric Videos
Computer Vision and Pattern Recognition (CVPR), 2024
[paper] [code]
Wonder3D: Single Image to 3D using Cross-Domain Diffusion
Computer Vision and Pattern Recognition (CVPR), 2024
Poster Highlight - 11.9% of accepted papers
[project page] [paper] [code]
VINECS: Video-based Neural Character Skinning
Computer Vision and Pattern Recognition (CVPR), 2024
[project page] [paper]
Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Cameras
Computer Vision and Pattern Recognition (CVPR), 2024
[project page] [paper] [code]
Physically-Based Lighting for 3D Generative Models of Cars
Proceedings of the Eurographics Conference 2024
[project page] [paper] [code]
EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams
Computer Vision and Pattern Recognition (CVPR), 2024
[project page] [paper] [code]
3D Human Pose Perception from Egocentric Stereo Videos
Computer Vision and Pattern Recognition (CVPR), 2024
CVPR Highlight
[project page] [paper] [code]
Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement
Computer Vision and Pattern Recognition (CVPR), 2024
[project page] [paper] [code]
ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis
Computer Vision and Pattern Recognition (CVPR), 2024
[project page] [paper] [dataset]
ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering
Computer Vision and Pattern Recognition (CVPR), 2024
[project page] [paper] [code] [dataset]
Discovering Failure Modes of Text-guided Diffusion Models via Adversarial Search
International Conference on Learning Representations (ICLR), 2024
[paper]
Source-Free and Image-Only Unsupervised Domain Adaptation for Category Level Object Pose Estimation
International Conference on Learning Representations (ICLR), 2024
[paper]
Adding 3D Geometry Control to Diffusion Models
International Conference on Learning Representations (ICLR), 2024
Selected as spotlight (top 5%)
[paper]
Unsupervised Event-based Video Reconstruction
In Winter Conference on Applications of Computer Vision (WACV) 2024
[project page] [paper]
Neural Textured Deformable Meshes for Robust Analysis-by-Synthesis
Winter Conference on Applications of Computer Vision (WACV), 2024
[paper]
Robust Category-Level 3D Pose Estimation from Synthetic Data
Winter Conference on Applications of Computer Vision (WACV), 2024
[paper]
3D Pose Estimation of Two Interacting Hands from a Monocular Event Camera
International Conference on 3D Vision (3DV), 2024
[project page] [paper] [code]
ROAM: Robust and Object-aware Motion Generation using Neural Pose Descriptors
International Conference on 3D Vision (3DV), 2024
[project page] [paper]
MACS: Mass Conditioned 3D Hand and Object Motion Synthesis
International Conference on 3D Vision (3DV), 2024
[project page] [paper]
Quantum-Hybrid Stereo Matching With Nonlinear Regularization and Spatial Pyramids
International Conference on 3D Vision (3DV), 2024
[project page] [paper]
SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenes
International Conference on 3D Vision (3DV), 2024
[project page] [paper]
2023
A Deeper Analysis of Volumetric Relightable Faces
International Journal of Computer Vision (IJCV), 2023
[paper]
3D-QAE: Fully Quantum Auto-Encoding of 3D Point Clouds
British Machine Vision Conference (BMVC), 2023 (Brave new ideas)
[project page] [paper] [code]
Decaf: Monocular Deformation Capture for Face and Hand Interactions
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2023
[project page] [paper] [dataset]
AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2023
[project page] [paper]
Neural Field Convolutions by Repeated Differentiation
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2023
[project page] [paper] [supplement]
Diffusion Posterior Illumination for Ambiguity-aware Inverse Rendering
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2023
[project page] [paper] [supplement]
Discovering Fatigued Movements for Virtual Character Animation
Proc. of SIGGRAPH Asia, 2023
[project page] [paper] [code]
An Implicit Neural Representation for the Image Stack: Depth, All in Focus, and High Dynamic Range
Proc. of SIGGRAPH Asia, 2023
[project page] [paper] [supplement]
Batch-based Model Registration for Fast 3D Sherd Reconstruction
International Conference on Computer Vision (ICCV), 2023
[project page] [code]
Weakly Supervised 3D Open-vocabulary Segmentation
Advances in Neural Information Processing Systems (NeurIPS), 2023
[paper] [code]
3D-Aware Visual Question Answering about Parts, Poses and Occlusions
Advances in Neural Information Processing Systems (NeurIPS), 2023
[paper]
DELIFFAS: Deformable Light Fields for Fast Avatar Synthesis
Advances in Neural Information Processing Systems (NeurIPS), 2023
[paper coming soon]
WRLKit: Computational Design of Personalized Wearable Robotic Limbs
ACM Conference on User Interface Software and Technology (UIST), 2023
[project page] [paper]
NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstruction
International Conference on Computer Vision (ICCV), 2023
[project page] [paper] [code]
GlowGAN: Unsupervised Learning of HDR Images from LDR Images in the Wild
International Conference on Computer Vision (ICCV), 2023
[project page] [paper]
Imitator: Personalized Speech-driven 3D Facial Animation
International Conference on Computer Vision (ICCV), 2023
[project page] [paper]
LiveHand: Real-time and Photorealistic Neural Hand Rendering
International Conference on Computer Vision (ICCV), 2023
[project page] [paper] [code]
WaveNeRF: Wavelet-based Generalizable Neural Radiance Fields
International Conference on Computer Vision (ICCV), 2023
[paper]
Pose-Free Neural Radiance Fields via Implicit Pose Regularization
International Conference on Computer Vision (ICCV), 2023
[paper coming soon]
3D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation
International Conference on Computer Vision (ICCV), 2023
[project page] [paper] [code]
Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shape
International Conference on Computer Vision (ICCV), 2023
[paper coming soon]
Multimodal Image Synthesis and Editing: The Generative AI Era
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
[project page] [paper]
HDHumans: A Hybrid Approach for High-fidelity Digital Humans
ACM/EUROGRAPHICS Symposium on Computer Animation (SCA), 2023 (best paper honorable mention)
[project page] [paper]
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion
International Conference on Machine Learning (ICML), 2023
[project page] [paper]
EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2023
[project page] [paper] [code]
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2023
[project page] [paper] [code]
3D Gaussian Splatting for Real-Time Radiance Field Rendering
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2023 (Best Paper Award)
[project page] [paper]
StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields
Computer Vision and Pattern Recognition (CVPR), 2023
[project page] [paper] [code]
Quantum Multi-Model Fitting
Computer Vision and Pattern Recognition (CVPR), 2023
[paper] [code]
NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies
Computer Vision and Pattern Recognition (CVPR), 2023
[project page] [paper] [code]
Scene-aware Egocentric 3D Human Pose Estimation
Computer Vision and Pattern Recognition (CVPR), 2023
[project page] [paper] [supplement] [dataset]
Self-supervised Pre-training with Masked Shape Prediction for 3D Scene Understanding
Computer Vision and Pattern Recognition (CVPR), 2023
[paper]
Grid-guided Neural Radiance Fields for Large Urban Scenes
Computer Vision and Pattern Recognition (CVPR), 2023
[project page] [paper] [supplement]
MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis
Computer Vision and Pattern Recognition (CVPR), 2023 (Hightlight)
[project page] [paper]
Regularized Vector Quantization for Tokenized Image Synthesis
Computer Vision and Pattern Recognition (CVPR), 2023
[paper]
EventNeRF: Neural Radiance Fields from a Single Colour Event Camera
Computer Vision and Pattern Recognition (CVPR), 2023
[project page] [paper] [dataset] [code]
CCuantuMM: Cycle-Consistent Quantum-Hybrid Matching of Multiple Shapes
Computer Vision and Pattern Recognition (CVPR), 2023
[project page] [paper] [code]
Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning
Computer Vision and Pattern Recognition (CVPR), 2023 (Highlight)
[paper]
F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories
Computer Vision and Pattern Recognition (CVPR), 2023 (Highlight)
[project page]
Robust Model-based Face Reconstruction through Weakly-Supervised Outlier Segmentation
Computer Vision and Pattern Recognition (CVPR), 2023
[paper] [code]
PoseExaminer: Automated Testing of Out-of-Distribution Robustness in Human Pose and Shape Estimation
Computer Vision and Pattern Recognition (CVPR), 2023
[paper] [code]
Unbiased 4D: Monocular 4D Reconstruction with a Neural Deformation Model
Computer Vision and Pattern Recognition Workshop (CVPRW), 2023
[project page] [paper] [code] [data]
VoGE: A Differentiable Volume Renderer using Gaussian Ellipsoids for Analysis-by-Synthesis
International Conference on Learning Representations (ICLR), 2023
[paper]
General Neural Gauge Fields
International Conference on Learning Representations (ICLR), 2023
[project page] [paper] [dataset] [code]
QuAnt: Quantum Annealing with Learnt Couplings
International Conference on Learning Representations (ICLR), 2023 (spotlight)
[project page] [paper] [supplement] [dataset] [code]
Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstruction
International Conference on Learning Representations (ICLR), 2023 (spotlight)
[project page] [paper]
NeRFshop: Interactive Editing of Neural Radiance Fields
ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D), 2023
[project page] [paper]
State of the Art in Dense Monocular Non-Rigid 3D Reconstruction
Eurographics, 2023 (STAR)
[project page] [paper] [extended version]
Scene-Aware 3D Multi-Human Motion Capture from a Single Camera
Eurographics, 2023
[project page] [paper] [code]
IMoS: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions
Eurographics, 2023
[project page] [paper] [code]
2022
Generation of Truly Random Numbers on a Quantum Annealer
IEEE Access, 2022
[project page] [paper] [code]
An Implicit Parametric Morphable Dental Model
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2022
[project page] [paper] [code]
Neural Point Catacaustics for Novel-View Synthesis of Reflections
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia), 2022
[project page] [paper]
VMRF: View Matching Neural Radiance Fields
ACM International Conference on Multimedia (ACM MM), 2022
[paper]
HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow
Symposium on Vision, Modeling, and Visualization (VMV), 2022 (Best Paper Honorable Mention)
[project page] [paper]
VoRF: Volumetric Relightable Faces
British Machine Vision Conference (BMVC), 2022 (Best Paper Award Honourable Mention)
[project page] [paper (coming soon)]
HiFECap: Monocular High-Fidelity and Expressive Capture of Human Performances.
British Machine Vision Conference (BMVC), 2022
[project page] [paper] [supplement]
MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenes
International Conference on 3D Vision (3DV), 2022, (Best Student Paper Award)
[project page] [paper] [code]
gCoRF: Generative Compositional Radiance Fields
International Conference on 3D Vision (3DV), 2022
[project page] [paper]
GAN2X: Non-Lambertian Inverse Rendering of Image GANs
International Conference on 3D Vision (3DV), 2022
[project page] [paper] [supplement]
Auto-regressive Image Synthesis with Integrated Quantization
European Conference on Computer Vision (ECCV), 2022 (Oral)
[paper] [code]
Bi-level Feature Alignment for Versatile Image Translation and Manipulation
European Conference on Computer Vision (ECCV), 2022
[paper] [code]
NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors
European Conference on Computer Vision (ECCV), 2022
[project page] [paper] [code]
Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination
European Conference on Computer Vision (ECCV), 2022 (Oral)
[project page] [paper] [supplement]
HULC: 3D HUman Motion Capture with Pose Manifold Sampling and Dense Contact Guidance
European Conference on Computer Vision (ECCV), 2022
[project page] [paper]
Quantum Motion Segmentation
European Conference on Computer Vision (ECCV), 2022
[project page] [paper] [code]
UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capture
European Conference on Computer Vision (ECCV), 2022
[project page] [paper] [code]
Neural Radiance Fields for Outdoor Scene Relighting
European Conference on Computer Vision (ECCV), 2022
[project page] [paper] [code]
PartImageNet: A Large, High-Quality Dataset of Parts
European Conference on Computer Vision (ECCV), 2022
[paper] [dataset]
Robust Category-Level 6D Pose Estimation with Coarse-to-Fine Rendering of Neural Features
European Conference on Computer Vision (ECCV), 2022
[project page (coming soon)]
OOD-CV: A Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images
European Conference on Computer Vision (ECCV), 2022 (Oral)
[project page] [paper] [code]
BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering
European Conference on Computer Vision (ECCV), 2022
[project page] [paper] [supplement] [code]
SAGA: Stochastic Whole-Body Grasping with Contact
European Conference on Computer Vision (ECCV), 2022
[project page] [paper] [code]
A Motion Matching-based Framework for Controllable Gesture Synthesis from Speech
Proc. of SIGGRAPH 2022
[project page] [paper] [supplementary] [video]
Physics Informed Neural Fields for Smoke Reconstruction with Sparse Data
ACM Transactions on Graphics (Proc. of SIGGRAPH 2022)
[project page] [paper] [supplementary]
Advances in Neural Rendering
Computer Graphics Forum (Eurographics STAR report), 2022
[project page] [paper]
Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images
Computer Vision and Pattern Recognition (CVPR), 2022
[project page] [paper] [supplementary] [video]
Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors
Computer Vision and Pattern Recognition (CVPR), 2022 (best paper finalist)
[project page] [paper] [video]
VEOs: Virtual Elastic Objects
Computer Vision and Pattern Recognition (CVPR), 2022
[project page] [paper] [dataset]
Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervision
Computer Vision and Pattern Recognition (CVPR), 2022
[project page] [paper] [supplementary] [video] [dataset]
Playable Environments: Video Manipulation in Space and Time
Computer Vision and Pattern Recognition (CVPR), 2022
[project page] [paper] [supplementary] [code]
φ-SfT: Shape-from-Template with a Physics-Based Deformation Model
Computer Vision and Pattern Recognition (CVPR), 2022
[project page] [paper] [supplementary] [dataset]
BEHAVE: Dataset and Method for Tracking Human Object Interactions
Computer Vision and Pattern Recognition (CVPR), 2022
[project page] [paper] [supplementary]
Amodal Segmentation through Out-of-Task and Out-of-Distribution Generalization with a Bayesian Model
Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)
[paper] [arXiv] [code]
Learning Part Segmentation through Unsupervised Domain Adaptation from Synthetic Vehicles
Computer Vision and Pattern Recognition (CVPR), 2022 (Oral)
[paper] [arXiv] [dataset]
Simulated Adversarial Testing of Face Recognition Models
Computer Vision and Pattern Recognition (CVPR), 2022
[paper] [arXiv]
SwapMix: Diagnosing and Regularizing the Over-reliance on Visual Context in Visual Question Answering
Computer Vision and Pattern Recognition (CVPR), 2022
[paper] [arXiv]
StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis
International Conference on Learning Representations (ICLR), 2022
[project page] [paper]
2021
Learning Speech-driven 3D Conversational Gestures from Video
ACM International Conference on Intelligent Virtual Agents (IVA), 2021 (best paper)
[project page] [paper] [dataset]
HandVoxNet++: 3D Hand Shape and Pose Estimation using Voxel-Based Neural Networks
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
[project page] [paper]
Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2021)
[project page] [paper] [video]
NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
Advances in Neural Information Processing Systems (NeurIPS), 2021 (Spotlight)
[project page] [paper] [code]
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis
Advances in Neural Information Processing Systems (NeurIPS), 2021
[project page] [paper] [code]
Direct Dense Pose Estimation
International Conference on 3D Vision (3DV), 2021
[paper]
Deep Physics-aware Inference of Cloth Deformation for Monocular Human Performance Capture
International Conference on 3D Vision (3DV), 2021
[project page] [paper]
HumanGAN: A Generative Model of Human Images
International Conference on 3D Vision (3DV), 2021 (Oral)
[project page] [paper]
Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing
International Conference on Computer Vision (ICCV), 2021
[paper]
Synthesis of Compositional Animations from Textual Descriptions
International Conference on Computer Vision (ICCV), 2021
[project page] [paper]
Gravity-Aware Monocular 3D Human-Object Reconstruction
International Conference on Computer Vision (ICCV), 2021
[project page] [paper] [code] [dataset] [video]
EventHands: Real-Time Neural 3D Hand Reconstruction from an Event Stream
International Conference on Computer Vision (ICCV), 2021
[project page] [paper] [video]
Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video
International Conference on Computer Vision (ICCV), 2021
[project page] [paper] [code]
Efficient and Differentiable Shadow Computation for Inverse Problems
International Conference on Computer Vision (ICCV), 2021
[project page] [paper]
Q-Match: Iterative Shape Matching via Quantum Annealing
International Conference on Computer Vision (ICCV), 2021
[project page] [paper]
Estimating Egocentric 3D Human Pose in Global Space
International Conference on Computer Vision (ICCV), 2021 (Oral)
[project page] [paper] [video]
EgoRenderer: Rendering Human Avatars from Egocentric Camera Images
International Conference on Computer Vision (ICCV), 2021
[project page coming soon] [paper coming soon]
Adaptive Surface Normal Constraint for Depth Estimation
International Conference on Computer Vision (ICCV), 2021
[project page coming soon] [paper]
StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGAN
British Mashine Vision conference (BMVC), 2021
[project page] [paper] [arXiv] [video]
A Deeper Look into DeepCap
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
[project page] [paper] [dataset]
Neural Monocular 3D Human Motion Capture with Physical Awareness
ACM Transactions on Graphics (Proc. of SIGGRAPH 2021)
[project page] [paper] [arXiv]
Learning Meaningful Controls for Fluids
ACM Transactions on Graphics (Proc. of SIGGRAPH 2021)
[project page] [paper] [code]
Real-time Deep Dynamic Characters
ACM Transactions on Graphics (Proc. of SIGGRAPH 2021)
[project page] [paper] [video]
PhotoApp: Photorealistic Appearance Editing of Head Portraits
ACM Transactions on Graphics (Proc. of SIGGRAPH 2021)
[project page] [paper]
Monocular Reconstruction of Neural Face Reflectance Fields
Computer Vision and Pattern Recognition (CVPR), 2021
[project page] [paper]
Learning Complete 3D Morphable Face Models from Images and Videos
Computer Vision and Pattern Recognition (CVPR), 2021
[project page] [paper]
Monocular Real-time Full Body Capture with Inter-part Correlations
Computer Vision and Pattern Recognition (CVPR), 2021
[project page] [paper] [arXiv] [supplementary] [video]
Quantum Permutation Synchronization
(* denotes equal contribution)
Computer Vision and Pattern Recognition (CVPR), 2021
[project page] [paper]
H-P. Seidel, S. Castillo, C. Theobalt and M. Magnor
High-Fidelity Neural Human Motion Transfer from Monocular Video
Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)
[project page] [paper] [video]
Pose-Guided Human Animation from a Single Image in the Wild
Computer Vision and Pattern Recognition (CVPR), 2021
[project page] [paper]
Differentiable Event Stream Simulator for Non-Rigid 3D Tracking
Computer Vision and Pattern Recognition Workshops (Event-based Vision Workshop), 2021
[project page] [paper] [arXiv] [supplementary]
i3DMM: Deep Implicit 3D Morphable Model of Human Heads
Computer Vision and Pattern Recognition (CVPR), 2021 (Oral)
[project page] [paper] [video]
VideoForensicsHQ: Detecting High-quality Manipulated Face Videos
International Conference on Multimedia and Expo (ICME), 2021
[project page] [paper]
Real-time Global Illumination Decomposition of Videos
ACM Transactions on Graphics (to be presented at SIGGRAPH 2021)
[project page] [paper] [arXiv] [supplementary]
2020
LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registration
Advances in Neural Information Processing Systems (NeurIPS), 2020 (Oral)
[project page] [paper] [arXiv] [supplementary] [code]
Neural Sparse Voxel Fields
Advances in Neural Information Processing Systems (NeurIPS), 2020 (Spotlight)
[project page] [paper] [video] [code & data]
Intrinsic Dynamic Shape Prior for Dense Non-Rigid Structure from Motion
3DV, 2020
[project page] [paper] [arXiv] [poster] [dataset] [video]
Adiabatic Quantum Graph Matching with Permutation Matrix Constraints
3DV, 2020
[project page] [paper] [supplementary]
Fast Simultaneous Gravitational Alignment of Multiple Point Sets
3DV, 2020 (Oral)
[project page] [paper]
Egocentric Videoconferencing
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2020)
[project page] [paper] [video]
PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2020)
[project page] [paper] [arXiv] [video]
PIE: Portrait Image Embedding for Semantic Control
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2020)
[project page] [paper] [supplementary] [video]
RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2020)
[project page] [paper] [video]
Deep Relightable Textures: Volumetric Performance Capture with Neural Rendering
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2020)
[project page] [paper]
Neural Human Video Rendering by Learning Dynamic Textures and Rendering-to-Video Translation
IEEE TVCG, 2020
[project page] [paper] [video]
Occlusion-Aware Depth Estimation with Adaptive Normal Constraints
European Conference on Computer Vision (ECCV), 2020
[project page] [paper]
Combining Implicit Function Learning and Parametric Models for 3D Human Reconstruction
European Conference on Computer Vision (ECCV), 2020 (Oral)
[paper] [supplementary]
Neural Re-Rendering of Humans from a Single Image
European Conference on Computer Vision (ECCV), 2020
[project page] [paper]
PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations
European Conference on Computer Vision (ECCV), 2020
[project page] [paper]
DEMEA: Deep Mesh Autoencoders for Non-Rigidly Deforming Objects
European Conference on Computer Vision (ECCV), 2020 (Spotlight)
[project page] [paper]
Neural Dense Non-Rigid Structure from Motion with Latent Space Constraints
European Conference on Computer Vision (ECCV), 2020
[project page] [paper]
HTML: A Parametric Hand Texture Model for 3D Hand Reconstruction and Personalization
European Conference on Computer Vision (ECCV), 2020
[project page] [paper]
and M. Niessner
Neural Voice Puppetry: Audio-driven Facial Reenactment
European Conference on Computer Vision (ECCV), 2020
[project page] [paper]
and W. Smith
Self-supervised Outdoor Scene Relighting
European Conference on Computer Vision (ECCV), 2020
[project page] [paper] [supplementary]
CVPR Tutorial on Neural Rendering, 2020.
[project page]
Vid2Curve: Simultaneous Camera Motion Estimation and Thin Structure Reconstruction from an RGB Video
ACM Transactions on Graphics (Proc. of SIGGRAPH 2020)
[paper] [video]
XNect: Real-time Multi-person 3D Motion Capture with a Single RGB Camera
ACM Transactions on Graphics (Proc. of SIGGRAPH 2020)
[project page] [paper] [Demo@CVPR19] [SelecSLS-Pytorch]
3D Morphable Face Models - Past, Present and Future.
ACM Transactions on Graphics, 2020
[paper]
State of the Art on Neural Rendering.
Computer Graphics Forum (Eurographics STAR report), 2020
[paper]
Generative Model-Based Loss to the Rescue: A Method to Overcome Annotation Errors for Depth-Based Hand Pose Estimation
FG 2020
[project page] [paper] [video]
DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data.
Computer Vision and Pattern Recognition (CVPR), 2020
[project page] [paper] [video]
MINA: Convex Mixed-Integer Programming for Non-Rigid Shape Alignment.
Computer Vision and Pattern Recognition (CVPR), 2020
[paper]
HandVoxNet: Deep Voxel-Based Network for 3D Hand Shape and Pose Estimation from a Single Depth Map.
Computer Vision and Pattern Recognition (CVPR), 2020
[paper] [supplemental]
A Quantum Computational Approach to Correspondence Problems on Point Sets.
Computer Vision and Pattern Recognition (CVPR), 2020
[paper]
StyleRig: Rigging StyleGAN for 3D Control over Portrait Images
Computer Vision and Pattern Recognition (CVPR), 2020 (Oral)
[project page] [paper] [video]
Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data
Computer Vision and Pattern Recognition (CVPR), 2020
[project page] [paper] [video]
EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera
Computer Vision and Pattern Recognition (CVPR), 2020 (Oral)
[project page] [paper] [video]
DeepCap: Monocular Human Performance Capture Using Weak Supervision
Computer Vision and Pattern Recognition (CVPR), 2020 (Oral)
Recipient of the CVPR 2020 Best Student Paper Honorable Mention Award
[project page] [paper] [video]
Image-guided Neural Object Rendering
International Conference on Learning Representations (ICLR), 2020
[project page] [pdf] [video]
2019
HandSeg: An Automatically Labeled Dataset for Hand Segmentation from Depth Images
Conference on Computer and Robot Vision (CRV), 2019
[project page] [paper]
Intrinsic Dynamic Shape Prior for Dense Non-Rigid Structure from Motion
3DV, 2020
[project page] [paper]
Neural Style-Preserving Visual Dubbing.
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2019)
[project page] [paper] [video]
Optimising for Scale in Globally Multiply-Linked Gravitational Point Set Registration Leads to Singularities.
International Conference on 3DVision (3DV), 2019
[paper] [supplemental]
DispVoxNets: Non-Rigid Point Set Alignment with Supervised Learning Proxies
International Conference on 3DVision (3DV), 2019
[project page] [paper] [video]
Convex Optimisation for Inverse Kinematics
International Conference on 3DVision (3DV), 2019
[paper]
Accelerated Gravitational Point Set Alignment with Altered Physical Laws.
International Conference on Computer Vision (ICCV), 2019
[paper] [supplemental]
HiPPI: Higher-Order Projected Power Iterations for Scalable Multi-Matching
International Conference on Computer Vision (ICCV), 2019
[paper]
Multi-Garment Net: Learning to Dress 3D People from Images
International Conference on Computer Vision (ICCV), 2019
[project page] [paper]
Tex2Shape: Detailed Full Human Body Geometry from a Single Image
International Conference on Computer Vision (ICCV), 2019
[project page] [paper]
Text-based Editing of Talking-head Video
ACM Transactions on Graphics (Proc. of SIGGRAPH 2019)
[project page] [paper] [video]
Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera
ACM Transactions on Graphics (Proc. of SIGGRAPH 2019)
[project page] [paper] [video]
Deep Reflectance Fields - High-Quality Facial Reflectance Field Inference From Color Gradient Illumination
ACM Transactions on Graphics (Proc. of SIGGRAPH 2019)
[project page] [paper] [video]
IsMo-GAN: Adversarial Learning for Monocular Non-Rigid 3D Reconstruction.
Computer Vision and Pattern Recognition Workshops (Photogrammetric Computer Vision Workshop), 2019; Oral.
[paper]
In the Wild Human Pose Estimation Using Explicit 2D Features and Intermediate 3D Representations
Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
[project page] [paper] [video]
Learning to Reconstruct People in Clothing from a Single RGB Camera
Computer Vision and Pattern Recognition (CVPR), 2019
[project page] [paper] [video]
A convex relaxation for multi-graph matching
Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
[paper]
FML: Face Model Learning from Videos
Computer Vision and Pattern Recognition (CVPR), 2019 (Oral)
[project page] [paper] [video]
On Implicit Filter Level Sparsity in Convolutional Neural Networks
Computer Vision and Pattern Recognition (CVPR), 2019
[paper]
Synchronisation of Partial Multi-Matchings via Non-negative Factorisations
Pattern Recognition, 2019
[paper]
Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera
IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VR, 2019)
[project page] [paper]
Face2Face: Real-time Face Capture and Reenactment of RGB Videos
Communications of the ACM 2019
[project page] [pdf] [video]
Neural Animation and Reenactment of Human Actor Videos
ACM Transactions on Graphics(to be presented at SIGGRAPH 2019)
[project page] [paper]
LiveCap: Real-time Human Performance Capture from Monocular Video
ACM Transactions on Graphics (to be presented at SIGGRAPH 2019)
[project page] [paper]
2018
Denoising of point-clouds based on structured dictionary learning
Symposium on Geometry Processing (SGP 2018 Invited Poster)
[pdf]
A lifting method for analyzing distributed synchronization on the unit sphere
Automatica
[pdf]
FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures for On-Skin Input
ACM International Conference on Interactive Surfaces and Spaces (ISS), 2018
[project page] [paper]
High-Fidelity Monocular Face Reconstruction based on an Unsupervised Model-based Face Autoencoder
To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
[project page] [paper] [IEEE]
NRST: Non-rigid Surface Tracking from Monocular Video
German Conference on Pattern Recognition(GCPR), 2018
[project page] [paper]
CurveFusion: Reconstructing Thin Structures from RGBD Sequences
ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2018)
[project page] [paper]
Structured Low-Rank Matrix Factorization for Point-Cloud Denoising
International Conference on 3D Vision (3DV), 2018
[paper]
Single-Shot Multi-Person 3D Pose Estimation From Monocular RGB Input
International Conference on 3D Vision (3DV), 2018
[project page] [paper]
Detailed Human Avatars from Monocular Video
International Conference on 3D Vision (3DV), 2018
[project page] [paper]
A Hybrid Model for Identity Obfuscation by Face Replacement
European Conference on Computer Vision (ECCV), 2018
[project page] [paper]
Deep Video Portraits
ACM Transactions on Graphics (Proc. SIGGRAPH 2018)
[project page] [paper] [video]
HeadOn: Real-time Reenactment of Human Portrait Videos
ACM Transactions on Graphics (Proc. SIGGRAPH 2018)
[project page] [paper] [video]
State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications
Computer Graphics Forum (presented at Eurographics, 2018)
[project page] [pdf]
State of the Art on 3D Reconstruction with RGB-D Cameras
Computer Graphics Forum (presented at Eurographics, 2018)
[project page] [pdf]
Video Based Reconstruction of 3D People Models
Computer Vision and Pattern Recognition (CVPR), 2018
[project page] [pdf] [video]
Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hz
Computer Vision and Pattern Recognition (CVPR), 2018 (Oral)
[project page] [pdf] [video]
InverseFaceNet: Deep Single-Shot Inverse Face Rendering From A Single Image
Computer Vision and Pattern Recognition (CVPR), 2018
[project page] [pdf] [video]
Tighter Lifting-Free Convex Relaxations for Quadratic Matching Problems
Computer Vision and Pattern Recognition (CVPR), 2018
[pdf]
LIME: Live Intrinsic Material Estimation
Computer Vision and Pattern Recognition (CVPR), 2018 (Spotlight)
[project page] [pdf] [video]
GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB
Computer Vision and Pattern Recognition (CVPR), 2018 (Spotlight)
[project page] [pdf] [video]
FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality
ACM Transactions on Graphics (presented at SIGGRAPH 2018)
[project page] [pdf] [video]
Illumination-invariant Robust Multiview 3D Human Motion Capture
Winter Conference on Applications of Computer Vision, WACV 2018
[project page] [pdf] [video]
MonoPerfCap: Human Performance Capture from Monocular Video
ACM Transactions on Graphics (presented at SIGGRAPH 2018)
[project page] [pdf] [video]
2017
Distributed Synchronization of Euclidean Transformations with Guaranteed Convergence
IEEE Conference on Decision and Control (CDC 2017)
[pdf]
Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervision
International Conference on 3D Vision (3DV 2017)
[project page] [pdf]
Opt: A Domain Specific Language for Non-linear Least Squares Optimization in Graphics and Imaging
ACM Transactions on Graphics
[project page] [pdf]
Criteria Sliders: Learning Continuous Database Criteria via Interactive Ranking
The British Machine Vision Conference (BMVC), 2017
[project page]
Building statistical shape spaces for 3D human modeling
Pattern Recognition
[pdf]
Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor
International Conference on Computer Vision (ICCV), 2017
[project page] [pdf] [video]
MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction
International Conference on Computer Vision (ICCV), 2017 (Oral)
[project page] [pdf] [video]
SIGGRAPH 2017 Emerging Technologies
[link] [project page]
BundleFusion: Real-time Globally Consistent 3D Reconstruction using Online Surface Re-integration
ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)
[project page] [pdf] [video]
Demo of VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera
Proc. Computer Vision and Pattern Recognition (Demo) (CVPR 2017)
[project page]
VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera
ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)
[project page] [pdf] [video]
Live User-guided Intrinsic Video For Static Scenes
IEEE Transactions on Visualization and Computer Graphics (to be presented at ISMAR 2017).
[project page] [pdf] [video]
Multi-view Performance Capture of Surface Details
International Journal of Computer Vision (IJCV) 2017.
[project page] [pdf]
WatchSense: On- and Above-Skin Input Sensing through a Wearable Depth Sensor
ACM Conference on Human Factors in Computing Systems (CHI) 2017, Denver, USA
[project page] [pdf] [video]
MARCOnI - ConvNet-based MARker-less Motion Capture in Outdoor and Indoor Scenes
To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
[IEEE page]
2016
National IT Summit 2016
[project page]
Model-based teeth reconstruction
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2016)
[project page] [pdf]
Corrective 3D reconstruction of lips from monocular video
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2016)
[project page] [pdf]
EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2016)
[project page] [pdf]
Model-based Outdoor Performance Capture
International Conference on 3D Vision, 3DV 2016
[project page] [pdf]
Dense Wide-Baseline Scene Flow From Two Handheld Video Cameras.
International Conference on 3D Vision (3DV), 2016
[project page] [pdf]
Real-time Halfway Domain Reconstruction of Motion and Geometry
International Conference on 3D Vision (3DV), 2016
[project page] [pdf]
SIGGRAPH 2016 Emerging Technologies
[link]
Max Planck Forschung 2016
[link]
General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues
ECCV 2016
[project page] [pdf]
Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input
ECCV 2016
[project page] [pdf]
VolumeDeform: Real-time Volumetric Non-rigid Reconstruction
ECCV 2016
[project page] [pdf] [video]
FullHand: Markerless Skeleton-based Tracking for Free-Hand Interaction
MPI-I-2016-4-002. Saarbrücken: Max-Planck-Institut für Informatik 2016.
[Pubman] [pdf]
Live Intrinsic Video
ACM Transactions on Graphics (Proc. of SIGGRAPH 2016).
[project page]
Face2Face: Real-time Face Capture and Reenactment of RGB Videos
Proc. Computer Vision and Pattern Recognition (Oral) (CVPR 2016)
[project page] [pdf]
Reconstruction of Personalized 3D Face Rigs from Monocular Video
ACM Transactions on Graphics (TOG), 2016. (To be presented at SIGGRAPH 2016)
[project page] [pdf low res]
2015
Fast Tracking of Hand and Finger Articulations Using a Single Depth Camera
Technical Report MPI-I-2014-4-002. Saarbrücken: Max-Planck-Institut für Informatik 2015.
[pdf]
A Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation
International Conference on Computer Vision (ICCV), 2015
[project page] [pdf]
Context-guided Diffusion for Label Propagation on Graphs
International Conference on Computer Vision (ICCV), 2015
[project page] [pdf]
HDR Image Noise Calibration for Denoising Tone Mapped Images
European Conference on Visual Media and Production (CVMP), 2015
[project page] [pdf]
Generalizing Wave Gestures from Sparse Examples for Real-time Character Control
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2015).
[project page] [pdf]
Real-time Expression Transfer for Facial Reenactment
ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2015).
[project page] [pdf]
4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation
Computer Graphics Forum (Proc. Pacific Graphics 2015)
[project page] [pdf]
User-Centric Computational Videography
Course at SIGGRAPH 2015
[course page]
Shading-based Refinement on Volumetric Signed Distance Functions.
ACM Transactions on Graphics (Proc. of SIGGRAPH 2015).
[project page] [pdf]
Local High-order Regularization on Data Manifolds.
In Proc. of Computer Vision and Pattern Recognition (CVPR) 2015.
[project page] [pdf]
Semi-supervised Learning with Explicit Relationship Regularization.
In Proc. of Computer Vision and Pattern Recognition (CVPR) 2015.
[project page] [pdf]
S. Sridhar, F. Mueller, A. Oulasvirta, and C. Theobalt.
Fast and Robust Hand Tracking Using Detection-Guided Optimization.
In Proc. of Computer Vision and Pattern Recognition (CVPR) 2015.
[project page]
Efficient ConvNet-based Marker-less Motion Capture in General Scenes with a Low Number of Cameras
In Proc. of Computer Vision and Pattern Recognition (CVPR) 2015.
[project page]
M. Granados, T. Aydin, J. R. Tena, J.-F. Lalonde, and C. Theobalt,
Contrast Use Metrics for Tone Mapping Images
IEEE International Conference on Computational Photography (ICCP), 2015.
[pdf]
Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality
ISBN: 9781482243819 - CAT# K23451, Publisher: CRC Press, 2015.
S. Sridhar, A. M. Feit, C. Theobalt, A. Oulasvirta,
Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry
Proc. of SIGCHI Conference on Human Factors in Computing Systems (CHI) 2015.
[project page] [pdf]
P. Garrido , L. Valgaerts , H. Sarmadi , I. Steiner , K. Varanasi , P. Perez , C. Theobalt,
VDub: Modifying Face Video of Actors for Plausible Visual Alignment to a Dubbed Audio Track
Computer Graphics Forum (Proc. Eurographics 2015).
[project page] [pdf low res]
Y. Kwon, K. I. Kim, J. Tompkin, JH. Kim, C. Theobalt
Efficient Learning of Image Super-resolution and Compression Artifact Removal with Semi-local Gaussian Processes
IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 2015.
[project page] [pdf]
2014
S. Sridhar, H. Rhodin, H.-P. Seidel, A. Oulasvirta, C. Theobalt,
Real-time Hand Tracking Using a Sum of Anisotropic Gaussians Model
Accepted at the International Conference on 3D Vision (3DV), 2014.
[project page]
N. Robertini, E. de Aguiar, T. Helten, C. Theobalt,
Efficient Multi-view Performance Capture of Fine-Scale Surface Detail
International Conference on 3D Vision (3DV), 2014.
[pdf]
A. Elhayek, C. Stoll, K. I. Kim, C. Theobalt,
Outdoor Human Motion Capture by Simultaneous Optimization of Pose and Camera Parameters
Computer Graphics Forum (CGF), 2014.
[pdf] [video] [project page]
C. Wu, M. Zollhöfer, M. Nießner, M. Stamminger, S. Izadi, C. Theobalt,
Real-time Shading-based Refinement for Consumer Depth Cameras
Accepted at SIGGRAPH Asia 33 (6), 200:1--200:10 (2014).
[project page]
T. Neumann, K. Varanasi, C. Theobalt, M. Magnor, M. Wacker,
Compressed Manifold Modes for Mesh Processing
Computer Graphics Forum (Proc. of Symposium on Geometry Processing SGP), vol. 33, no. 5, pp. 1–10, Eurographics Association, 2014.
[pdf]
M. Zollhöfer, M. Nießner, S. Izadi, C. Rheman, C. Zach, M. Fisher, C. Wu, A. Fitzgibbon, C. Loop, C. Theobalt, M. Stamminger,
Real-time Non-rigid Reconstruction using an RGB-D Camera
Accepted at ACM Transactionson Graphics 33 (4) (Proc. SIGGRAPH), 156:1-156:12 (2014).
[project page]
P. Garrido , L. Valgaerts, O. Rehmsen, T. Thormaehlen, P. Pere, and C. Theobalt,
Automatic Face Reenactment
Accepted at CVPR, 4217-4224 (2014).
[project page]
H. Rhodin, J. Tompkin, K.I. Kim, K. Varanasi, H-P Seidel, C. Theobalt,
Interactive Motion Mapping for Real-time Character Control
Computer Graphics Forum (Proceedings Eurographics)33, 273–282 (2014).
[pdf] [project page]
Modified GrabCut for human face segmentation
Ain Shams Engineering Journal 5 (4), 1083 - 1091 (2014)
[pdf]
F. Pece, J. Tompkin, H. Pfister, J. Kautz, C. Theobalt,
Device Effect on Panoramic Video+Context Tasks
Proceedings of European Conference on Visual Media Production (CVMP) 2014.
Local High-order Regularization on Data Manifolds
MMPI-I-2014-4-001, 2014.
S. Sridhar, A. Oulasvirta, C. Theobalt,
Fast Tracking of Hand and Finger Articulations Using a Single Depth Camera
MPI-I-2014-4-002. Saarbrücken: Max-Planck-Institut für Informatik 2015.
2013
T. Neumann, K. Varanasi, S. Wenger, M. Wacker, M. Magno, C. Theobalt,
Sparse localized deformation components
SIGGRAPH Asia 2013.
[pdf] [supplementary material] [video] [project page]
N. Robertini, T. Neumann, K. Varanasi, and C. Theobalt,
Capture of arm muscle deformations using a depth camera
Proceedings of CVMP, 12:1--12:10 (2013). [pdf]
T. Helten, M. Müller, and H.-P. Seidel, and C. Theobalt,
Real-time Body Tracking with One Depth Camera and Inertial Sensors
In 2013 IEEE International Conference on Computer Vision (ICCV) Sydney, Australia, 1105-1112, 2013. [project]
S. Sridhar, A. Oulasvirta, and C. Theobalt,
Interactive Markerless Articulated Hand Motion Tracking using RGB and Depth Data
In 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia, 2456 - 2463 (2013). [project page]
C. Wu, C. Stoll, L. Valgaerts, C. Theobalt,
On-set Performance Capture of Multiple Actors With A Stereo Camera
In ACM Transactions on Graphics (Proc. of SIGGRAPH Asia) 32, 1-11 (2013). [project page]
P. Garrido, L. Valgaerts, C. Wu, C. Theobalt,
Reconstructing Detailed Dynamic Face Geometry from Monocular Video
In ACM Transactions on Graphics (Proc. of SIGGRAPH Asia) 32, 158:1-158:10 (2013). [project page]
J. Tompkin, M.H. Kim, K.I. Kim, J. Kautz, C. Theobalt,
Preference and Artifact Analysis of Video Transitions of Places
In ACM Transactions on Applied Perception vol. 10 (3), 13:1-13:19 (2013). [project page]
J. Tompkin, F. Pece, R. Shah, S. Izadi, J. Kautz, C. Theobalt,
Video Collections in Panoramic Contexts
in: UIST, 131 - 140 (2013). [project page]
M. Granados, K. I. Kim, J. Tompkin, C. Theobalt,
Automatic Noise Modeling for Ghost-free HDR Reconstruction
In ACM Transactions on Graphics (Proc. of SIGGRAPH Asia) 32, 201:1-201:10 (2013). [pdf] [video] [project page]
K. I. Kim, J. Tompkin, C. Theobalt,
Curvature-aware regularization on Riemannian submanifolds
in: ICCV, 881-888 (2013).
Y. Liu, J. Gall, C. Stoll, Q. Dai, H.-P. Seidel, C. Theobalt,
Markerless Motion Capture of Multiple Characters Using Multi-view Image Segmentation
accepted in IEEE Transaction on PAMI 2013. [pdf] [video]
T. Helten, A. Baak, G. Bharaj, M. Müller, H.-P. Seidel, C. Theobalt,
Personalization and Evaluation of a Real-time Depth-based Full Body Tracker
in proceedings of 3DV, 279-286, 2013. [pdf] [video]
T. Neumann, K. Varanasi, N. Hasler, M. Wacker, M. Magnor, C. Theobalt,
Capture and statistical modeling of arm-muscle deformations
in Computer Graphics Forum (Proc. Eurographics) 32, 285-294 (2013). [pdf] [video]
G. Li, C. Wu, C. Stoll, Y. Liu, K. Varanasi, Q. Dai, C. Theobalt,
Capturing Relightable Human Performances under General Uncontrolled Illumination
in Computer Graphics Forum (Proc. Eurographics) 32, 1-8 (2013). [pdf] [video] [project page]
Y. Cui, S. Schuon, S. Thrun, D. Stricker, C. Theobalt,
Algorithms for 3D shape scanning with a depth camera
Transaction on PAMI 35, 1039-1050 (2013).
G. Ye, Y. Liu, Y. Deng, N. Hasler, X. Ji, Q. Dai, C. Theobalt,
Free-viewpoint Video of Human Actors using Multiple Handheld Kinects
accepted in IEEE Trans. System, Man & Cybernetics Part B, vol. 43 (5), 1370-1382 (2013).
D. Kurmankhojayev, N. Hasler, C. Theobalt,
Monocular Pose Capture with a Depth Camera Using a Sums-of-Gaussians Body Model
in: Pattern Recognition (DAGM/GCPR) 35, 415 - 425 (2013).
C. Rupprecht, O. Pauly, C. Theobalt, S. Ilic,
3D Semantic Parameterization for Human Shape Modeling: Application to 3D Animation
in proceedings of 3DV, 255 - 262 (2013).
2012
L. Valgaerts, C. Wu, A. Bruhn, H.-P. Seidel, C. Theobalt,
Lightweight Binocular Facial Performance Capture under Uncontrolled Lighting
in ACM Transactions on Graphics (Proc. SIGGRAPH ASIA), 31 (6), 1-11 (2012). [pdf] [supplementary material] [video] [project page]
M. Granados, K. I. Kim, J. Tompkin, J. Kautz, C. Theobalt,
Background inpainting for videos with dynamic objects and a free-moving camera
in: ECCV, 682 - 695 (2012). [pdf] [video] [project page]
Performance Capture of Interacting Characters with Handheld Kinects. in: ECCV, 272 - 285 (2012). [pdf] [project page]
K. I. Kim, J. Tompkin, M. Theobald, J. Kautz, C. Theobalt,
Match graph construction for large image databases
in European Conference on Computer Vision (ECCV), 2012. [pdf] [supplementary material]
C. Wu, K. Varanasi, C. Theobalt,
Full-body performance capture under uncontrolled and varying illumination : A shading-based approach
European Conference on Computer Vision (ECCV), 757 - 770 (2012). [pdf] [video] [supplementary material]
D. Wu, Y. Liu, I. Ihrke, Q. Dai, C. Theobalt,
Performance Capture of High-Speed Motion Using Staggered Multi-view Recording
Computer Graphics Forum (Proc. Pacific Graphics) 31 (7), 2019 - 2028 (2012). [pdf] [video] [project page]
Y. Kown, K. I. Kim, J.-H. Kim, C. Theobalt,
Efficient learning-based image enhancement: application to super-resolution and compression artifact removal
in BMVC, 340 - 347 (2012). [project page]
M. Richter, K. Varanasi, N. Hasler, C. Theobalt,
Real-time reshaping of humans
International Conference on 3D Imaging, Data Processing, Visualization and Transmission (3DimPVT), 2012. [pdf] [video]
A. Elhayek, C. Stoll, K. I. Kim, H.-P. Seidel, C. Theobalt
Feature-Based Multi-Video Synchronization with Subframe Accuracy
in: Pattern Recognition. Springer Lecture Notes in Computer Science (DAGM), 2012. [pdf] [supplementary material]
J. Tompkin, K.I. Kim, J. Kautz, C. Theobalt
Videoscapes: Exploring Sparse, Unstructured Video Collections
in ACM Transactions on Graphics (Proc. of SIGGRAPH) 31 (4), 1 - 12 (2012). [pdf] [supplementary material] [video] [pptx]
A. Elhayek, C. Stoll, N. Hasler, K. I. Kim, H.-P. Seidel, C. Theobalt
Spatio-temporal Motion Tracking with Unsynchronized Cameras
in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, USA, 1870 - 1877 (2012), [pdf] [video]
G. Bharaj, T. Thormählen, H.-P. Seidel, C. Theobalt
Automatically Rigging Multi-component Characters
in Computer Graphics Forum (Proc. EUROGRAPHICS), 31 (2), 755 - 764 (2012). [pdf] [video] (project page)
How Not to Be Seen - Object Removal from Videos of Crowded Scenes
in Computer Graphics Forum (Proc. EUROGRAPHICS), 31 (2), 219 - 228 (2012). [pdf] [video] [project page]
Coherent Spatiotemporal Filtering, Upsampling and Rendering of RGBZ Videos
in Computer Graphics Forum (Proc. EUROGRAPHICS), 31 (2), 247 - 256 (2012). [pdf] [video] [project page]
Feature-Based Multi-Video Synchronization with Subframe Accuracy
in: Pattern Recognition. Springer Lecture Notes in Computer Science (DAGM), 266 - 275 (2012). [pdf] [supplementary material]
2011
Fast Articulated Motion Tracking using a Sums of Gaussians Body Model
IEEE International Conference on Computer Vision (ICCV), 951 - 958 (2011). [pdf] [video]
Shading-based Dynamic Shape Refinement from Multi-view Video under General Illumination,
IEEE International Conference on Computer Vision (ICCV), 1108 - 1115 (2011).[pdf] [video]
A Data-Driven Approach for Real-Time Full Body Pose Reconstruction from a Depth Camera
IEEE International Conference on Computer Vision (ICCV), 1092 - 1099 (2011). [pdf] [video] (project page)
Video-based Characters - Creating New Human Performances from a Multi-view Video Database
in ACM Transactions on Graphics 30(4) (Proc. of SIGGRAPH 2011) [pdf] [video]
Markerless Motion Capture of Interacting Characters Using Multi-view Image Segmentation
IEEE Conference on Computer Vision and Pattern Recognition (CVPR),
p. 1249-1256, 2011 - oral presentation. [pdf] [video]
High-quality shape from multi-view stereo and shading under general illumination
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2011. [pdf] (data)
Efficient Learning-based Image Enhancement,
MPI-I-2011-4-002, 2011.
2010
Video-based Reconstruction of Animatable Human Characters
on Graphics (Proc. SIGGRAPH ASIA), 29(6), p. 139-149 (2010), Seoul, Korea.
[pdf] [video] [project page]
MovieReshape: Tracking and Reshaping of Humans in Videos
in ACM Transactions on Graphics (Proc. SIGGRAPH ASIA), 29(6), p.149-157 (2010), Seoul, Korea.
[pdf] [video] [project page]
Joint Estimation of Motion, Structure and Geometry from Stereo Sequences
in Proc. of European Conference on Computer Vision (ECCV) 2010.
[pdf] [project page]
Space-Time Visual Effects as a Post-Production Process,
in Proc. ACM Workshop on 3D Video Processing, Firenze, Italy, 1 - 6 (October 2010) (paper)
Optimal HDR reconstruction with linear digital cameras,
In Proc. IEEE CVPR, 215 - 222 (2010) [pdf] [project page]
Y. Cui, S. Schuon, D. Chan, S. Thrun, C. Theobalt
3D Shape Scanning with a Time-of-Flight Camera
In Proc. of CVPR, p. 1173-1180 (2010), [pdf] [supplementary material] [video] [data]
2009
S. Levine, C. Theobalt, V. Koltun,
Real-Time Prosody-Driven Synthesis of Body Language.
in ACM TOG (Proc. of SIGGRAPH Asia), 28(5), 2009, Yokohama, Japan.[pdf] [video]
Y. M. Kim, C. Theobalt, J. Diebel, J. Kosecka, B. Micusik, S. Thrun,
Multi-view Image and ToF Sensor Fusion for Dense 3D Reconstruction.
In Proc. of 3DIM 2009, co-hosted with ICCV 2009. [pdf] (Project Page)
i23 - Rapid Interactive 3D Reconstruction from a Single Image, Proc. VMV, 2009 [pdf][video]
LidarBoost: Depth Superresolution for ToF 3D Shape Scanning.
In Proc. of IEEE CVPR, p. 343-350, 2009. [pdf] [supplementary material][data]
Motion Capture using Joint Skeleton Tracking and Surface Estimation
Proc. IEEE Conference on Computer Vision and Pattern Recognition 2009 [pdf] [project]
2008
Design and Calibration of a Multi-view TOF Sensor Fusion System.
in Proc. IEEE CVPR Workshop on Time-of-flight Computer Vision 2008. [pdf]
in Proc. of ECCV Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications, 2008. [pdf]
High-quality Scanning using Time-of-Flight Depth Superresolution.
in IEEE CVPR Workshop on Time-Of-Flight Computer Vision 2008. [pdf]
Performance Capture from Sparse Multi-view Video,
in Proc. of SIGGRAPH 2008, ACM TOG 27(3), 2008. Los Angeles, USA. [project page]
Robust Fusion of Dynamic Shape and Normal Capture for High-quality Reconstruction of Time-varying Geometry,
in Proc. of CVPR 2008. [pdf] [video]
Dense Correspondence Finding for Parametrization-free Animation Reconstruction from Video,
in Proc. of CVPR 2008. [Oral presentation - Acceptance Rate 3.95%] [pdf] [video]
Automatic Conversion of Mesh Animations into Skeleton-based Animations.
In Proc. of EUROGRAPHICS 2008 (Computer Graphics Forum, vol. 27 issue 2), Crete, Greece.
[BibTeX] [project page]
Floating Textures.
In Proc. of EUROGRAPHICS 2008 (Computer Graphics Forum, vol. 27 issue 2), Crete, Greece. [pdf] [video]
2007
Interactive Global Illumination Using Implicit Visibility,
Accepted by Pacific Graphics 2007 (oral paper),[PDF]
Animation Collage,
Proc. ACM SIGGRAPH/EUROGRAPHICS Symposium on Computer Animation, p. 271-280, 2007, San Diego, USA. [project page]
Spatio-Temporal Registration Techniques for Relightable 3D Video,
Proc. of IEEE ICIP, p. 501-504, 2007 [project page]
Eikonal Rendering - Efficient Light Transport in Refractive Objects.
ACM Transactions on Graphics (Proc. of ACM SIGGRAPH 2007), ACM TOG, 26(3), p. 59ff, San Diego, USA. [project page]
A Generic Framework for Efficient 2D and 3D Facial Expression Analogy,
IEEE Transactions on Multimedia, 9(7), p.1384-1395, 2007. [Publisher's page] (preprint)
A Volumetric Approach to Interactive Shape Editing.
Technical Report MPI-I-2007-4-004, MPII, 2007. [pdf] [avi]
Marker-less Deformable Mesh Tracking for Human Shape and Motion Capture.
In Proc. of IEEE CVPR 2007, Minneapolis, USA.
[pdf] [BibTeX] [project page]
E.de Aguiar, C. Theobalt, C. Stoll, H.-P. Seidel,
Rapid Animation of Laser-scanned Humans,
in Proc. of IEEE Virtual Reality 2007, Charlotte, USA.[paper]
N. Ahmed, C. Theobalt, H.-P. Seidel,
Spatio-temporal Reflectance Sharing for Relighatble 3D Video,
Proc. of MIRAGE, Paris, 2007.[paper] [project page]
G. Ziegler, R. Dimitrov, C. Theobalt, H.-P.Seidel,
Real-time Quadtree Analysis using HistoPyramids,
in Proc. of IS&T/SPIE Symposium on Electronic Imaging, 2007, San Jose, CA.[paper][videos]
High-quality Reconstruction of Virtual Actors from Multi-view Video Streams,
in IEEE Signal Processing Magazine, 24(6), 2007. [pdf]
3DTV: 3D Time-varying Scene Capture Technologies - A Survey, in IEEE Transactions on Circuits and Systems for Video Technology, 17(11), p. 1568-1586, 2007.
Seeing People in Different Light: Joint Shape, Motion, and Reflectance Capture,
in IEEE Transactions on Visualization and Computer Graphics, 13(4), p. 663-674 2007. (publisher's webpage)(PDF)
C. Weidenbach, B. Afshordel, U. Brahm, C. Cohrs, T. Engel, E. Keen, C. Theobalt, D. Topic. System Description: SPASS Version 1.0.0 . In Harald Ganzinger, editor, Proc. 16th Int. Conf. on Automated Deduction (CADE-16-99), LNCS 1632, pages 378-382. Springer Verlag, 1999.
E. de Aguiar, C. Theobalt, C. Stoll, H.-P. Seidel,
Marker-less 3D Feature Tracking for Mesh-based Human Motion Capture,
in ICCV Workshop on Human Motion - Understanding, Modeling, Capture and Animation, LNCS Vol. 4814, p. 1-15, 2007, Rio de Janeiro, Brazil. [pdf].
E. de Aguiar, R. Zayer, C. Theobalt, M. Magnor, H.-P. Seidel,
A Simple Framework for Natural Animation of Digitized Models,
Proc. of SIBGRAPI. IEEE Press, p. 3-10, 2007. [pdf].
E. de Aguiar, R. Zayer, C. Theobalt, M. Magnor, H.-P. Seidel,
Video-driven Animation of Human Body Scans,
Proc. of SIBGRAPI. IEEE Press, p. 3-10, 2007. [pdf].
E. de Aguiar, R. Zayer, C. Theobalt, M. Magnor, H.-P. Seidel,
Video-driven Animation of Human Body Scans,
IEEE 3DTV-Conference, 2007, Kos Island, Greece. [pdf].
C. Stoll, E. de Aguiar, C. Theobalt, H.P. Seidel,
A Volumetric Approach to Interactive Shape Editing ,
MPI-I-2007-4-004, 2007.
2006
G. Ziegler, A. Tevs, C. Theobalt, H.-P. Seidel,
GPU Point List Generation Through Histogram Pyramids,
in Proc. of VMV'06, p. 137--141, Aachen, Germany, 2006. [paper][videos]
Enhanced Dynamic Reflectometry for Relightable Free-Viewpoint Video,
MPI-I-2006-4-006, 2006.
A Framework for Natural Animation of Digitized Models,
MPI-I-2006-4-003, 2006.
A Framework for Natural Animation of Digitized Models,
MPI-I-2006-4-003, 2006.
2005
Reconstructing Human Shape and Motion from Multi-view Video,
in Proc. of CVMP 2005, p. 42-49, London, UK, 2005. [pdf] (project page)
3D Image Analysis and Synthesis at MPI Informatik,
invited paper, in Proc. of Vision, Video and Graphics, p. 85-91, Edinburgh, UK, 2005.
Joint Motion and Reflectance Capture for Creating Relightable 3D Videos,
Technical Report MPI-I-2005-4-004, Max-Planck-Institut fuer Informatik, 2005.
2004
Combining 3D Flow Fields with Silhouette-based Human Motion Capture for Immersive Video,
in Graphical Models, 66, pages 333-351, 2004. (preprint PDF)
3D Video - Being Part of the Movie,
in ACM Computer Graphics, Vol. 38, No. 3, pages 18-20, 2004. [pdf],(complete journal issue)
C. Theobalt, M. Magnor, P. Schueler, H.P. Seidel,
Combining 2D Feature Tracking and Volume Reconstruction for Online Video-based Human Motion Capture,
extended paper, in International Journal of Image and Graphics (IJIG) - Special issue on Combining Images and Graphics, Vol. 4, No. 4, pages 563-583, 2004. (publisher) (preprint).
Marker-free Kinematic Skeleton Estimation from Sequences of Volume Data.
Proc. of ACM Symposium on Virtual Reality Software and Technology (VRST), p.57-64, Hong Kong, China, 2004.[pdf]
M^3: Marker-free Model Reconstruction and Motion Tracking from 3D Voxel Data,
in Proc. of Pacific Graphics, p.101-110, Seoul, Korea, 2004.[pdf]
Model-Based Free-Viewpoint Video: Acquisition, Rendering and Encoding ,
Proc. Picture Coding Symposium (PCS'04), San Francisco, USA, 2004. [pdf]
Pitching a Baseball - Tracking High-Speed Motion with Multi-Exposure Images, Proc. of ACM SIGGRAPH 2004 (ACM Transactions on Graphics Special issue), pages 540-547, Los Angeles, USA, 2004. [pdf] [project page]
2003
Free-Viewpoint Video of Human Actors. in Proc. of ACM SIGGRAPH 2003, p.569-577, San Diego, CA. [pdf] (project page)
2002
C. Theobalt, M. Magnor, P. Schueler, H.P. Seidel,
Combining 2D Feature Tracking and Volume Reconstruction for Online Video-based Human Motion Capture,
. in Proceedings of Pacific Graphics 2002, Beijing, China. p.96-103. [pdf]
C. Theobalt, J. Bos, T. Chapman, A. Espinosa-Romero, M. Fraser, G. Hayes, E. Klein, T. Oka, R. Reeve. Talking to Godot: Dialogue with a Mobile Robot. Proc. of IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS2002). pages 1338-1343. Lausanne, Switzerland. 2002. [pdf]
Projects Pages
G. Ziegler, R. Dimitrov, C. Theobalt, H.-P.Seidel,
Real-time Quadtree Analysis using HistoPyramids,
in Proc. of IS&T/SPIE Symposium on Electronic Imaging, 2007, San Jose, CA.[paper][videos]
G. Ziegler, A. Tevs, C. Theobalt, H.-P. Seidel,
GPU Point List Generation Through Histogram Pyramids,
in Proc. of VMV'06, p. 137--141, Aachen, Germany, 2006. [paper][videos]
