Friedrich-Alexander-Universität Erlangen-Nürnberg

Chair of Visual Computing
Cognitive Computer Vision Lab


This email address is being protected from spambots. You need JavaScript enabled to view it.

 

I study how humans and machines can perceive faces and shapes in general. In particular, I choose to focus on statistical shape models and the 3D Morphable Models as generative representation since they naturally disentangle the underlying variables. In combination with computer graphics we simulate the image formation process and approach the inverse problem in an analysis-by-synthesis manner. I'm junior professor (adidas Stiftungsprofessur) at the chair of visual computing at Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU). Before joing FAU I was a postdoc in Josh Tenenbaum's Computational Cognitive Science Lab at the Departement of Brain and Cognitive Sciences at MIT and the Center for Brains, Minds and Machines (CBMM) and Polina Golland's group at MIT Computer Science & Artificial Intelligence Lab. I did my PhD on facial image annotation and interpretation in unconstrained images in the Graphics and Vision Research Group at the University of Basel. Before my doctorate I obtained my M.Sc. and B.Sc. in Computer Science at the University of Basel and an upper secondary school teaching Diploma at the University of Applied Sciences Northwestern Switzerland.

Publications

Building 3D Generative Models from Minimal Data [pdf]
Skylar Sutherland, Bernhard Egger, Joshua Tenenbaum
International Journal of Computer Vision (IJCV), 2023

 

PLIKS: A Pseudo-Linear Inverse Kinematic Solver for 3D Human Body Estimation [pdf]
Karthik Shetty, Annette Birkhold, Srikrishna Jaganathan, Norbert Strobel, Markus Kowarschik, Andreas Maier and Bernhard Egger
Conference on Computer Vision and Pattern Recognition (CVPR), June 2023
presented as highlight

 

To fit or not to fit: Model-based Face Reconstruction and Occlusion Segmentation from Weak Supervision [pdf] [code]
Chunlu Li, Andreas Morel-Forster, Thomas Vetter, Bernhard Egger*, Adam Kortylewski*
Conference on Computer Vision and Pattern Recognition (CVPR), June 2023

 

Survey and Systematization of 3D Object Detection Models and Methods [pdf]
Moritz Drobnitzky, Jonas Friederich, Bernhard Egger, Patrick Zschech
The Visual Computer, 2023

 

State of the Art in Dense Monocular Non-Rigid 3D Reconstruction [pdf]
Edith Tretschk, Navami Kairanda, Mallikarjun B R, Rishabh Dabral, Adam Kortylewski, Bernhard Egger, Marc Habermann, Pascal Fua, Christian Theobalt, Vladislav Golyanik
EUROGRAPHICS State-of-the-Art Report (STARs), 2023
DOI: http://dx.doi.org/10.1111/cgf.14774

 

Evaluating 3D human face reconstruction from a frontal 2D image, focusing on facial regions associated with foetal alcohol syndrome [pdf] [press]
Felix Atuhaire, Bernhard Egger, Tinashe Mutsvangwa
South African Journal of Science, 2023
DOI: https://doi.org/10.17159/sajs.2023/12064

 

Approximating Intersections and Differences Between Statistical Shape Models [pdf]
Maximilian Weiherer, Finn Klein, Bernhard Egger
arXiv, 2023

 

ShaRPy: Shape Reconstruction and Hand Pose Estimation from RGB-D with Uncertainty [pdf]
Vanessa Wirth, Anna-Maria Liphardt, Birte Coppers, Johanna Bräunig, Simon Heinrich, Arnd Kleyer, Georg Schett, Martin Vossiek, Bernhard Egger, and Marc Stamminger
arXiv, 2023

 

NeRFtrinsic Four: An End-To-End Trainable NeRF Jointly Optimizing Diverse Intrinsic and Extrinsic Camera Parameters [pdf]
Hannah Schieber, Fabian Deuser, Bernhard Egger, Norbert Oswald, Daniel Roth
arXiv, 2023

 

BOSS: Bones, Organs and Skin Shape Modele [pdf]
Karthik Shetty, Annette Birkhold, Srikrishna Jaganathan, Norbert Strobel, Bernhard Egger, Markus Kowarschik, Andreas Maier
arXiv, 2023

 

Rotation-Equivariant Conditional Spherical Neural Fields for Learning a Natural Illumination Prior [pdf] [project page] [code] [data]
James AD Gardner, Bernhard Egger, William AP Smith
NeurIPS, 2022

 

A Lightweight Machine Learning Pipeline for LiDAR-simulation [pdf]
Richard Marcus, Niklas Knoop, Bernhard Egger and Marc Stamminger
In Proceedings of the 3rd International Conference on Deep Learning Theory and Applications - DeLTA, 176-183, Lisbon, Portugal, 2022
DOI: https://doi.org/10.5220/0011309100003277

 

MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation [pdf] [video]
Safa C. Medin, Bernhard Egger, Anoop Cherian, Ye Wang, Joshua B. Tenenbaum, Xiaoming Liu, Tim K. Marks
36th AAAI Conference on Artificial Intelligence 2022
DOI: https://doi.org/10.1609/aaai.v36i2.20091

 

Learning the shape of female breasts: an open-access 3D statistical shape model of the female breast built from 110 breast scans [pdf]
Maximilian Weiherer, Andreas Eigenberger, Bernhard Egger, Vanessa Brébant, Lukas Prantl, Christoph Palm
The Visual Computer, 2022
DOI: https://doi.org/10.1007/s00371-022-02431-3

 

Identity-Expression Ambiguity in 3D Morphable Face Models [pdf] [video]
Bernhard Egger, Skylar Sutherland, Safa C. Medin, Josh Tenenbaum
Conference on Automatic Face and Gesture Recognition, December 2021
Round 1 accept, oral presentation, best poster award

 

Beyond Flatland: Pre-training with a Strong 3D Inductive Bias [pdf] [talk]
Shubhaankar Gupta, Thomas P O'Connell, Bernhard Egger
Preregistration Workshop at NeurIPS'21.

 

Improving the reconstruction of disentangled representation learners via multi-stage modelling [pdf]
Akash Srivastava, Yamini Bansal, Yukun Ding, Cole Hurwitz, Kai Xu, Bernhard Egger, Prasanna Sattigeri, Josh Tenenbaum, David D Cox, Dan Gutfreund
arXiv, 2021

 

Building 3D Morphable Models from a Single Scan [pdf] [code]
Skylar Sutherland, Bernhard Egger, Josh Tenenbaum
International Conference on Computer Vision (ICCV) Workshops, October 2021

 

Seeing in the dark: Testing deep neural network and analysis-by-synthesis accounts of 3D shape perception with highly degraded images [pdf]
Hakan Yilmaz, Gargi Singh, Bernhard Egger, Joshua B Tenenbaum, Ilker Yildirim
43nd Annual Virtual Meeting of the Cognitive Science Society (CogSci), July 2021

 

Deep Learning compatible Differentiable X-ray Projections for Inverse Rendering [pdf]
Karthik Shetty, Annette Birkhold, Norbert Strobel, Bernhard Egger, Srikrishna Jaganathan, Markus Kowarschik, Andreas Maier
Bildverarbeitung für die Medizin (BVM) 2021

 

What computational model provides the best explanation of face representations in the primate brain? [pdf]
Le Chang, Bernhard Egger, Thomas Vetter, Doris Y. Tsao
Current Biology,  2021
DOI: https://doi.org/10.1101/2020.06.07.111930

 

Inverse Rendering Best Explains Face Perception Under Extreme Illuminations
Bernhard Egger, Max Siegel, Riya Arora, Amir Arsalan Soltani, Ilker Yildirim, Josh Tenenbaum
42nd Annual Virtual Meeting of the Cognitive Science Society (CogSci), July 2020

 

A Morphable Face Albedo Model [pdf] [code] [model]
William A.P Smith, Alassane Seck, Hannah Dee, Bernard Tiddeman, Josh Tenenbaum, Bernhard Egger
Conference on Computer Vision and Pattern Recognition (CVPR), June 2020
oral presentation
https://openaccess.thecvf.com/content_CVPR_2020/papers/Smith_A_Morphable_Face_Albedo_Model_CVPR_2020_paper.pdf

 

3D Morphable Face Models - Past, Present and Future [pdf] [video]
Bernhard Egger, William A.P Smith, Ayush Tewari, Stefanie Wuhrer, Michael Zollhoefer, Thabo Beeler, Florian Bernard, Timo Bolkart, Adam Kortylewski, Sami Romdhani, Christian Theobalt, Volker Blanz, Thomas Vetter
ACM Transactions on Graphics, 2020
DOI: https://doi.org/10.1145/3395208

 

3D Morphable Models (Dagstuhl Seminar 19102) [pdf]
Editors: Bernhard Egger and William Smith and Christian Theobalt and Thomas Vetter
Dagstuhl Reports, Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, 2019
DOI: http://doi.org/10.4230/DagRep.9.3.16

 

Patient-specific Conditional Joint Models of Shape, Image Features and Clinical Indicators [pdf] [video]
Bernhard Egger, Markus Schirmer, Florian Dubost, Marco Nardin, Natalia Rost, Polina Golland
International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) 2019, Shenzhen, China, October 2019
Early Accept
DOI: https://doi.org/10.1007/978-3-030-32251-9_11

 

Analyzing and Reducing the Damage of Dataset Bias to Face Recognition with Synthetic Data [pdf] [code]
Adam Kortylewski, Bernhard Egger, Andreas Schneider, Thomas Gerig, Andreas Morel-Forster, Thomas Vetter
Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2019
Best Paper Award
https://openaccess.thecvf.com/.../Kortylewski_Analyzing_and_Reducing_the_Damage_of_Dataset_Bias_to_Face_CVPRW_2019_paper.pdf

 

Shape in Medical Imaging [webpage]
Editors: Martin Reuter, Christian Wachinger, Hervé Lombaert, Beatriz Paniagua, Marcel Lüthi, Bernhard Egger
International Workshop, ShapeMI 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings
DOI: https://doi.org/10.1007/978-3-030-04747-4

 

Occlusion-aware 3D Morphable Models and an Illumination Prior for Face Image Analysis [pdf] [tutorial] [code]
Bernhard Egger, Sandro Schönborn, Andreas Schneider, Adam Kortylewski, Andreas Morel-Forster, Clemens Blumer and Thomas Vetter
International Journal of Computer Vision (IJCV), 2018
DOI: https://doi.org/10.1007/s11263-018-1064-8

 

Empirically Analyzing the Effect of Dataset Biases on Deep Face Recognition Systems [pdf] [code]
Adam Kortylewski, Bernhard Egger, Andreas Schneider, Thomas Gerig, Andreas Morel-Forster, Thomas Vetter
Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2018
http://openaccess.thecvf.com/content_cvpr_2018_workshops/papers/w41/Kortylewski_Empirically_Analyzing_the_CVPR_2018_paper.pdf

 

Morphable Face Models - An Open Framework [pdf] [code]
Thomas Gerig, Andreas Morel-Forster, Clemens Blumer, Bernhard Egger, Marcel Lüthi, Sandro Schönborn, Thomas Vetter
Conference on Automatic Face and Gesture Recognition, May 2018
DOI: https://doi.org/10.1109/FG.2018.00021

 

A Parametric Freckle Model for Faces [pdf]
Andreas Schneider, Bernhard Egger, Thomas Vetter
Conference on Automatic Face and Gesture Recognition, May 2018
DOI: https://doi.org/10.1109/FG.2018.00069

 

Efficient Global Illumination for Morphable Models [pdf] [tutorial]
Andreas Schneider, Sandro Schönborn, Bernhard Egger, Lavrenti Frobeen, Thomas Vetter
International Conference on Computer Vision (ICCV), October 2017
DOI: https://doi.org/10.1109/ICCV.2017.417

 

Copula Eigenfaces with Attributes: Semiparametric Principal Component Analysis for a Combined Color, Shape and Attribute Model [pdf
Bernhard Egger*, Dinu Kaufmann*, Sandro Schönborn, Volker Roth and Thomas Vetter
Communications in Computer and Information Science book series (CCIS, volume 693), 2017
DOI: https://doi.org/10.1007/978-3-319-64870-5_5

 

Semantic Morphable Models [pdf] [code]
Bernhard Egger
PhD Thesis, University of Basel, 2017
DOI: https://doi.org/10.5451/unibas-006722192

 

Probabilistic Morphable Models [pdf] [code]
Bernhard Egger, Sandro Schönborn, Clemens Blumer, Thomas Vetter
Bookchapter in: Statistical Shape and Deformation Analysis - Methods, Implementation and Applications, Elsevier 2017
DOI: https://doi.org/10.1016/B978-0-12-810493-4.00006-7

 

Markov Chain Monte Carlo for Automated Face Image Analysis [pdf] [tutorial] [code]
Sandro Schönborn, Bernhard Egger, Andreas Morel-Forster, Thomas Vetter
International Journal of Computer Vision (IJCV), 2017
DOI: http://dx.doi.org/10.1007/s11263-016-0967-5  

 

Occlusion-aware 3D Morphable Face Models [data] [pdf] [press] [code]
Bernhard Egger, Andreas Schneider, Clemens Blumer, Andreas Morel-Forster, Sandro Schönborn, Thomas Vetter
British Machine Vision Conference (BMVC), September 2016
DOI: https://dx.doi.org/10.5244/C.30.64

 

Copula Eigenfaces - Semiparametric Principal Component Analysis for Facial Appearance Modeling [pdf
Bernhard Egger*, Dinu Kaufmann*, Sandro Schönborn, Volker Roth and Thomas Vetter
11th International Conference on Computer Graphics Theory and Applications (GRAPP), February 27-29, 2016 
DOI:  http://dx.doi.org/10.5220/0005718800480056

 

Background Modeling for Generative Image Models [pdf] [code]
Sandro Schönborn, Bernhard Egger, Andreas Forster, and Thomas Vetter
Computer Vision and Image Understanding (CVIU), 2015
DOI: http://dx.doi.org/10.1016/j.cviu.2015.01.008 

 

Pose Normalization for Eye Gaze Estimation and Facial Attribute Description from Still Images [pdf
Bernhard Egger, Sandro Schönborn, Andreas Forster and Thomas Vetter
IN: 36th German Conference of Pattern Recognition, GCPR 2014,
Münster, Germany, September 2-5, 2014
DOI: http://dx.doi.org/10.1007/978-3-319-11752-2_25 

 

A Monte Carlo Strategy to Integrate Detection and Model-Based Face Analysis [pdf] [code]
Sandro Schönborn, Andreas Forster, Bernhard Egger and Thomas Vetter
IN: 35th German Conference of Pattern Recognition, GCPR 2013,
Saarbrücken, Germany, September 3-6, 2013
DOI: http://dx.doi.org/10.1007/978-3-642-40602-7_11 

Videos

Identity-Expression Ambiguity in 3D Morphable Face Models - AFC Lab Talk Series

Identity-Expression Ambiguity in 3D Morphable Face Models 

3D Morphable Face Models - Past, Present and Future - Presentation - SIGGRAPH oral

A Morphabe Face Albedo Model

Patient-specific Conditional Joint Models of Shape, Image Features and Clinical Indicators

My presentation at the IPAM Workshop I: Geometric Processing

Varia

Curated List of 3D Morphable Model Software and Data [list]
one result from Dagstuhl seminar on 3D Morphable Models in March 2019

 

Semantic Morphable Model Tutorial [resources]
Bernhard Egger and Thomas Vetter

 

Probabilistic Fitting Tutorial [resources]
Sandro Schönborn, Andreas Morel-Forster, Bernhard Egger and Thomas Vetter

 

Teaching Shape Modelling at High Schools [resources]
Bernhard Egger, Sandro Schönborn and Thomas Vetter
IN: Proceedings of the 2nd Shape Symposium, 2015, Delémont, Switzerland, September 30 - October 2, p 19.
Proceedings: http://shapesymposium.org

SIGBOVIK

From Zero to Hero: Convincing with Extremely Complicated Math [pdf]
Maximilian Weiherer and Bernhard Egger
SIGBOVIK (Special Interest Group on Harry Quechua Bovik),  March 31st 2023

 

A Free Computer Vision Lesson for Car Manufacturers or It is Time to Retire the Erlkonig [pdf]
Maximilian Weiherer and Bernhard Egger
SIGBOVIK (Special Interest Group on Harry Quechua Bovik), April 8st 2022

 

ACTION: A Catchy Title Is all yOu Need! [pdf]
Bernhard Egger, Kevin Smith*, Thomas O’Connell*, Max Siegel (*Co-middle Authors)
SIGBOVIK (Special Interest Group on Harry Quechua Bovik), April 8st 2022

 

(Un)helper functions [pdf]
Kevin Smith and Bernhard Egger
SIGBOVIK (Special Interest Group on Harry Quechua Bovik), April 8st 2022

 

openCHEAT: Computationally Helped Error bar Approximation Tool-Kickstarting Science 4.0 [pdf]
Bernhard Egger, Kevin Smith, David Cox, Max Siegel (Co-First and Co-Last Authors)
SIGBOVIK (Special Interest Group on Harry Quechua Bovik), April 1st 2021

 

HonkFast, PreHonk, HonkBack, PreHonkBack, HERS, AdHonk and AHC: the Missing Keys for Autonomous Driving [pdf]
Bernhard Egger, Max Siegel (Co-First and Co-Last Authors)
SIGBOVIK (Special Interest Group on Harry Quechua Bovik), April 1st 2020
Honk award

 

These authors contributed equally to this work