Research Projects

Energy-based modeling for inverse problems


Involved researchers from our group: Martin Holler, Hendrik Kleikamp

Description of the research project:

Bayesian inverse problems have gained significant attention in recent years due to their strong mathematical foundations, which allow for thorough theoretical analysis. Moreover, the incorporation of measurement errors and noise is of utmost importance to obtain reliable results, for instance, in the context of computational imaging problems, such as computed tomography (CT) and magnetic resonance imaging (MRI).

Energy-based methods constitute a particular way to model probability distributions via Gibbs densities containing a suitable energy functional. These approaches can be used to model prior distributions in Bayesian inverse problems. The energy functional is parametrized, for instance, via fields of expert models and learned from image data using modern machine learning architectures. Thanks to its rich mathematical foundations, the Bayesian framework allows for rigorous theoretical guarantees regarding the obtained image reconstructions. A review paper on the topic of energy-based models for inverse imaging problems is available in [HHPZ2025].

A crucial challenge in learning the components of the prior from data lies in sampling from the prior distribution. Two methods, based on subgradient steps and the unadjusted Langevin algorithm, were developed in [HHP2024] and can also be applied to certain non-smooth potentials.

Associated publications:

[HHPZ2025] Habring, Andreas and Holler, Martin and Pock, Thomas and Zach, Martin. Energy-based models for inverse imaging problems. 2025
[HHP2024] Habring, Andreas and Holler, Martin and Pock, Thomas. Subgradient Langevin Methods for Sampling from Nonsmooth Potentials. SIAM Journal on Mathematics of Data Science, 6(4):897-925, Society for Industrial & Applied Mathematics (SIAM), 2024
[NHHP2024] Dominik Narnhofer and Andreas Habring and Martin Holler and Thomas Pock. Posterior-variance-based error quantification for inverse problems in imaging. SIAM Journal on Imaging Sciences, 17:301-333, 2024

Magnetic Resonance Imaging


Involved researchers from our group: Martin Holler, Matthias Höfler, Hendrik Kleikamp

Description of the research project:
Magnetic resonance imaging (MRI) is a versatile and widely used imaging technique that enables visualization of different anatomical structures and physiological processes inside the body. A key disadvantage of MRI, however, is that data acquisition is typically slow, resulting in long per-patient scan times and low overall patient throughput. The challenge is even greater when imaging dynamic objects such as the beating heart, where motion during data acquisition introduces inconsistencies in the data and, consequently, errors in the reconstructed images.

To address this, a well-established strategy is to acquire only a reduced amount of data during an MR measurement and to compensate for the missing information using either hand-crafted or learned imaging models that incorporate prior knowledge about the structure of typical images.

Our research group is actively working in this field, particularly in the context of dynamic MRI. In our work, we have for example developed novel image reconstruction methods that reduce MRI data acquisition times by a factor of eight or more, without compromising the quality or diagnostic value of the reconstructed images.

Associated publications:

[KHKOBS2017] Florian Knoll and Martin Holler and Thomas Koesters and Richardo Otazo and Kristian Bredies and Daniel K Sodickson. Joint MR-PET reconstruction using a multi-channel image regularizer. IEEE Transactions on Medical Imaging, 36(1):1-16, 2017
[SHSBS2017] Matthias Schloegl and Martin Holler and Andreas Schwarzl and Kristian Bredies and Rudolf Stollberger. Infimal convolution of total generalized variation functionals for dynamic MRI. Magnetic Resonance in Medicine, 78(1):142-155, 2017
[LSHBS2019] Andreas Lesch and Matthias Schloegl and Martin Holler and Kristian Bredies and Rudolf Stollberger. Ultrafast 3D Bloch-Siegert B1+-mapping using variational modeling. Magnetic Resonance in Medicine, 81(2):881-892, 2019
[AHKL2023] Abdullah, Abdullah and Holler, Martin and Kunisch, Karl and Landman, Malena Sabate. Latent-Space Disentanglement with Untrained Generator Networks for the Isolation of Different Motion Types in Video Data. Scale Space and Variational Methods in Computer Vision, Springer International Publishing, 2023
[KHKBS2016] Florian Knoll and Martin Holler and Thomas Koesters and Kristian Bredies and Daniel K.~Sodickson. Simultaneous PET-MRI reconstruction with vectorial second order total generalized variation. Proceedings of the 2015 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC), 2016
Reconstructed MR Images < >

Optimal control and model order reduction


Involved researchers from our group: Hendrik Kleikamp

Description of the research project:

Optimal control problems play an important role in several areas of applied mathematics. The governing dynamical systems frequently involve parameters, and the resulting optimal control problem needs to be solved quickly for many different values of the parameters – for instance in a real-time or many-query context. Solving the exact optimal control problem is usually already costly for a single parameter. Hence, doing so for many values of the parameter is prohibitively expensive and infeasible in most applications.

We are interested in applying model order reduction combined with machine learning approaches. Such a combination has proven to achieve significant speedups while maintaining theoretical guarantees such as a posteriori error estimates. In particular, the certifications available for model order reduction methods, such as the reduced basis method, can be transferred to the machine learning prediction as well. This results in certified machine learning methods that are orders of magnitude faster than classical methods [KLM2025], [KR2025]. A purely data-driven method with certification using the high-fidelity model was developed in [KKLOO2022] to improve the results of enhanced oil recovery.

The aforementioned machine learning methods can be integrated in adaptive model hierarchies [HKOSW2023] consisting of a full order model, a reduced model and a machine learning surrogate. It is possible to apply different machine learning approaches [WHKOS2024] while maintaining the certification via the reduced basis approach. Such adaptive model hierarchies are automatically tailored to the parameters of interest and adjust dynamically depending on the performance of the individual components. In the context of parametrized optimal control problems, adaptive model hierarchies have for instance been applied in [K2024].

Most of the methods developed in this research topic are presented extensively in [K2025].

The methods developed in this research area contribute to Work Group 2 (ML for CT) of the COST Action InterCoML, in which we actively participate.

Associated publications:

[HKOSW2023] Haasdonk, Bernard and Kleikamp, Hendrik and Ohlberger, Mario and Schindler, Felix and Wenzel, Tizian. A New Certified Hierarchical and Adaptive RB-ML-ROM Surrogate Model for Parametrized PDEs. SIAM Journal on Scientific Computing, 45(3):A1039--A1065, 2023
[KKLOO2022] Keil, Tim and Kleikamp, Hendrik and Lorentzen, Rolf J. and Oguntola, Micheal B. and Ohlberger, Mario. Adaptive machine learning-based surrogate modeling to accelerate PDE-constrained optimization in enhanced oil recovery. Advances in Computational Mathematics, 48(6):73, 2022
[KLM2025] Kleikamp, Hendrik and Lazar, Martin and Molinari, Cesare. Be greedy and learn: efficient and certified algorithms for parametrized optimal control problems. ESAIM -- Mathematical Modelling and Numerical Analysis, 59(1):291--330, EDP Sciences, 2025
[KR2025] Kleikamp, Hendrik and Renelt, Lukas. Two-Stage Model Reduction Approaches for the Efficient and Certified Solution of Parametrized Optimal Control Problems. Journal of Scientific Computing, 104(3), Springer, 2025
[K2024] Kleikamp, Hendrik. Application of an adaptive model hierarchy to parametrized optimal control problems. 2024
[WHKOS2024] Wenzel, Tizian and Haasdonk, Bernard and Kleikamp, Hendrik and Ohlberger, Mario and Schindler, Felix. Application of Deep Kernel Models for Certified and Adaptive RB-ML-ROM Surrogate Modeling. Lecture Notes in Computer Science, Springer Nature Switzerland, 2024
[K2025] Kleikamp, Hendrik. Parametrized optimal control and transport-dominated problems reduced basis methods, nonlinear reduction strategies and data-driven surrogates. Universität Münster, 2024