Research Projects

Energy-based modeling for inverse problems


Involved researchers from our group: Martin Holler, Hendrik Kleikamp

Description of the research project:

Bayesian inverse problems have gained significant attention in recent years due to their strong mathematical foundations, which allow for thorough theoretical analysis. Moreover, the incorporation of measurement errors and noise is of utmost importance to obtain reliable results, for instance, in the context of computational imaging problems, such as computed tomography (CT) and magnetic resonance imaging (MRI).

Energy-based methods constitute a particular way to model probability distributions via Gibbs densities containing a suitable energy functional. These approaches can be used to model prior distributions in Bayesian inverse problems. The energy functional is parametrized, for instance, via fields of expert models and learned from image data using modern machine learning architectures. Thanks to its rich mathematical foundations, the Bayesian framework allows for rigorous theoretical guarantees regarding the obtained image reconstructions. A review paper on the topic of energy-based models for inverse imaging problems is available in [HHPZ2025].

A crucial challenge in learning the components of the prior from data lies in sampling from the prior distribution. Two methods, based on subgradient steps and the unadjusted Langevin algorithm, were developed in [HHP2024] and can also be applied to certain non-smooth potentials.

Associated publications:

[HHPZ2025] Habring, Andreas and Holler, Martin and Pock, Thomas and Zach, Martin. Energy-based models for inverse imaging problems. 2025
[HHP2024] Habring, Andreas and Holler, Martin and Pock, Thomas. Subgradient Langevin Methods for Sampling from Nonsmooth Potentials. SIAM Journal on Mathematics of Data Science, 6(4):897-925, Society for Industrial & Applied Mathematics (SIAM), 2024
[NHHP2024] Dominik Narnhofer and Andreas Habring and Martin Holler and Thomas Pock. Posterior-variance-based error quantification for inverse problems in imaging. SIAM Journal on Imaging Sciences, 17:301-333, 2024

Neural Network Approximation


Involved researchers from our group: Martin Holler, Erion Morina

Description of the research project:

The success of neural network–based machine learning methods stems from their ability to accurately approximate a wide range of functions, enabling them to effectively address diverse real-world problems. This capability is rooted in universal approximation theorems, which position neural networks as versatile and powerful tools for tasks such as image recognition, natural language processing, and predictive modeling.

However, achieving this requires a deep understanding of expressiveness, which determines how well a neural network can capture intricate patterns. This understanding is also key to addressing challenges like overfitting and ensuring robust generalization to unseen data. The study of neural network architectures is also important, including the design of their structures and the choice of activation functions. Developing efficient architectures is a key goal because it ensures models that balance computational cost with high performance across these applications.

Our research group has investigated how the norm of parameters of approximating neural networks behaves asymptotically (see [HM2024]). This is a crucial factor for establishing consistency results in training and plays a significant role in our convergence results for structured model learning, as well as in conducting a full error analysis. In other work, we derived approximation results up to the first derivative with rates for neural networks that use rational functions as activation functions (see [HM2025]).

Associated publications:

[HM2024] Holler, Martin and Morina, Erion. On the growth of the parameters of approximating ReLU neural networks. 2024
[HM2025] Holler, Martin and Morina, Erion. $C^1$-approximation with rational functions and rational neural networks. 2025

Connecting Theoretical Tomography with the World of Computers


Involved researchers from our group: Richard Huber

Description of the research project:
Computed tomography is a crucial method in medicine, allowing doctors to investigate a patient's body's interior. Tomographic reconstruction results in an ill-posed inverse problem whose solution is non-trivial. While theoretical tomography is commonly understood as operator equations in function spaces, in practice, only finitely many measurements can be made, and finitely many calculations can be performed to process them.

Hence, in practice, tomographic reconstruction is performed on computers using discretizations, i.e., reduced models of finite dimensions.

This naturally raises the question of whether the discrete problems are related to our continuous understanding of computed tomography. One cannot hope for discrete inverse problems to fully describe the infinite-dimensional setting; however, one would expect that when refining discretizations, e.g., by increasing resolutions, the discretizations are more and more representative of the infinite-dimensional situation.

The investigations move in multiple directions that benefit each other. Quite naturally the discrete forward operator should be as representative of the true operator as possible, a goal that leads to development of better discretization schemes. But that alone is not enough to guarantee that the solutions we obtained for the discrete problems, in fact, converge to solutions of the continuous inverse problem. Investigating for which methods and which senses this is the case is another key aspect of this project.

Associated publications:

[HA2025] Richard Huber. Convergence of Ray- and Pixel-Driven Discretization Frameworks in the Strong Operator Topology. 2025
[BH2021] Bredies, Kristian and Huber, Richard. Convergence Analysis of Pixel-Driven Radon and Fanbeam Transforms. SIAM Journal on Numerical Analysis, 59(3):1399-1432, 2021
[HB2025] Richard Huber. A Novel Interpretation of the Radon Transform's Ray and Pixel-Driven Discretizations Under Balanced Resolutions. Scale Space and Variational Methods in Computer Vision, Springer Nature Switzerland, 2025

Machine Learning Methods for Emergency Care Medicine


Involved researchers from our group: Martin Holler

Description of the research project:

Cardiac arrest remains a leading cause of death in the Western world, with survival rates around 10%. Timely treatment, including defibrillation and cardiopulmonary resuscitation, is critical for survival. To improve outcomes, analyzing real-world data is essential, yet difficult to obtain. Beyond documentation by emergency medical services, defibrillator recordings are a key data source but are typically limited by proprietary software that allows only predefined analyses.

Our group has worked on several aspects of analyzing defibrillator and physiological data from cardiac arrest cases in order to improve quality control and treatment guidelines in cardiac arrest. Buildin on a large dataset of deffibrillator recordings from cardiac arrest data, we have developed a standardized framework to process and annotate data independent of proprietary tools, a novel algorithm to detect chest compressions from accelerometer-based feedback sensors, and a machine-learning approach where data from accelerometer-based feedback sensors is combined with ECG recordings in order to predict the patient’s circulatory state.

Our work in this field is result of a collaboration with several colleagues from the University of Graz, the Medical University of Graz, the University Hospitals Schleswig-Holstein and Münster, and the German Society of Anaesthisiology & Intensive Care Medicine. As a result of this collaboration, we have implemented a automatic plotting and evaluation tool that is now being used in the German Resuscitation Registry to process data form cardiac arrest treatments throughout Germany and Austria, see here for an onlime demo.

Associated publications:

[OKASBHGW2022] Simon Orlob and Wolfgang J. Kern and Birgitt Alpers and Michael Schörghuber and Andreas Bohn and Martin Holler and Jan-Thorsten Gräsner and Jan Wnent. Chest compression fraction calculation: A new, automated, robust method to identify periods of chest compressions from defibrillator data - Tested in Zoll X Series. Resuscitation, 172:162-169, 2022
[KOBTWGH2023] Wolfgan J. Kern and Simon Orlob and Andreas Bohn and Wolfgang Toller and Jan Wnent and Jan-Thorsten Gräsner and Martin Holler. Accelerometry-based classification of circulatory states during out-of-hospital cardiac arrest. IEEE Transactions on Biomedical Engineering, 70(8):2310-2317, 2023
Examplary Plot < >

Magnetic Resonance Imaging


Involved researchers from our group: Martin Holler, Matthias Höfler, Hendrik Kleikamp

Description of the research project:
Magnetic resonance imaging (MRI) is a versatile and widely used imaging technique that enables visualization of different anatomical structures and physiological processes inside the body. A key disadvantage of MRI, however, is that data acquisition is typically slow, resulting in long per-patient scan times and low overall patient throughput. The challenge is even greater when imaging dynamic objects such as the beating heart, where motion during data acquisition introduces inconsistencies in the data and, consequently, errors in the reconstructed images.

To address this, a well-established strategy is to acquire only a reduced amount of data during an MR measurement and to compensate for the missing information using either hand-crafted or learned imaging models that incorporate prior knowledge about the structure of typical images.

Our research group is actively working in this field, particularly in the context of dynamic MRI. In our work, we have for example developed novel image reconstruction methods that reduce MRI data acquisition times by a factor of eight or more, without compromising the quality or diagnostic value of the reconstructed images.

Associated publications:

[KHKOBS2017] Florian Knoll and Martin Holler and Thomas Koesters and Richardo Otazo and Kristian Bredies and Daniel K Sodickson. Joint MR-PET reconstruction using a multi-channel image regularizer. IEEE Transactions on Medical Imaging, 36(1):1-16, 2017
[SHSBS2017] Matthias Schloegl and Martin Holler and Andreas Schwarzl and Kristian Bredies and Rudolf Stollberger. Infimal convolution of total generalized variation functionals for dynamic MRI. Magnetic Resonance in Medicine, 78(1):142-155, 2017
[LSHBS2019] Andreas Lesch and Matthias Schloegl and Martin Holler and Kristian Bredies and Rudolf Stollberger. Ultrafast 3D Bloch-Siegert B1+-mapping using variational modeling. Magnetic Resonance in Medicine, 81(2):881-892, 2019
[AHKL2023] Abdullah, Abdullah and Holler, Martin and Kunisch, Karl and Landman, Malena Sabate. Latent-Space Disentanglement with Untrained Generator Networks for the Isolation of Different Motion Types in Video Data. Scale Space and Variational Methods in Computer Vision, Springer International Publishing, 2023
[KHKBS2016] Florian Knoll and Martin Holler and Thomas Koesters and Kristian Bredies and Daniel K.~Sodickson. Simultaneous PET-MRI reconstruction with vectorial second order total generalized variation. Proceedings of the 2015 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC), 2016
Reconstructed MR Images < >

Optimal control and model order reduction


Involved researchers from our group: Hendrik Kleikamp

Description of the research project:

Optimal control problems play an important role in several areas of applied mathematics. The governing dynamical systems frequently involve parameters, and the resulting optimal control problem needs to be solved quickly for many different values of the parameters – for instance in a real-time or many-query context. Solving the exact optimal control problem is usually already costly for a single parameter. Hence, doing so for many values of the parameter is prohibitively expensive and infeasible in most applications.

We are interested in applying model order reduction combined with machine learning approaches. Such a combination has proven to achieve significant speedups while maintaining theoretical guarantees such as a posteriori error estimates. In particular, the certifications available for model order reduction methods, such as the reduced basis method, can be transferred to the machine learning prediction as well. This results in certified machine learning methods that are orders of magnitude faster than classical methods [KLM2025], [KR2025]. A purely data-driven method with certification using the high-fidelity model was developed in [KKLOO2022] to improve the results of enhanced oil recovery.

The aforementioned machine learning methods can be integrated in adaptive model hierarchies [HKOSW2023] consisting of a full order model, a reduced model and a machine learning surrogate. It is possible to apply different machine learning approaches [WHKOS2024] while maintaining the certification via the reduced basis approach. Such adaptive model hierarchies are automatically tailored to the parameters of interest and adjust dynamically depending on the performance of the individual components. In the context of parametrized optimal control problems, adaptive model hierarchies have for instance been applied in [K2024].

Most of the methods developed in this research topic are presented extensively in [K2025].

The methods developed in this research area contribute to Work Group 2 (ML for CT) of the COST Action InterCoML, in which we actively participate.

Associated publications:

[HKOSW2023] Haasdonk, Bernard and Kleikamp, Hendrik and Ohlberger, Mario and Schindler, Felix and Wenzel, Tizian. A New Certified Hierarchical and Adaptive RB-ML-ROM Surrogate Model for Parametrized PDEs. SIAM Journal on Scientific Computing, 45(3):A1039--A1065, 2023
[KKLOO2022] Keil, Tim and Kleikamp, Hendrik and Lorentzen, Rolf J. and Oguntola, Micheal B. and Ohlberger, Mario. Adaptive machine learning-based surrogate modeling to accelerate PDE-constrained optimization in enhanced oil recovery. Advances in Computational Mathematics, 48(6):73, 2022
[KLM2025] Kleikamp, Hendrik and Lazar, Martin and Molinari, Cesare. Be greedy and learn: efficient and certified algorithms for parametrized optimal control problems. ESAIM -- Mathematical Modelling and Numerical Analysis, 59(1):291--330, EDP Sciences, 2025
[KR2025] Kleikamp, Hendrik and Renelt, Lukas. Two-Stage Model Reduction Approaches for the Efficient and Certified Solution of Parametrized Optimal Control Problems. Journal of Scientific Computing, 104(3), Springer, 2025
[K2024] Kleikamp, Hendrik. Application of an adaptive model hierarchy to parametrized optimal control problems. 2024
[WHKOS2024] Wenzel, Tizian and Haasdonk, Bernard and Kleikamp, Hendrik and Ohlberger, Mario and Schindler, Felix. Application of Deep Kernel Models for Certified and Adaptive RB-ML-ROM Surrogate Modeling. Lecture Notes in Computer Science, Springer Nature Switzerland, 2024
[K2025] Kleikamp, Hendrik. Parametrized optimal control and transport-dominated problems reduced basis methods, nonlinear reduction strategies and data-driven surrogates. Universität Münster, 2024

Positron Emission Tomography


Involved researchers from our group: Martin Holler, Erion Morina

Description of the research project:

Positron Emission Tomography (PET) is a non-invasive imaging technique that uses radioactive tracers to visualize and measure metabolic activity in the body. By detecting gamma rays from tracer interactions, PET creates detailed 3D images of biological processes. Dynamic PET goes a step further by capturing a series of images over time, providing both spatial and temporal insights into how tracers move and interact, revealing metabolic rates and mechanisms. However, PET imaging faces significant challenges: Reconstructiong a PET image from corresponding measurements requires to solve an inverse problem with a highly ill-posed forward model. Further, PET raw data is usually corrupted by particularly strong noise, which is even more pronounced in dynamic brain PET.

Our research group works on improving PET imaging in several aspects: In some of our works, such as [SHRVKBBN2017, SH2022, SHKBKBN2017, KHKOBS2017] we deal with modelling- and algorithmic aspects of PET image reconstruction, developing efficient algorithms and MR-prior based approaches to improve the quality of the reconstructed images. In other works, such as [HM2024, HM2025], we address more fundamental questions regarding the unique identifiability of physiological parameters in PET tracer kinetic modeling.

Associated publications:

[KHKOBS2017] Florian Knoll and Martin Holler and Thomas Koesters and Richardo Otazo and Kristian Bredies and Daniel K Sodickson. Joint MR-PET reconstruction using a multi-channel image regularizer. IEEE Transactions on Medical Imaging, 36(1):1-16, 2017
[SHRVKBBN2017] Georg Schramm and Martin Holler and Ahmadreza Rezaei and Kathleen Vunckx and Florian Knoll and Kristian Bredies and Fernando Boada and Johan Nuyts. Evaluation of Parallel Level Sets and Bowsher's Method as Segmentation-Free Anatomical Priors for Time-of-Flight PET Reconstruction. IEEE Transaction on Medical Imaging, 37(2):590 - 603, 2017
[SH2022] Georg Schramm and Martin Holler. Fast and memory-efficient reconstruction of sparse Poisson data in listmode with non-smooth priors with application to time-of-flight PET. Physics in Medicine & Biology, 67(15):155020, 2022
[HM2024] Holler, Martin and Morina, Erion and Schramm, Georg. Exact parameter identification in PET pharmacokinetic modeling using the irreversible two tissue compartment model. Physics in Medicine & Biology, 69(16):165008, IOP Publishing, 2024
[HM2025] Holler, Martin and Morina, Erion and Schramm, Georg. Exact Parameter Identification in PET Pharmacokinetic Modeling - Extension to the Reversible Two Tissue Compartment Model. Inverse Problems, 41(9):095009, 2025
[SHKBKBN2017] Georg Schramm and Martin Holler and Thomas Koesters and Fernando Boada and Florian Knoll and Kristian Bredies and Johann Nuyts. PET reconstruction with non-smooth gradient-based priors. Proceedings of the 2016 IEEE Nuclear Science Symposium, Medical Imaging Conference and Room-Temperature Semiconductor Detector Workshop (NSS/MIC/RTSD), 2017

Characterization of Plausible Tomography Data


Involved researchers from our group: Richard Huber

Description of the research project:
Tomography is a crucial method in medicine, allowing doctors to investigate a patient's body's interior from a sequence of independent projections (views of the body -- e.g., via X-rays -- from different directions). The tomographic reconstruction process is ill-posed, i.e., it can be very strongly impacted by minor corruptions of the used data, resulting in undesired artifacts. However, medical imaging data obtained in practice are unavoidably corrupted, not only by random noise, but also by more systematic errors caused by patients' motion or imperfect detector setups.

Thus, preprocessing the data into a suitable form is a key step of tomographic reconstruction. To that end, detecting and correcting said corruptions prior to reconstruction is crucial. Doing so requires differentiation between plausible and implausible data.

One way to describe the plausibility of data is by checking whether they are in the range of tomographic projection operators describing the measurement process. The level of deviation from said range can indicate the level of corruption. However, how can we check whether data is in the range without doing reconstruction? Data in the range inherently possesses information overlaps between different projections that systematic corruptions will perturb.

Hence, the goal of this research is the characterization of tomographic projection operators' ranges and their related inherent information overlap. We develop general methods for characterizing the range of tomographic projection operators and describe how they can be employed in tomographic preprocessing.

Associated publications:

[HCD2025] Huber, Richard and Clackdoyle, Rolf and Desbat, Laurent. Determination of Range Conditions for General Projection Pair Operators. 2025
[H2023] Huber, Richard and Clackdoyle, Rolf and Desbat, Laurent. Pairwise data consistency conditions for the exponential fanbeam transform. Conference Proceedings for the 17th International Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine, 2023
Poster on Data consistency conditions < >

Conformal Prediction for Image Segmentation


Involved researchers from our group: Martin Holler, Bruno Viti

Description of the research project:

Most machine learning-based image segmentation models produce pixel-wise confidence scores that represent the model’s predicted probability for each class label at every pixel. While this information can be particularly valuable in high-stakes domains such as medical imaging, these scores are heuristic in nature and do not constitute rigorous quantitative uncertainty estimates. Conformal prediction (CP) provides a principled framework for transforming heuristic confidence scores into statistically valid uncertainty estimates.

Our research is dedicated to advancing both the theoretical foundations and practical applications of innovative, non-trivial conformal prediction methods aimed at improving the interpretability and reliability of image segmentation. In pre-print [1], we extend pixel-wise CP methods by developing CONSIGN (Conformal Segmentation Informed by Spatial Groupings via Decomposition), a method to leverage spatial correlation for improved results.

The following figure illustrates an example where ignoring the correlation between pixels results in inconsistent predictions and unrealistic pixel combinations. In contrast, our method effectively captures spatial and contextual dependencies, enabling the enforcement of structural constraints. As shown in the figure, our approach achieves a smooth and coherent transition between the segmentation of a sheep and a cow while offering valuable insights into prediction reliability.

Associated publications:

[1] Viti, Bruno and Karabelas, Elias and Holler, Martin. CONSIGN: Conformal Segmentation Informed by Spatial Groupings via Decomposition. 2025
Conformal Prediction < >

Structured model learning


Involved researchers from our group: Martin Holler, Richard Huber, Štěpán Zapadlo, Erion Morina

Description of the research project:

The field of learning PDE-based models from data is growing rapidly. It is driven by the need to bridge physical principles with data-driven insights and enables successful advances in learning unknown parameters in partially specified PDEs, discovering entirely new PDE structures, and approximating solution operators with remarkable accuracy. Alongside practical applications, there is increasing attention to theoretical analysis addressing consistency, convergence, and generalization. These are essential for ensuring the reliability and robustness of learned models in scientific and engineering contexts.

Our research group focuses on the framework of "structured model learning." Structured model learning builds on approximate physical knowledge and addresses the limitations of overly coarse abstractions by incorporating fine-scale physics learned from data. This approach improves interpretability, accuracy, and generality, enabling the model to handle complex scenarios and external factors beyond the scope of simplified physical principles. Augmenting known physics with data-driven components enables the model to effectively describe phenomena, even in non-ideal or challenging contexts. However, it is crucial to learn only what is necessary to ensure that the augmentation remains efficient and grounded in physical understanding.

Our research group is actively engaged in structured model learning, focusing on both the theoretical foundations and the practical applications. We have investigated the unique identifiability of learned fine-scale physics and established a convergence result with practical relevance (see [HM2024]). Currently, a major focus of our work is learning multi-pool dynamics in magnetic resonance imaging (MRI).

Associated publications:

[HM2024] Holler, Martin and Morina, Erion. On uniqueness in structured model learning. 2024
[AHN2023] Christian Aarset and Martin Holler and Tram T. N. Nguyen. Learning-informed parameter identification in nonlinear time-dependent PDEs. Applied Mathematics & Optimization, 88(3):1-53, 2023
Unique Learning < >

Variational Methods for Inverse Problems in Imaging


Involved researchers from our group: Martin Holler, Richard Huber

Description of the research project:

Variational methods are a state-of-the-art approach for solving inverse problems in image processing and beyond. By employing suitable regularization functionals, variational methods enable provably stable and consistent reconstructions for a wide range of inverse imaging problems and effectively compensate for missing data through appropriate mathematical modeling.

Our research group has made several fundamental contributions to the field of variational methods for inverse problems. These include:

  1. the development and analysis of higher-order, non-smooth regularization functionals [BCHKS2025, BCH2022, BH2020, BHSW2018, HHK2018, BH2014],
  2. the creation of non-smooth models for image and video decompression [BH2015a, BH2015b, BH2015c, BH2012], and
  3. the development of novel models for texture data [CHP2020].

Associated publications:

[BH2012] Kristian Bredies and Martin Holler. A total variation-based JPEG decompression model. SIAM Journal on Imaging Sciences, 5(1):366--393, 2012
[BH2014] Kristian Bredies and Martin Holler. Regularization of linear inverse problems with total generalized variation. Journal of Inverse and Ill-Posed Problems, 22(6):871--913, 2014
[BH2015a] Kristian Bredies and Martin Holler. A TGV-based framework for variational image decompression, zooming and reconstruction. Part I: Analytics. SIAM Journal on Imaging Sciences, 8(4):2814-2850, 2015
[BH2015b] Kristian Bredies and Martin Holler. A TGV-based framework for variational image decompression, zooming and reconstruction. Part II: Numerics. SIAM Journal on Imaging Sciences, 8(4):2851--2886, 2015
[HHK2018] Martin Holler and Richard Huber and Florian Knoll. Coupled regularization with multiple data discrepancies. Inverse Problems, 34(8):084003, 2018
[BHSW2018] Kristian Bredies and Martin Holler and Martin Storath and Andreas Weinmann. Total Generalized Variation for manifold-valued data. SIAM Journal on Imaging Sciences, 11(3):1785-1848, 2018
[CHP2020] Antonin Chambolle and Martin Holler and Thomas Pock. A Convex Variational Model for Learning Convolutional Image Atoms from Incomplete Data. Journal of Mathematical Imaging and Vision, 62(3):417-444, Springer, 2020
[BH2020] Kristian Bredies and Martin Holler. Higher-order total variation approaches and generalisations. Inverse Problems. Topical Review, 36(12):123001, 2020
[BCH2022] Kristian Bredies and Marcello Carioni and Martin Holler. Regularization Graphs -- A unified framework for variational regularization of inverse problems. Inverse Problems, 38(10):105006, 2022
[BCHKS2025] Kristian Bredies, Marcello Carioni, Martin Holler, Yury Korolev and Carola-Bibiane Schönlieb. A sparse optimization approach to infinite infimal convolution regularization. Numerische Mathematik, 157:1-96, 2025
[BH2013] Kristan Bredies and Martin Holler. A TGV Regularized Wavelet Based Zooming Model. Scale Space and Variational Methods in Computer Vision, Springer Berlin Heidelberg, 2013
[BH2015c] Kristian Bredies and Martin Holler. Artifact-Free Variational MPEG Decompression. Scale Space and Variational Methods in Computer Vision, Springer, 2015
[BH2012] Kristian Bredies and Martin Holler. A pointwise characterization of the subdifferential of the total variation functional. 2016