Welcome to multimodars documentation!
multimodars: A Rust-powered cardiac multi-image modality fusion package.
Warning
Not intended for clinical use.
This package aims to combine different cardiac imaging modalities to combined 3D models. A particular focus is on the fusion of intravascular imaging (either intravascular ultrasound [IVUS] or optical coherence tomography [OCT]) with a 3D geometry created from computed coronary tomography angiography (CCTA).
The main functionalities are organized into two major categories:
Intravascular Alignment: This category addresses the co-registration of intravascular frames through translation and rotation to minimize the distance between adjacent frames. This approach is particularly useful for correcting misalignments introduced by cardiac motion during intravascular image acquisition. It further encompasses the alignment of separate intravascular pullbacks (e.g., acquired under rest and stress conditions) as well as the co-registration of systolic and diastolic frames within the same pullback.
CCTA-Intravascular Fusion: This category covers the fusion of intravascular frames with a three-dimensional geometry reconstructed from coronary computed tomography angiography (CCTA). This is particularly valuable for generating high-resolution three-dimensional models of coronary arteries by combining the high spatial resolution of intravascular imaging with the three-dimensional geometry provided by CCTA. Functionalities in this category include the anatomical labeling of CCTA geometries based on centerlines, the registration of intravascular frames onto a centerline, and the subsequent fusion of the resulting geometry with the CCTA reconstruction.
Intravascular image data are accepted either as CSV files following the output format of AIVUS, an open-source tool for automated intravascular ultrasound analysis, or directly as NumPy arrays, affording greater flexibility for integration with custom pipelines.
Table of Contents
- Installation
- Intravascular Alignment Tutorial
- CCTA Intravascular Fusion Tutorial
- 1. Read in and prepare CCTA geometries and centerlines
- 2. Prepare centerlines, detect branches, and discretize the vessel tree
- 3. Load and align intravascular geometry
- 4. Label the anomalous region
- 5. Compute scaling factors
- 6. Morph CCTA to intravascular geometry
- 7. Remove intramural region and stitch geometries
- 8. Remesh and smooth
- 9. Visualise and export sections
- 10. Re-label the final geometry
- Intravascular Notebook
- CCTA Notebook
- 1. Read in and prepare CCTA geometries and centerlines
- 2. Discretize CCTA and map reference points
- 3. Load and align intravascular geometry
- 4. Label the anomalous region
- 5. Compute scaling factors
- 6. Morph CCTA to intravascular geometry
- 7. Remove intramural region and stitch geometries
- 8. Remesh and smooth
- 9. Visualise and export sections
- 10. Re-label the final geometry
- Benchmarks
- API Reference
- Changelog multimodars
- [0.4.3] - 2026-06-04
- [0.4.2] - 2026-06-04
- [0.4.1] - 2026-06-02
- [0.4.0] - 2026-05-25
- [0.3.5] - 2026-05-15
- [0.3.4] - 2026-05-13
- [0.3.3] - 2026-05-06 Release JOSS paper
- [0.3.2] - 2026-05-05
- [0.3.1] - 2026-05-04
- [0.3.0] - 2026-04-30
- [0.2.3] - 2026-03-06
- [0.2.2] - 2026-03-03
- [0.2.1] - 2026-01-12
- [0.2.0] - 2026-01-11
- [0.1.2] - 2025-11-21
- [0.1.1] - 2025-11-17
- [0.1.0] - 2025-11-17
License
This package is covered by the open source MIT License.
Developers
Anselm Stark1,2
Marc Ilic1,2
Ali Mokthari1,2
1Department of Cardiology, Inselspital, Bern University Hospital, University of Bern, Switzerland 2Graduate School for Cellular and Biomedical Sciences, University of Bern, Bern, Switzerland
Contributing
We’d welcome your contributions to multimodars. Please read the
contributing guidelines on how to contribute to multimodars.