
Abstract Numerous imaging techniques are available for observing and interrogating biological samples, and several of them can be used consecutively to enable correlative analysis of different image modalities with varying resolutions and the inclusion of structural or molecular information. Achieving accurate registration of multimodal images is essential for the correlative analysis process, but it remains a challenging computer vision task with no widely accepted solution. Moreover, supervised registration methods require annotated data produced by experts, which is limited. To address this challenge, we propose a general unsupervised pipeline for multimodal image registration using deep learning. We provide a comprehensive evaluation of the proposed pipeline versus the current state-of-the-art image registration and style transfer methods on four types of biological problems utilizing different microscopy modalities. We found that style transfer of modality domains paired with fully unsupervised training leads to comparable image registration accuracy to supervised methods and, most importantly, does not require human intervention.
Microscopy, Deep Learning, Case Study, QH3015 Molecular biology / molekuláris biológia, 610, Humans, Correlative Microscopy ; Deep Learning ; Microscopy ; Unsupervised Multimodal Image Registration, QR Microbiology / mikrobiológia, QH301 Biology / biológia, 004
Microscopy, Deep Learning, Case Study, QH3015 Molecular biology / molekuláris biológia, 610, Humans, Correlative Microscopy ; Deep Learning ; Microscopy ; Unsupervised Multimodal Image Registration, QR Microbiology / mikrobiológia, QH301 Biology / biológia, 004
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 3 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
