A curated list of image registration related books, papers, videos, and toolboxes
Image registration is the process of transforming different sets of data into one coordinate system. Data may be multiple photographs, and from different sensors, times, depths, or viewpoints.
It is used in computer vision, medical imaging, military automatic target recognition, compiling and analyzing images and data from satellites. Registration is necessary in order to be able to compare or integrate the data obtained from different measurements.
[toc]
- Datasets
- Competitions
- Toolbox
- Books
- Tutorials
- Blogs
- Courses Seminars and Videos
- Conferences and Workshops
- Journals
A paper list of image registration.
medi.: medical image | nat.: natural image | rs.: remote sensing | pc.: point cloud
data.: dataset | dep.: deep learning
oth.: other, including correspondence, mapping, matching, alignment...
Statistics: 🔥 code is available & stars >= 100 | ⭐ citation >= 50
Last updated: 2024/12/03
2024/12/03 - update recent papers
2024/04/30 - update recent papers on TPAMI/MICCAI/CVPR/ICCV/ECCV/AAAI/NeurIPS/MIA
2023/03/02 - add papers according to 3D-PointCloud, update recent papers on CVPR/ECCV 2022
2022/07/27 - update recent papers on ECCV 2022
2022/07/14 - add the corresponding open source code for the 2022 papers
2022/07/12 - update recent papers on AAAI 2022 and add information about competitions
2022/06/19 - update recent TPAMI papers (2017-2021) about image registration according to dblp search engine, update recent MICCAI papers about image registration according to MICCAI-OpenSourcePapers.
2022/06/18 - update recent papers (2017-2021) on CVPR/ICCV/ECCV/AAAI/NeurIPS/MIA about image registration according to dblp search engine.
2022/06/18 - update papers (2020-2022) about point cloud registration from awesome-point-cloud-analysis-2023.
2020/04/20 - update recent papers (2017-2020) about point cloud registration and make some diagram about history of image registration.
[MIA] PViT-AIR: Puzzling vision transformer-based affine image registration for multi histopathology and faxitron images of breast tissue.
[MIA] MUsculo-Skeleton-Aware (MUSA) deep learning for anatomically guided head-and-neck CT deformable registration
[AAAI] Test-Time Adaptation via Style and Structure Guidance for Histological Image Registration.
[AAAI] PosDiffNet: Positional Neural Diffusion for Point Cloud Registration in a Large Field of View with Perturbations. [pc.]
[AAAI] SuperJunction: Learning-Based Junction Detection for Retinal Image Registration.
[AAAI] SPEAL: Skeletal Prior Embedded Attention Learning for Cross-Source Point Cloud Registration. [pc.]
[CVPR] Dynamic Cues-Assisted Transformer for Robust Point Cloud Registration.
[CVPR] Bi-level Learning of Task-Specific Decoders for Joint Registration and One-Shot Medical Image Segmentation
[CVPR] H-ViT: A Hierarchical Vision Transformer for Deformable Image Registration
[CVPR] Intraoperative 2D/3D Image Registration via Differentiable X-Ray Rendering.
[CVPR] Scalable 3D Registration via Truncated Entry-Wise Absolute Residuals.
[CVPR] Diffeomorphic Template Registration for Atmospheric Turbulence Mitigation.
[CVPR] Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extension
[CVPR] IIRP-Net: Iterative Inference Residual Pyramid Network for Enhanced Image Registration
[CVPR] Correlation-aware Coarse-to-fine MLPs for Deformable Medical Image Registration
[CVPR] Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration.
[CVPR] ColorPCR: Color Point Cloud Registration with Multi-Stage Geometric-Color Fusion
[CVPR] From a Bird's Eye View to See: Joint Camera and Subject Registration without the Camera Calibration.
[CVPR] Learning Instance-Aware Correspondences for Robust Multi-Instance Point Cloud Registration in Cluttered Scenes.
[CVPR] Inlier Confidence Calibration for Point Cloud Registration
[CVPR] Correspondence-Free Non-Rigid Point Set Registration Using Unsupervised Clustering Analysis
[ECCV] GaussReg: Fast 3D Registration with Gaussian Splatting.
[ECCV] PointRegGPT: Boosting 3D Point Cloud Registration Using Generative Point-Cloud Pairs for Training
[ECCV] SemReg: Semantics Constrained Point Cloud Registration
[ECCV] Unsupervised Multi-modal Medical Image Registration via Invertible Translation.
[ECCV] UMERegRobust - Universal Manifold Embedding Compatible Features for Robust Point Cloud Registration
[ECCV] Equi-GSPR: Equivariant SE(3) Graph Network Model for Sparse Point Cloud Registration
[ECCV] NICP: Neural ICP for 3D Human Registration at Scale.
[ECCV] Fast Registration of Photorealistic Avatars for VR Facial Animation.
[ECCV] Weakly-Supervised Camera Localization by Ground-to-Satellite Image Registration
[ECCV] NePhi: Neural Deformation Fields for Approximately Diffeomorphic Medical Image Registration
[ECCV] Diff-Reg: Diffusion Model in Doubly Stochastic Matrix Space for Registration Problem
[ECCV] ML-SemReg: Boosting Point Cloud Registration with Multi-level Semantic Consistency.
[ECCV] PARE-Net: Position-Aware Rotation-Equivariant Networks for Robust Point Cloud Registration.
[ECCV] Adaptive Correspondence Scoring for Unsupervised Medical Image Registration
[ECCV] Correspondence-Free SE(3) Point Cloud Registration in RKHS via Unsupervised Equivariant Learning.
[TPAMI] Match Normalization: Learning-Based Point Cloud Registration for 6D Object Pose Estimation in the Real World
[TPAMI] Efficient and Robust Point Cloud Registration via Heuristics-Guided Parameter Search.
[TPAMI] Transformation Decoupling Strategy Based on Screw Theory for Deterministic Point Cloud Registration With Gravity Prior.
[TPAMI] MAC: Maximal Cliques for 3D Registration
[TPAMI] RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registration. [pc.]
[MICCAI] Keypoint Matching for Instrument-Free 3D Registration in Video-Based Surgical Navigation.
[MICCAI] WiNet: Wavelet-Based Incremental Learning for Efficient Medical Image Registration
[MICCAI] Intraoperative Registration by Cross-Modal Inverse Neural Rendering.
[MICCAI] One Registration is Worth Two Segmentations.
[MICCAI] Epicardium Prompt-Guided Real-Time Cardiac Ultrasound Frame-to-Volume Registration
[MICCAI] GMM-CoRegNet: A Multimodal Groupwise Registration Framework Based on Gaussian Mixture Model.
[MICCAI] Biomechanics-Informed Non-rigid Medical Image Registration and its Inverse Material Property Estimation with Linear and Nonlinear Elasticity.
[MICCAI] Data-Driven Tissue- and Subject-Specific Elastic Regularization for Medical Image Registration
[MICCAI] Hierarchical Symmetric Normalization Registration Using Deformation-Inverse Network
[MICCAI] PULPo: Probabilistic Unsupervised Laplacian Pyramid Registration
[MICCAI] DINO-Reg: General Purpose Image Encoder for Training-Free Multi-modal Deformable Medical Image Registration
[MICCAI] uniGradICON: A Foundation Model for Medical Image Registration
[MICCAI] LIBR+: Improving Intraoperative Liver Registration by Learning the Residual of Biomechanics-Based Deformable Registration
[MICCAI] Groupwise Deformable Registration of Diffusion Tensor Cardiovascular Magnetic Resonance: Disentangling Diffusion Contrast, Respiratory and Cardiac Motions
[MICCAI] Toward Universal Medical Image Registration via Sharpness-Aware Meta-Continual Learning.
[MICCAI] TLRN: Temporal Latent Residual Networks for Large Deformation Image Registration.
[MICCAI] Noise Removed Inconsistency Activation Map for Unsupervised Registration of Brain Tumor MRI Between Pre-operative and Follow-Up Phases.
[MICCAI] On-the-Fly Guidance Training for Medical Image Registration.
[MICCAI] MemWarp: Discontinuity-Preserving Cardiac Registration with Memorized Anatomical Filters
[MICCAI] Heteroscedastic Uncertainty Estimation Framework for Unsupervised Registration
[MICCAI] Deep-Learning-Based Groupwise Registration for Motion Correction of Cardiac T1 Mapping.
[MICCAI] DiffuseReg: Denoising Diffusion Model for Obtaining Deformation Fields in Unsupervised Deformable Image Registration
[MIA] Placental vessel segmentation and registration in fetoscopy: Literature review and MICCAI FetReg2021 challenge findings.
[MIA] Classification, registration and segmentation of ear canal impressions using convolutional neural networks.
[MIA] JOSA: Joint surface-based registration and atlas construction of brain geometry and function.
[MIA] Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery.
[MIA] CMAN: Cascaded Multi-scale Spatial Channel Attention-guided Network for large 3D deformable registration of liver CT images
[MIA] SUGAR: Spherical ultrafast graph attention framework for cortical surface registration
[MIA] Comparing regularized Kelvinlet functions and the finite element method for registration of medical images to sparse organ data
[MIA] Medical image registration via neural fields
[MIA] Privacy preserving image registration.
[MIA] Retinal image registration method for myopia development.
[MIA] The ACROBAT 2022 challenge: Automatic registration of breast cancer tissue
[MIA] PRSCS-Net: Progressive 3D/2D rigid Registration network with the guidance of Single-view Cycle Synthesis.
[MIA] Longitudinally consistent registration and parcellation of cortical surfaces using semi-supervised learning.
[MIA] Residual Aligner-based Network (RAN): Motion-separable structure for coarse-to-fine discontinuous deformable registration. [Code] [medi.]
[NeurIPS] Lung250M-4B: A Combined 3D Dataset for CT- and Point Cloud-Based Intra-Patient Lung Registration. [**data. ** pc.]
[NeurIPS] SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose Estimation. [pc.]
[NeurIPS] Non-Rigid Shape Registration via Deep Functional Maps Prior.
[NeurIPS] E2PNet: Event to Point Cloud Registration with Spatio-Temporal Representation Learning. [pc.]
[NeurIPS] Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matching. [pc.]
[ICCV] DReg-NeRF: Deep Registration for Neural Radiance Fields.
[ICCV] Rethinking Point Cloud Registration as Masking and Reconstruction. [pc.]
[ICCV] SIRA-PCR: Sim-to-Real Adaptation for 3D Point Cloud Registration. [pc.]
[ICCV] AutoSynth: Learning to Generate 3D Training Data for Object Point Cloud Registration. [pc.]
[ICCV] Preserving Tumor Volumes for Unsupervised Medical Image Registration.
[ICCV] Towards Saner Deep Image Registration.
[ICCV] Point-TTA: Test-Time Adaptation for Point Cloud Registration Using Multitask Meta-Auxiliary Learning. [pc.]
[ICCV] Chasing clouds: Differentiable volumetric rasterisation of point clouds as a highly efficient and accurate loss for large-scale deformable 3D registration. [pc.]
[ICCV] Center-Based Decoupled Point Cloud Registration for 6D Object Pose Estimation. [pc.]
[ICCV] 2D3D-MATR: 2D-3D Matching Transformer for Detection-free Registration between Images and Point Clouds. [pc.]
[ICCV] RegFormer: An Efficient Projection-Aware Transformer Network for Large-Scale Point Cloud Registration. [pc.]
[ICCV] Density-invariant Features for Distant Point Cloud Registration. [pc.]
[ICCV] Batch-based Model Registration for Fast 3D Sherd Reconstruction.
[ICCV] PointMBF: A Multi-scale Bidirectional Fusion Network for Unsupervised RGB-D Point Cloud Registration. [pc.]
[ICCV workshop] Occluded Gait Recognition via Silhouette Registration Guided by Automated Occlusion Degree Estimation.
[CVPR] BUFFER: Balancing Accuracy, Efficiency, and Generalizability in Point Cloud Registration. [pc.]
[CVPR] Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields.
[CVPR] ObjectMatch: Robust Registration using Canonical Object Correspondences.
[CVPR] PEAL: Prior-embedded Explicit Attention Learning for Low-overlap Point Cloud Registration. [pc.]
[CVPR] Indescribable Multi-modal Spatial Evaluator [Code] [medi.]
[CVPR] Robust Outlier Rejection for 3D Registration with Variational Bayes [Code] [pc.]
[CVPR] 3D Registration with Maximal Cliques [Code] [pc.]
[CVPR] Deep Graph-based Spatial Consistency for Robust Non-rigid Point Cloud Registration [Code] [pc.]
[CVPR] Unsupervised Deep Probabilistic Approach for Partial Point Cloud Registration [pc.]
[CVPR] Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweighting [Code] [pc.]
[AAAI] Rethinking Rotation Invariance with Point Cloud Registration [Code] [pc.]
[AAAI] Fourier-Net: Fast Image Registration with Band-Limited Deformation.
[AAAI] Stroke Extraction of Chinese Character Based on Deep Structure Deformable Image Registration.
[TPAMI] RoReg: Pairwise Point Cloud Registration with Oriented Descriptors and Local Rotations [Code] [pc.]
[TPAMI] DPCN++: Differentiable Phase Correlation Network for Versatile Pose Registration.
[TPAMI] SC${2}$2-PCR++: Rethinking the Generation and Selection for Efficient and Robust Point Cloud Registration. [pc.]
[TPAMI] Robust Point Cloud Registration Framework Based on Deep Graph Matching. [pc.]
[TPAMI] Multiway Non-Rigid Point Cloud Registration via Learned Functional Map Synchronization. [pc.]
[TPAMI] QGORE: Quadratic-Time Guaranteed Outlier Removal for Point Cloud Registration. [pc.]
[TPAMI] Sparse-to-Dense Matching Network for Large-Scale LiDAR Point Cloud Registration [pc.]
[TPAMI] HRegNet: A Hierarchical Network for Efficient and Accurate Outdoor LiDAR Point Cloud Registration. [pc.]
[TPAMI]
[TPAMI] Learning General and Distinctive 3D Local Deep Descriptors for Point Cloud Registration. [pc.]
[TPAMI] GeoTransformer: Fast and Robust Point Cloud Registration With Geometric Transformer. [pc.]
[TPAMI] Cycle Registration in Persistent Homology With Applications in Topological Bootstrap.
[TPAMI] STORM: Structure-Based Overlap Matching for Partial Point Cloud Registration. [pc.]
[TPAMI] MURF: Mutually Reinforcing Multi-Modal Image Registration and Fusion.
[TPAMI] A New Outlier Removal Strategy Based on Reliability of Correspondence Graph for Fast Point Cloud Registration. [pc.]
[TPAMI] Hunter: Exploring High-Order Consistency for Point Cloud Registration With Severe Outliers. [pc.]
[TPAMI] Fast and Robust Non-Rigid Registration Using Accelerated Majorization-Minimization.
[MICCAI] A Denoised Mean Teacher for Domain Adaptive Point Cloud Registration. code [pc.]
[MICCAI] Unsupervised 3D Registration Through Optimization-Guided Cyclical Self-training. code
[MICCAI] Implicit Neural Representations for Joint Decomposition and Registration of Gene Expression Images in the Marmoset Brain. code
[MICCAI] An Unsupervised Multispectral Image Registration Network for Skin Diseases code
[MICCAI] GSMorph: Gradient Surgery for Cine-MRI Cardiac Deformable Registration. code
[MICCAI] Inverse Consistency by Construction for Multistep Deep Registration. code
[MICCAI] Learning Expected Appearances for Intraoperative Registration During Neurosurgery. code
[MICCAI] StructuRegNet: Structure-Guided Multimodal 2D-3D Registration.
[MICCAI] SAMConvex: Fast Discrete Optimization for CT Registration Using Self-supervised Anatomical Embedding and Correlation Pyramid
[MICCAI] Co-learning Semantic-Aware Unsupervised Segmentation for Pathological Image Registration. code
[MICCAI] PIViT: Large Deformation Image Registration with Pyramid-Iterative Vision Transformer. code
[MICCAI] CortexMorph: Fast Cortical Thickness Estimation via Diffeomorphic Registration Using VoxelMorph code
[MICCAI] Non-iterative Coarse-to-Fine Transformer Networks for Joint Affine and Deformable Image Registration.
[MICCAI] FSDiffReg: Feature-Wise and Score-Wise Diffusion-Guided Unsupervised Deformable Image Registration for Cardiac Images. code
[MICCAI] WarpEM: Dynamic Time Warping for Accurate Catheter Registration in EM-Guided Procedures.
[MICCAI] Regularized Kelvinlet Functions to Model Linear Elasticity for Image-to-Physical Registration of the Breast.
[MICCAI] DISA: DIfferentiable Similarity Approximation for Universal Multimodal Registration. code
[MICCAI] FocalErrorNet: Uncertainty-Aware Focal Modulation Network for Inter-modal Registration Error Estimation in Ultrasound-Guided Neurosurgery.
[MICCAI] X-Ray to CT Rigid Registration Using Scene Coordinate Regression. code
[MICCAI] Nonuniformly Spaced Control Points Based on Variational Cardiac Image Registration.
[MICCAI] Progressively Coupling Network for Brain MRI Registration in Few-Shot Situation.
[MICCAI] ModeT: Learning Deformable Image Registration via Motion Decomposition Transformer. code
[MICCAI] Importance Weighted Variational Cardiac MRI Registration Using Transformer and Implicit Prior
[MICCAI] TractCloud: Registration-Free Tractography Parcellation with a Novel Local-Global Streamline Point Cloud Representation
[MICCAI] A Novel Video-CTU Registration Method with Structural Point Similarity for FURS Navigation.
[MICCAI] A Patient-Specific Self-supervised Model for Automatic X-Ray/CT Registration code
[MICCAI] SPR-Net: Structural Points Based Registration for Coronary Arteries Across Systolic and Diastolic Phases
[MIA] Strain estimation in aortic roots from 4D echocardiographic images using medial modeling and deformable registration.
[MIA] Colonoscopy 3D video dataset with paired depth from 2D-3D registration.
[MIA] AMNet: Adaptive multi-level network for deformable registration of 3D brain MR images.
[MIA] DuSFE: Dual-Channel Squeeze-Fusion-Excitation co-attention for cross-modality registration of cardiac SPECT and CT.
[MIA] Semantic similarity metrics for image registration.
[MIA] R2Net: Efficient and flexible diffeomorphic image registration using Lipschitz continuous residual networks.
[MIA] Anatomically constrained and attention-guided deep feature fusion for joint segmentation and deformable medical image registration.
[MIA] Prototypical few-shot segmentation for cross-institution male pelvic structures with spatial registration.
[MIA] WarpPINN: Cine-MR image registration with physics-informed neural networks.
[MIA] A robust and interpretable deep learning framework for multi-modal registration via keypoints.
[MIA] PC-Reg: A pyramidal prediction-correction approach for large deformation image registration.
[MIA] DragNet: Learning-based deformable registration for realistic cardiac MR sequence generation from a single frame.
[MIA] SpineRegNet: Spine Registration Network for volumetric MR and CT image by the joint estimation of an affine-elastic deformation field.
[MIA] QACL: Quartet attention aware closed-loop learning for abdominal MR-to-CT synthesis via simultaneous registration.
[EECV] Bayesian Tracking of Video Graphs Using Joint Kalman Smoothing and Registration.
[EECV] Learning-Based Point Cloud Registration for 6D Object Pose Estimation in the Real World. [pc.]
[EECV] DiffuseMorph: Unsupervised Deformable Image Registration Using Diffusion Model. [Code]
[EECV] PCR-CG: Point Cloud Registration via Deep Explicit Color and Geometry. [Code]
[EECV] Unsupervised Deep Multi-shape Matching. [Code]
[EECV] ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformer. [Code]
[EECV] CMT: Context-Matching-Guided Transformer for 3D Tracking in Point Clouds. [code]
[EECV] A Comparative Study of Graph Matching Algorithms in Computer Vision.
[EECV] Self-supervised Learning of Visual Graph Matching.
[EECV] 3DG-STFM: 3D Geometric Guided Student-Teacher Feature Matching. [Code]
[EECV] Is Geometry Enough for Matching in Visual Localization?
[EECV] Explaining Deepfake Detection by Analysing Image Matching [Code]
[EECV] Semi-Supervised Keypoint Detector and Descriptor for Retinal Image Matching [Code]
[EECV] DFNet: Enhance Absolute Pose Regression with Direct Feature Matching [Code]
[EECV] Unitail: Detecting, Reading, and Matching in Retail Scene
[EECV] Implicit field supervision for robust non-rigid shape matching [Code]
[EECV] Registration based Few-Shot Anomaly Detection [Code]
[ECCV] Improving RGB-D Point Cloud Registration by Learning Multi-scale Local Linear Transformation [Code] [pc.]
[ECCV] PointCLM: A Contrastive Learning-based Framework for Multi-instance Point Cloud Registration [Code] [pc.]
[ECCV] SuperLine3D: Self-supervised Line Segmentation and Description for LiDAR Point Cloud [Code] [pc.]
[AAAI] Stochastic Planner-Actor-Critic for Unsupervised Deformable Image Registration. [code] [medi.]
[AAAI] DeTarNet: Decoupling Translation and Rotation by Siamese Network for Point Cloud Registration. [code] [pc.]
[AAAI] Deep Confidence Guided Distance for 3D Partial Shape Registration.
[AAAI] Reliable Inlier Evaluation for Unsupervised Point Cloud Registration. [code] [pc.]
[AAAI] FINet: Dual Branches Feature Interaction for Partial-to-Partial Point Cloud Registration. [code] [pc.]
[AAAI] End-to-End Learning the Partial Permutation Matrix for Robust 3D Point Cloud Registration. [pc.]
[CVPR] Deterministic Point Cloud Registration via Novel Transformation Decomposition. [pc.]
[CVPR] Aladdin: Joint Atlas Building and Diffeomorphic Registration Learning with Pairwise Alignment. [Code]
[CVPR] Coherent Point Drift Revisited for Non-rigid Shape Matching and Registration. [Code]
[CVPR] A variational Bayesian method for similarity learning in non-rigid image registration. [Code]
[CVPR] Affine Medical Image Registration with Coarse-to-Fine Vision Transformer. [Code]
[CVPR] Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow. [Code]
[CVPR] Global-Aware Registration of Less-Overlap RGB-D Scans. [Code]
[CVPR] Multi-instance Point Cloud Registration by Efficient Correspondence Clustering. [Code] [pc.]
[CVPR] NODEO: A Neural Ordinary Differential Equation Based Optimization Framework for Deformable Image Registration. [Code]
[CVPR] RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion.
[CVPR] REGTR: End-to-end Point Cloud Correspondences with Transformers. [code] [pc.]
[CVPR] SC2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registration. [code] [pc.]
[CVPR] Geometric Transformer for Fast and Robust Point Cloud Registration. [code] [pc.] 🔥
[CVPR] Lepard: Learning partial point cloud matching in rigid and deformable scenes [Code]
[MICCAI] Adapting the Mean Teacher for Keypoint-Based Lung Registration Under Geometric Domain Shifts.
[MICCAI] Vol2Flow: Segment 3D Volumes Using a Sequence of Registration Flows.
[MICCAI] Deformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration.
[MICCAI] Dual-Branch Squeeze-Fusion-Excitation Module for Cross-Modality Registration of Cardiac SPECT and CT.
[MICCAI] ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registration.
[MICCAI] Learning Iterative Optimisation for Deformable Image Registration of Lung CT with Recurrent Convolutional Networks.
[MICCAI] Weakly-Supervised Biomechanically-Constrained CT/MRI Registration of the Spine.
[MICCAI] End-to-End Multi-Slice-to-Volume Concurrent Registration and Multimodal Generation
[MICCAI] On the Dataset Quality Control for Image Registration Evaluation.
[MICCAI] DSR: Direct Simultaneous Registration for Multiple 3D Images
[MICCAI] Global Multi-modal 2D/3D Registration via Local Descriptors Learning.
[MICCAI] Non-iterative Coarse-to-Fine Registration Based on Single-Pass Deep Cumulative Learning. code
[MICCAI] An Optimal Control Problem for Elastic Registration and Force Estimation in Augmented Surgery.
[MICCAI] Unsupervised Deformable Image Registration with Absent Correspondences in Pre-operative and Post-recurrence Brain Tumor MRI Scans.
[MICCAI] Embedding Gradient-Based Optimization in Image Registration Networks.
[MICCAI] Collaborative Quantization Embeddings for Intra-subject Prostate MR Image Registration.
[MICCAI] XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attention.
[MICCAI] Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network.
[MICCAI] A Deep-Discrete Learning Framework for Spherical Surface Registration.
[MICCAI] Privacy Preserving Image Registration.
[MICCAI] LiftReg: Limited Angle 2D/3D Deformable Registration.
[MICCAI] Electron Microscope Image Registration Using Laplacian Sharpening Transformer U-Net.
[MICCAI] Double-Uncertainty Guided Spatial and Temporal Consistency Regularization Weighting for Learning-Based Abdominal Registration.
[MICCAI] SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI.
[MICCAI] Learning-Based US-MR Liver Image Registration with Spatial Priors
[MICCAI] Swin-VoxelMorph: A Symmetric Unsupervised Learning Model for Deformable Medical Image Registration Using Swin Transformer.
[MIA] Robust joint registration of multiple stains and MRI for multimodal 3D histology reconstruction: Application to the Allen human brain atlas. [medi.] [code]
[MIA] Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance. [medi.]
[MIA] Dual-stream pyramid registration network. [medi.] [Unofficial code]
[MIA] Atlas-ISTN: Joint segmentation, registration and atlas construction with image-and-spatial transformer networks. [medi.]
[NeurIPS] Non-rigid Point Cloud Registration with Neural Deformation Pyramid [Code]
[NeurIPS] One-Inlier is First: Towards Efficient Position Encoding for Point Cloud Registration.
[ICLR] Partial Wasserstein Adversarial Network for Non-rigid Point Set Registration]
[TIP] GraphReg: Dynamical Point Cloud Registration with Geometry-aware Graph Signal Processing [Code]
[TPAMI] Robust Point Cloud Registration Framework Based on Deep Graph Matching [Code]
[TPAMI] RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registration
[SIGGRAPH] ImLoveNet: Misaligned Image-supported Registration Network for Low-overlap Point Cloud Pairs
[ACM MM] You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant Descriptors [Code]
[TVCG] WSDesc: Weakly Supervised 3D Local Descriptor Learning for Point Cloud Registration [Code]
[RAL] GraffMatch: Global Matching of 3D Lines and Planes for Wide Baseline LiDAR Registration
[CVPR] PREDATOR: Registration of 3D Point Clouds with Low Overlap. [code-pytorch] [pc.] 🔥
[CVPR] SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration. [code-pytorch] [pc.] 🔥
[CVPR] Robust Point Cloud Registration Framework Based on Deep Graph Matching. [code] [pc.]
[CVPR] PointDSC: Robust Point Cloud Registration using Deep Spatial Consistency. [pc.]
[CVPR] ReAgent: Point Cloud Registration using Imitation and Reinforcement Learning.[pc.]
[CVPR] DeepI2P: Image-to-Point Cloud Registration via Deep Classification. [code] [pc.] 🔥
[CVPR] UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Rendering. [pc.]
[CVPR] PointNetLK Revisited. [code] [pc.]
[CVPR] RPSRNet: End-to-End Trainable Rigid Point Set Registration Network Using Barnes-Hut 2D-Tree Representation
[CVPR] Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration
[CVPR] Recurrent Multi-View Alignment Network for Unsupervised Surface Registration.
[CVPR] Spatiotemporal Registration for Event-Based Visual Odometry.
[CVPR] Learning-Based Image Registration With Meta-Regularization.
[CVPR] Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registration.
[ICCV] HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud Registration. [code] [pc.]
[ICCV oral] (Just) A Spoonful of Refinements Helps the Registration Error Go Down. [pc.]
[ICCV] A Robust Loss for Point Cloud Registration. [pc.]
[ICCV] Deep Hough Voting for Robust Global Registration. [pc.]
[ICCV] Sampling Network Guided Cross-Entropy Method for Unsupervised Point Cloud Registration.[pc.]
[ICCV] LSG-CPD: Coherent Point Drift with Local Surface Geometry for Point Cloud Registration.[code] [pc.]
[ICCV] OMNet: Learning Overlapping Mask for Partial-to-Partial Point Cloud Registration.[code] [pc.]
[ICCV] DeepPRO: Deep Partial Point Cloud Registration of Objects. [pc.]
[ICCV] Feature Interactive Representation for Point Cloud Registration.[code] [pc.]
[ICCV] Provably Approximated Point Cloud Registration. [pc.]
[ICCV] Distinctiveness oriented Positional Equilibrium for Point Cloud Registration. [pc.]
[ICCV] PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds. [pc.]
[ICCV] Generative Adversarial Registration for Improved Conditional Deformable Templates.
[ICCV] Deep Hough Voting for Robust Global Registration.
[AAAI] Low-Rank Registration Based Manifolds for Convection-Dominated PDEs.
[AAAI] TAILOR: Teaching with Active and Incremental Learning for Object Registration.
[NeurIPS] Accurate Point Cloud Registration with Robust Optimal Transport.
[NeurIPS] Shape Registration in the Time of Transformers.
[NeurIPS] CoFiNet: Reliable Coarse-to-fine Correspondences for Robust PointCloud Registration.
[Robotics and Autonomous Systems] A Benchmark for Point Clouds Registration Algorithms [code] [pc.]
[TPAMI] Supervision by Registration and Triangulation for Landmark Detection.
[TPAMI] Acceleration of Non-Rigid Point Set Registration With Downsampling and Gaussian Process Regression.
[TPAMI] Point Set Registration for 3D Range Scans Using Fuzzy Cluster-Based Metric and Efficient Global Optimization.
[TPAMI] Topology-Aware Non-Rigid Point Cloud Registration.
[MICCAI] A Deep Discontinuity-Preserving Image Registration Network. Code [medi.]
[MICCAI] A Deep Network for Joint Registration and Parcellation of Cortical Surfaces. Code [medi.]
[MICCAI] Conditional Deformable Image Registration with Convolutional Neural Network. [code] [medi.]
[MICCAI] Cross-modal Attention for MRI and Ultrasound Volume Registration. [code] [medi.]
[MICCAI] End-to-end Ultrasound Frame to Volume Registration. [code] [medi.]
[MICCAI] Learning Unsupervised Parameter-specific Affine Transformation for Medical Images Registration. [code] [medi.]
[MICCAI] Multi-view analysis of unregistered medical images using cross-view transformers. [code] [medi.]
[MICCAI] Revisiting iterative highly efficient optimisation schemes in medical image registration. [code] [medi.]
[MICCAI] Unsupervised Diffeomorphic Surface Registration and Non-Linear Modelling. [code] [medi.]
[MIA] A hybrid, image-based and biomechanics-based registration approach to markerless intraoperative nodule localization during video-assisted thoracoscopic surgery. [medi.]
[MIA] Real-time multimodal image registration with partial intraoperative point-set data. [medi.]
[MIA] Leveraging unsupervised image registration for discovery of landmark shape descriptor. [medi.]
[MIA] Weakly-supervised learning of multi-modal features for regularised iterative descent in 3D image registration. [medi.]
[MIA] Shape registration with learned deformations for 3D shape reconstruction from sparse and incomplete point clouds. [medi.]
[MIA] Variational multi-task MRI reconstruction: Joint reconstruction, registration and super-resolution. [medi.]
[MIA] A novel approach to 2D/3D registration of X-ray images using Grangeat's relation. [medi.]
[MIA] Biomechanically constrained non-rigid MR-TRUS prostate registration using deep learning based 3D point cloud matching. [medi.]
[MIA] Fracture reduction planning and guidance in orthopaedic trauma surgery via multi-body image registration. [medi.]
[MIA] CNN-based lung CT registration with multiple anatomical constraints. [medi.]
[MIA] End-to-end multimodal image registration via reinforcement learning. [medi.]
[MIA] Difficulty-aware hierarchical convolutional neural networks for deformable registration of brain MR images. [medi.]
[MIA] CycleMorph: Cycle consistent unsupervised deformable image registration. [medi.]
[MIA] Rethinking medical image reconstruction via shape prior, going deeper and faster: Deep joint indirect registration and reconstruction. [medi.]
[MIA] Deformation analysis of surface and bronchial structures in intraoperative pneumothorax using deformable mesh registration. [medi.]
[MIA] Re-Identification and growth detection of pulmonary nodules without image registration using 3D siamese neural networks. [medi.]
[MIA] Image registration: Maximum likelihood, minimum entropy and deep learning. [medi.]
[MIA] ProsRegNet: A deep learning framework for registration of MRI and histopathology images of the prostate. [medi.]
[MIA] 3D Registration of pre-surgical prostate MRI and histopathology images via super-resolution volume reconstruction. [medi.]
[MIA] A deep learning framework for pancreas segmentation with multi-atlas registration and 3D level-set. [medi.]
[MIA] Anatomy-guided multimodal registration by learning segmentation without ground truth: Application to intraprocedural CBCT/MR liver segmentation and registration. [medi.]
[CVPR] Learning multiview 3D point cloud registration. [code] [pc.] 🔥
[CVPR] SampleNet: Differentiable Point Cloud Sampling. [code] [pc.] 🔥
[CVPR] Feature-metric Registration: A Fast Semi-supervised Approach for Robust Point Cloud Registration without Correspondences. [code] [pc.]
[CVPR oral] Deep Global Registration. [pc.]
[CVPR] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation.
[CVPR] Smooth Shells: Multi-Scale Shape Registration With Functional Maps.
[CVPR] Global Optimality for Point Set Registration Using Semidefinite Programming.
[CVPR] Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks.
[CVPR] 3DRegNet: A Deep Neural Network for 3D Point Registration.
[CVPR] DeepFLASH: An Efficient Network for Learning-Based Medical Image Registration.
[CVPR] Quasi-Newton Solver for Robust Non-Rigid Registration.
[NeurIPS] LoopReg: Self-supervised Learning of Implicit Surface Correspondences, Pose and Shape for 3D Human Mesh Registration.
[NeurIPS] CoMIR: Contrastive Multimodal Image Representation for Registration.
[ECCV] Deep Complementary Joint Model for Complex Scene Registration and Few-Shot Segmentation on Medical Images.
[ECCV] Iterative Distance-Aware Similarity Matrix Convolution with Mutual-Supervised Point Elimination for Efficient Point Cloud Registration.
[ECCV] JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-modal Image Alignment of Large-Scale Pathological CT Scans.
[ECCV] A Closest Point Proposal for MCMC-based Probabilistic Surface Registration.
[ECCV] DeepGMR: Learning Latent Gaussian Mixture Models for Registration.
[3DV] Registration Loss Learning for Deep Probabilistic Point Set Registration. [code-pytorch] [pc.]
[TPAMI] Aggregated Wasserstein Distance and State Registration for Hidden Markov Models.
[MICCAI] MvMM-RegNet: A New Image Registration Framework Based on Multivariate Mixture Model and Neural Network Estimation [code] [medi.]
[MICCAI] Highly Accurate and Memory Efficient Unsupervised Learning-Based Discrete CT Registration Using 2.5D Displacement Search [code] [medi.]
[MICCAI] Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registration [code] [medi.]
[MICCAI] Non-Rigid Volume to Surface Registration Using a Data-Driven Biomechanical Model [code] [medi.]
[MIA] Hubless keypoint-based 3D deformable groupwise registration. [medi.]
[MIA] Multi-atlas image registration of clinical data with automated quality assessment using ventricle segmentation. [medi.]
[MIA] Groupwise registration with global-local graph shrinkage in atlas construction. [medi.]
[MIA] SLIR: Synthesis, localization, inpainting, and registration for image-guided thermal ablation of liver tumors. [medi.]
[CVPR] DeepMapping: Unsupervised Map Estimation From Multiple Point Clouds. [code] [pc.] 🔥
[CVPR] PointNetLK: Point Cloud Registration using PointNet. [code-pytorch] [pc.] 🔥
[CVPR] SDRSAC: Semidefinite-Based Randomized Approach for Robust Point Cloud Registration without Correspondences. [matlab] [pc.]
[CVPR] FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterization. [code] [pc.]
[CVPR] PointNetLK: Robust & Efficient Point Cloud Registration using PointNet. [code-pytorch] [pc.] 🔥
[CVPR] 3D Local Features for Direct Pairwise Registration. [pc.]
[CVPR] Multiview 2D/3D Rigid Registration via a Point-Of-Interest Network for Tracking and Triangulation.
[CVPR] Metric Learning for Image Registration.
[CVPR] Networks for Joint Affine and Non-Parametric Image Registration.
[ICCV] DeepVCP: An End-to-End Deep Neural Network for 3D Point Cloud Registration. [pc.]
[ICCV] Accelerated Gravitational Point Set Alignment with Altered Physical Laws. [pc.]
[ICCV] Deep Closest Point: Learning Representations for Point Cloud Registration. [pc.]
[ICCV] Efficient Learning on Point Clouds with Basis Point Sets. [code] [ pc.] 🔥
[ICCV] Robust Variational Bayesian Point Set Registration. [pc.]
[ICCV] Efficient and Robust Registration on the 3D Special Euclidean Group.
[ICCV] Linearly Converging Quasi Branch and Bound Algorithms for Global Rigid Registration.
[ICCV] A Deep Step Pattern Representation for Multimodal Retinal Image Registration.
[ICCV] Recursive Cascaded Networks for Unsupervised Medical Image Registration.
[ICCV] Automatic and Robust Skull Registration Based on Discrete Uniformization.
[NeurIPS] Arbicon-Net: Arbitrary Continuous Geometric Transformation Networks for Image Registration.
[NeurIPS] Recurrent Registration Neural Networks for Deformable Image Registration.
[NeurIPS] PRNet: Self-Supervised Learning for Partial-to-Partial Registration.
[TPAMI] Efficient Registration of High-Resolution Feature Enhanced Point Clouds.
[MICCAI] Closing the Gap between Deep and Conventional Image Registration using Probabilistic Dense Displacement Networks [code] [medi.]
[ICRA] Robust low-overlap 3-D point cloud registration for outlier rejection. [matlab] [pc.]
[ICRA] Robust Generalized Point Set Registration Using Inhomogeneous Hybrid Mixture Models Via Expectation. [pc.]
[ICRA] CELLO-3D: Estimating the Covariance of ICP in the Real World. [pc.]
[CVPR] Density Adaptive Point Set Registration. [code] [pc.]
[CVPR] Inverse Composition Discriminative Optimization for Point Cloud Registration. [pc.]
[CVPR] An Unsupervised Learning Model for Deformable Medical Image Registration.
[CVPR] Supervision-by-Registration: An Unsupervised Approach to Improve the Precision of Facial Landmark Detectors.
[CVPR] CNN Driven Sparse Multi-Level B-Spline Image Registration.
[CVPR] 3D Registration of Curves and Surfaces Using Local Differential Information.
[AAAI] Dilated FCN for Multi-Agent 2D/3D Medical Image Registration.
[ECCV] Learning and Matching Multi-View Descriptors for Registration of Point Clouds. [pc.]
[ECCV] 3DFeat-Net: Weakly Supervised Local 3D Features for Point Cloud Registration. [code-tensorflow] [pc.] 🔥
[ECCV] Efficient Global Point Cloud Registration by Matching Rotation Invariant Features Through Translation Search. [pc.]
[ECCV] HGMR: Hierarchical Gaussian Mixtures for Adaptive 3D Registration. [pc.]
[ECCV] Robust Image Stitching with Multiple Registrations.
[TPAMI] Guaranteed Outlier Removal for Point Cloud Registration with Correspondences. [pc.]
[TPAMI] Collocation for Diffeomorphic Deformations in Medical Image Registration. [medi.]
[TPAMI] Hierarchical Sparse Representation for Robust Image Registration.
[TPAMI] Multiresolution Search of the Rigid Motion Space for Intensity-Based Registration.
[3DV] PCN: Point Completion Network. [code-tensorflow] [pc. ] 🔥
[ICRA] Robust Generalized Point Cloud Registration Using Hybrid Mixture Model. [pc.]
[ICRA] A General Framework for Flexible Multi-Cue Photometric Point Cloud Registration. [pc.]
[IROS] Dynamic Scaling Factors of Covariances for Accurate 3D Normal Distributions Transform Registration. [pc.]
[IROS] Robust Generalized Point Cloud Registration with Expectation Maximization Considering Anisotropic Positional Uncertainties. [pc.]
[IROS] PCAOT: A Manhattan Point Cloud Registration Method Towards Large Rotation and Small Overlap. [pc.]
[IEEE Access] Multi-temporal Remote Sensing Image Registration Using Deep Convolutional Features [code] 🔥 [rs.]
[CVPR] 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions. [code] [pc. data. ] 🔥 ⭐
[CVPR] Discriminative Optimization: Theory and Applications to Point Cloud Registration. [pc.]
[CVPR] 3D Point Cloud Registration for Localization using a Deep Neural Network Auto-Encoder. [code] [pc.]
[CVPR] Convex Global 3D Registration with Lagrangian Duality.
[CVPR] Group-Wise Point-Set Registration Based on Rényi's Second Order Entropy.
[CVPR] Fine-to-Coarse Global Registration of RGB-D Scans.
[CVPR] Joint Registration and Representation Learning for Unconstrained Face Identification.
[CVPR] A General Framework for Curve and Surface Comparison and Registration with Oriented Varifolds.
[ICCV] Colored Point Cloud Registration Revisited. [pc.]
[ICCV] Local-to-Global Point Cloud Registration Using a Dictionary of Viewpoint Descriptors.
[ICCV] Joint Layout Estimation and Global Multi-view Registration for Indoor Reconstruction.
[ICCV] Deep Free-Form Deformation Network for Object-Mask Registration.
[ICCV] Point Set Registration with Global-Local Correspondence and Transformation Estimation.
[ICCV] Surface Registration via Foliation.
[AAAI] An Artificial Agent for Robust Image Registration.
[AAAI] Non-Rigid Point Set Registration with Robust Transformation Estimation under Manifold Regularization.
[ICRA] Using 2 point+normal sets for fast registration of point clouds with small overlap. [pc.]
[TPAMI] Image Registration and Change Detection under Rolling Shutter Motion Blur.
[TPAMI] Hyperbolic Harmonic Mapping for Surface Registration.
[TPAMI] Randomly Perturbed B-Splines for Nonrigid Image Registration.
[ECCV] Fast Global Registration Code
[TPAMI] Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration Code
[ICRA] Fast point feature histograms (FPFH) for 3D registration
[RSS] Generalized-ICP
[TPAMI] A method for registration of 3-D shapes
[TPAMI] Least-squares fitting of two 3-D point sets
Many thanks to yzhao062 Anomaly Detection Learning Resources. I followed his style to collect resources
This resources collect:
- Books & Academic Papers
- Datasets
- Open-source and Commercial Libraries/Toolkits
- On-line Courses and Videos
- Key Conferences & Journals
-
A. Sotiras, et.al., “Deformable medical image registration: A survey,” 2013.
-
N. J. Tustison, et.al., “Learning image-based spatial transformations via convolutional neural networks : A review,” 2019.
-
G. Haskins,et.al. “Deep Learning in Medical Image Registration: A Survey,” 2019.
-
N. Tustison, et.al., “Learning image-based spatial transformations via convolutional neural networks: A review,”2019.
- [Eurographics 2022] A Survey of Non-Rigid 3D Registration
- [arXiv 2021] A comprehensive survey on point cloud registration
| Dataset | Number | Modality | Region | Format |
|---|---|---|---|---|
| DIRLAB | 10 | 4D CT | Lung | .img |
| LPBA40 | 40 | 3D MRI | T1 Brain | .img+.hdr .nii |
| IBSR18 | 18 | 3D MRI | T1 Brain | .img+.hdr |
| EMPIRE | 30 | 4D CT | Lung | .mhd+.raw |
| LiTS | 131 | 3D CT | Liver | .nii |
| CT-scans-before-and-after | ||||
| Openi | X-ray | |||
| POPI | 6 | 4D CT | ||
| NLST | CT | Lung | ||
| ADNI | 3D MRI | Brain | ||
| OASIS | 3D MRI | Brain | ||
| ABIDE | 3D MRI | Brain | ||
| ADHD200 | ||||
| CUMC12 | 12 | 3D MRI | Brain | .img+.hdr |
| MGH10 | 10 | 3D MRI | Brain | .img+.hdr |
| FIRE | 134 | 2D fundus | Retina | .jpg |
| MSD | CT | Liver | ||
| BFH | 92 | CT | Liver | |
| SLIVER | 20 | CT | Liver | |
| LSPIG | 17 | CT | Liver | |
| OAI | 20000+ | 3D MRI | Osteoarthritis | |
| CIMA | 108 | 2D | lesions | .png |
Indoor LiDAR-RGBD Scan Dataset
ETH3D SLAM & Stereo Benchmarks
ViViD : Vision for Visibility Dataset
HPatches: The HPatches dataset was used as the basis for the local descriptor evaluation challenge that was presented in the Local Features: State of the Art, Open Problems and Performance Evaluation workshop during ECCV 2016.
The Zurich Urban Micro Aerial Vehicle Dataset
Inria Aerial Image Labeling DataSet
The Stanford 3D Scanning Repository（斯坦福大学的3d扫描存储库）
http://graphics.stanford.edu/data/3Dscanrep/
这应该是做点云数据最初大家用最多的数据集，其中包含最开始做配准的Bunny、Happy Buddha、Dragon等模型。
[Stanford 3D] The Stanford 3D Scanning Repository. [pc.]
Shapenet
ShapeNet是一个丰富标注的大规模点云数据集，其中包含了55中常见的物品类别和513000个三维模型。
The KITTI Vision Benchmark Suite
链接：http://www.cvlibs.net/datasets/kitti/
这个数据集来自德国卡尔斯鲁厄理工学院的一个项目，其中包含了利用KIT的无人车平台采集的大量城市环境的点云数据集（KITTI），这个数据集不仅有雷达、图像、GPS、INS的数据，而且有经过人工标记的分割跟踪结果，可以用来客观的评价大范围三维建模和精细分类的效果和性能。
Robotic 3D Scan Repository
链接：http://kos.informatik.uni-osnabrueck.de/3Dscans/
这个数据集比较适合做SLAM研究，包含了大量的 Riegl 和 Velodyne 雷达数据
佐治亚理工大型几何模型数据集
链接：https://www.cc.gatech.edu/projects/large_models/
PASCAL3D+
链接：http://cvgl.stanford.edu/projects/pascal3d.html
包含了12中刚体分类，每一类超过了3000个实例。并且包含了对应的imageNet中每一类的图像。
其他总结
链接：https://github.com/timzhang642/3D-Machine-Learning
Other
[UWA Dataset] [pc.] (Uploaded by @sukun1045 for their repository shlizee/Predict-Cluster)
[ASL Datasets Repository(ETH)] This site is dedicated to provide datasets for the Robotics community with the aim to facilitate result evaluations and comparisons. [ pc. ]
[3D Match] Keypoint Matching Benchmark, Geometric Registration Benchmark, RGB-D Reconstruction Datasets. [pc. ]
The Visual Localization Benchmark
MICCAI 2022
the AutomatiC Registration Of Breast cAncer Tissue (ACROBAT) challenge
CuRIOUS:2019 | Official solution
1 Register pre-operative MRI to iUS before tumor resection
2 Register iUS after tumor resection to iUS before tumor resection
ANHIR:2019 | Official solution
IEEE International Symposium on Biomedical Imaging (ISBI) 2019
High-resolution (up to 40x magnification) whole-slide images of tissues (lesions, lung-lobes, mammary-glands) were acquired - the original size of our images is up to 100k x 200k pixels. The acquired images are organized in sets of consecutive sections where each slice was stained with a different dye and any two images within a set can be meaningfully registered.
Continuous Registration Challenge
Multi-shell Diffusion MRI Harmonisation Challenge 2018 (MUSHAC)
[C++] [Python] OpenCV: OpenCV (Open Source Computer Vision Library) is an open source computer vision and machine learning software library. OpenCV was built to provide a common infrastructure for computer vision applications and to accelerate the use of machine perception in the commercial products.
[C++] PCL: Point Cloud Library. The Point Cloud Library (PCL) is a standalone, large scale, open project for 2D/3D image and point cloud processing.
[C++] Ceres Solver: Ceres Solver is an open source C++ library for modeling and solving large, complicated optimization problems. It can be used to solve Non-linear Least Squares problems with bounds constraints and general unconstrained optimization problems.
[C++] Open3D: Open3D is an open-source library that supports rapid development of software that deals with 3D data. The Open3D frontend exposes a set of carefully selected data structures and algorithms in both C++ and Python. The backend is highly optimized and is set up for parallelization.
[c++] ITK: Segmentation & Registration Toolkit
An open-source, cross-platform system that provides developers with an extensive suite of software tools for image analysis. Developed through extreme programming methodologies. ITK employs leading-edge algorithms for registering and segmenting multidimensional data.
[c++] [Python] [Java] SimpleITK: a simplified layer built on top of ITK.
[c++] ANTs: Advanced Normalization Tools.
Image registration with variable transformations (elastic, diffeomorphic, diffeomorphisms, unbiased) and similarity metrics (landmarks, cross-correlation, mutual information, etc.). Image segmentation with priors & nonparametric, multivariate models.
[c++] Elastix: open source software, based on the well-known ITK .
The software consists of a collection of algorithms that are commonly used to solve (medical) image registration problems. [manual]
[C++] [Python] [Java] [R] [Ruby] [Lua] [Tcl] [C#] SimpleElastix: a medical image registration library that makes state-of-the-art image registration really easy to do in languages like Python, Java and R.
3D slicer : an open source software platform for medical image informatics, image processing, and three-dimensional visualization. Built over two decades through support from the National Institutes of Health and a worldwide developer community, Slicer brings free, powerful cross-platform processing tools to physicians, researchers, and the general public.
Github repository for deep learning medical image registration:
[Keras] VoxelMorph 🔥
[Keras] FAIM 🔥
[Tensorflow] Weakly-supervised CNN 🔥
[Tensorflow] RegNet3D 🔥
[Tensorflow] Recursive-Cascaded-Networks
[Pytorch] Probabilistic Dense Displacement Network
[Pytorch] Linear and Deformable Image Registration
[Pytorch] Inverse-Consistent Deep Networks
[Pytorch] Non-parametric image registration 🔥
[Pytorch] One Shot Deformable Medical Image Registration
[Pytorch] Image-and-Spatial Transformer Networks
[C++] OTB: Orfeo ToolBox (OTB) is an open-source project for state-of-the-art remote sensing. Built on the shoulders of the open-source geospatial community, it can process high resolution optical, multispectral and radar images at the terabyte scale. A wide variety of applications are available: from ortho-rectification or pansharpening, all the way to classification, SAR processing, and much more!
[C++] [Python] OpenCV: OpenCV (Open Source Computer Vision Library) is an open source computer vision and machine learning software library. OpenCV was built to provide a common infrastructure for computer vision applications and to accelerate the use of machine perception in the commercial products.Being a BSD-licensed product, OpenCV makes it easy for businesses to utilize and modify the code.
[C++] ITK: Insight Toolkit (ITK) an open-source, cross-platform system that provides developers with an extensive suite of software tools for image analysis. Developed through extreme programming methodologies, ITK employs leading-edge algorithms for registering and segmenting multidimensional data.
[Python] Spectral Python (SPy): Spectral Python (SPy) is a pure Python module for processing hyperspectral image data (imaging spectroscopy data). It has functions for reading, displaying, manipulating, and classifying hyperspectral imagery.
Post Processing Tools
[C++] enblend: Enblend blends away the seams in a panoramic image mosaic using a multi-resolution spline. Enfuse merges different exposures of the same scene to produce an image that looks much like a tone-mapped image.
[C++] maxflow: An implementation of the maxflow algorithm which can be used to detect the optimal seamline.
[C++] [Matlab] gco-v3.0: Multi-label optimization library by Olga Veksler and Andrew Delong.
Source Code
Parallax-tolerant image stitching 🔥
简介：是一款开源、可移植和可扩展的三维几何处理系统。主要用于处理和编辑3D三角网格，它提供了一组用于编辑、清理、修复、检查、渲染、纹理化和转换网格的工具。提供了处理由3D数字化工具/设备生成的原始数据以及3D打印功能，功能全面而且丰富。MeshLab支持多数市面上常见的操作系统，包括Windows、Linux及Mac OS X，支持输入/输出的文件格式有：STL 、OBJ 、 VRML2.0、U3D、X3D、COLLADA MeshLab可用于各种学术和研究环境，如微生物学、文化遗产及表面重建等。
g-icp 🔥
Multiple view geometry in computer vision by Richard Hartley and Andrew Zisserman, 2004: Mathematic and geometric basis for 2D-2D and 2D-3D registration. A must-read for people in the field of registration. [E-book](https://github.com/DeepRobot2020/books/blob/master/Multiple View Geometry in Computer Vision (Second Edition).pdf)
Computer Vision: A Modern Approach by David A. Forsyth, Jean Ponce: for upper-division undergraduate- and graduate-level courses in computer vision found in departments of Computer Science, Computer Engineering and Electrical Engineering.
Algebra, Topology, Differential Calculus, and Optimization Theory For Computer Science and Engineering by Jean Gallier and Jocelyn Quaintance. The latest book from upenn about the algebra and optimization theory.
Three-Dimensional Computer vision-A Geometric Viewpoint Classical 3D computer vision textbook.
An invitation to 3D vision a self-contained introduction to the geometry of three-dimensional (3-D) vision.
Zhenhuan Zhou, et.al: A software guide for medical image segmentation and registration algorithm. 医学图像分割与配准(ITK实现分册) Part Ⅱ introduces the most basic network and architecture of medical registration algorithms (Chinese Version).
2-D and 3-D Image Registration for Medical, Remote Sensing, and Industrial Applications by A. Ardeshir Goshtasby
医学图像配准技术与应用 by 吕晓琪
Intensity-based 2D-3D Medical Image Registration by Russakoff, Daniel
Biomedical Image Registration by Fischer, Dawant, Lorenz
Medical Image Registration by Hajnal, Joseph V.
Deep Learning for Medical Image Analysis (part IV)
14 lectures on visual SLAM By Xiang Gao and Tao Zhang and Yi Liu and Qinrui Yan. 视觉SLAM十四讲 视觉配准方向较易懂的入门教材。通俗讲述视觉匹配的物理模型， 数学几何基础，优化过程等。 新手必读。 [github] [Videos]
点云数据配准及曲面细分技术 by 薛耀红, 赵建平, 蒋振刚, 等 书籍内容比较过时，仅适合零基础读者阅读。推荐自行查找相关博客学习。
Image Registration for Remote Sensing
2-D and 3-D Image Registration: For Medical, Remote Sensing, and Industrial Applications by A. A. Goshtasby, 2005.
Introduction to Remote Sensing
Remote Sensing and Image Interpretation
Remote Sensing: Models and Methods for Image Processing
A demo that implement image registration by matching SIFT descriptors and appling RANSAC and affine transformation.
Big thanks to Yipeng Hu organizing the excellent tutorial.
Description:
Medical image registration has been a cornerstone in the research fields of medical image computing and computer assisted intervention, responsible for many clinical applications. Whilst machine learning methods have long been important in developing pairwise algorithms, recently proposed deep-learning-based frameworks directly infer displacement fields without iterative optimization for unseen image pairs, using neural networks trained from large population data. These novel approaches promise to tackle several most challenging aspects previously faced by classical pairwise methods, such as high computational cost, robustness for generalization and lack of inter-modality similarity measures.
Output from several international research groups working in this area include award-winning conference presentations, high-impact journal publications, well-received open-source implementations and industrial-partnered translational projects, generating significant interests to all levels of world-wide researchers. Accessing to the experience and expertise in this inherently multidisciplinary topic can be beneficial to many in our community, especially for the next generation of young scientists, engineers and clinicians who often have only been exposed to a subset of these methodologies and applications.
We organize a tutorial including both theoretical and practical sessions, inviting expert lectures and tutoring coding for real-world examples. Three hands-on sessions guiding participants to understand and implement published algorithms using clinical imaging data. This aims to provide an opportunity for the participants to bridge the gap between expertises in medical image registration and deep learning, as well as to start a forum to discuss know-hows, challenges and future opportunities in this area.
- [MICCAI2019] Autograd Image Registration Laboratory
- [kaggle 2018] X-Ray Patient Scan Registration
SimpleITK, ITK, scipy, OpenCV, Tensorflow and PyTorch all offer tools for registering images, we explore a few here to see how well they work when applied to the fairly tricky problem of registering from the same person at different time and disease points.
- [Sibgrapi 2018] Practical Review on Medical Image Registration: from Rigid to Deep Learning based Approaches [PDF&Slides] 🔥
A tutorial for anyone who wants to learn Medical Image Registration, by Natan Andrade, Fabio Augusto Faria, Fábio Augusto Menocci Cappabianco
- [kaggle 2016] Image registration, the R way, (almost) from scratch
There are some packages in R for image manipulation and after some test I select “imager” , based on the CImg C++, fast and providing several image processing tools.
图像配准会议介绍@ MICCAI2019 / CVPR2019 / ICCV2019 / NeurIPS2019
Image Registration: From SIFT to Deep Learning
16-822: Geometry-based Methods in Vision
[VALSE 2018] Talk: 2017以来的2D to 3D by 吴毅红
CVPR 2021 Image Matching: Local Features and Beyond
WBIR - International Workshop on Biomedical Image Registration
WBIR 2022: Munich, Germany
WBIR 2020: Portorož, Slovenia
WBIR 2018: Leiden, Netherlands
WBIR 2016: Las Vegas NV
WBIR 2014: London, UK
CVPR: IEEE International Conference on Computer Vision and Pattern Recognition
ICCV: IEEE International Conference on Computer Vision
ECCV: European Conference on Computer Vision
NeurIPS: Conference on Neural Information Processing Systems
AAAI: Association for the Advancement of Artificial Intelligence
ICML: International Conference on Machine Learning
ICPR: International Conference on Pattern Recognition
IJCNN: International Joint Conference on Neural Networks
ICIP: IEEE International Conference on Image Processing
IJCAI: International Joint Conferences on Artificial Intelligence
ICRA: IEEE International Conference on Robotics and Automation
International Conference on 3D Vision
WACV: Winter Conference on Applications of Computer Vision
MICCAI: International Conference on Medical Image Computing and Computer Assisted Intervention
IPMI: Information Processing in Medical Imaging
ISBI: International Symposium on Biomedical Imaging
点云配准主要应用于工业制造业的逆向工程、古文物修复、医学三维图像构建等领域。研究内容是属于计算机视觉领域的研究范畴。国际上的会议如计算机视觉三大顶会ICCV、CVPR、ECCV等都会有相关技术，除此之外，还有ACCV、BMVC、SSVM等认可度也比较高。
IEEE Transactions on Pattern Analysis and Machine Intelligence
International Journal of Computer Vision
ISPRS Journal of Photogrammetry and Remote Sensing
TMI: IEEE Transactions on Medical Imaging
MIA: Medical Image Analysis
TIP: IEEE Transactions on Image Processing
TBME: IEEE Transactions on Biomedical Engineering
BOE: Biomedical Optics Express
JHBHI: Journal of Biomedical and Health Informatics
ISPRS Journal of Photogrammetry And Remote Sensing
IEEE Transactions on Geoscience And Remote Sensing
International Journal of Applied Earth Observation and Geoinformation
IEEE Geoscience and Remote Sensing Letters
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Photogrammetric engineering and remote sensing
International journal of remote sensing
Journal of Applied Remote Sensing
IEEE旗下的TPAMI，TIP等，还有SIAM Journal Image Sciences，Springer那边有IJCV
We have QQ Group 【配准萌新交流群】（已满3000人）869211738 欢迎加入【配准萌新交流（二群)】 929134506 and Wechat Group 【配准交流群】（已满员） for comunications.
More items will be added to the repository. Please feel free to suggest other key resources by opening an issue report, submitting a pull request, or dropping me an email @ ([email protected]). Enjoy reading!
Many thanks ❤️ to all project contributors:
Many thanks ❤️ to the other awesome list:
- Yochengliu awesome-point-cloud-analysis
- zhulf0804 3D-PointCloud
- NUAAXQ awesome-point-cloud-analysis-2022
- visionxiang awesome-computational-photography
- tzxiang awesome-image-alignment-and-stitching
- hoya012 deep_learning_object_detection
- JunMa11 MICCAI-OpenSourcePapers
- Amusi awesome-object-detection
- youngfish42 Awesome-Federated-Learning-on-Graph-and-Tabular-Data
- yzhao062 Anomaly Detection Learning Resources
