Multi-Modality Vertebra Recognition in Arbitrary Views Using 3D Deformable Hierarchical Model
- 14 January 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 34 (8), 1676-1693
- https://doi.org/10.1109/tmi.2015.2392054
Abstract
Computer-aided diagnosis of spine problems relies on the automatic identification of spine structures in images. The task of automatic vertebra recognition is to identify the global spine and local vertebra structural information such as spine shape, vertebra location and pose. Vertebra recognition is challenging due to the large appearance variations in different image modalities/views and the high geometric distortions in spine shape. Existing vertebra recognitions are usually simplified as vertebrae detections, which mainly focuses on the identification of vertebra locations and labels but cannot support further spine quantitative assessment. In this paper, we propose a vertebra recognition method using 3D deformable hierarchical model (DHM) to achieve cross-modality local vertebra location+pose identification with accurate vertebra labeling, and global 3D spine shape recovery. We recast vertebra recognition as deformable model matching, fitting the input spine images with the 3D DHM via deformations. The 3D model-matching mechanism provides a more comprehensive vertebra location+pose+label simultaneous identification than traditional vertebra location+label detection, and also provides an articulated 3D mesh model for the input spine section. Moreover, DHM can conduct versatile recognition on volume and multi-slice data, even on single slice. Experiments show our method can successfully extract vertebra locations, labels, and poses from multi-slice T1/T2 MR and volume CT, and can reconstruct 3D spine model on different image views such as lumbar, cervical, even whole spine. The resulting vertebra information and the recovered shape can be used for quantitative diagnosis of spine problems and can be easily digitalized and integrated in modern medical PACS systems.Keywords
This publication has 36 references indexed in Scilit:
- Spine detection in CT and MR using iterated marginal space learningMedical Image Analysis, 2013
- Detecting, Grouping, and Structure Inference for Invariant Repetitive Patterns in ImagesIEEE Transactions on Image Processing, 2013
- Vertebrae Localization in Pathological Spine CT via Dense Classification from Sparse AnnotationsLecture Notes in Computer Science, 2013
- A Generative Model for Image Segmentation Based on Label FusionIEEE Transactions on Medical Imaging, 2010
- Labeling of Lumbar Discs Using Both Pixel- and Object-Level Features With a Two-Level Probabilistic ModelIEEE Transactions on Medical Imaging, 2010
- Convolutional deep belief networks for scalable unsupervised learning of hierarchical representationsPublished by Association for Computing Machinery (ACM) ,2009
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- Data driven image models through continuous joint alignmentIeee Transactions On Pattern Analysis and Machine Intelligence, 2005
- Histograms of Oriented Gradients for Human DetectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Application of Lie Algebras to Visual ServoingInternational Journal of Computer Vision, 2000