National Alliance for Medical Image Computing

The Publication Database hosted by SPL

All Publications | Upload | Advanced Search | Gallery View | Download Statistics | Help | Import | Log in

Dictionary Pruning with Visual Word Significance for Medical Image Retrieval

Institution:
1School of Information Technologies, University of Sydney, Australia.
2Department of Radiology, Brigham & Womens Hospital, Harvard Medical School, Boston, MA, USA.
3School of Computer Science, Carnegie Mellon University, USA.
4Department of PET and Nuclear Medicine, Royal Prince Alfred Hospital, Australia.
5Department of Informatics, University of Albany State University of New York, NY, USA.
Publication Date:
Feb-2016
Journal:
Neurocomputing.
Volume Number:
177
Pages:
75-88
Citation:
Neurocomputing. 2016 Feb; 177:75-88.
PubMed ID:
27688597
PMCID:
PMC5036942
Keywords:
Medical image retrieval, bag-of-visual-words (BoVW), Dictionary pruning
Appears in Collections:
NAC, NA-MIC, SLICER, SPL
Sponsors:
U54 EB005149/EB/NIBIB NIH HHS/United States
P41 EB015902/EB/NIBIB NIH HHS/United States
Generated Citation:
Zhang F., Song Y., Cai W., Hauptmann A.G., Liu S., Pujol S., Kikinis R., Fulham M.J., Feng D.D., Cheng M. Dictionary Pruning with Visual Word Significance for Medical Image Retrieval. Neurocomputing. 2016 Feb; 177:75-88. PMID: 27688597. PMCID: PMC5036942.
Downloaded: 19 times. [view map]
Paper: Download, View online
Export citation:
Google Scholar: link

Content-based medical image retrieval (CBMIR) is an active research area for disease diagnosis and treatment but it can be problematic given the small visual variations between anatomical structures. We propose a retrieval method based on a bag-of-visual-words (BoVW) to identify discriminative characteristics between different medical images with Pruned Dictionary based on Latent Semantic Topic description. We refer to this as the PD-LST retrieval. Our method has two main components. First, we calculate a topic-word significance value for each visual word given a certain latent topic to evaluate how the word is connected to this latent topic. The latent topics are learnt, based on the relationship between the images and words, and are employed to bridge the gap between low-level visual features and high-level semantics. These latent topics describe the images and words semantically and can thus facilitate more meaningful comparisons between the words. Second, we compute an overall-word significance value to evaluate the significance of a visual word within the entire dictionary. We designed an iterative ranking method to measure overall-word significance by considering the relationship between all latent topics and words. The words with higher values are considered meaningful with more significant discriminative power in differentiating medical images. We evaluated our method on two public medical imaging datasets and it showed improved retrieval accuracy and efficiency.

Additional Material
1 File (228.402kB)
Zhang-Neurocomputing2016-fig11.jpg (228.402kB)