{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:40:32Z","timestamp":1760244032471,"version":"build-2065373602"},"reference-count":60,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2009,12,17]],"date-time":"2009-12-17T00:00:00Z","timestamp":1261008000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes a novel global-to-local nonrigid brain MR image registration to compensate for the brain shift and the unmatchable outliers caused by the tumor resection. The mutual information between the corresponding salient structures, which are enhanced by the joint saliency map (JSM), is maximized to achieve a global rigid registration of the two images. Being detected and clustered at the paired contiguous matching areas in the globally registered images, the paired pools of DoG keypoints in combination with the JSM provide a useful cluster-to-cluster correspondence to guide the local control-point correspondence detection and the outlier keypoint rejection. Lastly, a quasi-inverse consistent deformation is smoothly approximated to locally register brain images through the mapping the clustered control points by compact support radial basis functions. The 2D implementation of the method can model the brain shift in brain tumor resection MR images, though the theory holds for the 3D case.<\/jats:p>","DOI":"10.3390\/s91210270","type":"journal-article","created":{"date-parts":[[2009,12,18]],"date-time":"2009-12-18T12:47:28Z","timestamp":1261140448000},"page":"10270-10290","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Nonrigid Registration of Brain Tumor Resection MR Images Based on Joint Saliency Map and Keypoint Clustering"],"prefix":"10.3390","volume":"9","author":[{"given":"Zhijun","family":"Gu","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, School of Life Sciences & Biotechnology, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7445-1582","authenticated-orcid":false,"given":"Binjie","family":"Qin","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, School of Life Sciences & Biotechnology, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2009,12,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1109\/TMI.2005.856734","article-title":"Robust nonrigid registration to capture brain shift from intraoperative MRI","volume":"24","author":"Clatz","year":"2005","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4612","DOI":"10.1118\/1.2977728","article-title":"Mutual-information-based patient registration using intraoperative ultrasound in image-guided neurosurgery","volume":"35","author":"Ji","year":"2008","journal-title":"Med. Phys."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: a survey","volume":"21","author":"Zitova","year":"2003","journal-title":"Image Vision Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1109\/42.563664","article-title":"Multimodality image registration by maximization of mutual information","volume":"16","author":"Maes","year":"1997","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by maximization of mutual information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1109\/42.925292","article-title":"Hierarchical estimation of a dense deformation field for 3-D robust registration","volume":"20","author":"Hellier","year":"2001","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hachama, M., Desolneux, A., and Richard, F. (2006, January July). Combining registration and abnormality detection in mammography. Utrecht, The Netherland.","DOI":"10.1007\/11784012_22"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1109\/TMI.2009.2016560","article-title":"Registration of cervical MRI using multifeature mutual information","volume":"28","author":"Staring","year":"2009","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1109\/TIP.2005.843756","article-title":"An automatic nonrigid registration for stained histological sections","volume":"14","author":"Auer","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.cmpb.2009.04.012","article-title":"Feature-based registration of histopathology images with different stains: an application for computerized follicular lymphoma prognosis","volume":"96","author":"Cooper","year":"2009","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3304","DOI":"10.1118\/1.2222077","article-title":"A deformable image registration method to handle distended rectums in prostate cancer radiotherapy","volume":"33","author":"Gao","year":"2006","journal-title":"Med. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.media.2006.12.001","article-title":"Removal of local and biased global maxima in intensity-based registration","volume":"11","author":"Salvado","year":"2007","journal-title":"Med. Image Anal."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"854","DOI":"10.1109\/TMI.2003.815077","article-title":"Interpolation artifacts in multimodality image registration based on maximization of mutual information","volume":"22","author":"Tsao","year":"2003","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.compmedimag.2007.12.001","article-title":"Mutual information-based multimodal image registration using a novel joint histogram estimation","volume":"32","author":"Lu","year":"2008","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1109\/LSP.2009.2033728","article-title":"Registration of images with outliers using joint saliency map","volume":"17","author":"Qin","year":"2010","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1109\/TIP.2007.891342","article-title":"Robust and accurate registration of 2-D electrophoresis gels using point-matching","volume":"16","author":"Rogers","year":"2007","journal-title":"IEEE Trans. Imag. Proc."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1016\/j.acra.2005.03.063","article-title":"Semiautomatic nonrigid registration for the prostate and pelvic MR volumes","volume":"12","author":"Fei","year":"2005","journal-title":"Acad. Radiol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1023\/A:1012460413855","article-title":"Saliency, scale and image description","volume":"45","author":"Kadir","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","unstructured":"Huang, X., Sun, Y., Metaxas, D., Sauer, F., and Xu, C. (02,, January June). Hybrid image registration based on configural matching of scale-invariant salient region features. Washington, DC, USA."},{"key":"ref_20","unstructured":"Yang, Y., Williams, J.P., Sun, Y., Blum, R.S., and Xu, C. (2006, January June). Non-rigid image registration using geometric features and local salient region features. New York, NY, USA."},{"key":"ref_21","first-page":"77","article-title":"Feature detection with automatic scale selection","volume":"30","author":"Lindeberg","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1016\/j.acra.2007.07.018","article-title":"Registering histological and MR images of prostate for image-based cancer detection","volume":"14","author":"Zhan","year":"2007","journal-title":"Acad. Radiol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","unstructured":"Franz, A., Carlsen, I., and Renisch, S. (2006). Bildverarbeitung fr die Medizin, Springer."},{"key":"ref_25","first-page":"791","article-title":"Deformable registration using scale space keypoints","volume":"6144","author":"Moradi","year":"2006","journal-title":"Proc. SPIE Med. Imaging: Image Process"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1016\/j.compmedimag.2009.05.006","article-title":"Reconstruction of volumetric ultrasound panorama based on improved 3D SIFT","volume":"33","author":"Ni","year":"2009","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5944","DOI":"10.1118\/1.3013563","article-title":"Objective assessment of deformable image registration in radiotherapy: A multi-institution study","volume":"35","author":"Kashani","year":"2008","journal-title":"Med. Phys."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kelman, A., Sofka, M., and Stewart, C.V. (2007, January June). Keypoint descriptor for matching across multiple image modalities and non-linear intensity variations. Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383426"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1016\/j.compmedimag.2009.03.004","article-title":"Deformation invariant attribute vector for deformable registration of longitudinal brain MR images","volume":"33","author":"Li","year":"2009","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_30","unstructured":"Liao, S., and Chung, A.C.S. (2009). Feature based non-rigid brain MR image registration with symmetric alpha stable filters. IEEE Trans. Med. Imag."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ou, Y., and Davatzikos, C. (2009, January July). DRAMMS: Deformable registration via attribute matching and mutual-saliency weighting. Williamsburg, WV, USA.","DOI":"10.1007\/978-3-642-02498-6_5"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1109\/TMI.2005.848374","article-title":"A registration framework for the comparison of mammogram sequences","volume":"24","author":"Marias","year":"2005","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11263-007-0085-5","article-title":"Keypoint detection and local feature matching for textured 3D face recognition","volume":"79","author":"Mian","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1109\/42.796284","article-title":"Nonrigid registration using free-form deformations: Application to breast MR images","volume":"18","author":"Rueckert","year":"1999","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/S1077-3142(03)00009-2","article-title":"A new point matching algorithm for non-rigid registration","volume":"89","author":"Chui","year":"2003","journal-title":"Comput. Vision Image Understanding"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/S1361-8415(02)00102-0","article-title":"A unified non-rigid feature registration method for brain mapping","volume":"7","author":"Chui","year":"2003","journal-title":"Med. Image Anal."},{"key":"ref_37","unstructured":"Tustison, N.J., Awate, S.P., Song, G., Cook, T.S., and Gee, J.C. A new information-theoretic measure to control the robustness-sensitivity trade-off for DMFFD point-set registration. Williamsburg, WV, USA."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Patt. Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1109\/34.908967","article-title":"Robust point correspondence applied to two- and three-dimensional image registration","volume":"23","author":"Guest","year":"2001","journal-title":"IEEE Trans. Patt. Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.media.2004.09.002","article-title":"Thoracic non-rigid registration combining self-organizing maps and radial basis functions","volume":"9","author":"Matsopoulos","year":"2005","journal-title":"Med Image Anal."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Economopoulos, T.L., Asvestas, P.A., and Matsopoulos, G.K. (2009). Automatic correspondence on medical images: A comparative study of four methods for allocating corresponding points. J. Digital Imaging.","DOI":"10.1007\/s10278-009-9190-z"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1109\/TMI.2002.1009381","article-title":"Consistent landmark and intensity-based image registration","volume":"21","author":"Johnson","year":"2002","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/S0262-8856(00)00057-3","article-title":"Radial basis functions with compact support for elastic registration of medical images","volume":"19","author":"Fornefett","year":"2001","journal-title":"Image Vis. Comput."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1016\/j.media.2007.12.002","article-title":"Multimodal image registration using floating regressors in the joint intensity scatter plot","volume":"12","author":"Orchard","year":"2008","journal-title":"Med. Image Anal."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Liu, F., and Gleicher, M. (2006, January July). Region enhanced scale-invariant saliency detection. Toronto, Ontario, Canada.","DOI":"10.1109\/ICME.2006.262821"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/S1361-8415(01)00036-6","article-title":"A global optimization method for robust affine registration of brain images","volume":"5","author":"Jenkinson","year":"2001","journal-title":"Med. Image Anal."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1109\/TMI.2009.2016337","article-title":"Unified bundling and registration of brain white matter fibers","volume":"28","author":"Xu","year":"2009","journal-title":"IEEE Trans. Med. Imag."},{"key":"ref_48","unstructured":"Vedaldi, A. UCLA CSD Technical Report 070012, 2006; Available online: http:\/\/www.vlfeat.org\/~vedaldi\/code\/siftpp.html (Accessed on 25 November 2009)."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm","volume":"39","author":"Dempster","year":"1977","journal-title":"J. Royal Statistical Soc."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1109\/TPAMI.2006.111","article-title":"Bayesian feature and model selection for gaussian mixture models","volume":"28","author":"Constantinopoulos","year":"2006","journal-title":"IEEE Trans. Patt. Anal. Mach. Intell."},{"key":"ref_51","first-page":"230","article-title":"Method of threshold and peak detection based on histogram exponent smoothing","volume":"2","author":"Ren","year":"1997","journal-title":"China J. Image Graphics"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1016\/j.media.2004.03.001","article-title":"Adaptive registration using local information measures","volume":"8","author":"Park","year":"2004","journal-title":"Med. Image Anal."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/S1077-3142(03)00116-4","article-title":"Point similarity measures for non-rigid registration of multi-modal data","volume":"92","author":"Rogelj","year":"2003","journal-title":"Comput. Vis. Image Understanding"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s11263-006-8704-0","article-title":"Information theoretic deformable registration using local image information","volume":"72","author":"Karacali","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1109\/TIP.2005.863114","article-title":"A comparative study of transformation functions for nonrigid image registration","volume":"15","author":"Zagorchev","year":"2006","journal-title":"IEEE Trans. Imag. Proc."},{"key":"ref_56","unstructured":"Roche, A., Malandain, G., Pennec, X., and Ayache, N. (, January October). The correlation ratio as a new similarity measure for multimodal image registration. Cambridge, MA, USA."},{"key":"ref_57","unstructured":"MIPAV (Medical image processing, analysis, and visualization), Center for Information Technology, U.S. National Institutes of Health Available online: http:\/\/mipav.cit.nih.gov\/ (Accessed on 19 September 2009)."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/S1361-8415(98)80022-4","article-title":"Image matching as a diffusion process: an analogy with maxwell's demons","volume":"2","author":"Thirion","year":"1998","journal-title":"Med. Image Anal."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"S61","DOI":"10.1016\/j.neuroimage.2008.10.040","article-title":"Diffeomorphic demons: Efficient non-parametric image registration","volume":"45","author":"Vercauteren","year":"2009","journal-title":"NeuroImage"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/S0031-3203(98)00091-0","article-title":"An overlap invariant entropy measure of 3D medical image alignment","volume":"32","author":"Studholme","year":"1999","journal-title":"Patt. Recogn."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/9\/12\/10270\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T22:12:01Z","timestamp":1760220721000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/9\/12\/10270"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,12,17]]},"references-count":60,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2009,12]]}},"alternative-id":["s91210270"],"URL":"https:\/\/doi.org\/10.3390\/s91210270","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2009,12,17]]}}}