{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,22]],"date-time":"2025-11-22T11:17:28Z","timestamp":1763810248034,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2020,3,26]],"date-time":"2020-03-26T00:00:00Z","timestamp":1585180800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41901388"],"award-info":[{"award-number":["41901388"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China Transport Telecommucations &amp; Information Center Reserve Project","award":["2018CB07"],"award-info":[{"award-number":["2018CB07"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Image mosaicking which is a process of constructing multiple orthoimages into a single seamless composite orthoimage, is one of the key steps for the production of large-scale digital orthophoto maps (DOM). Seamline determination is one of the most difficult technologies in the automatic mosaicking of orthoimages. The seamlines that follow the centerlines of roads where no significant differences exist are beneficial to improve the quality of image mosaicking. Based on this idea, this paper proposes a novel method of seamline determination based on road probability map from the D-LinkNet neural network for urban image mosaicking. This method optimizes the seamlines at both the semantic and pixel level as follows. First, the road probability map is obtained with the D-LinkNet neural network and related post processing. Second, the preferred road areas (PRAs) are determined by binarizing the road probability map of the overlapping area in the left and right image. The PRAs are the priority areas in which the seamlines cross. Finally, the final seamlines are determined by Dijkstra\u2019s shortest path algorithm implemented with binary min-heap at the pixel level. The experimental results of three group data sets show the advantages of the proposed method. Compared with two previous methods, the seamlines obtained by the proposed method pass through the less obvious objects and mainly follow the roads. In terms of the computational efficiency, the proposed method also has a high efficiency.<\/jats:p>","DOI":"10.3390\/s20071832","type":"journal-article","created":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T03:44:13Z","timestamp":1585712653000},"page":"1832","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Automatic Seamline Determination for Urban Image Mosaicking Based on Road Probability Map from the D-LinkNet Neural Network"],"prefix":"10.3390","volume":"20","author":[{"given":"Shenggu","family":"Yuan","sequence":"first","affiliation":[{"name":"China Transport Telecommunications and Information Center, Beijing 100011, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ke","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xin","family":"Li","sequence":"additional","affiliation":[{"name":"Guojiao Spatial Information Technology (Beijing) Co., Ltd., Beijing 100011, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongyue","family":"Cai","sequence":"additional","affiliation":[{"name":"Guojiao Spatial Information Technology (Beijing) Co., Ltd., Beijing 100011, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/S0924-2716(01)00033-8","article-title":"Seamline detection in colour orthoimage mosaicking by use of twin snakes","volume":"56","author":"Kerschner","year":"2001","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.isprsjprs.2017.01.015","article-title":"Using vector building maps to aid in generating seams for low-attitude aerial orthoimage mosaicking: Advantages in avoiding the crossing of buildings","volume":"125","author":"Wang","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1658","DOI":"10.1109\/TGRS.2013.2253110","article-title":"Seamline network refinement based on area Voronoi diagrams 1with overlap","volume":"52","author":"Pan","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1080\/01431161.2018.1519282","article-title":"An improved approach for generating globally consistent seamline networks for aerial image mosaicking","volume":"40","author":"He","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.isprsjprs.2018.02.007","article-title":"A novel orthoimage mosaic method using a weighted a* algorithm\u2014Implementation and evaluation","volume":"138","author":"Zheng","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1109\/LGRS.2013.2293197","article-title":"Seamline determination based on segmentation for urban image mosaicking","volume":"11","author":"Pan","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"121","DOI":"10.14358\/PERS.82.2.121","article-title":"Seamline determination for high resolution orthoimage mosaicking using watershed segmentation","volume":"82","author":"Wang","year":"2016","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dong, Q., and Liu, J. (2017). Seamline Determination Based on PKGC Segmentation for Remote Sensing Image Mosaicking. Sensors, 17.","DOI":"10.3390\/s17081721"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1109\/T-C.1975.224142","article-title":"Computer methods for creating photomosaics","volume":"24","author":"Milgram","year":"1975","journal-title":"IEEE Trans. Comput."},{"key":"ref_10","first-page":"115","article-title":"Mosaicking of orthorectified aerial images","volume":"64","author":"Afek","year":"1998","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1109\/TPAMI.2006.99","article-title":"Morphological image compositing","volume":"28","author":"Soille","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, L., Ai, H., and Zhang, L. (2010, January 25\u201326). Automated seamline detection in orthophoto mosaicking using improved snakes. Proceedings of the International Conference on Information Engineering and Computer Science (ICIECS), Wuhan, China.","DOI":"10.1109\/ICIECS.2010.5678345"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1631\/jzus.C1000235","article-title":"Intelligent optimization of seam-line finding for orthophoto mosaicking with LiDAR point clouds","volume":"12","author":"Ma","year":"2011","journal-title":"J. Zhejiang Univ. Sci. C"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.14358\/PERS.78.11.1141","article-title":"Aerial image mosaicking with the aid of vector roads","volume":"78","author":"Wang","year":"2012","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/LGRS.2011.2167712","article-title":"Tracking of vector roads for the determination of seams in aerial image mosaics","volume":"9","author":"Wan","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2012.11.002","article-title":"Automatic determination of seamlines for aerial image mosaicking based on vector roads alone","volume":"76","author":"Wan","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"12334","DOI":"10.3390\/rs61212334","article-title":"Automatic seamline network generation for urban orthophoto mosaicking with the use of a digital surface Model","volume":"6","author":"Chen","year":"2014","journal-title":"Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1080\/2150704X.2016.1264023","article-title":"Seamline optimization based on ground objects classes for orthoimage mosaicking","volume":"8","author":"Pan","year":"2017","journal-title":"Remote Sens. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.isprsjprs.2009.09.001","article-title":"Seam-line determination for image mosaicking: A technique minimizing the maximum local mismatch and the global cost","volume":"65","author":"Chon","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.isprsjprs.2015.04.004","article-title":"Region change rate-driven seamline determination method","volume":"105","author":"Pan","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2015.12.007","article-title":"Optimal seamline detection for multiple image mosaicking via graph cuts","volume":"113","author":"Li","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3908","DOI":"10.1080\/01431161.2018.1447164","article-title":"Superpixel-based optimal seamline detection in the gradient domain via graph cuts for orthoimage mosaicking","volume":"39","author":"Li","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Li, M., Li, D., Guo, B., Li, L., Wu, T., and Zhang, W. (2018). Automatic seam-line detection in UAV remote sensing image mosaicking by use of graph cuts. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi7090361"},{"key":"ref_24","first-page":"877","article-title":"A seam line detection algorithm for orthophoto mosaicking based on disparity image","volume":"44","author":"Yuan","year":"2015","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2015.11.007","article-title":"SGM-based seamline determination for urban orthophoto mosaicking","volume":"112","author":"Pang","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, L., Yao, J., Liu, Y., Yuan, W., Shi, S., and Yuan, S. (2017). Optimal seamline detection for orthoimage mosaicking by combining deep convolutional neural network and graph cuts. Remote Sens., 9.","DOI":"10.3390\/rs9070701"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1109\/36.662728","article-title":"Detection of linear features in SAR images: Application to road network extraction","volume":"36","author":"Tupin","year":"1998","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhou, T., Sun, C., and Fu, H. (2019). Road information extraction from high-resolution remote sensing images based on road reconstruction. Remote Sens., 11.","DOI":"10.3390\/rs11010079"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1998","DOI":"10.1109\/LGRS.2017.2745900","article-title":"Rural building detection in high-resolution imagery based on a two-stage cnn model","volume":"14","author":"Sun","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1109\/LGRS.2018.2802944","article-title":"Road extraction by deep residual U-Net","volume":"15","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1109\/LGRS.2017.2672734","article-title":"Road structure refined CNN for road extraction in aerial image","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lyu, Y., and Huang, X. (2018). Road segmentation using CNN with GRU. arXiv.","DOI":"10.1109\/ISCAS.2019.8702174"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"20707","DOI":"10.1109\/ACCESS.2017.2757765","article-title":"Robust topological navigation via convolutional neural network feature and sharpness measure","volume":"5","author":"Ma","year":"2017","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhou, L., Zhang, C., and Wu, M. (2018, January 18\u201322). D-LinkNet: LinkNet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00034"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Demir, I., Koperski, K., Lindenbaum, D., Pang, G., Huang, J., Basu, S., Hughes, F., Tuia, D., and Raska, R. (2018, January 18\u201322). Deepglobe 2018: A challenge to parse the earth through satellite images. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00031"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chaurasia, A., and Culurciello, E. (2017). LinkNet: Exploiting encoder representations for efficient semantic segmentation. arXiv.","DOI":"10.1109\/VCIP.2017.8305148"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas Blvd, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chen, C., Tian, X., Xiong, Z., and Wu, F. (2017, January 22\u201329). UDNet: Up-down network for compact and efficient feature representation in image super-resolution. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshop (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.130"},{"key":"ref_40","unstructured":"Wen, H., and Zhou, J. (2008, January 20\u201322). An improved algorithm for image mosaic. Proceedings of the 2008 International Symposium on Information Science and Engieering (ISISE 2008), Shanghai, China."},{"key":"ref_41","first-page":"23","article-title":"A threshold selection method from gray-level histograms","volume":"11","author":"Otsu","year":"1975","journal-title":"Automatica"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/0734-189X(88)90022-9","article-title":"A Survey of Thresholding Techniques","volume":"41","author":"Sahoo","year":"1988","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/BF01386390","article-title":"A note on two problems in connexion with graphs","volume":"1","author":"Dijkstra","year":"1959","journal-title":"Numer. Math."},{"key":"ref_44","unstructured":"Cormen, T., Leiserson, C., Rivest, R., and Stein, C. (2001). Introduction to Algorithms, MIT Press."},{"key":"ref_45","unstructured":"(2019, December 02). Welcome to Amigo Optima. Available online: http:\/\/www.amigooptima.com\/inpho\/ortho-vista.php\/."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.isprsjprs.2012.11.003","article-title":"Global seamline networks for orthomosaic generation via local search","volume":"75","author":"Mills","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1737","DOI":"10.1109\/TGRS.2008.2009880","article-title":"Automatic generation of seamline network using area voronio diagrams with overlap","volume":"47","author":"Pan","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/7\/1832\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:11:53Z","timestamp":1760173913000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/7\/1832"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,26]]},"references-count":47,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["s20071832"],"URL":"https:\/\/doi.org\/10.3390\/s20071832","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,3,26]]}}}