{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:24:53Z","timestamp":1760243093392,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2015,7,17]],"date-time":"2015-07-17T00:00:00Z","timestamp":1437091200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41322010"],"award-info":[{"award-number":["41322010"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Hi-Tech Research and Development Program","award":["2013AA12A401"],"award-info":[{"award-number":["2013AA12A401"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2014213020201"],"award-info":[{"award-number":["2014213020201"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Geographic National Condition Monitoring Engineering Research Center of Sichuan Province","award":["GC201514"],"award-info":[{"award-number":["GC201514"]}]},{"name":"Research Funds of the Key Laboratory of Mapping from Space, National Administration of Surveying, Mapping and Geoinformation","award":["K201405"],"award-info":[{"award-number":["K201405"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The paper presents an automatic region detection based method to reconstruct street scenes from driving recorder images. The driving recorder in this paper is a dashboard camera that collects images while the motor vehicle is moving. An enormous number of moving vehicles are included in the collected data because the typical recorders are often mounted in the front of moving vehicles and face the forward direction, which can make matching points on vehicles and guardrails unreliable. Believing that utilizing these image data can reduce street scene reconstruction and updating costs because of their low price, wide use, and extensive shooting coverage, we therefore proposed a new method, which is called the Mask automatic detecting method, to improve the structure results from the motion reconstruction. Note that we define vehicle and guardrail regions as \u201cmask\u201d in this paper since the features on them should be masked out to avoid poor matches. After removing the feature points in our new method, the camera poses and sparse 3D points that are reconstructed with the remaining matches. Our contrast experiments with the typical pipeline of structure from motion (SfM) reconstruction methods, such as Photosynth and VisualSFM, demonstrated that the Mask decreased the root-mean-square error (RMSE) of the pairwise matching results, which led to more accurate recovering results from the camera-relative poses. Removing features from the Mask also increased the accuracy of point clouds by nearly 30%\u201340% and corrected the problems of the typical methods on repeatedly reconstructing several buildings when there was only one target building.<\/jats:p>","DOI":"10.3390\/rs70709091","type":"journal-article","created":{"date-parts":[[2015,7,17]],"date-time":"2015-07-17T11:18:48Z","timestamp":1437131928000},"page":"9091-9121","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Optimized 3D Street Scene Reconstruction from Driving Recorder Images"],"prefix":"10.3390","volume":"7","author":[{"given":"Yongjun","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079,  China"}]},{"given":"Qian","family":"Li","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079,  China"}]},{"given":"Hongshu","family":"Lu","sequence":"additional","affiliation":[{"name":"Electronic Science and Engineering, National University of Defence Technology,  Changsha 410000, China"}]},{"given":"Xinyi","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079,  China"}]},{"given":"Xu","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079,  China"}]},{"given":"Chao","family":"Song","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079,  China"}]},{"given":"Shan","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079,  China"}]},{"given":"Jingyi","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079,  China"}]}],"member":"1968","published-online":{"date-parts":[[2015,7,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1111\/j.1477-9730.2006.00352.x","article-title":"Stability analysis of low-cost digital cameras for aerial mapping using different georeferencing techniques","volume":"21","author":"Habib","year":"2006","journal-title":"Photogramm. Rec."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1111\/j.1477-9730.2005.00316.x","article-title":"3D building modelling with digital map, LiDAR data and video image sequences","volume":"20","author":"Zhang","year":"2005","journal-title":"Photogramm. Rec."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Xiao, J., Fang, T., Zhao, P., Lhuillier, M., and Quan, L. (2009). Image-based street-side city modeling. Acm Trans. Graph., 28.","DOI":"10.1145\/1661412.1618460"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/s11263-007-0081-9","article-title":"3D urban scene modeling integrating recognition and reconstruction","volume":"78","author":"Cornelis","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3701","DOI":"10.3390\/rs5083701","article-title":"Automatic removal of imperfections and change detection for accurate 3D urban cartography by classification and incremental updating","volume":"5","author":"Aijazi","year":"2013","journal-title":"Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4652","DOI":"10.3390\/rs5094652","article-title":"Synthesis of transportation applications of mobile LiDAR","volume":"5","author":"Williams","year":"2013","journal-title":"Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Frahm, J., Lazebnik, S., Fite-Georgel, P., Gallup, D., Johnson, T., Raguram, W.C., Jen, Y., Dunn, E., and Clipp, B. (2010, January 5\u201311). Building Rome on a cloudless day. Proceeding of the 2010 Europe Conference on Computer Vision (ECCV), Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_27"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/s11263-011-0445-z","article-title":"Modeling and recognition of landmark image collections using iconic scene graphs","volume":"95","author":"Raguram","year":"2011","journal-title":"Int. J. Comput. Vis."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Snavely, N., Seitz, S.M., and Szeliski, R. (2006). Photo tourism: Exploring photo collections in 3D. ACM Trans. Graph., 25.","DOI":"10.1145\/1141911.1141964"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11263-007-0107-3","article-title":"Modeling the world from internet photo collections","volume":"80","author":"Snavely","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_13","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_14","unstructured":"Lienhart, R., and Maydt, J. (2002, January 22\u201325). An extended set of haar-like features for rapid object detection. Proceedings of the 2002 International Conference on Image Processing, New York, NY, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1023\/A:1007614523901","article-title":"Improved boosting algorithms using confidence-rated predictions","volume":"37","author":"Schapire","year":"1999","journal-title":"Mach. Learn."},{"key":"ref_16","unstructured":"Ponsa, D., Lopez, A., Lumbreras, F., Serrat, J., and Graf, T. (2005, January 13\u201316). 3D vehicle sensor based on monocular vision. Proceedings of the 2005 IEEE Intelligent Transportation Systems, Vienna, Austria."},{"key":"ref_17","unstructured":"OpencvTeam OpenCV 2.4.9.0 Documentation. Available online:http:\/\/docs.opencv.org\/modules\/objdetect\/doc\/cascade_classification.html."},{"key":"ref_18","unstructured":"Jiang, J.L., and Loe, K.F. (2003, January 18\u201320). S-AdaBoost and pattern detection in complex environment. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201903), Los Alamitos, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kutulakos, K.N. (2012). Trends and Topics in Computer Vision, Springer.","DOI":"10.1007\/978-3-642-35740-4"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1109\/TIP.2011.2162422","article-title":"Fast vanishing-point detection in unstructured environments","volume":"21","author":"Moghadam","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","unstructured":"Frahm, J.M., and Pollefeys, M. (2006, January 17\u201322). RANSAC for (Quasi-) degenerate data (QDEGSAC). Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u203206), New York, NY, USA."},{"key":"ref_22","unstructured":"Torr, P., and Zisserman, A. (1998, January 4\u20137). Robust computation and parametrization of multiple view relations. Proceedings of the Sixth International Conference on Computer Vision, Bombay, India."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_24","unstructured":"Wu, C. VisualSFM: A Visual Structure from Motion System. Available online:http:\/\/ccwu.me\/vsfm\/."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wu, C. (July, January 29). Towards linear-time incremental structure from motion. Proceedings of the 2013 International Conference on 3D Vision IEEE, Seattle, WA, USA.","DOI":"10.1109\/3DV.2013.25"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/TPAMI.2004.17","article-title":"An efficient solution to the five-point relative pose problem","volume":"26","author":"Nister","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","unstructured":"Microsoft Corporation Photosynth. Available online:https:\/\/photosynth.net\/Background.aspx."},{"key":"ref_28","unstructured":"Nister, D., and Stewenius, H. (2006, January 17\u201322). Scalable recognition with a vocabulary tree. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/7\/7\/9091\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:49:21Z","timestamp":1760215761000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/7\/7\/9091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,17]]},"references-count":28,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2015,7]]}},"alternative-id":["rs70709091"],"URL":"https:\/\/doi.org\/10.3390\/rs70709091","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2015,7,17]]}}}