{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T11:25:52Z","timestamp":1792927552294,"version":"4.5.0"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T00:00:00Z","timestamp":1573171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>We propose a novel learning method to rectify document images with various distortion types from a single input image. As opposed to previous learning-based methods, our approach seeks to first learn the distortion flow on input image patches rather than the entire image. We then present a robust technique to stitch the patch results into the rectified document by processing in the gradient domain. Furthermore, we propose a second network to correct the uneven illumination, further improving the readability and OCR accuracy. Due to the less complex distortion present on the smaller image patches, our patch-based approach followed by stitching and illumination correction can significantly improve the overall accuracy in both the synthetic and real datasets.<\/jats:p>","DOI":"10.1145\/3355089.3356563","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T20:27:58Z","timestamp":1573244878000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":52,"title":["Document rectification and illumination correction using a patch-based CNN"],"prefix":"10.1145","volume":"38","author":[{"given":"Xiaoyu","family":"Li","sequence":"first","affiliation":[{"name":"Hong Kong UST"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Zhang","sequence":"additional","affiliation":[{"name":"Hong Kong UST, Microsoft Research Asia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Liao","sequence":"additional","affiliation":[{"name":"City University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pedro V.","family":"Sander","sequence":"additional","affiliation":[{"name":"Hong Kong UST"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,8]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Asian Conference on Computer Vision. Springer, 173--183","author":"Bako Steve","year":"2016","unstructured":"Steve Bako, Soheil Darabi, Eli Shechtman, Jue Wang, Kalyan Sunkavalli, and Pradeep Sen. 2016. Removing Shadows from Images of Documents. In Asian Conference on Computer Vision. Springer, 173--183."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937649"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.871082"},{"key":"e_1_2_2_4_1","volume-title":"Document Analysis and Recognition, 2003. Proceedings. Seventh International Conference on. IEEE, 71--75","author":"Cao Huaigu","year":"2003","unstructured":"Huaigu Cao, Xiaoqing Ding, and Changsong Liu. 2003. Rectifying the bound document image captured by the camera: A model based approach. In Document Analysis and Recognition, 2003. Proceedings. Seventh International Conference on. IEEE, 71--75."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-006-0062-y"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3103010.3121030"},{"key":"e_1_2_2_7_1","doi-asserted-by":"crossref","unstructured":"MENG Gaofeng SU Yuanqi WU Ying Shiming Xiang PAN Chunhong et al. 2018. Exploiting Vector Fields for Geometric Rectification of Distorted Document Images. (2018).","DOI":"10.1007\/978-3-030-01270-0_11"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818127"},{"key":"e_1_2_2_9_1","volume-title":"Image processing. Digital image processing 2","author":"Gonzalez Rafael C","year":"2007","unstructured":"Rafael C Gonzalez and Richard E Woods. 2007. Image processing. Digital image processing 2 (2007)."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3144455"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2013.88"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925974"},{"key":"e_1_2_2_14_1","volume-title":"Image-to-image translation with conditional adversarial networks. arXiv preprint","author":"Isola Phillip","year":"2017","unstructured":"Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-image translation with conditional adversarial networks. arXiv preprint (2017)."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2017.146"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.04.026"},{"key":"e_1_2_2_18_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15552-9_31"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2009.2019301"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2001.958227"},{"key":"e_1_2_2_22_1","volume-title":"Soviet physics doklady","author":"Levenshtein Vladimir I","unstructured":"Vladimir I Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. In Soviet physics doklady, Vol. 10. 707--710."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00499"},{"key":"e_1_2_2_24_1","volume-title":"Int. Workshop on Camerabased Document Analysis and Recognition. 25--29","author":"Liang Jian","year":"2005","unstructured":"Jian Liang, Daniel DeMenthon, and David Doermann. 2005. Unwarping images of curved documents using global shape optimization. In Int. Workshop on Camerabased Document Analysis and Recognition. 25--29."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70724"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00494"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.497"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Gaofeng Meng Shiming Xiang Nanning Zheng Chunhong Pan et al. 2013. Nonparametric illumination correction for scanned document images via convex hulls. age 9 10 (2013) 11.","DOI":"10.1109\/TPAMI.2012.251"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/11553595_131"},{"key":"e_1_2_2_30_1","volume-title":"Proc. Third International Workshop Camera-Based Docu-ment Analysis and Recognition","volume":"2","author":"Oliveira Daniel Marques","year":"2009","unstructured":"Daniel Marques Oliveira and Rafael Dueire Lins. 2009. A new method for shading removal and binarization of documents acquired with portable digital cameras. In Proc. Third International Workshop Camera-Based Docu-ment Analysis and Recognition, Vol. 2. 3--10."},{"key":"e_1_2_2_31_1","volume-title":"Adaptive document image binarization. Pattern recognition 33, 2","author":"Sauvola Jaakko","year":"2000","unstructured":"Jaakko Sauvola and Matti Pietik\u00e4inen. 2000. Adaptive document image binarization. Pattern recognition 33, 2 (2000), 225--236."},{"key":"e_1_2_2_32_1","volume-title":"An Iterative Approach for Shadow Removal in Document Images. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE","author":"Shah Vatsal","year":"2018","unstructured":"Vatsal Shah and Vineet Gandhi. 2018. An Iterative Approach for Shadow Removal in Document Images. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1892--1896."},{"key":"e_1_2_2_33_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/1304596.1304846"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.40"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995540"},{"key":"e_1_2_2_37_1","volume-title":"International workshop on vision algorithms. Springer, 298--372","author":"Triggs Bill","year":"1999","unstructured":"Bill Triggs, Philip F McLauchlan, Richard I Hartley, and Andrew W Fitzgibbon. 1999. Bundle adjustment a modern synthesis. In International workshop on vision algorithms. Springer, 298--372."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2007.383251"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1030397.1030434"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007906904009"},{"key":"e_1_2_2_41_1","volume-title":"High-Performance Computing on the Intel\u00ae Xeon Phi\u00e2\u010e\u0107","author":"Wang Endong","unstructured":"Endong Wang, Qing Zhang, Bo Shen, Guangyong Zhang, Xiaowei Lu, Qing Wu, and Yajuan Wang. 2014. Intel math kernel library. In High-Performance Computing on the Intel\u00ae Xeon Phi\u00e2\u010e\u0107. Springer, 167--188."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-70659-3_36"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2004.1334171"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024184"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2675980"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIAP.2007.4362769"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2009.03.025"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70831"},{"key":"e_1_2_2_49_1","volume-title":"Chew Lim Tan, and Liying Fan","author":"Zhang Zheng","year":"2004","unstructured":"Zheng Zhang, Chew Lim Tan, and Liying Fan. 2004. Restoration of curved document images through 3D shape modeling. In null. IEEE, 10--15."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356563","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3355089.3356563","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:41Z","timestamp":1750203881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356563"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,8]]},"references-count":49,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3355089.3356563"],"URL":"https:\/\/doi.org\/10.1145\/3355089.3356563","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,8]]},"assertion":[{"value":"2019-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}