{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T02:48:39Z","timestamp":1747190919135,"version":"3.40.5"},"reference-count":28,"publisher":"Wiley","license":[{"start":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Intelligence and Neuroscience"],"published-print":{"date-parts":[[2022,1,28]]},"abstract":"<jats:p>Image processing is a mainstream processing method. When people enjoy artists\u2019 singing videos, there will be a problem that the subtitles of the lyrics are out of sync with the singer\u2019s mouth shape. This problem needs to be solved using image processing technology, letting the computer realize lip-reading recognition function and correct the mouth shape and lyrics subtitles in the image according to the extracted lip-reading data, so that the mouth shape and lyrics in singing practice can be synchronized. Lip-reading information can effectively improve the accuracy of language cognition, save part of capital and manpower investment, and make viewers get a good audio-visual interactive experience. The results show the following: (1) After the UI test, the system user interface function design is reasonable and there is no bad BUG. We can find that the average processing time of each frame is 628\u2009ms, the system performance evaluation is good, and the success rate can be as high as 98.80%. 0.36724\u2009s is the average time for each step when the system processes the image. (2) The human image can basically identify the portrait area and lip area from various angles. (3) Compared with DCT and DWT, the recognition rate of the two cascade lip region feature extraction methods is improved by nearly 10%, and the feature vector dimension is reduced by nearly 65%. (4) Classify the mouth shape more finely and optimize the image of the tester\u2019s mouth shape to make the mouth shape closer to the standard mouth shape. (5) After systematic correction of mouth shape and subtitles, the success rate is higher than 90%. Finally, we can find that the running effect is good and the method has achieved high results, which can carry out the details of the next optimization work.<\/jats:p>","DOI":"10.1155\/2022\/5138442","type":"journal-article","created":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T21:05:42Z","timestamp":1643403942000},"page":"1-13","source":"Crossref","is-referenced-by-count":0,"title":["Collaborative Research on Mouth Shape and Lyrics in Singing Practice Based on Image Processing"],"prefix":"10.1155","volume":"2022","author":[{"given":"Lujia","family":"Xu","sequence":"first","affiliation":[{"name":"Xiamen University Tan Kah Kee College, Zhangzhou 363123, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6498-6583","authenticated-orcid":true,"given":"Chen","family":"Chen","sequence":"additional","affiliation":[{"name":"The First Affiliated Hospital of Xiamen University, Xiamen 361000, China"}]}],"member":"311","reference":[{"issue":"2","key":"1","first-page":"239","article-title":"A survey of lipreading\u2014\u2014one of visual languages","volume":"29","author":"H. X. Yao","year":"2001","journal-title":"Acta Electronica Sinica"},{"volume-title":"Research on Lip reading Recognition Technology Based on Video Image by Tao Hong [D]","year":"2005","key":"2"},{"first-page":"31","volume-title":"Pan Finland\u2019s Research on Intelligent Attendance System Based on Face Recognition Technology","year":"2014","key":"3"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1023\/b:vlsi.0000015091.47302.07"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1109\/access.2020.3036865"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.5370\/kiee.2014.63.6.813"},{"key":"7","first-page":"29","article-title":"Lip reading Technical research report of electronic information and communication society","volume":"114","author":"T. Saitoh","year":"2014","journal-title":"Emm, High Technology Enrichment of Multimedia Information"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.2478\/v10175-012-0041-6"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.4028\/www.scientific.net\/amm.734.412"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-5580-0_16"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.48084\/etasr.4102"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.32604\/cmc.2021.016509"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.3390\/fi13070182"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1007\/s10772-021-09816-0"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1883\/1\/012083"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1142\/s0218001420540038"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1007\/s10015-007-0494-0"},{"issue":"5","key":"18","article-title":"Lip contour detection techniques based on front view of face","volume":"2","author":"S. K. Bandyopadhyay","year":"2011","journal-title":"Journal of Global Research in Computer Science"},{"issue":"4","key":"19","first-page":"484","article-title":"Digital image processing","volume":"28","author":"R. C. Gonzalez","year":"2008","journal-title":"Prentice Hall International"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.05.106"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1016\/s0969-4765(19)30085-2"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1016\/j.displa.2021.102022"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1063\/1.4823282"},{"key":"24","first-page":"192","article-title":"The spectral image processing system (SIPS)\u2014interactive visualization and analysis of imaging spectrometer data","volume":"283","author":"F. A. Kruse","year":"1993","journal-title":"American Institute of Physics"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1186\/s13640-017-0233-y"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1121\/1.2229005"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.3103\/s0278641917020030"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1109\/tmm.2015.2407694"}],"container-title":["Computational Intelligence and Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2022\/5138442.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2022\/5138442.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2022\/5138442.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T21:05:55Z","timestamp":1643403955000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/cin\/2022\/5138442\/"}},"subtitle":[],"editor":[{"given":"Baiyuan","family":"Ding","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,1,28]]},"references-count":28,"alternative-id":["5138442","5138442"],"URL":"https:\/\/doi.org\/10.1155\/2022\/5138442","relation":{},"ISSN":["1687-5273","1687-5265"],"issn-type":[{"type":"electronic","value":"1687-5273"},{"type":"print","value":"1687-5265"}],"subject":[],"published":{"date-parts":[[2022,1,28]]}}}