{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T17:39:10Z","timestamp":1678901950553},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,5]],"date-time":"2020-02-05T00:00:00Z","timestamp":1580860800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,5]],"date-time":"2020-02-05T00:00:00Z","timestamp":1580860800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Video (used as a form of examination or homework) as an efficient approach for examining students\u2019 abilities is drawing increasing attention in the education field. How to assess video assignments effectively and accurately has become a significant topic in academia. This work proposes a method based on a multi-channel CNN-LSTM hybrid architecture to extract and classify image features such as students\u2019 actions and expressions, as well as audio features such as speech rates and pauses in the video assignments, and then conducts a two-category assessment of \u201cqualified\u201d or \u201cunqualified\u201d. Additionally, build this system in a cloud computing environment as a Cloud-based Intelligent Evaluation Service application could provide universal service to meet the needs of multiple teaching units. The proposed method is shown to be feasible and effective through experiments.<\/jats:p>","DOI":"10.1186\/s13677-020-0156-5","type":"journal-article","created":{"date-parts":[[2020,2,5]],"date-time":"2020-02-05T14:03:48Z","timestamp":1580911428000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["CIES: Cloud-based Intelligent Evaluation Service for video homework using CNN-LSTM network"],"prefix":"10.1186","volume":"9","author":[{"given":"Rui","family":"Song","sequence":"first","affiliation":[]},{"given":"Zhiyi","family":"Xiao","sequence":"additional","affiliation":[]},{"given":"Jinjiao","family":"Lin","sequence":"additional","affiliation":[]},{"given":"Ming","family":"Liu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,2,5]]},"reference":[{"issue":"1","key":"156_CR1","first-page":"101","volume":"35","author":"T Jinyu","year":"2018","unstructured":"Jinyu T, Fang C et al (2018) Application of video work in higher vocational nursing training class [J]. Nurs Res China 35(1):101\u2013120","journal-title":"Nurs Res China"},{"issue":"1","key":"156_CR2","doi-asserted-by":"publisher","first-page":"5:1","DOI":"10.1007\/s10916-018-1121-4","volume":"43","author":"Y Chen","year":"2019","unstructured":"Chen Y, Ding S, Xu Z, Zheng H, Yang S (2019) Blockchain-Based Medical Records Secure Storage and Medical Service Framework. J Med Syst 43(1):5:1\u20135:9","journal-title":"J Med Syst"},{"key":"156_CR3","first-page":"3","volume":"03","author":"HU Zhuang-lin","year":"2006","unstructured":"Zhuang-lin HU, Jia DONG et al (2006) How Is Construed Mutilmodally \u2014\u2014 A case study of a PowerPoint presentation contest [J]. Techn Enhanced Foreign Lang Educ 03:3\u201312","journal-title":"Techn Enhanced Foreign Lang Educ"},{"key":"156_CR4","first-page":"78","volume":"07","author":"W Caixia","year":"2015","unstructured":"Caixia W, Xinping Z et al (2015) Research on presentation teaching and high quality PPT making strategy [J]. Comput Era 07:78\u201380","journal-title":"Comput Era"},{"issue":"04","key":"156_CR5","first-page":"108","volume":"18","author":"LIU Wei","year":"2016","unstructured":"Wei LIU, Zi-sen QI, Mu-xuan WANG et al (2016) Automated Assessment of Subjective Tests [J]. J Beijing Univ Posts Telecomm (Social Sciences Edition) 18(04):108\u2013116","journal-title":"J Beijing Univ Posts Telecomm (Social Sciences Edition)"},{"key":"156_CR6","first-page":"132","volume":"14","author":"S Gao","year":"2004","unstructured":"Gao S, Chunfeng Y et al (2004) The Application of Sentence Similarity Measurement in Automated Assessment Technology of Subjective Tests [J]. Comput Eng Appl 14:132\u2013135","journal-title":"Comput Eng Appl"},{"key":"156_CR7","first-page":"205","volume":"11","author":"DING Wei-ping","year":"2007","unstructured":"Wei-ping DING, Zhi-jin GUAN, Jian-ping CHEN et al (2007) Research and Application of Intelligent Assessment Algorithm Based on Programming Subjective Questions [J]. Comput Technol Dev 11:205\u2013208","journal-title":"Comput Technol Dev"},{"issue":"8","key":"156_CR8","doi-asserted-by":"publisher","first-page":"3515","DOI":"10.1007\/s00521-017-3290-3","volume":"31","author":"S Alawadi","year":"2019","unstructured":"Alawadi S (2019) Manuel Fern\u00e1ndez Delgado, David Mera, Sen\u00e9n Barro. Polynomial Kernel Discriminant Analysis for 2D visualization of classification problems. Neural Comput & Applic 31(8):3515\u20133531","journal-title":"Neural Comput & Applic"},{"key":"156_CR9","volume-title":"Automated Correction for Syntax Errors in Programming Assignments using Recurrent Neural Networks [J]","author":"S Bhatia","year":"2016","unstructured":"Bhatia S, Singh R (2016) Automated Correction for Syntax Errors in Programming Assignments using Recurrent Neural Networks [J]"},{"key":"156_CR10","unstructured":"Weiqian L, Guoliang W, Jia L, Runsheng L et al (2005) Phone-based pronunciation quality assessment algorithm [J]. J Tsinghua Univ (Science and Technology) (01):5\u20138"},{"issue":"S1","key":"156_CR11","first-page":"1349","volume":"49","author":"H Shen","year":"2009","unstructured":"Shen H, Hongyan LI, Shijin W, Jia\u2019en L, Bo X et al (2009) Automatic assessment of speech fluency in computer aided speech grading systems [J]. J Tsinghua Univ (Science and Technology) 49(S1):1349\u20131355","journal-title":"J Tsinghua Univ (Science and Technology)"},{"issue":"1","key":"156_CR12","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1177\/0265532216679451","volume":"35","author":"Z Wang","year":"2018","unstructured":"Wang Z, Zechner K, Sun Y (2018) Monitoring the Performance of Human and Automated Scores for Spoken Responses [J]. Lang Test 35(1):101\u2013120","journal-title":"Lang Test"},{"key":"156_CR13","unstructured":"Zhang Yanbin, Hu Yuening, Chu Min, Huang Cha, Liang Mangui, et al. Mandarin tone error detection [J]. J Tsinghua Univ (Science and Technology), 2008(S1):683\u2013687"},{"key":"156_CR14","unstructured":"Long Z et al (2014) Research on Automatic Evaluation Methods of Mandarin Pronunciation Quality [D]. Harbin: Harbin Institute of Technology"},{"key":"156_CR15","unstructured":"Kai D et al (2015) An Automatic Marking System Based on Handwritten Character Recognition [D]. Taiyuan: Taiyuan University of Technology"},{"key":"156_CR16","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1016\/j.patcog.2016.08.005","volume":"61","author":"Xu-Yao Zhang","year":"2017","unstructured":"Zhang X-Y, Bengio Y, Liu C-L (2017) Online and offline handwritten Chinese character recognition: A comprehensive study and new benchmark [J]. Pattern Recogn 61;(61):348\u2013360.","journal-title":"Pattern Recognition"},{"issue":"08","key":"156_CR17","first-page":"38","volume":"28","author":"L Zu-ying","year":"2018","unstructured":"Zu-ying L, Dan-hui Z et al (2018) Auto-evaluation of Classroom Teaching & Learning and Its Preliminary Research Findings [J]. Mod Educ Technol 28(08):38\u201344","journal-title":"Mod Educ Technol"},{"issue":"07","key":"156_CR18","first-page":"87","volume":"29","author":"W Yan-tao","year":"2019","unstructured":"Yan-tao W, Dao-ying Q, Jia-min H, Huang Y, Ya-fei S et al (2019) The Recognition of Students\u2019 Classroom Behaviors based on Deep Learning [J]. Mod Educ Technol 29(07):87\u201391","journal-title":"Mod Educ Technol"},{"key":"156_CR19","doi-asserted-by":"crossref","unstructured":"Gammulle H, Denman S, Sridharan S, Fookes C (2020) Fine-grained action segmentation using the semi-supervised action GAN [J]. Pattern Recogn 98;107039","DOI":"10.1016\/j.patcog.2019.107039"},{"key":"156_CR20","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1016\/j.jvcir.2019.02.003","volume":"61","author":"K Yang","year":"2019","unstructured":"Yang K, Shen X, Qiao P, Li S, Li D, Dou Y (2019) Exploring frame segmentation networks for temporal action localization [J]. J Visual Comm Image Representation 61:296\u2013302","journal-title":"J Visual Comm Image Representation"},{"key":"156_CR21","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1016\/j.neucom.2019.05.058","volume":"358","author":"Zhenxing Zheng","year":"2019","unstructured":"Zheng Z, An G, Wu D, Ruan Q (2019) Spatial-temporal pyramid based Convolutional Neural Network for action recognition [J]. Neurocomputing 358;446\u2013455","journal-title":"Neurocomputing"},{"issue":"1","key":"156_CR22","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/s00521-016-2430-5","volume":"29","author":"S Bhattacharya","year":"2018","unstructured":"Bhattacharya S, Roy S, Chowdhury S (2018) A neural network-based intelligent cognitive state recognizer for confidence-based e-learning system. Neural Comput & Applic 29(1):205\u2013219","journal-title":"Neural Comput & Applic"},{"key":"156_CR23","doi-asserted-by":"crossref","unstructured":"Wu Z, Wang X, Jiang YG et al (2015) Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification [J]. IEEE Trans Multimedia 20(11);3137\u20133147","DOI":"10.1145\/2733373.2806222"},{"issue":"6","key":"156_CR24","doi-asserted-by":"publisher","first-page":"1701","DOI":"10.1007\/s00521-018-3458-5","volume":"30","author":"JP Ferreira","year":"2018","unstructured":"Ferreira JP, Vieira A, Ferreira P, Cris\u00f3stomo MM (2018) A. Paulo Coimbra. Human knee joint walking pattern generation using computational intelligence techniques. Neural Comput & Applic 30(6):1701\u20131713","journal-title":"Neural Comput & Applic"},{"issue":"01","key":"156_CR25","first-page":"72","volume":"30","author":"W Heng","year":"2019","unstructured":"Heng W, Xia L, Xiaofang L, Xu W et al (2019) Classification of breast cancer histopathological images based on ResNet50 network [J]. J China Univ Metrology 30(01):72\u201377","journal-title":"J China Univ Metrology"},{"issue":"2","key":"156_CR26","first-page":"1","volume":"2014","author":"DM Williamson","year":"2015","unstructured":"Williamson DM (2015) A Study of the Use of the \u201ce-rater\u201d\u00ae Scoring Engine for the Analytical Writing Measure of the \u201cGRE\u201d\u00ae revised General Test [J]. Ets Res Rep 2014(2):1\u201366","journal-title":"Ets Res Rep"},{"issue":"1","key":"156_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/ets2.12047","volume":"2015","author":"C Ramineni","year":"2015","unstructured":"Ramineni C, Trapani CS, Williamson DM (2015) Evaluation of e-rater\u00ae for the Praxis I\u00ae Writing Test [J]. ETS Res Rep Series 2015(1):1\u201328","journal-title":"ETS Res Rep Series"},{"key":"156_CR28","first-page":"27","volume":"04","author":"K-z Luo","year":"2014","unstructured":"Luo K-z, Bao-cheng H (2014) A Critical Review of Two Automated Speech Scoring Systems: Ordinate & SpeechRater [J]. Comput Assist Foreign Lang Educ 04:27\u201332","journal-title":"Comput Assist Foreign Lang Educ"},{"issue":"10","key":"156_CR29","first-page":"64","volume":"50","author":"LIU YueXia","year":"2016","unstructured":"YueXia LIU, Zhiyao NIU, Ning WU (2016) An automatic Scoring Method of Student programs Using Multi-Feature Analysis for Massive Open Online Courses [J]. Journal of Xi\u2019an Jiaotong University 50(10):64\u201370","journal-title":"Journal of Xi\u2019an Jiaotong University"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-020-0156-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13677-020-0156-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-020-0156-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,4]],"date-time":"2021-02-04T00:12:28Z","timestamp":1612397548000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-020-0156-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,5]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["156"],"URL":"https:\/\/doi.org\/10.1186\/s13677-020-0156-5","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,5]]},"assertion":[{"value":"19 October 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This manuscript has not been submitted to, nor is under review at, another journal or other publishing venue. The authors declare that they have no competing interests among authors.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"7"}}