{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T04:00:30Z","timestamp":1771992030366,"version":"3.50.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,7,8]],"date-time":"2020-07-08T00:00:00Z","timestamp":1594166400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,8]],"date-time":"2020-07-08T00:00:00Z","timestamp":1594166400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cloud Comp"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Utilizing speech as the transmission medium in Internet of things (IoTs) is an effective way to reduce latency while improving the efficiency of human-machine interaction. In the field of speech recognition, Recurrent Neural Network (RNN) has significant advantages to achieve accuracy improvement on speech recognition. However, some of RNN-based intelligence speech recognition applications are insufficient in the privacy-preserving of speech data, and others with privacy-preserving are time-consuming, especially about model training and speech recognition. Therefore, in this paper we propose a novel <jats:bold>P<\/jats:bold>rivacy-preserving <jats:bold>S<\/jats:bold>peech <jats:bold>R<\/jats:bold>ecognition framework using <jats:bold>B<\/jats:bold>idirectional <jats:bold>L<\/jats:bold>ong short-term memory neural network, namely PSRBL. On the one hand, PSRBL designs new functions to construct security activation functions by combing with an additive secret sharing protocol, namely a secure piecewise-linear <jats:italic>Sigmoid<\/jats:italic> and a secure piecewise-linear <jats:italic>Tanh<\/jats:italic> respectively, to achieve privacy-preserving of speech data during speech recognition process running on edge servers. On the other hand, in order to reduce the time spent on both the training and the recognition of the speech model while keeping high accuracy during speech recognition process, PSRBL first utilizes secure activation functions to refit original activation functions in the bidirectional <jats:bold>L<\/jats:bold>ong <jats:bold>S<\/jats:bold>hort-<jats:bold>T<\/jats:bold>erm <jats:bold>M<\/jats:bold>emory neural network (LSTM), and then makes full use of the left and the right context information of speech data by employing bidirectional LSTM. Experiments conducted on the speech dataset TIMIT show that our framework PSRBL performs well. Specifically compared with the state-of-the-art ones, PSRBL significantly reduces the time consumption on both the training and the recognition of the speech model under the premise that PSRBL and the comparisons are consistent in the privacy-preserving of speech data.<\/jats:p>","DOI":"10.1186\/s13677-020-00186-7","type":"journal-article","created":{"date-parts":[[2020,7,8]],"date-time":"2020-07-08T13:03:51Z","timestamp":1594213431000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["A novel privacy-preserving speech recognition framework using bidirectional LSTM"],"prefix":"10.1186","volume":"9","author":[{"given":"Qingren","family":"Wang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chuankai","family":"Feng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7723-8250","authenticated-orcid":false,"given":"Yan","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hong","family":"Zhong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Victor S.","family":"Sheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,7,8]]},"reference":[{"key":"186_CR1","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.jnca.2017.08.017","volume":"97","author":"M Alaa","year":"2017","unstructured":"Alaa M, Zaidan A, Zaidan B, Talal M, Mat Kiah M (2017) A review of smart home applications based on internet of things. J Netw Comput Appl 97:48\u201365.","journal-title":"J Netw Comput Appl"},{"issue":"1","key":"186_CR2","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1109\/TIV.2016.2578706","volume":"1","author":"B Paden","year":"2016","unstructured":"Paden B, Cap M, Yong S, Yershov D, Frazzoli E (2016) A survey of motion planning and control techniques for self-driving urban vehicles. IEEE Trans Intell Veh 1(1):33\u201355.","journal-title":"IEEE Trans Intell Veh"},{"key":"186_CR3","volume-title":"Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing: 26-31 May 2013","author":"A Graves","year":"2013","unstructured":"Graves A, Mohamed A, Hinton G (2013) Speech recognition with deep recurrent neural networks In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing: 26-31 May 2013.. IEEE, Vancouver."},{"issue":"5","key":"186_CR4","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1109\/JIOT.2016.2579198","volume":"3","author":"W Shi","year":"2016","unstructured":"Shi W, Cao J, Zhang Q, Li Y, Xu L (2016) Edge computing: Vision and challenges. IEEE Internet Things J 3(5):637\u2013646.","journal-title":"IEEE Internet Things J"},{"key":"186_CR5","doi-asserted-by":"publisher","unstructured":"Zhang Y, Cui G, Deng S, Chen F, Wang Y, He QEfficient query of quality correlation for service composition. IEEE Trans Serv Comput. https:\/\/doi.org\/10.1109\/TSC.2018.2830773 (in press).","DOI":"10.1109\/TSC.2018.2830773"},{"key":"186_CR6","doi-asserted-by":"publisher","unstructured":"Zhou J, Sun J, Cong P, Liu Z, Wei T, Zhou X, Hu S (2019) Security-critical energy-aware task scheduling for heterogeneous real-time mpsocs in iot. IEEE Trans Serv Comput. https:\/\/doi.org\/10.1109\/TSC.2019.2963301 (in press).","DOI":"10.1109\/TSC.2019.2963301"},{"key":"186_CR7","first-page":"1","volume":"2018","author":"W Gong","year":"2018","unstructured":"Gong W, Qi L, Xu Y (2018) Privacy-aware multidimensional mobile service quality prediction and recommendation in distributed fog environment. Wirel Commun Mob Comput 2018:1\u20138.","journal-title":"Wirel Commun Mob Comput"},{"key":"186_CR8","first-page":"1","volume":"2017","author":"Y Xu","year":"2017","unstructured":"Xu Y, Qi L, Dou W, Yu J (2017) Privacy-preserving and scalable service recommendation based on simhash in a distributed cloud environment. Complexity 2017:1\u20139.","journal-title":"Complexity"},{"issue":"12","key":"186_CR9","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1007\/s10916-016-0627-x","volume":"40","author":"M Hossain","year":"2016","unstructured":"Hossain M (2016) Patient state recognition system for healthcare using speech and facial expressions. J Med Syst 40(12):272.","journal-title":"J Med Syst"},{"issue":"4","key":"186_CR10","doi-asserted-by":"publisher","first-page":"1404","DOI":"10.1109\/TASL.2007.894526","volume":"15","author":"P Smaragdis","year":"2007","unstructured":"Smaragdis P, Shashanka M (2007) A framework for secure speech recognition. IEEE Trans Audio Speech Lang Process 15(4):1404\u20131413.","journal-title":"IEEE Trans Audio Speech Lang Process"},{"issue":"2","key":"186_CR11","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1109\/TASL.2012.2215602","volume":"21","author":"M Pathak","year":"2012","unstructured":"Pathak M, Raj B (2012) Privacy-preserving speaker verification and identification using gaussian mixture models. IEEE Trans Audio Speech Lang Process 21(2):397\u2013406.","journal-title":"IEEE Trans Audio Speech Lang Process"},{"key":"186_CR12","volume-title":"Proceedings of ACM SIGSAC Conference on Computer and Communications Security: 24-28 October 2016","author":"M Abadi","year":"2016","unstructured":"Abadi M, Chu A, Goodfellow I, McMahan H, Mironov I, Talwar K, Zhang L (2016) Deep learning with differential privacy In: Proceedings of ACM SIGSAC Conference on Computer and Communications Security: 24-28 October 2016.. ACM, Vienna."},{"key":"186_CR13","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781107337756","volume-title":"Secure Multiparty Computation and Secret Sharing","author":"R Cramer","year":"2015","unstructured":"Cramer R, Damgard I, Nielsen J (2015) Secure Multiparty Computation and Secret Sharing. Cambridge University Press, New York, NY, United States. https:\/\/doi.org\/10.1017\/CBO9781107337756."},{"issue":"5","key":"186_CR14","doi-asserted-by":"publisher","first-page":"8406","DOI":"10.1109\/JIOT.2019.2917933","volume":"6","author":"Z Ma","year":"2019","unstructured":"Ma Z, Liu Y, Liu X, Ma J, Li F (2019) Privacy-preserving outsourced speech recognition for smart iot devices. IEEE Internet Things J 6(5):8406\u20138420.","journal-title":"IEEE Internet Things J"},{"key":"186_CR15","first-page":"8","volume-title":"Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding 8- 12 Dec. 2013","author":"A Graves","year":"2013","unstructured":"Graves A, Jaitly N, Mohamed A (2013) Hybrid speech recognition with deep bidirectional lstm In: Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding 8- 12 Dec. 2013, 8\u201312.. IEEE, Olomouc."},{"issue":"7","key":"186_CR16","first-page":"2631","volume":"49","author":"Y Bin","year":"2018","unstructured":"Bin Y, Yang Y, Shen F, Xie N, Shen H, Li X (2018) Describing video with attention-based bidirectional lstm. IEEE Trans Dependable Secure Comput 49(7):2631\u20132641.","journal-title":"IEEE Trans Dependable Secure Comput"},{"issue":"8","key":"186_CR17","doi-asserted-by":"publisher","first-page":"1619","DOI":"10.1109\/TKDE.2017.2697856","volume":"29","author":"T Zhu","year":"2017","unstructured":"Zhu T, Li G, Zhou W, Y P (2017) Differentially private data publishing and analysis: A survey. IEEE Trans Knowl Data Eng 29(8):1619\u20131638.","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"186_CR18","doi-asserted-by":"publisher","unstructured":"Zhang Y, Yin C, Wu Q, He Q, Zhu HLocation-aware deep collaborative filtering for service recommendation. Trans Syst I Man Cybernet. https:\/\/doi.org\/10.1109\/TSMC.2019.2931723 (In press).","DOI":"10.1109\/TSMC.2019.2931723"},{"key":"186_CR19","doi-asserted-by":"publisher","unstructured":"Zhang Y, Wang K, He Q, Chen F, Deng S, Zheng Z, Yang YCovering-based web service quality prediction via neighborhood-aware matrix factorization. IEEE Trans Serv Comput. https:\/\/doi.org\/10.1109\/TSC.2019.2891517 (in press).","DOI":"10.1109\/TSC.2019.2891517"},{"issue":"3","key":"186_CR20","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1080\/00401706.1991.10484833","volume":"33","author":"B Juang","year":"1991","unstructured":"Juang B, Rabiner L (1991) Hidden markov models for speech recognition. Technometrics 33(3):251\u2013272.","journal-title":"Technometrics"},{"key":"186_CR21","volume-title":"Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing: 6-10 April 2003","author":"B Schuller","year":"2003","unstructured":"Schuller B, Rigoll G, Lang M (2003) Hidden markov model-based speech emotion recognition In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing: 6-10 April 2003.. IEEE, Hong Kong."},{"issue":"11","key":"186_CR22","doi-asserted-by":"publisher","first-page":"1641","DOI":"10.1109\/29.46546","volume":"37","author":"K Lee","year":"1989","unstructured":"Lee K, Hon H (1989) Speaker-independent phone recognition using hidden markov models. IEEE Trans Acoust Speech Signal Process 37(11):1641\u20131648.","journal-title":"IEEE Trans Acoust Speech Signal Process"},{"key":"186_CR23","unstructured":"Lipton Z, Berkowitz J, Elkan C (2015) A critical review of recurrent neural networks for sequence learning. arXiv preprint arXiv:1506.00019."},{"issue":"6","key":"186_CR24","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"S Ren","year":"2017","unstructured":"Ren S, He K, Girshick R, Sun J (2017) Faster r-cnn: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137\u20131149.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"10","key":"186_CR25","doi-asserted-by":"publisher","first-page":"2451","DOI":"10.1162\/089976600300015015","volume":"12","author":"F Gers","year":"2000","unstructured":"Gers F, Schmidhuber J, Cummins F (2000) Learning to forget: Continual prediction with lstm. Neural Computation 12(10):2451\u20132471.","journal-title":"Neural Computation"},{"key":"186_CR26","volume-title":"A Field Guide to Dynamical Recurrent Networks","author":"J Kolen","year":"2001","unstructured":"Kolen J, Kremer S (2001) A Field Guide to Dynamical Recurrent Networks. Wiley-IEEE Press, New York."},{"key":"186_CR27","volume-title":"Proceedings of International Conference on Machine Learning: 3-6 Dec. 2014","author":"A Graves","year":"2014","unstructured":"Graves A, Jaitly N (2014) Towards end-to-end speech recognition with recurrent neural networks In: Proceedings of International Conference on Machine Learning: 3-6 Dec. 2014.. Journal of Machine Learning Research (JMLR), Detroit."},{"issue":"7","key":"186_CR28","doi-asserted-by":"publisher","first-page":"2631","DOI":"10.1109\/TCYB.2018.2831447","volume":"49","author":"Y Bin","year":"2018","unstructured":"Bin Y, Yang Y, Shen F, Xie N, Shen H, Li X (2018) Describing video with attention-based bidirectional lstm. IEEE Trans Cybern 49(7):2631\u20132641.","journal-title":"IEEE Trans Cybern"},{"key":"186_CR29","volume-title":"Proceedings of International Conference on Machine Learning: 19-24 June 2016","author":"N Dowlin","year":"2016","unstructured":"Dowlin N, Gilad-Bachrach R, Laine K, Lauter K, Naehring M, Wernsing J (2016) Cryptonets: Applying neural networks to encrypted data with high throughput and accuracy In: Proceedings of International Conference on Machine Learning: 19-24 June 2016.. Journal of Machine Learning Research (JMLR), New York City."},{"key":"186_CR30","volume-title":"Proceedings of ACM SIGSAC Conference Computer and Communications Security: Oct. 30-Nov. 03 2017","author":"J Liu","year":"2017","unstructured":"Liu J, Juuti M, Lu Y, Asokan N (2017) Oblivious neural network predictions via minionn transformations In: Proceedings of ACM SIGSAC Conference Computer and Communications Security: Oct. 30-Nov. 03 2017.. ACM, Dallas."},{"issue":"5","key":"186_CR31","doi-asserted-by":"publisher","first-page":"1351","DOI":"10.1109\/TC.2015.2470255","volume":"65","author":"Q Zhang","year":"2015","unstructured":"Zhang Q, Yang L, Chen Z (2015) Privacy preserving deep computation model on cloud for big data feature learning. IEEE Trans Comput 65(5):1351\u20131362.","journal-title":"IEEE Trans Comput"},{"issue":"2","key":"186_CR32","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1109\/TDSC.2017.2693986","volume":"16","author":"E Yilmaz","year":"2019","unstructured":"Yilmaz E, Ferhatosmanoglu H, Ayday E, Aksoy R (2019) Privacy-preserving aggregate queries for optimal location selection. IEEE Trans Dependable Secure Comput 16(2):329\u2013343.","journal-title":"IEEE Trans Dependable Secure Comput"},{"key":"186_CR33","doi-asserted-by":"publisher","unstructured":"Huang K, Liu X, Fu S, Guo D, Xu MA lightweight privacy-preserving cnn feature extraction framework for mobile sensing. IEEE Trans Dependable Secure Comput. https:\/\/doi.org\/10.1109\/TDSC.2019.2913362 (In press).","DOI":"10.1109\/TDSC.2019.2913362"}],"container-title":["Journal of Cloud Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-020-00186-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13677-020-00186-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13677-020-00186-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,7]],"date-time":"2021-07-07T23:13:58Z","timestamp":1625699638000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofcloudcomputing.springeropen.com\/articles\/10.1186\/s13677-020-00186-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,8]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["186"],"URL":"https:\/\/doi.org\/10.1186\/s13677-020-00186-7","relation":{},"ISSN":["2192-113X"],"issn-type":[{"value":"2192-113X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,8]]},"assertion":[{"value":"15 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 July 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no conflict of interest.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"36"}}