{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T17:44:58Z","timestamp":1772041498496,"version":"3.50.1"},"publisher-location":"Cham","reference-count":53,"publisher":"Springer International Publishing","isbn-type":[{"value":"9783030594091","type":"print"},{"value":"9783030594107","type":"electronic"}],"license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020]]},"DOI":"10.1007\/978-3-030-59410-7_40","type":"book-chapter","created":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T16:57:43Z","timestamp":1600707463000},"page":"604-620","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["An Empirical Study on Bugs Inside TensorFlow"],"prefix":"10.1007","author":[{"given":"Li","family":"Jia","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Zhong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoyin","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Linpeng","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuansheng","family":"Lu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,9,18]]},"reference":[{"key":"40_CR1","unstructured":"Fix deadlocks in staging areas (2017). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/13684"},{"key":"40_CR2","unstructured":"Bug in tf.print summarized formatting (2018). https:\/\/github.com\/tensorflow\/tensorflow\/issues\/20751"},{"key":"40_CR3","unstructured":"Cannot opened include file \u201ctensorflow\/contrib\/tpu\/proto\/tpu$$\\_$$embedding$$\\_$$config. pb.h\u201d: no such file or directory (2018). https:\/\/github.com\/tensorflow\/tensorflow\/issues\/16262"},{"key":"40_CR4","unstructured":"Exception when not providing optional parameter frequency$$\\_$$skip in timefreqlstmcell (2018). https:\/\/github.com\/tensorflow\/tensorflow\/issues\/16100"},{"key":"40_CR5","unstructured":"Fix an imperfect implementation of tf.losses.mean$$\\_$$pairwise$$\\_$$squared$$\\_$$error (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/16433"},{"key":"40_CR6","unstructured":"Fix broken python3 build (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/16130"},{"key":"40_CR7","unstructured":"Fix build issue with KafkaDataset (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/17418"},{"key":"40_CR8","unstructured":"Fix error: ConvNDLSTMCell does not pass name parameter (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/17345"},{"key":"40_CR9","unstructured":"Fix possible memory leak (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/21950"},{"key":"40_CR10","unstructured":"Fix routing of quantized tensors (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/19894"},{"key":"40_CR11","unstructured":"Fix tf.argmax warnings on dimension argument by using axis instead (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/18558"},{"key":"40_CR12","unstructured":"Fix var type issue which breaks crf$$\\_$$decode (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/21371"},{"key":"40_CR13","unstructured":"Fixed build error on gcc-7 (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/21017"},{"key":"40_CR14","unstructured":"[INTEL MKL] fix bug in MklSlice op when allocating output tensor (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/22822"},{"key":"40_CR15","unstructured":"Max pooling cause error on empty batch (2018). https:\/\/github.com\/tensorflow\/tensorflow\/issues\/21338"},{"key":"40_CR16","unstructured":"MKL DNN: fix the TF1.6 speed issue by fixing MKL DNN LRN taking the optimum path (2018). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/17605"},{"key":"40_CR17","unstructured":"tf$$\\_$$cnn$$\\_$$benchmarks.py stuck when running with multiple GPUs and ImageNet data with protocol grpc+verbs (2018). https:\/\/github.com\/tensorflow\/tensorflow\/issues\/11725"},{"key":"40_CR18","unstructured":"Fix for stringPiece build failure (2019). https:\/\/github.com\/tensorflow\/tensorflow\/pull\/21956"},{"key":"40_CR19","unstructured":"Keras (2019). https:\/\/keras.io"},{"key":"40_CR20","unstructured":"Abadi, M., et al.: TensorFlow: a system for large-scale machine learning. In: Proceedings of OSDI, pp. 265\u2013283 (2016)"},{"key":"40_CR21","unstructured":"Anand, S.S., Bell, D.A., Hughes, J.G.: An empirical performance study of the Ingres search accelerator for a large property management database system. In: Proceedings of VLDB, pp. 676\u2013685 (1994)"},{"issue":"1","key":"40_CR22","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1109\/TDSC.2004.2","volume":"1","author":"A Avizienis","year":"2004","unstructured":"Avizienis, A., Laprie, J., Randell, B., Landwehr, C.E.: Basic concepts and taxonomy of dependable and secure computing. IEEE Trans. Dependable Sec. Comput. 1(1), 11\u201333 (2004)","journal-title":"IEEE Trans. Dependable Sec. Comput."},{"key":"40_CR23","first-page":"1137","volume":"3","author":"Y Bengio","year":"2003","unstructured":"Bengio, Y., Ducharme, R., Vincent, P., Janvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137\u20131155 (2003)","journal-title":"J. Mach. Learn. Res."},{"key":"40_CR24","unstructured":"Bergstra, J., et al.: Theano: deep learning on GPUs with Python. In: Proceedings of the NIPS, BigLearning Workshop (2011)"},{"key":"40_CR25","unstructured":"Collobert, R., Bengio, S., Marithoz, J.: Torch: a modular machine learning software library (2002)"},{"key":"40_CR26","doi-asserted-by":"crossref","unstructured":"Derr, E., Bugiel, S., Fahl, S., Acar, Y., Backes, M.: Keep me updated: an empirical study of third-party library updatability on android. In: Proceedings of the CCS, pp. 2187\u20132200 (2017)","DOI":"10.1145\/3133956.3134059"},{"issue":"2","key":"40_CR27","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1109\/TSE.1975.6312834","volume":"1","author":"A Endres","year":"1975","unstructured":"Endres, A.: An analysis of errors and their causes in system programs. IEEE Trans. Software Eng. 1(2), 140\u2013149 (1975)","journal-title":"IEEE Trans. Software Eng."},{"key":"40_CR28","doi-asserted-by":"crossref","unstructured":"Flor\u00eancio, D.A.F., Herley, C.: A large-scale study of web password habits. In: Proceedings of the WWW, pp. 657\u2013666 (2007)","DOI":"10.1145\/1242572.1242661"},{"issue":"2","key":"40_CR29","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1109\/TSE.1981.230831","volume":"7","author":"RL Glass","year":"1981","unstructured":"Glass, R.L.: Persistent software errors. IEEE Trans. Software Eng. 7(2), 162\u2013168 (1981)","journal-title":"IEEE Trans. Software Eng."},{"key":"40_CR30","volume-title":"Data Mining: Concepts and Techniques","author":"J Han","year":"2011","unstructured":"Han, J., Kamber, M., Pei, J.: Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers, Burlington (2011)"},{"issue":"6","key":"40_CR31","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","volume":"29","author":"G Hinton","year":"2012","unstructured":"Hinton, G., et al.: Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process. Mag. 29(6), 82\u201397 (2012)","journal-title":"IEEE Signal Process. Mag."},{"key":"40_CR32","doi-asserted-by":"crossref","unstructured":"Humbatova, N., Jahangirova, G., Bavota, G., Riccio, V., Stocco, A., Tonella, P.: Taxonomy of real faults in deep learning systems. In: Proceedings of the ICSE (2020, to appear)","DOI":"10.1145\/3377811.3380395"},{"key":"40_CR33","doi-asserted-by":"crossref","unstructured":"Islam, M.J., Nguyen, G., Pan, R., Rajan, H.: A comprehensive study on deep learning bug characteristics. In: Proceedings of the ESEC\/FSE, pp. 510\u2013520 (2019)","DOI":"10.1145\/3338906.3338955"},{"key":"40_CR34","doi-asserted-by":"crossref","unstructured":"Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the MM, pp. 675\u2013678 (2014)","DOI":"10.1145\/2647868.2654889"},{"key":"40_CR35","unstructured":"Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of the ICLR (2017)"},{"key":"40_CR36","unstructured":"Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of the NIPS, pp. 1106\u20131114 (2012)"},{"issue":"12","key":"40_CR37","first-page":"2118","volume":"12","author":"G Li","year":"2019","unstructured":"Li, G., Zhou, X., Li, S., Gao, B.: Qtune: a query-aware database tuning system with deep reinforcement learning. PVLDB 12(12), 2118\u20132130 (2019)","journal-title":"PVLDB"},{"key":"40_CR38","doi-asserted-by":"crossref","unstructured":"Lin, Q., Chen, G., Zhang, M.: On the design of adaptive and speculative concurrency control in distributed databases. In: Proceedings of the ICDE, pp. 1376\u20131379 (2018)","DOI":"10.1109\/ICDE.2018.00154"},{"key":"40_CR39","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1016\/0169-023X(91)90002-F","volume":"7","author":"PC Lockemann","year":"1991","unstructured":"Lockemann, P.C., Nagel, H., Walter, I.M.: Databases for knowledge bases: empirical study of a knowledge base management system for a semantic network. Data Knowl. Eng. 7, 115\u2013154 (1991)","journal-title":"Data Knowl. Eng."},{"key":"40_CR40","doi-asserted-by":"crossref","unstructured":"Ma, L., et al.: DeepGauge: multi-granularity testing criteria for deep learning systems. In: Proceedings of the ASE, pp. 120\u2013131 (2018)","DOI":"10.1145\/3238147.3238202"},{"key":"40_CR41","doi-asserted-by":"crossref","unstructured":"Pei, K., Cao, Y., Yang, J., Jana, S.: DeepXplore: automated whitebox testing of deep learning systems. In: Proceedings of the SOSP, pp. 1\u201318 (2017)","DOI":"10.1145\/3132747.3132785"},{"key":"40_CR42","doi-asserted-by":"crossref","unstructured":"Pham, H.V., Lutellier, T., Qi, W., Tan, L.: CRADLE: cross-backend validation to detect and localize bugs in deep learning libraries. In: Proceedings of the ICSE, pp. 1027\u20131038 (2019)","DOI":"10.1109\/ICSE.2019.00107"},{"issue":"5","key":"40_CR43","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1007\/s00778-014-0377-7","volume":"24","author":"K Ren","year":"2015","unstructured":"Ren, K., Thomson, A., Abadi, D.J.: VLL: a lock manager redesign for main memory database systems. VLDB J. 24(5), 681\u2013705 (2015)","journal-title":"VLDB J."},{"key":"40_CR44","doi-asserted-by":"crossref","unstructured":"van Renen, A., et al.: Managing non-volatile memory in database systems. In: Proceedings of the SIGMOD, pp. 1541\u20131555 (2018)","DOI":"10.1145\/3183713.3196897"},{"key":"40_CR45","unstructured":"Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Proceedings of the NIPS, pp. 3104\u20133112 (2014)"},{"issue":"6","key":"40_CR46","doi-asserted-by":"publisher","first-page":"1665","DOI":"10.1007\/s10664-013-9258-8","volume":"19","author":"L Tan","year":"2014","unstructured":"Tan, L., Liu, C., Li, Z., Wang, X., Zhou, Y., Zhai, C.: Bug characteristics in open source software. Empirical Softw. Eng. 19(6), 1665\u20131705 (2014)","journal-title":"Empirical Softw. Eng."},{"key":"40_CR47","doi-asserted-by":"crossref","unstructured":"Thung, F., Wang, S., Lo, D., Jiang, L.: An empirical study of bugs in machine learning systems. In: Proceedings of the ISSRE, pp. 271\u2013280 (2012)","DOI":"10.1109\/ISSRE.2012.22"},{"key":"40_CR48","doi-asserted-by":"crossref","unstructured":"Tian, Y., Pei, K., Jana, S., Ray, B.: DeepTest: automated testing of deep-neural-network-driven autonomous cars. In: Proceedings of the ICSE, pp. 303\u2013314 (2018)","DOI":"10.1145\/3180155.3180220"},{"key":"40_CR49","doi-asserted-by":"crossref","unstructured":"Wang, L., et al.: Superneurons: dynamic GPU memory management for training deep neural networks. In: Proceedings of the PPoPP, pp. 41\u201353 (2018)","DOI":"10.1145\/3200691.3178491"},{"key":"40_CR50","doi-asserted-by":"publisher","unstructured":"Wang, S., Liu, T., Nam, J., Tan, L.: Deep semantic feature learning for software defect prediction. IEEE Trans. Softw. Eng., 1 (2018, early access). https:\/\/doi.org\/10.1109\/TSE.2018.2877612","DOI":"10.1109\/TSE.2018.2877612"},{"issue":"2","key":"40_CR51","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1145\/3003665.3003669","volume":"45","author":"W Wang","year":"2016","unstructured":"Wang, W., Zhang, M., Chen, G., Jagadish, H.V., Ooi, B.C., Tan, K.: Database meets deep learning: challenges and opportunities. SIGMOD Record 45(2), 17\u201322 (2016)","journal-title":"SIGMOD Record"},{"key":"40_CR52","doi-asserted-by":"publisher","first-page":"35012","DOI":"10.1109\/ACCESS.2019.2904720","volume":"7","author":"B Xu","year":"2019","unstructured":"Xu, B., et al.: NADAQ: natural language database querying based on deep learning. IEEE Access 7, 35012\u201335017 (2019)","journal-title":"IEEE Access"},{"key":"40_CR53","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Chen, Y., Cheung, S., Xiong, Y., Zhang, L.: An empirical study on TensorFlow program bugs. In: Proceedings of the ISSTA, pp. 129\u2013140 (2018)","DOI":"10.1145\/3213846.3213866"}],"container-title":["Lecture Notes in Computer Science","Database Systems for Advanced Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-59410-7_40","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T18:53:44Z","timestamp":1710269624000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-59410-7_40"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"ISBN":["9783030594091","9783030594107"],"references-count":53,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-59410-7_40","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020]]},"assertion":[{"value":"18 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"DASFAA","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Database Systems for Advanced Applications","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Jeju","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Korea (Republic of)","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"24 September 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"27 September 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"25","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"dasfaa2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"http:\/\/db.pknu.ac.kr\/dasfaa2020\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Double-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"487","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"119","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"23","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"24% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3.11","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"6.81","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"15 demo papers and 4 industrial papers","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}