{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T07:19:19Z","timestamp":1763018359905,"version":"3.41.0"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T00:00:00Z","timestamp":1616112000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,3,19]]},"abstract":"<jats:p>In this study, we propose novel gamified active learning and inaccuracy detection for crowdsourced data labeling for an activity recognition system using mobile sensing (CrowdAct). First, we exploit active learning to address the lack of accurate information. Second, we present the integration of gamification into active learning to overcome the lack of motivation and sustained engagement. Finally, we introduce an inaccuracy detection algorithm to minimize inaccurate data. To demonstrate the capability and feasibility of the proposed model in realistic settings, we developed and deployed the CrowdAct system to a crowdsourcing platform. For our experimental setup, we recruited 120 diverse workers. Additionally, we gathered 6,549 activity labels from 19 activity classes by using smartphone sensors and user engagement information. We empirically evaluated the quality of CrowdAct by comparing it with a baseline using techniques such as machine learning and descriptive and inferential statistics. Our results indicate that CrowdAct was effective in improving activity accuracy recognition, increasing worker engagement, and reducing inaccurate data in crowdsourced data labeling. Based on our findings, we highlight critical and promising future research directions regarding the design of efficient activity data collection with crowdsourcing.<\/jats:p>","DOI":"10.1145\/3432222","type":"journal-article","created":{"date-parts":[[2021,3,30]],"date-time":"2021-03-30T18:56:41Z","timestamp":1617130601000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["CrowdAct"],"prefix":"10.1145","volume":"5","author":[{"given":"Nattaya","family":"Mairittha","sequence":"first","affiliation":[{"name":"Graduate School of Engineering, Kyushu Institute of Technology, Japan, Sensui, Tobata, Kitakyushu, Fukuoka"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tittaya","family":"Mairittha","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Kyushu Institute of Technology, Japan, Sensui, Tobata, Kitakyushu, Fukuoka"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paula","family":"Lago","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Kyushu Institute of Technology, Japan, Sensui, Tobata, Kitakyushu, Fukuoka"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sozo","family":"Inoue","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Kyushu Institute of Technology, Japan, Sensui, Tobata, Kitakyushu, Fukuoka"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,30]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Twenty-Sixth AAAI Conference on Artificial Intelligence.","author":"Abdullah Saeed","year":"2012","unstructured":"Saeed Abdullah , Nicholas D Lane , and Tanzeem Choudhury . 2012 . Towards population scale activity recognition: A framework for handling data diversity . In Twenty-Sixth AAAI Conference on Artificial Intelligence. Saeed Abdullah, Nicholas D Lane, and Tanzeem Choudhury. 2012. Towards population scale activity recognition: A framework for handling data diversity. In Twenty-Sixth AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328906"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25167-2_12"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502029"},{"key":"e_1_2_1_5_1","volume-title":"Queries and concept learning. Machine learning 2, 4","author":"Angluin Dana","year":"1988","unstructured":"Dana Angluin . 1988. Queries and concept learning. Machine learning 2, 4 ( 1988 ), 319--342. Dana Angluin. 1988. Queries and concept learning. Machine learning 2, 4 (1988), 319--342."},{"key":"e_1_2_1_6_1","unstructured":"Les E Atlas David A Cohn and Richard E Ladner. 1990. Training connectionist networks with queries and selective sampling. In Advances in neural information processing systems. 566--573.  Les E Atlas David A Cohn and Richard E Ladner. 1990. Training connectionist networks with queries and selective sampling. In Advances in neural information processing systems. 566--573."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638728.2641674"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Anahid Basiri Muki Haklay Giles Foody and Peter Mooney. 2019. Crowdsourced geospatial data quality: Challenges and future directions.  Anahid Basiri Muki Haklay Giles Foody and Peter Mooney. 2019. Crowdsourced geospatial data quality: Challenges and future directions.","DOI":"10.1080\/13658816.2019.1593422"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2010.5665868"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173805"},{"key":"e_1_2_1_11_1","unstructured":"Hennie Brugman Albert Russel and Xd Nijmegen. 2004. Annotating Multi-media\/Multi-modal Resources with ELAN.. In LREC.  Hennie Brugman Albert Russel and Xd Nijmegen. 2004. Annotating Multi-media\/Multi-modal Resources with ELAN.. In LREC."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2499621"},{"key":"e_1_2_1_13_1","volume-title":"Olivier Caelen, Yacine Kessaci, Fr\u00e9d\u00e9ric Obl\u00e9, and Gianluca Bontempi.","author":"Carcillo Fabrizio","year":"2019","unstructured":"Fabrizio Carcillo , Yann-A\u00ebl Le Borgne , Olivier Caelen, Yacine Kessaci, Fr\u00e9d\u00e9ric Obl\u00e9, and Gianluca Bontempi. 2019 . Combining unsupervised and supervised learning in credit card fraud detection. Information sciences (2019). Fabrizio Carcillo, Yann-A\u00ebl Le Borgne, Olivier Caelen, Yacine Kessaci, Fr\u00e9d\u00e9ric Obl\u00e9, and Gianluca Bontempi. 2019. Combining unsupervised and supervised learning in credit card fraud detection. Information sciences (2019)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2807524"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_2_1_16_1","volume-title":"Xgboost: extreme gradient boosting. R package version 0.4-2","author":"Chen Tianqi","year":"2015","unstructured":"Tianqi Chen , Tong He , Michael Benesty , Vadim Khotilovich , and Yuan Tang . 2015. Xgboost: extreme gradient boosting. R package version 0.4-2 ( 2015 ), 1--4. Tianqi Chen, Tong He, Michael Benesty, Vadim Khotilovich, and Yuan Tang. 2015. Xgboost: extreme gradient boosting. R package version 0.4-2 (2015), 1--4."},{"key":"e_1_2_1_17_1","volume-title":"Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public opinion quarterly 57, 1","author":"Church Allan H","year":"1993","unstructured":"Allan H Church . 1993. Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public opinion quarterly 57, 1 ( 1993 ), 62--79. Allan H Church. 1993. Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public opinion quarterly 57, 1 (1993), 62--79."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18072203"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2181037.2181040"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1979742.1979575"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.3182\/20130902-3-CN-3020.00044"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.indmarman.2013.05.006"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1961.10482090"},{"key":"e_1_2_1_24_1","volume-title":"An introduction to ROC analysis. Pattern recognition letters 27, 8","author":"Fawcett Tom","year":"2006","unstructured":"Tom Fawcett . 2006. An introduction to ROC analysis. Pattern recognition letters 27, 8 ( 2006 ), 861--874. Tom Fawcett. 2006. An introduction to ROC analysis. Pattern recognition letters 27, 8 (2006), 861--874."},{"key":"e_1_2_1_25_1","volume-title":"UbiComp 11: Proceedings of the 2011 ACM Conference on Ubiquitous Computing. ACM Press, 1--5.","author":"Fitz-Walter Zachary","year":"2011","unstructured":"Zachary Fitz-Walter and Dian W Tjondronegoro . 2011 . Exploring the opportunities and challenges of using mobile sensing for gamification and achievements . In UbiComp 11: Proceedings of the 2011 ACM Conference on Ubiquitous Computing. ACM Press, 1--5. Zachary Fitz-Walter and Dian W Tjondronegoro. 2011. Exploring the opportunities and challenges of using mobile sensing for gamification and achievements. In UbiComp 11: Proceedings of the 2011 ACM Conference on Ubiquitous Computing. ACM Press, 1--5."},{"key":"e_1_2_1_26_1","volume-title":"Ram\u00f3n Herv\u00e1s, and Jos\u00e9 Bravo.","author":"Fontecha Jes\u00fas","year":"2013","unstructured":"Jes\u00fas Fontecha , Fco Javier Navarro , Ram\u00f3n Herv\u00e1s, and Jos\u00e9 Bravo. 2013 . Elderly frailty detection by using accelerometer-enabled smartphones and clinical information records. Personal and ubiquitous computing 17, 6 (2013), 1073--1083. Jes\u00fas Fontecha, Fco Javier Navarro, Ram\u00f3n Herv\u00e1s, and Jos\u00e9 Bravo. 2013. Elderly frailty detection by using accelerometer-enabled smartphones and clinical information records. Personal and ubiquitous computing 17, 6 (2013), 1073--1083."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2014.377"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174023"},{"key":"e_1_2_1_29_1","unstructured":"Kim Hartman. 2011. How do intrinsic and extrinsic motivation correlate with each other in open source software development?  Kim Hartman. 2011. How do intrinsic and extrinsic motivation correlate with each other in open source software development?"},{"volume-title":"Proceedings of the 2009 IEEE international conference on Robotics and Automation. IEEE Press, 1567--1572","year":"2009","key":"e_1_2_1_30_1","unstructured":"Yu-chen Ho, Ching-hu Lu, I-han Chen, Shih-shinh Huang, Ching-yao Wang, Li-chen Fu, 2009 . Active-learning assisted self-reconfigurable activity recognition in a dynamic environment . In Proceedings of the 2009 IEEE international conference on Robotics and Automation. IEEE Press, 1567--1572 . Yu-chen Ho, Ching-hu Lu, I-han Chen, Shih-shinh Huang, Ching-yao Wang, Li-chen Fu, et al. 2009. Active-learning assisted self-reconfigurable activity recognition in a dynamic environment. In Proceedings of the 2009 IEEE international conference on Robotics and Automation. IEEE Press, 1567--1572."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2016.08.017"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351244"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994374.2994400"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287047"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357159"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.21437\/Eurospeech.2001-354"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1952.10483441"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1964897.1964918"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030160"},{"key":"e_1_2_1_40_1","volume-title":"Seventh International AAAI Conference on Weblogs and Social Media.","author":"Lee Tak Yeon","year":"2013","unstructured":"Tak Yeon Lee , Casey Dugan , Werner Geyer , Tristan Ratchford , Jamie Rasmussen , N Sadat Shami , and Stela Lupushor . 2013 . Experiments on motivational feedback for crowdsourced workers . In Seventh International AAAI Conference on Weblogs and Social Media. Tak Yeon Lee, Casey Dugan, Werner Geyer, Tristan Ratchford, Jamie Rasmussen, N Sadat Shami, and Stela Lupushor. 2013. Experiments on motivational feedback for crowdsourced workers. In Seventh International AAAI Conference on Weblogs and Social Media."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2099-5_1"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.09.005"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.4108\/ICST.PERVASIVEHEALTH2010.8851"},{"key":"e_1_2_1_44_1","volume-title":"Gamification for High-Quality Dataset in Mobile Activity Recognition. In International Conference on Mobile Computing, Applications, and Services. Springer, 216--222","author":"Mairittha Nattaya","year":"2018","unstructured":"Nattaya Mairittha and Sozo Inoue . 2018 . Gamification for High-Quality Dataset in Mobile Activity Recognition. In International Conference on Mobile Computing, Applications, and Services. Springer, 216--222 . Nattaya Mairittha and Sozo Inoue. 2018. Gamification for High-Quality Dataset in Mobile Activity Recognition. In International Conference on Mobile Computing, Applications, and Services. Springer, 216--222."},{"volume-title":"Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR)","author":"Mairittha Nattaya","key":"e_1_2_1_45_1","unstructured":"Nattaya Mairittha and Sozo Inoue . 2019. Crowdsourcing System Management for Activity Data with Mobile Sensors. In 2019 Joint 8th International Conference on Informatics , Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR) . IEEE , 85--90. Nattaya Mairittha and Sozo Inoue. 2019. Crowdsourcing System Management for Activity Data with Mobile Sensors. In 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR). IEEE, 85--90."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3267633"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.3390\/s19153434"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341162.3345585"},{"volume-title":"Reality is broken: Why games make us better and how they can change the world","author":"McGonigal Jane","key":"e_1_2_1_49_1","unstructured":"Jane McGonigal . 2011. Reality is broken: Why games make us better and how they can change the world . Penguin . Jane McGonigal. 2011. Reality is broken: Why games make us better and how they can change the world. Penguin."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030170"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.01.004"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173795"},{"key":"e_1_2_1_53_1","volume-title":"Running experiments on amazon mechanical turk. Judgment and Decision making 5, 5","author":"Paolacci Gabriele","year":"2010","unstructured":"Gabriele Paolacci , Jesse Chandler , and Panagiotis G Ipeirotis . 2010. Running experiments on amazon mechanical turk. Judgment and Decision making 5, 5 ( 2010 ), 411--419. Gabriele Paolacci, Jesse Chandler, and Panagiotis G Ipeirotis. 2010. Running experiments on amazon mechanical turk. Judgment and Decision making 5, 5 (2010), 411--419."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2628363.2628364"},{"key":"e_1_2_1_55_1","unstructured":"Sihang Qiu Ujwal Gadiraju and Alessandro Bozzon. [n.d.]. Improving Worker Engagement Through Conversational Microtask Crowdsourcing. ([n. d.]).  Sihang Qiu Ujwal Gadiraju and Alessandro Bozzon. [n.d.]. Improving Worker Engagement Through Conversational Microtask Crowdsourcing. ([n. d.])."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1689239.1689243"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2413097.2413148"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13278-013-0114-z"},{"volume-title":"Active Learning","author":"Settles Burr","key":"e_1_2_1_59_1","unstructured":"Burr Settles . 2012. Active Learning . Vol. 18 . Morgan & Claypool Publishers . Burr Settles. 2012. Active Learning. Vol. 18. Morgan & Claypool Publishers."},{"key":"e_1_2_1_60_1","volume-title":"A mathematical theory of communication. Bell system technical journal 27, 3","author":"Shannon Claude E","year":"1948","unstructured":"Claude E Shannon . 1948. A mathematical theory of communication. Bell system technical journal 27, 3 ( 1948 ), 379--423. Claude E Shannon. 1948. A mathematical theory of communication. Bell system technical journal 27, 3 (1948), 379--423."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.2307\/2333709"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46448-0_31"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2008.4911590"},{"key":"e_1_2_1_64_1","unstructured":"Nadeem Ahmed Syed Syed Huan Liu Kah and Kay Sung. 1999. Incremental learning with support vector machines. (1999).  Nadeem Ahmed Syed Syed Huan Liu Kah and Kay Sung. 1999. Incremental learning with support vector machines. (1999)."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18072365"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130972"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2008.4911586"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJCNDS.2013.054832"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-015-1395-y"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2444776.2444789"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287075"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2014.08.004"},{"volume-title":"A survey of crowdsourcing systems. In 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing","author":"Yuen Man-Ching","key":"e_1_2_1_73_1","unstructured":"Man-Ching Yuen , Irwin King , and Kwong-Sak Leung . 2011. A survey of crowdsourcing systems. In 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing . IEEE , 766--773. Man-Ching Yuen, Irwin King, and Kwong-Sak Leung. 2011. A survey of crowdsourcing systems. In 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing. IEEE, 766--773."},{"key":"e_1_2_1_74_1","volume-title":"Workshops at the Twenty-Fifth AAAI Conference on Artificial Intelligence.","author":"Zhao Liyue","year":"2011","unstructured":"Liyue Zhao , Gita Sukthankar , and Rahul Sukthankar . 2011 . Robust active learning using crowdsourced annotations for activity recognition . In Workshops at the Twenty-Fifth AAAI Conference on Artificial Intelligence. Liyue Zhao, Gita Sukthankar, and Rahul Sukthankar. 2011. Robust active learning using crowdsourced annotations for activity recognition. In Workshops at the Twenty-Fifth AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098052"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292522.3326010"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3432222","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3432222","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:09Z","timestamp":1750193229000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3432222"}},"subtitle":["Achieving High-Quality Crowdsourced Datasets in Mobile Activity Recognition"],"short-title":[],"issued":{"date-parts":[[2021,3,19]]},"references-count":76,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,3,19]]}},"alternative-id":["10.1145\/3432222"],"URL":"https:\/\/doi.org\/10.1145\/3432222","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2021,3,19]]},"assertion":[{"value":"2021-03-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}