{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T00:32:51Z","timestamp":1767141171268,"version":"build-2238731810"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T00:00:00Z","timestamp":1666915200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T00:00:00Z","timestamp":1666915200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100011273","name":"FP7 Information and Communication Technologies","doi-asserted-by":"publisher","award":["600623"],"award-info":[{"award-number":["600623"]}],"id":[{"id":"10.13039\/100011273","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/R026084\/1"],"award-info":[{"award-number":["EP\/R026084\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Robot"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Consider a mobile robot exploring an office building with the aim of observing as much human activity as possible over several days. It must learn where and when people are to be found, count the observed activities, and revisit popular places at the right time. In this paper we present a series of Bayesian estimators for the levels of human activity that improve on simple counting. We then show how these estimators can be used to drive efficient exploration for human activities. The estimators arise from modelling the human activity counts as a partially observable Poisson process (POPP). This paper presents novel extensions to POPP for the following cases: (i) the robot\u2019s sensors are correlated, (ii) the robot\u2019s sensor model, itself built from data, is also unreliable, (iii) both are combined. It also combines the resulting Bayesian estimators with a simple, but effective solution to the exploration-exploitation trade-off faced by the robot in a real deployment. A series of 15 day robot deployments show how our approach boosts the number of human activities observed by 70% relative to a baseline and produces more accurate estimates of the level of human activity in each place and time.<\/jats:p>","DOI":"10.1007\/s10514-022-10070-9","type":"journal-article","created":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T15:08:03Z","timestamp":1666969683000},"page":"121-138","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Efficiently exploring for human robot interaction: partially observable Poisson processes"],"prefix":"10.1007","volume":"47","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4911-540X","authenticated-orcid":false,"given":"Ferdian","family":"Jovan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Milan","family":"Tomy","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nick","family":"Hawes","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeremy","family":"Wyatt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,10,28]]},"reference":[{"issue":"2","key":"10070_CR1","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1109\/TEVC.2005.843751","volume":"9","author":"E Alba","year":"2005","unstructured":"Alba, E., & Dorronsoro, B. (2005). The exploration\/exploitation tradeoff in dynamic cellular genetic algorithms. IEEE Transactions on Evolutionary Computation, 9(2), 126\u2013142.","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"10070_CR2","doi-asserted-by":"crossref","unstructured":"Audibert, J. Y., & Munos, R., & Szepesv\u00e1ri, C. (2009). Exploration-exploitation tradeoff using variance estimates in multi-armed bandits. Theoretical Computer Science, 410(19), 1876\u20131902.","DOI":"10.1016\/j.tcs.2009.01.016"},{"issue":"8","key":"10070_CR3","doi-asserted-by":"publisher","first-page":"946","DOI":"10.1002\/bimj.200290006","volume":"44","author":"TL Bratcher","year":"2002","unstructured":"Bratcher, T. L., & Stamey, J. D. (2002). Estimation of poisson rates with misclassified counts. Biometrical Journal, 44(8), 946\u2013956.","journal-title":"Biometrical Journal"},{"key":"10070_CR4","unstructured":"Coppola, C., Krajn\u00edk, T., Duckett, T., & Bellotto, N., et al. (2016). Learning temporal context for activity recognition. European conference on artificial intelligence (pp. 107-115)."},{"key":"10070_CR5","unstructured":"Dondrup, C., Bellotto, N., Jovan, F., & Hanheide, M., et al. (2015). Real-time multisensor people tracking for human-robot spatial interaction. Proceedings of the 2015 international conference on robotics and automation. ICRA\/IEEE. Duckworth, P., Gatsoulis, Y., Jovan, F., Hawes,"},{"key":"10070_CR6","unstructured":"Hogg, N., & Cohn, D. A. (2016). Unsupervised learning of qualitative motion behaviours by a mobile robotunsupervised learning of qualitative motion behaviours by a mobile robot. (p. 1043-1051). Association for Computing Machinery."},{"issue":"1","key":"10070_CR7","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1177\/1471082X15588398","volume":"16","author":"M Dvorzak","year":"2016","unstructured":"Dvorzak, M., & Wagner, H. (2016). Sparse bayesian modelling of underreported count data. Statistical Modelling, 16 (1), 24\u201346.","journal-title":"Statistical Modelling"},{"key":"10070_CR8","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.artint.2015.08.008","volume":"247","author":"M Hanheide","year":"2017","unstructured":"Hanheide, M., G\u00f6belbecker, M., Horn, G.S., Pronobis, A., Sj\u00f6\u00f6, K., Aydemir, A., others (2017). Robot task planning and explanation in open and uncertain worlds. Artificial Intelligence, 247, 119\u2013150.","journal-title":"Artificial Intelligence"},{"key":"10070_CR9","doi-asserted-by":"crossref","unstructured":"Hawes, N., Burbridge, C., Jovan, F., Kunze, L., Lacerda, B., & Mudrov\u00e1, L., Young, J., Wyatt, J., Hebesberger, D., Kortner, T., Ambrus, R. (2016). The strands project: Long-term autonomy in everyday environments. arXiv preprint arXiv:1604.04384 .","DOI":"10.1109\/MRA.2016.2636359"},{"key":"10070_CR10","unstructured":"Jovan, F., Wyatt, J., & Hawes, N. (2018, 09-11 Apr). Efficient bayesian methods for counting processes in partially observable environments. A. Storkey & F. Perez-Cruz (Eds.), Proceedings of the twenty-first international conference on artificial intelligence and statistics (Vol. 84, pp. 1906-1913). Playa Blanca, Lanzarote, Canary Islands: PMLR."},{"key":"10070_CR11","doi-asserted-by":"crossref","unstructured":"Jovan, F., Wyatt, J., Hawes, N., & Krajn\u00edk, T. (2016). A Poisson-Spectral Model for Modelling the Spatio-Temporal Patterns in Human Data Observed by a Robot. Daejeon, South Korea: Pro ieee conf on intelligent robots and systems.","DOI":"10.1109\/IROS.2016.7759591"},{"key":"10070_CR12","doi-asserted-by":"crossref","unstructured":"Kaplow, R., Atrash, A., & Pineau, J. (2010). Variable resolution decomposition for robotic navigation under a pomdp framework. 2010 ieee international conference on robotics and automation (pp. 369-376).","DOI":"10.1109\/ROBOT.2010.5509188"},{"issue":"2","key":"10070_CR13","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1007\/s10514-009-9130-2","volume":"27","author":"R Martinez-Cantin","year":"2009","unstructured":"Martinez-Cantin, R., De Freitas, N., Brochu, E., Castellanos, J., Doucet, A. (2009). A bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot. Autonomous Robots, 27 (2), 93\u2013103.","journal-title":"Autonomous Robots"},{"issue":"2","key":"10070_CR14","doi-asserted-by":"publisher","first-page":"1304","DOI":"10.1109\/TRO.2021.3101358","volume":"38","author":"S Molina","year":"2022","unstructured":"Molina, S., Cielniak, G., Duckett, T. (2022). Robotic exploration for learning human motion patterns. IEEE Transactions on Robotics, 38 (2), 1304\u20131318. DOI: 10.1109\/TRO.2021.3101358.","journal-title":"IEEE Transactions on Robotics"},{"key":"10070_CR15","unstructured":"Papoulis, A., & Pillai, S.U. (2002). Probability, random variables, and stochastic processes. Tata McGraw-Hill Education."},{"issue":"3\u20134","key":"10070_CR16","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1016\/S0921-8890(02)00381-0","volume":"42","author":"J Pineau","year":"2003","unstructured":"Pineau, J., Montemerlo, M., Pollack, M., Roy, N., Thrun, S. (2003). Towards robotic assistants in nursing homes: Challenges and results. Robotics and autonomous systems, 42 (3\u20134), 271\u2013281.","journal-title":"Robotics and autonomous systems"},{"issue":"2","key":"10070_CR17","doi-asserted-by":"publisher","first-page":"605","DOI":"10.2307\/2532315","volume":"48","author":"R Sposto","year":"1992","unstructured":"Sposto, R., Preston, D.L., Shimizu, Y., Mabuchi, K. (1992). The effect of diagnostic misclassification on non-cancer and cancer mortality dose response in a-bomb survivors. Biometrics, 48 (2), 605\u2013617.","journal-title":"Biometrics"},{"key":"10070_CR18","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1613\/jair.1.11524","volume":"65","author":"M Sridharan","year":"2019","unstructured":"Sridharan, M., Gelfond, M., Zhang, S., Wyatt, J. (2019). Reba: A refinement-based architecture for knowledge representation and reasoning in robotics. Journal of Artificial Intelligence Research, 65, 87\u2013180.","journal-title":"Journal of Artificial Intelligence Research"},{"issue":"2","key":"10070_CR19","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1111\/j.1467-842X.2005.00381.x","volume":"47","author":"JD Stamey","year":"2005","unstructured":"Stamey, J.D., & Young, D.M. (2005). Maximum likelihood estimation for a poisson rat parameter with misclassified counts. Australian & New Zealand Journal of Statistics, 47 (2), 163\u2013172.","journal-title":"Australian & New Zealand Journal of Statistics"},{"issue":"5","key":"10070_CR20","doi-asserted-by":"publisher","first-page":"572","DOI":"10.1002\/bimj.200410059","volume":"46","author":"JD Stamey","year":"2004","unstructured":"Stamey, J.D., Young, D.M., Bratcher, T.L. (2004). Bayesian predictive probability functions for count data that are subject to misclassification. Biometrical Journal, 46 (5), 572\u2013578.","journal-title":"Biometrical Journal"},{"key":"10070_CR21","unstructured":"Street, C., Lacerda, B., M\u00fchlig, M., & Hawes, N. (2020). Multi-robot planning under uncertainty with congestion-aware models. 19th international conference on autonomous agents and multiagent systems (aamas). Auckland, New Zealand."},{"issue":"331","key":"10070_CR22","doi-asserted-by":"publisher","first-page":"1350","DOI":"10.1080\/01621459.1970.10481170","volume":"65","author":"A Tenenbein","year":"1970","unstructured":"Tenenbein, A. (1970). A double sampling scheme for estimating from binomial data with misclassifications. Journal of the American Statistical Association, 65 (331), 1350\u20131361.","journal-title":"Journal of the American Statistical Association"},{"key":"10070_CR23","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1613\/jair.3516","volume":"44","author":"J Velez","year":"2012","unstructured":"Velez, J., Hemann, G., Huang, A.S., Posner, I., Roy, N. (2012). Modelling observation correlations for active exploration and robust object detection. Journal of Artificial Intelligence Research, 44, 423\u2013453.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"10070_CR24","doi-asserted-by":"crossref","unstructured":"Whittemore, A.S., & Gong, G. (1991). Poisson regression with misclassified counts: Application to cervical cancer mortality rates. Journal of the Royal Statistical Society. Series C (Applied Statistics), 40(1), 81-93.","DOI":"10.2307\/2347906"},{"key":"10070_CR25","unstructured":"Winkelmann, R., & Zimmermann, K. F. (1993). Poisson-logistic regression. M\u00fcnchen: Volkswirtschaftl. Fakult\u00e4t d. Ludwig-Maximilians-Univ."},{"key":"10070_CR26","unstructured":"Wyatt, J. (1998). Exploration and inference in learning from reinforcement"}],"updated-by":[{"DOI":"10.1007\/s10514-023-10152-2","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,11,11]],"date-time":"2023-11-11T00:00:00Z","timestamp":1699660800000}}],"container-title":["Autonomous Robots"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-022-10070-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10514-022-10070-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10514-022-10070-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,11]],"date-time":"2023-11-11T02:19:10Z","timestamp":1699669150000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10514-022-10070-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,28]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["10070"],"URL":"https:\/\/doi.org\/10.1007\/s10514-022-10070-9","relation":{},"ISSN":["0929-5593","1573-7527"],"issn-type":[{"value":"0929-5593","type":"print"},{"value":"1573-7527","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,28]]},"assertion":[{"value":"20 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 November 2023","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s10514-023-10152-2","URL":"https:\/\/doi.org\/10.1007\/s10514-023-10152-2","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The Author(s) delcare(s) that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}