{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T03:41:39Z","timestamp":1767152499491,"version":"3.48.0"},"reference-count":36,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","funder":[{"DOI":"10.13039\/501100001659","name":"German Research Foundation","doi-asserted-by":"crossref","award":["HE2696\/29"],"award-info":[{"award-number":["HE2696\/29"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Semantic Computing"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:p>Human\u2013robot collaboration enables highly adaptive coworking. The variety of resulting workflows makes it difficult to measure metrics such as, e.g. makespans or idle times for multiple systems and tasks in a comparable manner. This issue can be addressed with virtual commissioning, where an arbitrary number of nondeterministic human\u2013robot workflows in assembly tasks can be simulated. To do this, data-driven models of human decisions are needed. Gathering the required large corpus of data with on-site user studies is quite time-consuming. In comparison, simulation-based studies would allow us to access a large pool of study participants with less effort. To rely on respective study results, human action sequences observed in a browser-based simulation environment must be shown to match those gathered in a laboratory setting. To this end, this work aims to understand whether cooperative assembly work in a simulated environment differs from that in an on-site laboratory setting. We show how a simulation environment can be aligned with a laboratory setting in which a robot and a human perform pick-and-place tasks together. A user study (N = 48) indicates that participants\u2019 assembly decisions and perception of the situation are consistent across different environments, including a scalable crowdsourcing setup.<\/jats:p>","DOI":"10.1142\/s1793351x25450059","type":"journal-article","created":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T06:23:42Z","timestamp":1759991022000},"page":"637-657","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating User Behavior Consistency: Comparing Studies in Virtual, Crowdsourced and Real-World Human\u2013Robot Cooperation Scenarios"],"prefix":"10.1142","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-4153-5493","authenticated-orcid":false,"given":"Jonathan","family":"H\u00fcmmer","sequence":"first","affiliation":[{"name":"Chair for Applied Computer Science III (Robotics and Embedded Systems), University of Bayreuth (UBT), Bayreuth, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7937-4755","authenticated-orcid":false,"given":"Dominik","family":"Riedelbauch","sequence":"additional","affiliation":[{"name":"Chair for Applied Computer Science III (Robotics and Embedded Systems), University of Bayreuth (UBT), Bayreuth, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0250-2728","authenticated-orcid":false,"given":"Dominik","family":"Henrich","sequence":"additional","affiliation":[{"name":"Chair for Applied Computer Science III (Robotics and Embedded Systems), University of Bayreuth (UBT), Bayreuth, Germany"}]}],"member":"219","published-online":{"date-parts":[[2025,11,8]]},"reference":[{"key":"S1793351X25450059BIB001","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-018-2400-4"},{"key":"S1793351X25450059BIB002","unstructured":"D. Riedelbauch, Dynamic task sharing for flexible human\u2013robot teaming under partial workspace observability, Doctoral thesis, University of Bayreuth (2020)."},{"volume-title":"ACM\/IEEE Human\u2013Robot Interaction Conf., 2019","year":"2020","author":"Bagchi S.","key":"S1793351X25450059BIB003"},{"key":"S1793351X25450059BIB004","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2014.6926329"},{"key":"S1793351X25450059BIB005","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3271602"},{"key":"S1793351X25450059BIB006","first-page":"27","volume-title":"2021 Fifth IEEE Int. Conf. Robotic Computing (IRC)","author":"Riedelbauch D.","year":"2021"},{"key":"S1793351X25450059BIB007","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-019-01237-x"},{"key":"S1793351X25450059BIB008","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.2.1.Breazeal"},{"key":"S1793351X25450059BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2011.6005284"},{"key":"S1793351X25450059BIB010","doi-asserted-by":"publisher","DOI":"10.1109\/IRC63610.2024.00034"},{"key":"S1793351X25450059BIB011","doi-asserted-by":"crossref","unstructured":"R. Hartman, A. Moss, S. Jaffe, C. Rosenzweig, L. Litman and J. Robinson, Introducing Connect by CloudResearch: Advancing online participant recruitment in the digital age (2023).","DOI":"10.31234\/osf.io\/ksgyr"},{"key":"S1793351X25450059BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN50785.2021.9515376"},{"key":"S1793351X25450059BIB013","first-page":"579","volume-title":"Companion of the 2020 ACM\/IEEE Int. Conf. Human\u2013Robot Interaction, HRI \u201920","author":"Law T.","year":"2020"},{"key":"S1793351X25450059BIB014","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0238133"},{"key":"S1793351X25450059BIB015","doi-asserted-by":"publisher","DOI":"10.1145\/3434073.3444672"},{"key":"S1793351X25450059BIB016","doi-asserted-by":"publisher","DOI":"10.1108\/S1877-636120220000028008"},{"key":"S1793351X25450059BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2022.101683"},{"key":"S1793351X25450059BIB018","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-021-00860-z"},{"key":"S1793351X25450059BIB019","first-page":"61","volume-title":"Proc. 6th Int. Conf. Human\u2013robot Interaction, HRI \u201911","author":"Eyssel F.","year":"2011"},{"key":"S1793351X25450059BIB020","doi-asserted-by":"publisher","DOI":"10.1145\/3434074.3447183"},{"key":"S1793351X25450059BIB021","doi-asserted-by":"publisher","DOI":"10.1177\/1071181321651110"},{"key":"S1793351X25450059BIB022","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-020-00624-1"},{"key":"S1793351X25450059BIB023","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11900-7_2"},{"key":"S1793351X25450059BIB024","unstructured":"M. Wollowski, C. Berry, R. Winck, A. Jern, D. Voltmer, A. Chiu and Y. Shibberu, A data-driven approach towards human\u2013robot collaborative problem solving in a shared space (2017), arXiv preprint arXiv:1710.00274."},{"key":"S1793351X25450059BIB025","doi-asserted-by":"publisher","DOI":"10.1145\/3434074.3447141"},{"key":"S1793351X25450059BIB026","doi-asserted-by":"publisher","DOI":"10.1007\/s10683-011-9273-9"},{"key":"S1793351X25450059BIB027","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.1488"},{"key":"S1793351X25450059BIB028","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.2.1.Trafton"},{"key":"S1793351X25450059BIB029","first-page":"806","volume-title":"2022 31st IEEE Int. Conf. Robot and Human Interactive Communication (RO-MAN)","author":"Riedelbauch D.","year":"2022"},{"key":"S1793351X25450059BIB030","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-015-0333-8"},{"key":"S1793351X25450059BIB031","series-title":"Soviet Union","first-page":"707","volume-title":"Soviet Physics Doklady","volume":"10","author":"Levenshtein V. I.","year":"1966"},{"key":"S1793351X25450059BIB032","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"S1793351X25450059BIB033","doi-asserted-by":"publisher","DOI":"10.1016\/j.jom.2017.06.001"},{"key":"S1793351X25450059BIB034","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.K.00568"},{"key":"S1793351X25450059BIB035","first-page":"644","volume-title":"2022 17th ACM\/IEEE Int. Conf. Human\u2013Robot Interaction (HRI)","author":"Zimmerman M.","year":"2022"},{"key":"S1793351X25450059BIB036","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21741-8_34"}],"container-title":["International Journal of Semantic Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793351X25450059","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T03:36:49Z","timestamp":1767152209000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S1793351X25450059"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,8]]},"references-count":36,"journal-issue":{"issue":"04","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["10.1142\/S1793351X25450059"],"URL":"https:\/\/doi.org\/10.1142\/s1793351x25450059","relation":{},"ISSN":["1793-351X","1793-7108"],"issn-type":[{"type":"print","value":"1793-351X"},{"type":"electronic","value":"1793-7108"}],"subject":[],"published":{"date-parts":[[2025,11,8]]}}}