{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T10:03:13Z","timestamp":1777716193837,"version":"3.51.4"},"reference-count":69,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T00:00:00Z","timestamp":1731369600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001459","name":"Ministry of Education - Singapore","doi-asserted-by":"publisher","award":["MOE Grant MOE-000488-01"],"award-info":[{"award-number":["MOE Grant MOE-000488-01"]}],"id":[{"id":"10.13039\/501100001459","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:p>Dual-arm manipulation of daily living objects is essential for robots operating in household environments. Learning from demonstration is a promising approach for teaching robots dual-arm manipulation skills. It usually requires a dataset of participants demonstrating the sequence of manipulation actions to achieve a goal. That sequence can be represented using symbolical or trajectory encoding. The symbolic-encoded sequence is known as the task plan. The chief limitations of current datasets are that most tend to disregard dual-arm manipulation skills and omit the formal grammar used to annotate the task plans. This paper introduces BiCap, a novel bi-modal dataset of dual-arm manipulation actions on daily living objects coupled with a bio-inspired action context-free grammar for fine-grained task plan annotation to train, test, and validate learning from demonstration-based algorithms for robotic dual-arm manipulation. 15 participants were recruited. The experimenter placed reflective markers on their upper limbs and pelvis. Then, the participants sat at a table where one or two objects were placed. They performed one of the following tasks: pouring, opening, and passing, using both hands. An RGB camera pointing towards the table recorded the participants\u2019 hand movements. Subsequently, an annotator reviewed the RGB videos and wrote the participants\u2019 task plans using the bio-inspired action context-free grammar. The participants\u2019 upper-limb kinematics were computed, too, which provides the trajectory-encoded action sequences. The resulting dataset, BiCap, contains 4,026 task plans, videos, and motion data of the 15 participants.<\/jats:p>","DOI":"10.1177\/02783649241290836","type":"journal-article","created":{"date-parts":[[2024,11,12]],"date-time":"2024-11-12T09:13:50Z","timestamp":1731402830000},"page":"891-907","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["BiCap: A novel bi-modal dataset of daily living dual-arm manipulation actions"],"prefix":"10.1177","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5533-9146","authenticated-orcid":false,"given":"David","family":"Carmona","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, National University of Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9876-4863","authenticated-orcid":false,"given":"Haoyong","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, National University of Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2024,11,12]]},"reference":[{"key":"e_1_3_4_2_1","volume-title":"Compilers: Principles, Techniques, & Tools","author":"Aho AV","year":"2007","unstructured":"Aho AV, Aho AV (eds) (2007) Compilers: Principles, Techniques, & Tools. 2nd edition edn. Boston: Pearson\/Addison Wesley. OCLC: ocm70775643.","edition":"2"},{"key":"e_1_3_4_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.humov.2021.102818"},{"key":"e_1_3_4_4_1","volume-title":"Proceedings of the Thirteenth Language Resources and Evaluation Conference\u2019, European Language Resources Association","author":"Baledent A","year":"2022","unstructured":"Baledent A, Mathet Y, Widl\u00f6cher A, et al. (2022) Validity, agreement, consensuality and annotated data quality. In: Calzolari N, B\u00e9chet F, Blache P, et al. (eds) Proceedings of the Thirteenth Language Resources and Evaluation Conference\u2019, European Language Resources Association. Marseille, France: ACL Anthology. https:\/\/aclanthology.org\/2022.lrec-1.315."},{"issue":"155","key":"e_1_3_4_5_1","first-page":"3","article-title":"Recalling past events: from infancy to early childhood","volume":"11","author":"Bauer PJ","year":"1995","unstructured":"Bauer PJ (1995) Recalling past events: from infancy to early childhood. Annals of Child Development 11(155): 3.","journal-title":"Annals of Child Development"},{"key":"e_1_3_4_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2015.03.005"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.aat8414"},{"key":"e_1_3_4_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/1753193412460149"},{"key":"e_1_3_4_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364914555720"},{"key":"e_1_3_4_10_1","doi-asserted-by":"crossref","unstructured":"Calli B Singh A Walsman A et al. (2015) The YCB object and Model set: towards common benchmarks for manipulation research. 2015 international conference on advanced robotics (ICAR) Istanbul Turkey 27\u201331 July 2015.","DOI":"10.1109\/ICAR.2015.7251504"},{"key":"e_1_3_4_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2015.2448951"},{"key":"e_1_3_4_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364917700714"},{"key":"e_1_3_4_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2010.2053034"},{"key":"e_1_3_4_14_1","article-title":"A novel learning-based task planner for dual-arm manipulation using a bio-inspired action context-free grammar","author":"Carmona D","year":"2023","unstructured":"Carmona D, Yu H (2023) A novel learning-based task planner for dual-arm manipulation using a bio-inspired action context-free grammar. International Journal of Robotics Research. Available at: https:\/\/www.researchgate.net\/publication\/385090602_A_Novel_Efficient_Learning-based_Task_Planner_using_a_Bio-inspired_Action_Context_free_Grammar_for_Dual-Arm_Manipulation, In preparation.","journal-title":"International Journal of Robotics Research"},{"key":"e_1_3_4_15_1","volume-title":"Syntax: A Generative Introduction","author":"Carnie A","year":"2021","unstructured":"Carnie A (2021) Syntax: A Generative Introduction. London: John Wiley & Sons."},{"key":"e_1_3_4_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.physio.2013.03.001"},{"key":"e_1_3_4_17_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0706273104"},{"key":"e_1_3_4_18_1","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aau9757"},{"key":"e_1_3_4_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-018-5381-5"},{"key":"e_1_3_4_20_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5778"},{"key":"e_1_3_4_21_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-49360-2"},{"key":"e_1_3_4_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-023-10133-5"},{"key":"e_1_3_4_23_1","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aay4663"},{"key":"e_1_3_4_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8760(99)00051-3"},{"key":"e_1_3_4_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-6632.2009.04582.x"},{"key":"e_1_3_4_26_1","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/awp118"},{"key":"e_1_3_4_27_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1106138"},{"key":"e_1_3_4_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2014.7041469"},{"key":"e_1_3_4_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0268-0033(99)00016-9"},{"key":"e_1_3_4_30_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-021-01107-2"},{"key":"e_1_3_4_31_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-091420-084139"},{"key":"e_1_3_4_32_1","doi-asserted-by":"crossref","unstructured":"G\u00f6rner M Haschke R Ritter H et al. (2019) MoveIt! Task constructor for task-level motion planning. 2019 international conference on robotics and automation (ICRA) Montreal Quebec Canada 20\u201324 May 2019.","DOI":"10.1109\/ICRA.2019.8793898"},{"key":"e_1_3_4_33_1","volume-title":"Monographs in Computer Science","author":"Grune D","year":"2008","unstructured":"Grune D, Jacobs CJH (2008) Parsing techniques: a practical guide. In: Monographs in Computer Science. 2nd edition edn. New York: Springer. OCLC: ocn191726482.","edition":"2"},{"key":"e_1_3_4_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-013-9366-8"},{"key":"e_1_3_4_35_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919849091"},{"key":"e_1_3_4_36_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2008.2274"},{"key":"e_1_3_4_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11370-022-00437-3"},{"key":"e_1_3_4_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-demo.41"},{"key":"e_1_3_4_39_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20113312"},{"key":"e_1_3_4_40_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2023.1147296"},{"key":"e_1_3_4_41_1","doi-asserted-by":"crossref","unstructured":"Krebs F Meixner A Patzer I et al. (2021) The KIT bimanual manipulation dataset in \u20182020 IEEE-RAS 20th international conference on humanoid robots (Humanoids)\u2019 Munich Germany 20 July 2021.","DOI":"10.1109\/HUMANOIDS47582.2021.9555788"},{"key":"e_1_3_4_42_1","first-page":"780","volume-title":"The Language of Actions: Recovering the Syntax and Semantics of Goal-Directed Human Activities","author":"Kuehne H","year":"2014","unstructured":"Kuehne H, Arslan A, Serre T (2014) The Language of Actions: Recovering the Syntax and Semantics of Goal-Directed Human Activities. Piscataway: IEEE, 780\u2013787."},{"key":"e_1_3_4_43_1","volume-title":"The problem of serial order in behavior","author":"Lashley KS","year":"1951","unstructured":"Lashley KS (1951) The problem of serial order in behavior. Oxford: Bobbs-Merrill Oxford, Vol. 21."},{"key":"e_1_3_4_44_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001756-199610020-00010"},{"key":"e_1_3_4_45_1","first-page":"325","article-title":"The working brain. Allen lane","volume":"106","author":"Luria A","year":"1973","unstructured":"Luria A, Haigh B (1973) The working brain. Allen lane. The Penquin Press. Middlesex. England. hemorrhage. Radiology 106: 325.","journal-title":"The Penquin Press. Middlesex. England. hemorrhage. Radiology"},{"key":"e_1_3_4_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2572685"},{"key":"e_1_3_4_47_1","first-page":"3659","volume-title":"Proceedings of the 29th International Conference on Computational Linguistics\u2019, International Committee on Computational Linguistics, Gyeongju, Republic of Korea","author":"Marchal M","year":"2022","unstructured":"Marchal M, Scholman M, Yung F, et al. (2022) Establishing annotation quality in multi-label annotations. In: Calzolari N, Huang C-R, Kim H, et al. (eds) Proceedings of the 29th International Conference on Computational Linguistics\u2019, International Committee on Computational Linguistics, Gyeongju, Republic of Korea. Piscataway: IEEE, 3659\u20133668. https:\/\/aclanthology.org\/2022.coling-1.322."},{"key":"e_1_3_4_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919844314"},{"key":"e_1_3_4_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-018-9799-1"},{"key":"e_1_3_4_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919882089"},{"key":"e_1_3_4_51_1","doi-asserted-by":"crossref","unstructured":"Meixner A Krebs F Jaquier N et al. (2023) An evaluation of action segmentation algorithms on bimanual manipulation datasets in \u20182023 IEEE\/RSJ international conference on intelligent robots and systems (IROS)\u2019 Detroit MI USA 1 October 2023. https:\/\/ieeexplore.ieee.org\/document\/10341956\/.","DOI":"10.1109\/IROS55552.2023.10341956"},{"key":"e_1_3_4_52_1","doi-asserted-by":"publisher","DOI":"10.3390\/s22052011"},{"key":"e_1_3_4_53_1","doi-asserted-by":"publisher","DOI":"10.1177\/02783649211050677"},{"key":"e_1_3_4_54_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-020-00776-9"},{"key":"e_1_3_4_55_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2011.0123"},{"key":"e_1_3_4_56_1","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aaw0955"},{"key":"e_1_3_4_57_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-100819-063206"},{"key":"e_1_3_4_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980235"},{"key":"e_1_3_4_59_1","article-title":"Spatiotemporal gait patterns during overt and covert evaluation in patients with Parkinson\u2019s disease and healthy subjects: is there a hawthorne effect?","volume":"31","author":"Robles-Garc\u00eda V","year":"2014","unstructured":"Robles-Garc\u00eda V, Corral-Berganti\u00f1os Y, Espinosa N, et al. (2014) Spatiotemporal gait patterns during overt and covert evaluation in patients with Parkinson\u2019s disease and healthy subjects: is there a hawthorne effect? Journal of Applied Biomechanics 31.","journal-title":"Journal of Applied Biomechanics"},{"key":"e_1_3_4_60_1","doi-asserted-by":"publisher","DOI":"10.1117\/1.JEI.23.3.033016"},{"key":"e_1_3_4_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30301-5"},{"key":"e_1_3_4_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2012.07.005"},{"key":"e_1_3_4_63_1","volume-title":"\u2018ZED2 Reference Guide\u2019","author":"Stereolabs Z","year":"2019","unstructured":"Stereolabs Z (2019) \u2018ZED2 Reference Guide\u2019. Paris, France: Stereolabs. Available at: https:\/\/www.stereolabs.com\/docs."},{"key":"e_1_3_4_64_1","doi-asserted-by":"publisher","DOI":"10.2307\/3319279"},{"key":"e_1_3_4_65_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1011462"},{"key":"e_1_3_4_66_1","volume-title":"Plug-in Gait Reference Guide","author":"Vicon M","year":"2017","unstructured":"Vicon M (2017) Plug-in Gait Reference Guide. Hauppauge: Vicon."},{"key":"e_1_3_4_67_1","volume-title":"Vicon Nexus 2. Reference Guide\u2019","author":"Vicon M","year":"2020","unstructured":"Vicon M (2020) Vicon Nexus 2. Reference Guide\u2019. Hauppauge: Vicon, Vol. 11."},{"key":"e_1_3_4_68_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.12995"},{"key":"e_1_3_4_69_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-7687.2006.00535.x"},{"key":"e_1_3_4_70_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-60923-5"}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649241290836","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02783649241290836","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649241290836","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T10:17:37Z","timestamp":1777457857000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649241290836"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,12]]},"references-count":69,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,5]]}},"alternative-id":["10.1177\/02783649241290836"],"URL":"https:\/\/doi.org\/10.1177\/02783649241290836","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"value":"0278-3649","type":"print"},{"value":"1741-3176","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,12]]}}}