{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T20:54:16Z","timestamp":1781211256162,"version":"3.54.1"},"reference-count":36,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T00:00:00Z","timestamp":1718323200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Bioeng. Biotechnol."],"abstract":"<jats:p>The simulation-to-reality (sim2real) problem is a common issue when deploying simulation-trained models to real-world scenarios, especially given the extremely high imbalance between simulation and real-world data (scarce real-world data). Although the cycle-consistent generative adversarial network (CycleGAN) has demonstrated promise in addressing some sim2real issues, it encounters limitations in situations of data imbalance due to the lower capacity of the discriminator and the indeterminacy of learned sim2real mapping. To overcome such problems, we proposed the imbalanced Sim2Real scheme (ImbalSim2Real). Differing from CycleGAN, the ImbalSim2Real scheme segments the dataset into paired and unpaired data for two-fold training. The unpaired data incorporated discriminator-enhanced samples to further squash the solution space of the discriminator, for enhancing the discriminator\u2019s ability. For paired data, a term targeted regression loss was integrated to ensure specific and quantitative mapping and further minimize the solution space of the generator. The ImbalSim2Real scheme was validated through numerical experiments, demonstrating its superiority over conventional sim2real methods. In addition, as an application of the proposed ImbalSim2Real scheme, we designed a finger joint stiffness self-sensing framework, where the validation loss for estimating real-world finger joint stiffness was reduced by roughly 41% compared to the supervised learning method that was trained with scarce real-world data and by 56% relative to the CycleGAN trained with the imbalanced dataset. Our proposed scheme and framework have potential applicability to bio-signal estimation when facing an imbalanced sim2real problem.<\/jats:p>","DOI":"10.3389\/fbioe.2024.1334643","type":"journal-article","created":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T11:12:41Z","timestamp":1718363561000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Addressing data imbalance in Sim2Real: ImbalSim2Real scheme and its application in finger joint stiffness self-sensing for soft robot-assisted rehabilitation"],"prefix":"10.3389","volume":"12","author":[{"given":"Zhongchao","family":"Zhou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxi","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pablo Enrique","family":"Tort\u00f3s","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruian","family":"Qin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shota","family":"Kokubu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fuko","family":"Matsunaga","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiaolian","family":"Xie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenwei","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,6,14]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"25632","DOI":"10.1109\/ACCESS.2021.3056150","article-title":"Material decomposition in spectral ct using deep learning: a Sim2Real transfer approach","volume":"9","author":"Abascal","year":"2021","journal-title":"IEEE Access"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/robotics8010004","article-title":"Deep reinforcement learning for soft, flexible robots: brief review with impending challenges","volume":"8","author":"Bhagat","year":"2019","journal-title":"Robotics"},{"key":"B3","doi-asserted-by":"publisher","first-page":"6187","DOI":"10.1109\/LRA.2022.3167064","article-title":"Bidirectional sim-to-real transfer for GelSight tactile sensors with CycleGAN","volume":"7","author":"Chen","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"B4","volume-title":"Human engineering design data digest","year":"2000"},{"key":"B5","doi-asserted-by":"publisher","first-page":"108890","DOI":"10.1016\/j.ress.2022.108890","article-title":"Deep imbalanced domain adaptation for transfer learning fault diagnosis of bearings under multiple working conditions","volume":"230","author":"Ding","year":"2023","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"B6","doi-asserted-by":"publisher","first-page":"1639","DOI":"10.1109\/ICRA40945.2020.9197512","article-title":"Sim-to-Real transfer for optical tactile sensing","author":"Ding","year":"2020","journal-title":"Proc. - IEEE Int. Conf. Robot. Autom."},{"key":"B7","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1007\/978-3-030-71704-9_65","article-title":"A brief review of domain adaptation","volume-title":"Advances in data science and information engineering","author":"Farahani","year":"2021"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2206.07275","article-title":"CARD: classification and regression diffusion models","volume":"35","author":"Han","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"B9","doi-asserted-by":"publisher","first-page":"3998","DOI":"10.1002\/mp.13656","article-title":"Paired cycle-GAN-based image correction for quantitative cone-beam computed tomography","volume":"46","author":"Harms","year":"2019","journal-title":"Med. Phys."},{"key":"B10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fbioe.2020.00111","article-title":"Soft rehabilitation actuator with integrated post-stroke finger spasticity evaluation","volume":"8","author":"Heung","year":"2020","journal-title":"Front. Bioeng. Biotechnol."},{"key":"B11","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1109\/TASE.2021.3064065","article-title":"Sim2Real in Robotics and automation: applications and challenges","volume":"18","author":"Hofer","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"B12","doi-asserted-by":"publisher","first-page":"8305","DOI":"10.1109\/ICRA46639.2022.9811801","article-title":"Reducing tactile Sim2Real domain gaps via deep texture generation networks","author":"Jianu","year":"2022","journal-title":"Proc. - IEEE Int. Conf. Robot. Autom."},{"key":"B13","doi-asserted-by":"publisher","first-page":"10193","DOI":"10.1109\/IROS47612.2022.9981951","article-title":"Analysis of randomization effects on Sim2Real transfer in reinforcement learning for robotic manipulation tasks","author":"Josifovski","year":"2022","journal-title":"IEEE Int. Conf. Intell. Robot. Syst."},{"key":"B14","doi-asserted-by":"publisher","first-page":"4873","DOI":"10.1109\/EMBC44109.2020.9176061","article-title":"Developing a hybrid soft mechanism for assisting individualized flexion and extension of finger joints","volume":"2020","author":"Kokubu","year":"2020","journal-title":"Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. EMBS"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TIM.2021.3136175","article-title":"Class-imbalance adversarial transfer learning network for cross-domain fault diagnosis with imbalanced data","volume":"71","author":"Kuang","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"B16","first-page":"370","article-title":"Bio-inspired design of artificial striated muscles composed of sarcomere-like contraction units","volume-title":"2021 20th int. Conf. Adv. Robot. ICAR 2021","author":"Labazanova","year":"2021"},{"key":"B17","doi-asserted-by":"publisher","first-page":"833","DOI":"10.3390\/s23020833","article-title":"Neural network-based active load-sensing scheme and stiffness adjustment for pneumatic soft actuators for minimally invasive surgery support","volume":"23","author":"Lu","year":"2023","journal-title":"Sensors"},{"key":"B18","first-page":"2794","article-title":"Least squares generative adversarial networks","volume-title":"Proceedings of the IEEE international conference on computer vision (ICCV)","author":"Mao","year":"2017"},{"key":"B19","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1089\/soro.2019.0115","article-title":"Toward a common framework and Database of materials for soft Robotics","volume":"8","author":"Marechal","year":"2021","journal-title":"Soft Robot."},{"key":"B20","doi-asserted-by":"publisher","first-page":"83","DOI":"10.3390\/robotics12030083","article-title":"Finger joint stiffness estimation with joint modular soft actuators for hand telerehabilitation","volume":"12","author":"Matsunaga","year":"2023","journal-title":"Robotics"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/frobt.2022.799893","article-title":"Robot learning from randomized simulations: a review","volume":"9","author":"Muratore","year":"2022","journal-title":"Front. Robot. AI"},{"key":"B22","doi-asserted-by":"publisher","first-page":"9842","DOI":"10.1109\/JSTARS.2022.3220875","article-title":"Domain adaptation in remote sensing image classification: a survey","volume":"15","author":"Peng","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"B23","doi-asserted-by":"publisher","first-page":"153171","DOI":"10.1109\/ACCESS.2021.3126658","article-title":"Crossing the reality gap: a survey on sim-to-real transferability of robot controllers in reinforcement learning","volume":"9","author":"Salvato","year":"2021","journal-title":"IEEE Access"},{"key":"B24","doi-asserted-by":"publisher","first-page":"8204","DOI":"10.1109\/CVPR42600.2020.00823","article-title":"A U-net based discriminator for generative adversarial networks","author":"Schonfeld","year":"2020","journal-title":"Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fbioe.2020.592637","article-title":"Verification of finger joint stiffness estimation method with soft robotic actuator","volume":"8","author":"Shi","year":"2020","journal-title":"Front. Bioeng. Biotechnol."},{"key":"B26","doi-asserted-by":"publisher","first-page":"31","DOI":"10.3390\/ACT7020031","article-title":"New layouts of fiber reinforcements to enable full finger motion assist with pneumatic multi-chamber elastomer actuators","volume":"7","author":"Tarvainen","year":"2018","journal-title":"Actuators"},{"key":"B27","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1109\/IROS.2017.8202133","article-title":"Domain randomization for transferring deep neural networks from simulation to the real world","author":"Tobin","year":"2017","journal-title":"IEEE Int. Conf. Intell. Robot. Syst."},{"key":"B28","doi-asserted-by":"publisher","first-page":"2634","DOI":"10.1109\/LRA.2021.3062303","article-title":"Bi-directional domain adaptation for Sim2Real transfer of embodied navigation agents","volume":"6","author":"Truong","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"B29","doi-asserted-by":"publisher","first-page":"8450","DOI":"10.1109\/LRA.2021.3105799","article-title":"Designing soft pneumatic actuators for thumb movements","volume":"6","author":"Wang","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"B30","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1007\/978-3-030-58565-5_30","article-title":"Self-supervised CycleGAN for object-preserving image-to-image domain adaptation","author":"Xie","year":"2020","journal-title":"Lect. Notes Comput. Sci. Incl. Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinforma. 12365 LNCS"},{"key":"B31","doi-asserted-by":"publisher","first-page":"9242","DOI":"10.1109\/CVPR.2018.00963","article-title":"Translating and segmenting multimodal medical volumes with cycle- and shape-consistency generative adversarial network","author":"Zhang","year":"2018","journal-title":"Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit."},{"key":"B32","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1109\/SSCI47803.2020.9308468","article-title":"Sim-to-Real transfer in deep reinforcement learning for Robotics: a survey","volume":"2020","author":"Zhao","year":"2020","journal-title":"2020 IEEE Symp. Ser. Comput. Intell. SSCI"},{"key":"B33","doi-asserted-by":"publisher","first-page":"104321","DOI":"10.1016\/j.robot.2022.104321","article-title":"Skill generalization of tubular object manipulation with tactile sensing and Sim2Real learning","volume":"160","author":"Zhao","year":"2023","journal-title":"Rob. Auton. Syst."},{"key":"B34","doi-asserted-by":"publisher","first-page":"5982","DOI":"10.1109\/lra.2022.3162021","article-title":"Optimization of spring constant of a pneumatic artificial muscle-spring driven antagonistic structure","volume":"7","author":"Zhou","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"B35","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1109\/iccv.2017.244","article-title":"Unpaired image-to-image translation using cycle-consistent adversarial networks","author":"Zhu","year":"2017","journal-title":"Proc. IEEE Int. Conf. Comput. Vis."},{"key":"B36","doi-asserted-by":"publisher","first-page":"1293","DOI":"10.1109\/TAI.2022.3196813","article-title":"Self-adaptive imbalanced domain adaptation with deep sparse autoencoder","volume":"4","author":"Zhu","year":"2022","journal-title":"IEEE Trans. Artif. Intell."}],"container-title":["Frontiers in Bioengineering and Biotechnology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2024.1334643\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T11:12:48Z","timestamp":1718363568000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fbioe.2024.1334643\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,14]]},"references-count":36,"alternative-id":["10.3389\/fbioe.2024.1334643"],"URL":"https:\/\/doi.org\/10.3389\/fbioe.2024.1334643","relation":{},"ISSN":["2296-4185"],"issn-type":[{"value":"2296-4185","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,14]]},"article-number":"1334643"}}