{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T14:45:24Z","timestamp":1776091524816,"version":"3.50.1"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T00:00:00Z","timestamp":1631145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,9,9]]},"abstract":"<jats:p>Sports analytics in the wild (i.e., ubiquitously) is a thriving industry. Swing tracking is a key feature in sports analytics. Therefore, a centimeter-level tracking resolution solution is required. Recent research has explored deep neural networks for sensor fusion to produce consistent swing-tracking performance. This is achieved by combining the advantages of two sensor modalities (IMUs and depth sensors) for golf swing tracking. Here, the IMUs are not affected by occlusion and can support high sampling rates. Meanwhile, depth sensors produce significantly more accurate motion measurements than those produced by IMUs. Nevertheless, this method can be further improved in terms of accuracy and lacking information for different domains (e.g., subjects, sports, and devices). Unfortunately, designing a deep neural network with good performance is time consuming and labor intensive, which is challenging when a network model is deployed to be used in new settings. To this end, we propose a network based on Neural Architecture Search (NAS), called SwingNet, which is a regression-based automatic generated deep neural network via stochastic neural network search. The proposed network aims to learn the swing tracking feature for better prediction automatically. Furthermore, SwingNet features a domain discriminator by using unsupervised learning and adversarial learning to ensure that it can be adaptive to unobserved domains. We implemented SwingNet prototypes with a smart wristband (IMU) and smartphone (depth sensor), which are ubiquitously available. They enable accurate sports analytics (e.g., coaching, tracking, analysis and assessment) in the wild.<\/jats:p>\n          <jats:p>Our comprehensive experiment shows that SwingNet achieves less than 10 cm errors of swing tracking with a subject-independent model covering multiple sports (e.g., golf and tennis) and depth sensor hardware, which outperforms state-of-the-art approaches.<\/jats:p>","DOI":"10.1145\/3478082","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T22:48:23Z","timestamp":1631659703000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["SwingNet"],"prefix":"10.1145","volume":"5","author":[{"given":"Hong","family":"Jia","sequence":"first","affiliation":[{"name":"The University of New South Wales, School of Computer Science and Engineering, Sydney, New South Wales, Australia, Eveleigh, Sydney, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiawei","family":"Hu","sequence":"additional","affiliation":[{"name":"The University of New South Wales, School of Computer Science and Engineering, Sydney, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wen","family":"Hu","sequence":"additional","affiliation":[{"name":"The University of New South Wales, School of Computer Science and Engineering, Sydney, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"11th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 14). 317--329.","author":"Adib Fadel","unstructured":"Fadel Adib , Zach Kabelac , Dina Katabi , and Robert C Miller . 2014. 3D tracking via body radio reflections . In 11th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 14). 317--329. Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D tracking via body radio reflections. In 11th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 14). 317--329."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00542"},{"key":"e_1_2_1_3_1","volume-title":"2013 13th International Conference on Control, Automation and Systems (ICCAS","author":"Nam Cao Nguyen Khoa","year":"2013","unstructured":"Nguyen Khoa Nam Cao , Young Soo Suh , and Quoc Khanh Dang . 2013 . 3D dynamics analysis of a golf full swing by fusing inertial sensor and vision data . In 2013 13th International Conference on Control, Automation and Systems (ICCAS 2013). IEEE, 1300--1303. Nguyen Khoa Nam Cao, Young Soo Suh, and Quoc Khanh Dang. 2013. 3D dynamics analysis of a golf full swing by fusing inertial sensor and vision data. In 2013 13th International Conference on Control, Automation and Systems (ICCAS 2013). IEEE, 1300--1303."},{"key":"e_1_2_1_4_1","volume-title":"OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008","author":"Cao Zhe","year":"2018","unstructured":"Zhe Cao , Gines Hidalgo , Tomas Simon , Shih-En Wei , and Yaser Sheikh . 2018. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008 ( 2018 ). Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2018. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008 (2018)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12102"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-013-1359-2"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267242.3267267"},{"key":"e_1_2_1_8_1","first-page":"1","article-title":"Neural Architecture Search: A Survey","volume":"20","author":"Elsken Thomas","year":"2019","unstructured":"Thomas Elsken , Jan Hendrik Metzen , and Frank Hutter . 2019 . Neural Architecture Search: A Survey . Journal of Machine Learning Research 20 , 55 (2019), 1 -- 21 . http:\/\/jmlr.org\/papers\/v20\/18-598.html Thomas Elsken, Jan Hendrik Metzen, and Frank Hutter. 2019. Neural Architecture Search: A Survey. Journal of Machine Learning Research 20, 55 (2019), 1--21. http:\/\/jmlr.org\/papers\/v20\/18-598.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00332"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 27th International Conference on Neural Information Processing Systems -","volume":"2","author":"Goodfellow Ian J.","year":"2014","unstructured":"Ian J. Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative Adversarial Nets . In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2 (NIPS'14). MIT Press, Cambridge, MA, USA, 2672--2680. http:\/\/dl.acm.org\/citation.cfm?id=2969033.2969125 Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2 (NIPS'14). MIT Press, Cambridge, MA, USA, 2672--2680. http:\/\/dl.acm.org\/citation.cfm?id=2969033.2969125"},{"key":"e_1_2_1_11_1","volume-title":"Lei Yang, Suresh Golwalkar, and Alexander Essanian.","author":"Gowda Mahanth","year":"2017","unstructured":"Mahanth Gowda , Ashutosh Dhekne , Sheng Shen , Romit Roy Choudhury , Lei Yang, Suresh Golwalkar, and Alexander Essanian. 2017 . Bringing IoT to sports analytics. In 14th {USENIX} Symposium on Networked Systems Design and Implementation ( {NSDI} 17). 499--513. Mahanth Gowda, Ashutosh Dhekne, Sheng Shen, Romit Roy Choudhury, Lei Yang, Suresh Golwalkar, and Alexander Essanian. 2017. Bringing IoT to sports analytics. In 14th {USENIX} Symposium on Networked Systems Design and Implementation ( {NSDI} 17). 499--513."},{"key":"e_1_2_1_12_1","volume-title":"High productivity software for complex networks. Webov\u00e1 str\u00e1 nka https:\/\/networkx.lanl.gov\/wiki","author":"Hagberg Aric","year":"2013","unstructured":"Aric Hagberg , Dan Schult , Pieter Swart , D Conway , L S\u00e9guin-Charbonneau , C Ellison , B Edwards , and J Torrents . 2013. Networkx. High productivity software for complex networks. Webov\u00e1 str\u00e1 nka https:\/\/networkx.lanl.gov\/wiki ( 2013 ). Aric Hagberg, Dan Schult, Pieter Swart, D Conway, L S\u00e9guin-Charbonneau, C Ellison, B Edwards, and J Torrents. 2013. Networkx. High productivity software for complex networks. Webov\u00e1 str\u00e1 nka https:\/\/networkx.lanl.gov\/wiki (2013)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.07.027"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397306"},{"key":"e_1_2_1_16_1","volume-title":"Densenet: Implementing efficient convnet descriptor pyramids. arXiv preprint arXiv:1404.1869","author":"Iandola Forrest","year":"2014","unstructured":"Forrest Iandola , Matt Moskewicz , Sergey Karayev , Ross Girshick , Trevor Darrell , and Kurt Keutzer . 2014 . Densenet: Implementing efficient convnet descriptor pyramids. arXiv preprint arXiv:1404.1869 (2014). Forrest Iandola, Matt Moskewicz, Sergey Karayev, Ross Girshick, Trevor Darrell, and Kurt Keutzer. 2014. Densenet: Implementing efficient convnet descriptor pyramids. arXiv preprint arXiv:1404.1869 (2014)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356250.3360032"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356250.3361968"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300061.3343395"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241548"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287063"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.14801\/JAITC.2019.9.2.65"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2785956.2787487"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPACS.2013.6704639"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411841"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6906889"},{"key":"e_1_2_1_27_1","volume-title":"Mcunet: Tiny deep learning on iot devices. arXiv preprint arXiv:2007.10319","author":"Lin Ji","year":"2020","unstructured":"Ji Lin , Wei-Ming Chen , Yujun Lin , John Cohn , Chuang Gan , and Song Han . 2020 . Mcunet: Tiny deep learning on iot devices. arXiv preprint arXiv:2007.10319 (2020). Ji Lin, Wei-Ming Chen, Yujun Lin, John Cohn, Chuang Gan, and Song Han. 2020. Mcunet: Tiny deep learning on iot devices. arXiv preprint arXiv:2007.10319 (2020)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3161412"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201316"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414117"},{"key":"e_1_2_1_31_1","volume-title":"LiftRight: Quantifying strength training performance using a wearable sensor. Smart Health","author":"Milanko Slobodan","year":"2020","unstructured":"Slobodan Milanko and Shubham Jain . 2020. LiftRight: Quantifying strength training performance using a wearable sensor. Smart Health ( 2020 ), 100115. Slobodan Milanko and Shubham Jain. 2020. LiftRight: Quantifying strength training performance using a wearable sensor. Smart Health (2020), 100115."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2013.2283548"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_29"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.19"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.139"},{"key":"e_1_2_1_36_1","unstructured":"Natural Point. 2009. Inc.: Optitrack-optical motion tracking solutions.  Natural Point. 2009. Inc.: Optitrack-optical motion tracking solutions."},{"key":"e_1_2_1_37_1","volume-title":"Regularized evolution for image classifier architecture search. arXiv","author":"Real E","year":"2018","unstructured":"E Real , A Aggarwal , Y Huang , and QV Le. [n.d.]. Regularized evolution for image classifier architecture search. arXiv 2018 . arXiv preprint arXiv:1802.01548 ([n. d.]). E Real, A Aggarwal, Y Huang, and QV Le. [n.d.]. Regularized evolution for image classifier architecture search. arXiv 2018. arXiv preprint arXiv:1802.01548 ([n. d.])."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241582"},{"key":"e_1_2_1_39_1","unstructured":"Pete Shinners et al. 2011. PyGame-Python game development. Retrieved from 785 (2011).  Pete Shinners et al. 2011. PyGame-Python game development. Retrieved from 785 (2011)."},{"key":"e_1_2_1_40_1","volume-title":"International Conference on Machine Learning. PMLR, 6105--6114","author":"Tan Mingxing","year":"2019","unstructured":"Mingxing Tan and Quoc Le . 2019 . Efficientnet: Rethinking model scaling for convolutional neural networks . In International Conference on Machine Learning. PMLR, 6105--6114 . Mingxing Tan and Quoc Le. 2019. Efficientnet: Rethinking model scaling for convolutional neural networks. In International Conference on Machine Learning. PMLR, 6105--6114."},{"key":"e_1_2_1_41_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008.  Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191773"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740070.2626330"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jshs.2014.12.003"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318265.3318297"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2789168.2790113"},{"key":"e_1_2_1_47_1","volume-title":"Exploring randomly wired neural networks for image recognition. arXiv preprint arXiv:1904.01569","author":"Xie Saining","year":"2019","unstructured":"Saining Xie , Alexander Kirillov , Ross Girshick , and Kaiming He. 2019. Exploring randomly wired neural networks for image recognition. arXiv preprint arXiv:1904.01569 ( 2019 ). Saining Xie, Alexander Kirillov, Ross Girshick, and Kaiming He. 2019. Exploring randomly wired neural networks for image recognition. arXiv preprint arXiv:1904.01569 (2019)."},{"key":"e_1_2_1_48_1","volume-title":"SNAS: stochastic neural architecture search. arXiv preprint arXiv:1812.09926","author":"Xie Sirui","year":"2018","unstructured":"Sirui Xie , Hehui Zheng , Chunxiao Liu , and Liang Lin . 2018. SNAS: stochastic neural architecture search. arXiv preprint arXiv:1812.09926 ( 2018 ). Sirui Xie, Hehui Zheng, Chunxiao Liu, and Liang Lin. 2018. SNAS: stochastic neural architecture search. arXiv preprint arXiv:1812.09926 (2018)."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2639108.2639111"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328936"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742662"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8485910"},{"key":"e_1_2_1_53_1","volume-title":"2019 18th ACM\/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 241--252","author":"Zhao H.","unstructured":"H. Zhao , S. Wang , G. Zhou , and W. Jung . 2019. TennisEye: Tennis Ball Speed Estimation using a Racket-mounted Motion Sensor . In 2019 18th ACM\/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 241--252 . https:\/\/doi.org\/10.1145\/3302506.3310404 H. Zhao, S. Wang, G. Zhou, and W. Jung. 2019. TennisEye: Tennis Ball Speed Estimation using a Racket-mounted Motion Sensor. In 2019 18th ACM\/IEEE International Conference on Information Processing in Sensor Networks (IPSN). 241--252. https:\/\/doi.org\/10.1145\/3302506.3310404"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369836"},{"key":"e_1_2_1_55_1","volume-title":"Monocap: Monocular human motion capture using a cnn coupled with a geometric prior","author":"Zhou Xiaowei","year":"2019","unstructured":"Xiaowei Zhou , Menglong Zhu , Georgios Pavlakos , Spyridon Leonardos , Konstantinos G Derpanis , and Kostas Daniilidis . 2019 . Monocap: Monocular human motion capture using a cnn coupled with a geometric prior . IEEE transactions on pattern analysis and machine intelligence 41, 4 (2019), 901--914. Xiaowei Zhou, Menglong Zhu, Georgios Pavlakos, Spyridon Leonardos, Konstantinos G Derpanis, and Kostas Daniilidis. 2019. Monocap: Monocular human motion capture using a cnn coupled with a geometric prior. IEEE transactions on pattern analysis and machine intelligence 41, 4 (2019), 901--914."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478082","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478082","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:32Z","timestamp":1750188692000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478082"}},"subtitle":["Ubiquitous Fine-Grained Swing Tracking Framework via Stochastic Neural Architecture Search and Adversarial Learning"],"short-title":[],"issued":{"date-parts":[[2021,9,9]]},"references-count":55,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9,9]]}},"alternative-id":["10.1145\/3478082"],"URL":"https:\/\/doi.org\/10.1145\/3478082","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,9]]},"assertion":[{"value":"2021-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}