{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T03:25:19Z","timestamp":1762917919513,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,5,21]],"date-time":"2018-05-21T00:00:00Z","timestamp":1526860800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,5,21]]},"DOI":"10.1145\/3240925.3240937","type":"proceedings-article","created":{"date-parts":[[2018,9,7]],"date-time":"2018-09-07T12:51:23Z","timestamp":1536324683000},"page":"178-186","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Cross-modal Recurrent Models for Weight Objective Prediction from Multimodal Time-series Data"],"prefix":"10.1145","author":[{"given":"Petar","family":"Veli\u010dkovi\u0107","sequence":"first","affiliation":[{"name":"University of Cambridge and Nokia Bell Labs, Cambridge, UK"}]},{"given":"Laurynas","family":"Karazija","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, UK"}]},{"given":"Nicholas D.","family":"Lane","sequence":"additional","affiliation":[{"name":"University of Oxford and Nokia Bell Labs, Oxford, UK"}]},{"given":"Sourav","family":"Bhattacharya","sequence":"additional","affiliation":[{"name":"Nokia Bell Labs, Cambridge, UK"}]},{"given":"Edgar","family":"Liberis","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, UK"}]},{"given":"Pietro","family":"Li\u00f2","sequence":"additional","affiliation":[{"name":"University of Cambridge, Cambridge, UK"}]},{"given":"Angela","family":"Chieh","sequence":"additional","affiliation":[{"name":"Nokia Digital Health - Withings, Issy-les-Moulineaux, France"}]},{"given":"Otmane","family":"Bellahsen","sequence":"additional","affiliation":[{"name":"Nokia Digital Health - Withings, Issy-les-Moulineaux, France"}]},{"given":"Matthieu","family":"Vegreville","sequence":"additional","affiliation":[{"name":"Nokia Digital Health - Withings, Issy-les-Moulineaux, France"}]}],"member":"320","published-online":{"date-parts":[[2018,5,21]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-011-2715-y"},{"key":"e_1_3_2_1_2_1","volume-title":"XFlow: 1D-2D Cross-modal Deep Neural Networks for Audiovisual Classification. arXiv preprint arXiv.1709.00572","author":"Cangea C\u0103nt\u0103nlina","year":"2017","unstructured":"C\u0103nt\u0103nlina Cangea , Petar Veli\u010dkovi\u0107 , and Pietro Li\u00f2 . 2017. XFlow: 1D-2D Cross-modal Deep Neural Networks for Audiovisual Classification. arXiv preprint arXiv.1709.00572 ( 2017 ). C\u0103nt\u0103nlina Cangea, Petar Veli\u010dkovi\u0107, and Pietro Li\u00f2. 2017. XFlow: 1D-2D Cross-modal Deep Neural Networks for Audiovisual Classification. arXiv preprint arXiv.1709.00572 (2017)."},{"key":"e_1_3_2_1_3_1","volume-title":"A cross-modal system linking primary auditory and visual cortices: Evidence from intrinsic fMPI connectivity analysis. Human brain mapping 29, 7","author":"Eckert Mark A","year":"2008","unstructured":"Mark A Eckert , Nirav V Kamdar , Catherine E Chang , Christian F Beckmann , Michael D Greicius , and Vinod Menon . 2008. A cross-modal system linking primary auditory and visual cortices: Evidence from intrinsic fMPI connectivity analysis. Human brain mapping 29, 7 ( 2008 ), 848--857. Mark A Eckert, Nirav V Kamdar, Catherine E Chang, Christian F Beckmann, Michael D Greicius, and Vinod Menon. 2008. A cross-modal system linking primary auditory and visual cortices: Evidence from intrinsic fMPI connectivity analysis. Human brain mapping 29, 7 (2008), 848--857."},{"key":"e_1_3_2_1_4_1","volume-title":"International Conference on Artificial Intelligence and Statistics. 249--256","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio . 2010 . Understanding the difficulty of training deep feedforward neural networks . In International Conference on Artificial Intelligence and Statistics. 249--256 . Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In International Conference on Artificial Intelligence and Statistics. 249--256."},{"key":"e_1_3_2_1_5_1","volume-title":"Generating sequences with recurrent neural networks. arXiv preprint arXiv.1308.0850","author":"Graves Alex","year":"2013","unstructured":"Alex Graves . 2013. Generating sequences with recurrent neural networks. arXiv preprint arXiv.1308.0850 ( 2013 ). Alex Graves. 2013. Generating sequences with recurrent neural networks. arXiv preprint arXiv.1308.0850 (2013)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.123"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_1_8_1","volume-title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv.1502.03167","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy . 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv.1502.03167 ( 2015 ). Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv.1502.03167 (2015)."},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of The 32nd International Conference on Machine Learning. 2342--2350","author":"Jozefowicz Rafal","year":"2015","unstructured":"Rafal Jozefowicz , Wojciech Zaremba , and Ilya Sutskever . 2015 . An Empirical Exploration of Recurrent Network Architectures . In Proceedings of The 32nd International Conference on Machine Learning. 2342--2350 . Rafal Jozefowicz, Wojciech Zaremba, and Ilya Sutskever. 2015. An Empirical Exploration of Recurrent Network Architectures. In Proceedings of The 32nd International Conference on Machine Learning. 2342--2350."},{"key":"e_1_3_2_1_10_1","volume-title":"One model to learn them all. arXiv preprint arXiv.1706.05137","author":"Kaiser Lukasz","year":"2017","unstructured":"Lukasz Kaiser , Aidan N Gomez , Noam Shazeer , Ashish Vaswani , Niki Parmar , Llion Jones , and Jakob Uszkoreit . 2017. One model to learn them all. arXiv preprint arXiv.1706.05137 ( 2017 ). Lukasz Kaiser, Aidan N Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, and Jakob Uszkoreit. 2017. One model to learn them all. arXiv preprint arXiv.1706.05137 (2017)."},{"key":"e_1_3_2_1_11_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik","year":"2014","unstructured":"Diederik Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_1_12_1","volume-title":"Are sleep duration, midpoint of sleep and sleep quality associated with dietary intake among Bavarian adults? European Journal of Clinical Nutrition","author":"Kleiser C","year":"2017","unstructured":"C Kleiser , N Wawro , M Stelmach-Mardas , H Boeing , K Gedrich , H Himmerich , and J Linseisen . 2017. Are sleep duration, midpoint of sleep and sleep quality associated with dietary intake among Bavarian adults? European Journal of Clinical Nutrition ( 2017 ). C Kleiser, N Wawro, M Stelmach-Mardas, H Boeing, K Gedrich, H Himmerich, and J Linseisen. 2017. Are sleep duration, midpoint of sleep and sleep quality associated with dietary intake among Bavarian adults? European Journal of Clinical Nutrition (2017)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2013.56"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2638728.2638807"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2968219.2968441"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/0005-2795(75)90109-9"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/3104322.3104425"},{"key":"e_1_3_2_1_18_1","volume-title":"Sleep curtailment is accompanied by increased intake of calories from snacks. The American journal of clinical nutrition 89, 1","author":"Nedeltcheva Arlet V","year":"2009","unstructured":"Arlet V Nedeltcheva , Jennifer M Kilkus , Jacqueline Imperial , Kristen Kasza , Dale A Schoeller , and Plamen D Penev . 2009. Sleep curtailment is accompanied by increased intake of calories from snacks. The American journal of clinical nutrition 89, 1 ( 2009 ), 126--133. Arlet V Nedeltcheva, Jennifer M Kilkus, Jacqueline Imperial, Kristen Kasza, Dale A Schoeller, and Plamen D Penev. 2009. Sleep curtailment is accompanied by increased intake of calories from snacks. The American journal of clinical nutrition 89, 1 (2009), 126--133."},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 28th international conference on machine learning (ICML-11)","author":"Ngiam Jiquan","year":"2011","unstructured":"Jiquan Ngiam , Aditya Khosla , Mingyu Kim , Juhan Nam , Honglak Lee , and Andrew Y Ng . 2011 . Multimodal deep learning . In Proceedings of the 28th international conference on machine learning (ICML-11) . 689--696. Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee, and Andrew Y Ng. 2011. Multimodal deep learning. In Proceedings of the 28th international conference on machine learning (ICML-11). 689--696."},{"volume-title":"Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods","author":"Platt John C.","key":"e_1_3_2_1_20_1","unstructured":"John C. Platt . 1999. Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods . In ADVANCES IN LARGE MARGIN CLASSIFIERS. MIT Press , 61--74. John C. Platt. 1999. Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods. In ADVANCES IN LARGE MARGIN CLASSIFIERS. MIT Press, 61--74."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/3016387.3016407"},{"key":"e_1_3_2_1_22_1","volume-title":"Freshmen in Dietetic Courses Study II Group, et al","author":"Sato-Mito Natsuko","year":"2011","unstructured":"Natsuko Sato-Mito , Satoshi Sasaki , Kentaro Murakami , Hitomi Okubo , Yoshiko Takahashi , Shigenobu Shibata , Kazuhiko Yamada , Kazuto Sato , Freshmen in Dietetic Courses Study II Group, et al . 2011 . The midpoint of sleep is associated with dietary intake and dietary behavior among young Japanese women. Sleep medicine 12, 3 (2011), 289--294. Natsuko Sato-Mito, Satoshi Sasaki, Kentaro Murakami, Hitomi Okubo, Yoshiko Takahashi, Shigenobu Shibata, Kazuhiko Yamada, Kazuto Sato, Freshmen in Dietetic Courses Study II Group, et al. 2011. The midpoint of sleep is associated with dietary intake and dietary behavior among young Japanese women. Sleep medicine 12, 3 (2011), 289--294."},{"key":"e_1_3_2_1_23_1","volume-title":"Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034","author":"Simonyan Karen","year":"2013","unstructured":"Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 ( 2013 ). Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013)."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"key":"e_1_3_2_1_25_1","unstructured":"Nitish Srivastava and Ruslan R Salakhutdinov. 2012. Multimodal learning with deep boltzmann machines. In Advances in neural information processing systems. 2222--2230.   Nitish Srivastava and Ruslan R Salakhutdinov. 2012. Multimodal learning with deep boltzmann machines. In Advances in neural information processing systems. 2222--2230."},{"key":"e_1_3_2_1_26_1","volume-title":"Cross-modal Recurrent Models for Human Weight Objective Prediction from Multimodal Time-series Data. arXiv preprint arXiv.1709.08073","author":"Veli\u010dkovi\u0107 Petar","year":"2017","unstructured":"Petar Veli\u010dkovi\u0107 , Laurynas Karazija , Nicholas D Lane , Sourav Bhattacharya , Edgar Liberis , Pietro Li\u00f2 , Angela Chieh , Otmane Bellahsen , and Matthieu Vegreville . 2017. Cross-modal Recurrent Models for Human Weight Objective Prediction from Multimodal Time-series Data. arXiv preprint arXiv.1709.08073 ( 2017 ). Petar Veli\u010dkovi\u0107, Laurynas Karazija, Nicholas D Lane, Sourav Bhattacharya, Edgar Liberis, Pietro Li\u00f2, Angela Chieh, Otmane Bellahsen, and Matthieu Vegreville. 2017. Cross-modal Recurrent Models for Human Weight Objective Prediction from Multimodal Time-series Data. arXiv preprint arXiv.1709.08073 (2017)."},{"key":"e_1_3_2_1_27_1","volume-title":"X-CNN: Cross-modal Convolutional Neural Networks for Sparse Datasets. arXiv preprint arXiv.1610.00163","author":"Veli\u010dkovi\u0107 Petar","year":"2016","unstructured":"Petar Veli\u010dkovi\u0107 , Duo Wang , Nicholas D Lane , and Pietro Li\u00f2 . 2016. X-CNN: Cross-modal Convolutional Neural Networks for Sparse Datasets. arXiv preprint arXiv.1610.00163 ( 2016 ). Petar Veli\u010dkovi\u0107, Duo Wang, Nicholas D Lane, and Pietro Li\u00f2. 2016. X-CNN: Cross-modal Convolutional Neural Networks for Sparse Datasets. arXiv preprint arXiv.1610.00163 (2016)."},{"key":"e_1_3_2_1_28_1","article-title":"Effect of a Web-Based Behavior Change Program on Weight Loss and Cardiovascular Risk Factors in Overweight and Obese Adults at High Risk of Developing Cardiovascular Disease","volume":"17","author":"Watson Sinead","year":"2015","unstructured":"Sinead Watson , V. Jayne Woodside , J. Lisa Ware , J. Steven Hunter , Alanna McGrath , R. Christopher Cardwell , M. Katherine Appleton , S. Ian Young , and C. Michelle McKinley . 2015 . Effect of a Web-Based Behavior Change Program on Weight Loss and Cardiovascular Risk Factors in Overweight and Obese Adults at High Risk of Developing Cardiovascular Disease : Randomized Controlled Trial. J Med Internet Res 17 , 7 (16 Jul 2015), e177. Sinead Watson, V. Jayne Woodside, J. Lisa Ware, J. Steven Hunter, Alanna McGrath, R. Christopher Cardwell, M. Katherine Appleton, S. Ian Young, and C. Michelle McKinley. 2015. Effect of a Web-Based Behavior Change Program on Weight Loss and Cardiovascular Risk Factors in Overweight and Obese Adults at High Risk of Developing Cardiovascular Disease: Randomized Controlled Trial. J Med Internet Res 17, 7 (16 Jul 2015), e177.","journal-title":"Randomized Controlled Trial. J Med Internet Res"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882471.1882478"},{"key":"e_1_3_2_1_30_1","volume-title":"Effects of Sound Frequency on Audiovisual Integration: An Event-Related Potential Study. PLoS ONE 10, 9 (09","author":"Yang Weiping","year":"2015","unstructured":"Weiping Yang , Jingjing Yang , Yulin Gao , Xiaoyu Tang , Yanna Ren , Satoshi Takahashi , and Jinglong Wu. 2015. Effects of Sound Frequency on Audiovisual Integration: An Event-Related Potential Study. PLoS ONE 10, 9 (09 2015 ), 1--15. Weiping Yang, Jingjing Yang, Yulin Gao, Xiaoyu Tang, Yanna Ren, Satoshi Takahashi, and Jinglong Wu. 2015. Effects of Sound Frequency on Audiovisual Integration: An Event-Related Potential Study. PLoS ONE 10, 9 (09 2015), 1--15."},{"key":"e_1_3_2_1_31_1","volume-title":"Recurrent neural network regularization. arXiv preprint arXiv.1409.2329","author":"Zaremba Wojciech","year":"2014","unstructured":"Wojciech Zaremba , Ilya Sutskever , and Oriol Vinyals . 2014. Recurrent neural network regularization. arXiv preprint arXiv.1409.2329 ( 2014 ). Wojciech Zaremba, Ilya Sutskever, and Oriol Vinyals. 2014. Recurrent neural network regularization. arXiv preprint arXiv.1409.2329 (2014)."}],"event":{"name":"PervasiveHealth '18: 12th EAI International Conference on Pervasive Computing Technologies for Healthcare","sponsor":["EAI The European Alliance for Innovation"],"location":"New York NY USA","acronym":"PervasiveHealth '18"},"container-title":["Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240925.3240937","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3240925.3240937","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:43:45Z","timestamp":1750207425000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3240925.3240937"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,21]]},"references-count":31,"alternative-id":["10.1145\/3240925.3240937","10.1145\/3240925"],"URL":"https:\/\/doi.org\/10.1145\/3240925.3240937","relation":{},"subject":[],"published":{"date-parts":[[2018,5,21]]},"assertion":[{"value":"2018-05-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}