{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T03:19:35Z","timestamp":1777173575137,"version":"3.51.4"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,7,10]],"date-time":"2023-07-10T00:00:00Z","timestamp":1688947200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"A3 Foresight Program of NSFC","award":["62061146002"],"award-info":[{"award-number":["62061146002"]}]},{"name":"Funds for Creative Research Groups of China","award":["61921003"],"award-info":[{"award-number":["61921003"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:p>Time series forecasting in the sensing system aims to predict future values based on historical records that sensors have collected. Previous works, however, usually focus on improving model structure or algorithm for better performance but the perspective of learning proper numeric representations is overlooked. The inappropriate and coarse numeric representations are not expressive enough to capture the intrinsic characteristics of numbers, which will obviously degrade the prediction performance.<\/jats:p>\n          <jats:p>In this article, we propose Num2vec, an algorithmic framework to learn numeric representations. Specifically, Num2vec lists three main logic characteristics of numbers: arithmetic, direction, and periodicity. By representing numbers into a transition space, Num2vec can translates numbers agilely to different Internet of Things tasks through selecting the corresponding characteristics. According to such a design, Num2vec enjoys flexible numeric representations to fit different Internet of Things time series tasks. Extensive experiments on four real-world datasets show that the approach achieves the best performance when compared with state-of-the-art baselines.<\/jats:p>","DOI":"10.1145\/3599728","type":"journal-article","created":{"date-parts":[[2023,6,7]],"date-time":"2023-06-07T07:12:56Z","timestamp":1686121976000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Num2vec: Pre-Training Numeric Representations for Time Series Forecasting in the Sensing System"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0119-1916","authenticated-orcid":false,"given":"Jinxiao","family":"Fan","sequence":"first","affiliation":[{"name":"Beijing University Posts and Telecommunications, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8658-7102","authenticated-orcid":false,"given":"Pengfei","family":"Wang","sequence":"additional","affiliation":[{"name":"Beijing University Posts and Telecommunications, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0576-7396","authenticated-orcid":false,"given":"Yu","family":"Fan","sequence":"additional","affiliation":[{"name":"Beijing University Posts and Telecommunications, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5040-2468","authenticated-orcid":false,"given":"Liang","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing University Posts and Telecommunications, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7199-5047","authenticated-orcid":false,"given":"Huadong","family":"Ma","sequence":"additional","affiliation":[{"name":"Beijing University Posts and Telecommunications, China"}]}],"member":"320","published-online":{"date-parts":[[2023,7,10]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"e_1_3_2_3_2","article-title":"Translating embeddings for modeling multi-relational data","author":"Bordes Antoine","year":"2013","unstructured":"Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS\u201913), Vol. 2. 2787\u20132795.","journal-title":"Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS\u201913), Vol. 2."},{"key":"e_1_3_2_4_2","article-title":"Conditional time series forecasting with convolutional neural networks","author":"Borovykh Anastasia","year":"2017","unstructured":"Anastasia Borovykh, Sander Bohte, and Cornelis W. Oosterlee. 2017. Conditional time series forecasting with convolutional neural networks. arXiv preprint arXiv:1703.04691 (2017).","journal-title":"arXiv preprint arXiv:1703.04691"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2807452"},{"key":"e_1_3_2_6_2","article-title":"Learning phrase representations using RNN encoder-decoder for statistical machine translation","author":"Cho Kyunghyun","year":"2014","unstructured":"Kyunghyun Cho, Bart Van Merri\u00ebnboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).","journal-title":"arXiv preprint arXiv:1406.1078"},{"key":"e_1_3_2_7_2","article-title":"A survey of knowledge graph embedding and their applications","author":"Choudhary Shivani","year":"2021","unstructured":"Shivani Choudhary, Tarun Luthra, Ashima Mittal, and Rajat Singh. 2021. A survey of knowledge graph embedding and their applications. arXiv preprint arXiv:2107.07842 (2021).","journal-title":"arXiv preprint arXiv:2107.07842"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9050750"},{"key":"e_1_3_2_9_2","article-title":"Transformer-XL: Attentive language models beyond a fixed-length context","author":"Dai Zihang","year":"2019","unstructured":"Zihang Dai, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc V. Le, and Ruslan Salakhutdinov. 2019. Transformer-XL: Attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860 (2019).","journal-title":"arXiv preprint arXiv:1901.02860"},{"key":"e_1_3_2_10_2","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).","journal-title":"arXiv preprint arXiv:1810.04805"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.3301890"},{"key":"e_1_3_2_12_2","first-page":"1","volume-title":"Proceedings of IEEE PES Innovative Smart Grid Technologies","author":"Ding Yuyu","year":"2012","unstructured":"Yuyu Ding, Hai Zhou, Zhiping Tan, Ying Chen, and Jie Ding. 2012. The influence of wind direction on short-term wind power prediction: A case study in north China. In Proceedings of IEEE PES Innovative Smart Grid Technologies. IEEE, Los Alamitos, CA, 1\u20135."},{"issue":"6","key":"e_1_3_2_13_2","doi-asserted-by":"crossref","first-page":"e269","DOI":"10.1016\/S1470-2045(15)70238-X","article-title":"Air pollution, climate change, and health","volume":"16","author":"Gibson Josefine","year":"2015","unstructured":"Josefine Gibson. 2015. Air pollution, climate change, and health. Lancet Oncology 16, 6 (2015), e269.","journal-title":"Lancet Oncology"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.3301922"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)0733-947X(1995)121:3(249)"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_17_2","article-title":"Time2vec: Learning a vector representation of time","author":"Kazemi Seyed Mehran","year":"2019","unstructured":"Seyed Mehran Kazemi, Rishab Goel, Sepehr Eghbali, Janahan Ramanan, Jaspreet Sahota, Sanjay Thakur, Stella Wu, Cathal Smyth, Pascal Poupart, and Marcus Brubaker. 2019. Time2vec: Learning a vector representation of time. arXiv preprint arXiv:1907.05321 (2019).","journal-title":"arXiv preprint arXiv:1907.05321"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210006"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450588.3450605"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/2886521.2886624"},{"key":"e_1_3_2_21_2","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Lin Yan","year":"2020","unstructured":"Yan Lin, Huaiyu Wan, Shengnan Guo, and Youfang Lin. 2020. Pre-training context and time aware location embeddings from spatial-temporal trajectories for user next location prediction. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_22_2","article-title":"Efficient estimation of word representations in vector space","author":"Mikolov Tomas","year":"2013","unstructured":"Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).","journal-title":"arXiv preprint arXiv:1301.3781"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.earscirev.2018.12.005"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_25_2","article-title":"Deep contextualized word representations","author":"Peters Matthew E.","year":"2018","unstructured":"Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. arXiv preprint arXiv:1802.05365 (2018).","journal-title":"arXiv preprint arXiv:1802.05365"},{"key":"e_1_3_2_26_2","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. Preprint."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-019-05815-0"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2016.2530312"},{"key":"e_1_3_2_29_2","first-page":"2071","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Trouillon Th\u00e9o","year":"2016","unstructured":"Th\u00e9o Trouillon, Johannes Welbl, Sebastian Riedel, \u00c9ric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In Proceedings of the International Conference on Machine Learning. 2071\u20132080."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2017.2754499"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397536.3422208"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v28i1.8870"},{"key":"e_1_3_2_33_2","article-title":"Extending the EOS long-term PM \\(_{2.5}\\)  data records since 2013 in China: Application to the VIIRS Deep Blue aerosol products","author":"Wei Jing","year":"2021","unstructured":"Jing Wei, Zhanqing Li, Lin Sun, Wenhao Xue, Zongwei Ma, Lei Liu, Tianyi Fan, and Maureen Cribb. 2021. Extending the EOS long-term PM \\(_{2.5}\\) data records since 2013 in China: Application to the VIIRS Deep Blue aerosol products. IEEE Transactions on Geoscience and Remote Sensing 60 (2021), Article 4100412.","journal-title":"IEEE Transactions on Geoscience and Remote Sensing"},{"key":"e_1_3_2_34_2","first-page":"2141","volume-title":"Proceedings of the 2021 IEEE 37th International Conference on Data Engineering (ICDE\u201921)","author":"Wen Haomin","year":"2021","unstructured":"Haomin Wen, Youfang Lin, Fan Wu, Huaiyu Wan, Shengnan Guo, Lixia Wu, Chao Song, and Yinghui Xu. 2021. Package pick-up route prediction via modeling couriers\u2019 spatial-temporal behaviors. In Proceedings of the 2021 IEEE 37th International Conference on Data Engineering (ICDE\u201921). IEEE, Los Alamitos, CA, 2141\u20132146."},{"key":"e_1_3_2_35_2","article-title":"Time series data augmentation for deep learning: A survey","author":"Wen Qingsong","year":"2020","unstructured":"Qingsong Wen, Liang Sun, Fan Yang, Xiaomin Song, Jingkun Gao, Xue Wang, and Huan Xu. 2020. Time series data augmentation for deep learning: A survey. arXiv preprint arXiv:2002.12478 (2020).","journal-title":"arXiv preprint arXiv:2002.12478"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/0169-7439(87)80084-9"},{"key":"e_1_3_2_37_2","article-title":"Embedding entities and relations for learning and inference in knowledge bases","author":"Yang Bishan","year":"2014","unstructured":"Bishan Yang, Wen-Tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2014. Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint arXiv:1412.6575 (2014).","journal-title":"arXiv preprint arXiv:1412.6575"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.5555\/2832747.2832806"},{"key":"e_1_3_2_39_2","first-page":"1","volume-title":"Proceedings of the 2017 Australasian Universities Power Engineering Conference (AUPEC\u201917)","author":"Yatiyana Eddie","year":"2017","unstructured":"Eddie Yatiyana, Sumedha Rajakaruna, and Arindam Ghosh. 2017. Wind speed and direction forecasting for wind power generation using ARIMA model. In Proceedings of the 2017 Australasian Universities Power Engineering Conference (AUPEC\u201917). IEEE, Los Alamitos, CA, 1\u20136."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-2104"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-2312(01)00702-0"},{"key":"e_1_3_2_42_2","volume-title":"Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI\u201921)","author":"Zhou Haoyi","year":"2021","unstructured":"Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wancai Zhang. 2021. Informer: Beyond efficient transformer for long sequence time-series forecasting. In Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI\u201921)."},{"key":"e_1_3_2_43_2","doi-asserted-by":"crossref","unstructured":"Francisco Mart\u00ednez Mar\u00eda Pilar Fr\u00edas Mar\u00eda Dolores P\u00e9rez and Antonio Jes\u00fas Rivera. 2019. A methodology for applying k-nearest neighbor to time series forecasting. Artificial Intelligence Review 52 3 (2019) 2019\u20132037.","DOI":"10.1007\/s10462-017-9593-z"},{"key":"e_1_3_2_44_2","doi-asserted-by":"crossref","unstructured":"Andrew D. Short and Arthur C. Trembanis. 2004. Decadal scale patterns in beach oscillation and rotation Narrabeen Beach Australia\u2014time series PCA and wavelet analysis. Journal of Coastal Research 20 2 (2004) 523\u2013532.","DOI":"10.2112\/1551-5036(2004)020[0523:DSPIBO]2.0.CO;2"},{"key":"e_1_3_2_45_2","doi-asserted-by":"crossref","unstructured":"Kiyoung Yang and Cyrus Shahabi. 2004. A PCA-based similarity measure for multivariate time series. In Proceedings of the 2nd ACM International Workshop on Multimedia Databases 65\u201374.","DOI":"10.1145\/1032604.1032616"},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","unstructured":"Yen-Hsien Lee Chih-Ping Wei Tsang-Hsiang Cheng and Ching-Ting Yang. 2012. Nearest-neighbor-based approach to time-series classification. Decision Support Systems 53 1 (2012) 207\u2013217.","DOI":"10.1016\/j.dss.2011.12.014"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3599728","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3599728","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:11Z","timestamp":1750178831000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3599728"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,10]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,11,30]]}},"alternative-id":["10.1145\/3599728"],"URL":"https:\/\/doi.org\/10.1145\/3599728","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,10]]},"assertion":[{"value":"2022-04-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-20","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}