{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T10:19:44Z","timestamp":1769595584272,"version":"3.49.0"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"9-10","license":[{"start":{"date-parts":[[2020,10,1]],"date-time":"2020-10-01T00:00:00Z","timestamp":1601510400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,6]],"date-time":"2020-10-06T00:00:00Z","timestamp":1601942400000},"content-version":"vor","delay-in-days":5,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/N509401\/1"],"award-info":[{"award-number":["EP\/N509401\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ann. Telecommun."],"published-print":{"date-parts":[[2020,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Transfer learning uses knowledge learnt in source domains to aid predictions in a target domain. When source and target domains are online, they are susceptible to concept drift, which may alter the mapping of knowledge between them. Drifts in online environments can make additional information available in each domain, necessitating continuing knowledge transfer both from source to target and vice versa. To address this, we introduce the Bi-directional Online Transfer Learning (BOTL) framework, which uses knowledge learnt in each online domain to aid predictions in others. We introduce two variants of BOTL that incorporate model culling to minimise negative transfer in frameworks with high volumes of model transfer. We consider the theoretical loss of BOTL, which indicates that BOTL achieves a loss no worse than the underlying concept drift detection algorithm. We evaluate BOTL using two existing concept drift detection algorithms: RePro and ADWIN. Additionally, we present a concept drift detection algorithm, Adaptive Windowing with Proactive drift detection (AWPro), which reduces the computation and communication demands of BOTL. Empirical results are presented using two data stream generators: the drifting hyperplane emulator and the smart home heating simulator, and real-world data predicting Time To Collision (TTC) from vehicle telemetry. The evaluation shows BOTL and its variants outperform the concept drift detection strategies and the existing state-of-the-art online transfer learning technique.<\/jats:p>","DOI":"10.1007\/s12243-020-00776-1","type":"journal-article","created":{"date-parts":[[2020,10,7]],"date-time":"2020-10-07T00:02:37Z","timestamp":1602028957000},"page":"523-547","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Bi-directional online transfer learning: a framework"],"prefix":"10.1007","volume":"75","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6598-4253","authenticated-orcid":false,"given":"Helen","family":"McKay","sequence":"first","affiliation":[]},{"given":"Nathan","family":"Griffiths","sequence":"additional","affiliation":[]},{"given":"Phillip","family":"Taylor","sequence":"additional","affiliation":[]},{"given":"Theo","family":"Damoulas","sequence":"additional","affiliation":[]},{"given":"Zhou","family":"Xu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,10,6]]},"reference":[{"key":"776_CR1","doi-asserted-by":"crossref","unstructured":"Arnold A, Nallapati R, Cohen WW (2007) A comparative study of methods for transductive transfer learning. In: Seventh IEEE international conference on data mining workshops (ICDMW 2007), pp 77\u201382","DOI":"10.1109\/ICDMW.2007.109"},{"issue":"1","key":"776_CR2","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1145\/1656274.1656287","volume":"11","author":"A Bifet","year":"2009","unstructured":"Bifet A (2009) Adaptive learning and mining for data streams and frequent patterns. SIGKDD Explor Newsl 11(1):55\u201356. https:\/\/doi.org\/10.1145\/1656274.1656287","journal-title":"SIGKDD Explor Newsl"},{"key":"776_CR3","doi-asserted-by":"publisher","unstructured":"Bifet A, Gavalda R (2007) Learning from time-changing data with adaptive windowing. In: Proceedings of the 2007 SIAM international conference on data mining. SIAM, pp 443\u2013448, DOI https:\/\/doi.org\/10.1137\/1.9781611972771.42, (to appear in print)","DOI":"10.1137\/1.9781611972771.42"},{"issue":"1","key":"776_CR4","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/j.procs.2010.04.022","volume":"1","author":"M Budka","year":"2010","unstructured":"Budka M, Gabrys B (2010) Ridge regression ensemble for toxicity prediction. Procedia Computer Science 1(1):193\u2013201. https:\/\/doi.org\/10.1016\/j.procs.2010.04.022. ICCS 2010","journal-title":"Procedia Computer Science"},{"key":"776_CR5","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1613\/JAIR.1872","volume":"26","author":"H Daume III","year":"2006","unstructured":"Daume III H, Marcu D (2006) Domain adaptation for statistical classifiers. J Artif Intell Res 26:101\u2013126. https:\/\/doi.org\/10.1613\/JAIR.1872","journal-title":"J Artif Intell Res"},{"key":"776_CR6","doi-asserted-by":"publisher","unstructured":"Dong B, Li Y, Gao Y, Haque A, Khan L, Masud MM (2017) Multistream regression with asynchronous concept drift detection. In: 2017 IEEE international conference on big data, pp 596\u2013605, DOI https:\/\/doi.org\/10.1109\/BIGDATA.2017.8257975, (to appear in print)","DOI":"10.1109\/BIGDATA.2017.8257975"},{"key":"776_CR7","unstructured":"Dutta H (2009) Measuring diversity in regression ensembles. In: IICAI. Citeseer, vol 9, p 17"},{"issue":"1","key":"776_CR8","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1023\/A:1009778005914","volume":"1","author":"JH Friedman","year":"1997","unstructured":"Friedman JH (1997) On bias, variance, 0\/1\u2014loss, and the curse-of-dimensionality. Data Min Knowl Disc 1(1):55\u201377. https:\/\/doi.org\/10.1023\/A:1009778005914","journal-title":"Data Min Knowl Disc"},{"issue":"4","key":"776_CR9","doi-asserted-by":"publisher","first-page":"44:1","DOI":"10.1145\/2523813","volume":"46","author":"J Gama","year":"2014","unstructured":"Gama J, \u017eliobait\u0117 I, Bifet A, Pechenizkiy M, Bouchachia A (2014) A survey on concept drift adaptation. ACM Comput Surv 46(4):44:1\u201344:37. https:\/\/doi.org\/10.1145\/2523813","journal-title":"ACM Comput Surv"},{"key":"776_CR10","doi-asserted-by":"publisher","unstructured":"Ge L, Gao J, Zhang A (2013) Oms-tl: a framework of online multiple source transfer learning. In: Proceedings of the 22nd ACM international conference on information & knowledge management, CIKM \u201913. ACM, pp 2423\u20132428, DOI https:\/\/doi.org\/10.1145\/2505515.2505603, (to appear in print)","DOI":"10.1145\/2505515.2505603"},{"key":"776_CR11","doi-asserted-by":"publisher","unstructured":"Grubinger T, Chasparis G, Natschl\u00e4ger T (2016) Online transfer learning for climate control in residential buildings. In: Proceedings of the 5th annual european control conference (ECC 2016), pp 1183\u20131188, DOI https:\/\/doi.org\/10.1109\/ECC.2016.7810450, (to appear in print)","DOI":"10.1109\/ECC.2016.7810450"},{"key":"776_CR12","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/J.ENBUILD.2016.12.074","volume":"139","author":"T Grubinger","year":"2017","unstructured":"Grubinger T, Chasparis G, Natschl\u00e4ger T (2017) Generalized online transfer learning for climate control in residential buildings. Energy and Buildings 139:63\u201371. https:\/\/doi.org\/10.1016\/J.ENBUILD.2016.12.074","journal-title":"Energy and Buildings"},{"key":"776_CR13","doi-asserted-by":"publisher","unstructured":"Hammerla NY, Pl\u00f6tz T (2015) Let\u2019s (not) stick together: pairwise similarity biases cross-validation in activity recognition. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, UbiComp \u201915. Association for Computing Machinery, pp 1041\u20131051, DOI https:\/\/doi.org\/10.1145\/2750858.2807551, (to appear in print)","DOI":"10.1145\/2750858.2807551"},{"key":"776_CR14","doi-asserted-by":"crossref","unstructured":"Haque A, Tao H, Chandra S, Liu J, Khan L (2018) A framework for multistream regression with direct density ratio estimation. In: Thirty-second AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v32i1.11820"},{"issue":"1","key":"776_CR15","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/S13748-011-0008-0","volume":"1","author":"TR Hoens","year":"2012","unstructured":"Hoens TR, Polikar R, Chawla NV (2012) Learning from streaming data with concept drift and imbalance: an overview. Progress in Artificial Intelligence 1(1):89\u2013101. https:\/\/doi.org\/10.1007\/S13748-011-0008-0","journal-title":"Progress in Artificial Intelligence"},{"key":"776_CR16","doi-asserted-by":"publisher","unstructured":"Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, KDD \u201901. ACM, pp 97\u2013106, DOI https:\/\/doi.org\/10.1145\/502512.502529, (to appear in print)","DOI":"10.1145\/502512.502529"},{"key":"776_CR17","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.knosys.2019.03.024","volume":"176","author":"Z Kang","year":"2019","unstructured":"Kang Z, Yang B, Li Z, Wang P (2019) Otlamc: an online transfer learning algorithm for multi-class classification. Knowl-Based Syst 176:133\u2013146. https:\/\/doi.org\/10.1016\/j.knosys.2019.03.024","journal-title":"Knowl-Based Syst"},{"key":"776_CR18","doi-asserted-by":"publisher","unstructured":"Kelly MG, Hand DJ, Adams NM (1999) The impact of changing populations on classifier performance. In: Proceedings of the fifth ACM SIGKDD international conference on knowledge discovery and data mining, KDD \u201999. ACM, pp 367\u2013371, DOI https:\/\/doi.org\/10.1145\/312129.312285, (to appear in print)","DOI":"10.1145\/312129.312285"},{"key":"776_CR19","doi-asserted-by":"publisher","unstructured":"Kolter JZ, Maloof MA (2003) Dynamic weighted majority: a new ensemble method for tracking concept drift. In: Third IEEE international conference on data mining, pp 123\u2013130, DOI https:\/\/doi.org\/10.1109\/ICDM.2003.1250911, (to appear in print)","DOI":"10.1109\/ICDM.2003.1250911"},{"key":"776_CR20","doi-asserted-by":"publisher","unstructured":"Kolter JZ, Maloof MA (2005) Using additive expert ensembles to cope with concept drift. In: Proceedings of the 22nd international conference on machine learning, ICML \u201905. ACM, pp 449\u2013456, DOI https:\/\/doi.org\/10.1145\/1102351.1102408, (to appear in print)","DOI":"10.1145\/1102351.1102408"},{"issue":"8","key":"776_CR21","doi-asserted-by":"publisher","first-page":"1866","DOI":"10.1109\/TKDE.2013.139","volume":"26","author":"G Li","year":"2014","unstructured":"Li G, Hoi SC, Chang K, Liu W, Jain R (2014) Collaborative online multitask learning. IEEE Trans Knowl Data Eng 26(8):1866\u20131876. https:\/\/doi.org\/10.1109\/TKDE.2013.139","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"776_CR22","doi-asserted-by":"crossref","unstructured":"Murugesan K, Carbonell J (2017) Multi-task multiple kernel relationship learning. In: Proceedings of the 2017 SIAM international conference on data mining. SIAM, pp 687\u2013 695","DOI":"10.1137\/1.9781611974973.77"},{"key":"776_CR23","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/J.NEUCOM.2015.12.097","volume":"190","author":"J Pan","year":"2016","unstructured":"Pan J, Hu X, Li P, Li H, He W, Zhang Y, Lin Y (2016) Domain adaptation via multi-layer transfer learning. Neurocomputing 190:10\u201324. https:\/\/doi.org\/10.1016\/J.NEUCOM.2015.12.097","journal-title":"Neurocomputing"},{"issue":"10","key":"776_CR24","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","volume":"22","author":"SJ Pan","year":"2010","unstructured":"Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22 (10):1345\u20131359. https:\/\/doi.org\/10.1109\/TKDE.2009.191","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"776_CR25","doi-asserted-by":"crossref","unstructured":"Ruvolo P, Eaton E (2013) Active task selection for lifelong machine learning. In: AAAI","DOI":"10.1609\/aaai.v27i1.8684"},{"key":"776_CR26","unstructured":"Saha A, Rai P, Daum\u00e3 H, Venkatasubramanian S (2011) Online learning of multiple tasks and their relationships. In: Proceedings of the 14th international conference on artificial intelligence and statistics, pp 643\u2013651"},{"issue":"3","key":"776_CR27","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/BF00116895","volume":"1","author":"JC Schlimmer","year":"1986","unstructured":"Schlimmer JC, Granger RH (1986) Incremental learning from noisy data. Mach Learn 1 (3):317\u2013354. https:\/\/doi.org\/10.1007\/BF00116895","journal-title":"Mach Learn"},{"key":"776_CR28","doi-asserted-by":"publisher","unstructured":"Street WN, Kim Y (2001) A streaming ensemble algorithm (sea) for large-scale classification. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, KDD \u201901. ACM, pp 377\u2013382, DOI https:\/\/doi.org\/10.1145\/502512.502568, (to appear in print)","DOI":"10.1145\/502512.502568"},{"issue":"5","key":"776_CR29","doi-asserted-by":"publisher","first-page":"4218,973","DOI":"10.1155\/2016\/4218973","volume":"12","author":"Y Sun","year":"2016","unstructured":"Sun Y, Wang Z, Liu H, Du C, Yuan J (2016) Online ensemble using adaptive windowing for data streams with concept drift. International Journal of Distributed Sensor Networks 12(5):4218,973","journal-title":"International Journal of Distributed Sensor Networks"},{"key":"776_CR30","unstructured":"Tsymbal A (2004) The problem of concept drift: definitions and related work. Computer Science Department, Trinity College Dublin 106"},{"issue":"7","key":"776_CR31","doi-asserted-by":"publisher","first-page":"1494","DOI":"10.1109\/TKDE.2017.2685597","volume":"29","author":"Q Wu","year":"2017","unstructured":"Wu Q, Wu H, Zhou X, Tan M, Xu Y, Yan Y, Hao T (2017) Online transfer learning with multiple homogeneous or heterogeneous sources. IEEE Trans Knowl Data Eng 29(7):1494\u20131507. https:\/\/doi.org\/10.1109\/TKDE.2017.2685597","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"7","key":"776_CR32","doi-asserted-by":"publisher","first-page":"3252","DOI":"10.1109\/TNNLS.2017.2751102","volume":"29","author":"Y Yan","year":"2018","unstructured":"Yan Y, Wu Q, Tan M, Ng MK, Min H, Tsang IW (2018) Online heterogeneous transfer by hedge ensemble of offline and online decisions. IEEE Transactions on Neural Networks and Learning Systems 29(7):3252\u20133263. https:\/\/doi.org\/10.1109\/TNNLS.2017.2751102","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"776_CR33","doi-asserted-by":"publisher","unstructured":"Yang Y, Wu X, Zhu X (2005) Combining proactive and reactive predictions for data streams. In: Proceedings of the eleventh ACM SIGKDD international conference on knowledge discovery in data mining, KDD \u201905. ACM, pp 710\u2013715, DOI https:\/\/doi.org\/10.1145\/1081870.1081961, (to appear in print)","DOI":"10.1145\/1081870.1081961"},{"issue":"3","key":"776_CR34","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1145\/1081870.1081961","volume":"13","author":"Y Yang","year":"2006","unstructured":"Yang Y, Wu X, Zhu X (2006) Mining in anticipation for concept change: proactive-reactive prediction in data streams. Data Min Knowl Disc 13(3):261\u2013289. https:\/\/doi.org\/10.1145\/1081870.1081961","journal-title":"Data Min Knowl Disc"},{"key":"776_CR35","doi-asserted-by":"publisher","unstructured":"Yin H, Yang YA (2017) Online transfer learning with extreme learning machine. In: AIP conference proceedings, vol 1839. AIP Publishing, p 020199, DOI https:\/\/doi.org\/10.1063\/1.4982564","DOI":"10.1063\/1.4982564"},{"key":"776_CR36","unstructured":"Zhao P, Hoi SC (2010) Otl: a framework of online transfer learning. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 1231\u20131238"},{"key":"776_CR37","doi-asserted-by":"crossref","unstructured":"Zhou ZH (2012) Ensemble methods: foundations and algorithms. Chapman and Hall\/CRC","DOI":"10.1201\/b12207"}],"container-title":["Annals of Telecommunications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12243-020-00776-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12243-020-00776-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12243-020-00776-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,22]],"date-time":"2022-11-22T10:03:19Z","timestamp":1669111399000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12243-020-00776-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10]]},"references-count":37,"journal-issue":{"issue":"9-10","published-print":{"date-parts":[[2020,10]]}},"alternative-id":["776"],"URL":"https:\/\/doi.org\/10.1007\/s12243-020-00776-1","relation":{},"ISSN":["0003-4347","1958-9395"],"issn-type":[{"value":"0003-4347","type":"print"},{"value":"1958-9395","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10]]},"assertion":[{"value":"5 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 October 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}