{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T14:00:58Z","timestamp":1762956058721,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T00:00:00Z","timestamp":1548288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Although the availability of sensor data is becoming prevalent across many domains, it still remains a challenge to make sense of the sensor data in an efficient and effective manner in order to provide users with relevant services. The concept of virtual sensors provides a step towards this goal, however they are often used to denote homogeneous types of data, generally retrieved from a predetermined group of sensors. The DIVS (Dynamic Intelligent Virtual Sensors) concept was introduced in previous work to extend and generalize the notion of a virtual sensor to a dynamic setting with heterogenous sensors. This paper introduces a refined version of the DIVS concept by integrating an interactive machine learning mechanism, which enables the system to take input from both the user and the physical world. The paper empirically validates some of the properties of the DIVS concept. In particular, we are concerned with the distribution of different budget allocations for labelled data, as well as proactive labelling user strategies. We report on results suggesting that a relatively good accuracy can be achieved despite a limited budget in an environment with dynamic sensor availability, while proactive labeling ensures further improvements in performance.<\/jats:p>","DOI":"10.3390\/s19030477","type":"journal-article","created":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T11:12:48Z","timestamp":1548328368000},"page":"477","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Collaborative Sensing with Interactive Learning using Dynamic Intelligent Virtual Sensors"],"prefix":"10.3390","volume":"19","author":[{"given":"Agnes","family":"Tegen","sequence":"first","affiliation":[{"name":"Internet of Things and People Research Center, Department of Computer Science and Media Technology, Malm\u00f6 University, 20506 Malm\u00f6, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Davidsson","sequence":"additional","affiliation":[{"name":"Internet of Things and People Research Center, Department of Computer Science and Media Technology, Malm\u00f6 University, 20506 Malm\u00f6, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Radu-Casian","family":"Mihailescu","sequence":"additional","affiliation":[{"name":"Internet of Things and People Research Center, Department of Computer Science and Media Technology, Malm\u00f6 University, 20506 Malm\u00f6, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9471-8405","authenticated-orcid":false,"given":"Jan A.","family":"Persson","sequence":"additional","affiliation":[{"name":"Internet of Things and People Research Center, Department of Computer Science and Media Technology, Malm\u00f6 University, 20506 Malm\u00f6, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/MS.2013.141","article-title":"Sensor Cloud: A Cloud of Virtual Sensors","volume":"31","author":"Madria","year":"2014","journal-title":"IEEE Softw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"862","DOI":"10.1016\/j.comnet.2009.10.017","article-title":"A survey of network virtualization","volume":"54","author":"Boutaba","year":"2010","journal-title":"Comput. Netw."},{"key":"ref_3","unstructured":"Corsini, P., Masci, P., and Vecchio, A. (2006, January 13\u201317). Configuration and tuning of sensor network applications through virtual sensors. Proceedings of the Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops, Pisa, Italy."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2175","DOI":"10.3390\/s120202175","article-title":"A Survey on Virtualization of Wireless Sensor Networks","volume":"12","author":"Islam","year":"2012","journal-title":"Sensors"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Castanedo, F., Garcia, J., Patricio, M.A., and Molina, J.M. (2008, January 7\u201311). A multi-agent architecture to support active fusion in a visual sensor network. Proceedings of the Second ACM\/IEEE International Conference on Distributed Smart Cameras, Stanford, CA, USA.","DOI":"10.1109\/ICDSC.2008.4635715"},{"key":"ref_6","unstructured":"Liu, L., Kuo, S.M., and Zhou, M. (2009, January 26\u201329). Virtual sensing techniques and their applications. Proceedings of the International Conference on Networking, Sensing and Control, Okayama, Japan."},{"key":"ref_7","unstructured":"Dailey, D.J., and Cathey, F.W. (2006). Deployment of a Virtual Sensor System, Based on Transit Probes in an Operational Traffic Management System, Washington State Transportation Center."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yan, Z., Subbaraju, V., Chakraborty, D., Misra, A., and Aberer, K. (2012, January 18\u201322). Energy-Efficient Continuous Activity Recognition on Mobile Phones: An Activity-Adaptive Approach. Proceedings of the 16th International Symposium on Wearable Computers, Newcastle, UK.","DOI":"10.1109\/ISWC.2012.23"},{"key":"ref_9","first-page":"217","article-title":"Towards Collaborative Sensing using Dynamic Intelligent Virtual Sensors","volume":"Volume 678","author":"Badica","year":"2017","journal-title":"Intelligent Distributed Computing X, Studies in Computational Intelligence"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MCI.2015.2471196","article-title":"Learning in nonstationary environments: A survey","volume":"10","author":"Ditzler","year":"2015","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_11","unstructured":"Vartak, M., Thiagarajan, A., Miranda, C., Bratman, J., and Larochelle, H. (2017, January 4\u20139). A Meta-Learning Perspective on Cold-Start Recommendations for Items. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_12","unstructured":"Koch, G., Zemel, R., and Salakhutdinov, R. (2015, January 10\u201311). Siamese neural networks for one-shot image recognition. Proceedings of the 2nd ICML Deep Learning Workshop, Lille, France."},{"key":"ref_13","unstructured":"Gepperth, A., and Hammer, B. (2016, January 27\u201329). Incremental learning algorithms and applications. Proceedings of the European Symposium on Artificial Neural Networks, Bruges, Belgium."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.knosys.2015.01.010","article-title":"Transfer learning using computational intelligence: A survey","volume":"80","author":"Lu","year":"2015","journal-title":"Knowl.-Based Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ekedahl, U., Mihailescu, R.-C., and Ma, Z. (2018, January 9\u201313). Lessons learned from adapting \u201cthings\u201d to IoT platforms in research and teaching. Proceedings of the 33rd Annual ACM Symposium on Applied Computing, Pau, France.","DOI":"10.1145\/3167132.3167421"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/07421222.1996.11518099","article-title":"Beyond Accuracy: What Data Quality Means to Data Consumers","volume":"12","author":"Wang","year":"1996","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.jnca.2016.08.002","article-title":"Data quality in Internet of Things: A state-of-the-art survey","volume":"73","author":"Karkouch","year":"2016","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1261","DOI":"10.1016\/j.neucom.2017.06.084","article-title":"Incremental on-line learning: A review and comparison of state of the art algorithms","volume":"275","author":"Losing","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_20","unstructured":"Hoi, S.C.H., Sahoo, D., Lu, J., and Zhao, P. (2018). Online Learning: A Comprehensive Survey. arXiv."},{"key":"ref_21","unstructured":"Settles, B. (2009). Active Learning Literature Survey, University of Wisconsin-Madison. Computer Sciences Technical Report, 1648."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/TNNLS.2012.2236570","article-title":"Active learning with drifting streaming data","volume":"25","author":"Zliobaite","year":"2014","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.enbuild.2015.11.071","article-title":"Accurate occupancy detection of an office room from light, temperature, humidity and CO2 measurements using statistical learning models","volume":"112","author":"Candanedo","year":"2016","journal-title":"Energy Build."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1996","DOI":"10.1109\/COMST.2014.2320099","article-title":"Machine learning in wireless sensor networks: Algorithms, strategies, and applications","volume":"16","author":"Alsheikh","year":"2014","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_25","first-page":"105","article-title":"A Study of Machine Learning in Wireless Sensor Network","volume":"4","author":"Khan","year":"2017","journal-title":"Int. J. Comput. Netw. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.knosys.2017.09.032","article-title":"Active and adaptive ensemble learning for online activity recognition from data streams","volume":"138","author":"Krawczyk","year":"2017","journal-title":"Knowl.-Based Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1583","DOI":"10.1016\/j.csda.2005.01.014","article-title":"Nonparametric estimation of the coefficient of overlapping\u2014Theory and empirical application","volume":"50","author":"Schmid","year":"2006","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3851","DOI":"10.1080\/03610928908830127","article-title":"The overlapping coefficient as a measure of agreement between probability distributions and point estimation of the overlap of two normal densities","volume":"18","author":"Inman","year":"1989","journal-title":"Commun. Stat.-Theory Methods"},{"key":"ref_29","unstructured":"Simard, P.Y., Amershi, S., Chickering, D.M., Pelton, A.E., Ghorashi, S., Meek, C., Ramos, G., Suh, J., Verwey, J., and Wang, M. (2017). Machine teaching: A new paradigm for building machine learning systems. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1142\/S0218001405003983","article-title":"Exploring conditions for the optimality of naive Bayes","volume":"19","author":"Zhang","year":"2005","journal-title":"Int. J. Pattern Recogn. Artif. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/477\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:28:28Z","timestamp":1760185708000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/477"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,24]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19030477"],"URL":"https:\/\/doi.org\/10.3390\/s19030477","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,1,24]]}}}