{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:25:28Z","timestamp":1760243128915,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2015,8,6]],"date-time":"2015-08-06T00:00:00Z","timestamp":1438819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The fruit fly Drosophila Melanogaster has become a model organism in the study of neurobiology and behavior patterns. The analysis of the way the fly moves and its behavior is of great scientific interest for research on aspects such as drug tolerance, aggression or ageing in humans. In this article, a procedure for detecting, identifying and tracking numerous specimens of Drosophila by means of computer vision-based sensing systems is presented. This procedure allows dynamic information about each specimen to be collected at each moment, and then for its behavior to be quantitatively characterized. The proposed algorithm operates in three main steps: a pre-processing step, a detection and segmentation step, and tracking shape. The pre-processing and segmentation steps allow some limits of the image acquisition system and some visual artifacts (such as shadows and reflections) to be dealt with. The improvements introduced in the tracking step allow the problems corresponding to identity loss and swaps, caused by the interaction between individual flies, to be solved efficiently. Thus, a robust method that compares favorably to other existing methods is obtained.<\/jats:p>","DOI":"10.3390\/s150819369","type":"journal-article","created":{"date-parts":[[2015,8,7]],"date-time":"2015-08-07T02:11:56Z","timestamp":1438913516000},"page":"19369-19392","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Automated Tracking of Drosophila Specimens"],"prefix":"10.3390","volume":"15","author":[{"given":"Rub\u00e9n","family":"Chao","sequence":"first","affiliation":[{"name":"University of Valladolid, Paseo del Cauce 59. Valladolid 47011, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Germ\u00e1n","family":"Mac\u00eda-V\u00e1zquez","sequence":"additional","affiliation":[{"name":"University of Valladolid, Paseo del Cauce 59. Valladolid 47011, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eduardo","family":"Zalama","sequence":"additional","affiliation":[{"name":"University of Valladolid, Instituto de las Tecnolog\u00edas Avanzadas de la Producci\u00f3n,  Paseo del Cauce 59. Valladolid 47011, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4763-5356","authenticated-orcid":false,"given":"Jaime","family":"G\u00f3mez-Garc\u00eda-Bermejo","sequence":"additional","affiliation":[{"name":"University of Valladolid, Instituto de las Tecnolog\u00edas Avanzadas de la Producci\u00f3n,  Paseo del Cauce 59. Valladolid 47011, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jos\u00e9-Ram\u00f3n","family":"Per\u00e1n","sequence":"additional","affiliation":[{"name":"Fundaci\u00f3n Cartif, Parque Tecnol\u00f3gico de Boecillo, Valladolid 47151, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,8,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1002\/neu.10166","article-title":"Invertebrate models of drug abuse","volume":"54","author":"Wolf","year":"2003","journal-title":"J. Neurobiol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/S0074-7742(03)54006-5","article-title":"Drosophila melanogaster, a genetic model systemfor alcohol research","volume":"54","author":"Guarnieri","year":"2003","journal-title":"Int. Rev. Neurobiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"19577","DOI":"10.1073\/pnas.0709803104","article-title":"Specific subgroups of FruM neurons control sexuallydimorphic patterns of aggression in Drosophila melanogaster","volume":"104","author":"Chan","year":"2007","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.cub.2007.12.052","article-title":"Octopamine in male aggression of Drosophila","volume":"18","author":"Hoyer","year":"2008","journal-title":"Curr. Biol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1016\/S0076-6879(05)93041-3","article-title":"Drosophila melanogaster: An insect model for fundamentalstudies of sleep","volume":"393","author":"Ho","year":"2005","journal-title":"Methods Enzymol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.exger.2007.10.008","article-title":"Drosophila aging","volume":"43","author":"Shaw","year":"2008","journal-title":"Exp. Gerontol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"S255","DOI":"10.1016\/S0197-4580(04)80856-X","article-title":"P2\u2013109 Drosophila modelsof Alzheimer\u2019s-related pathways","volume":"25","author":"Konsolaki","year":"2004","journal-title":"Neurobiol. Aging"},{"key":"ref_8","unstructured":"Manuela, C.E., Diego, S.M., and Dolores, G. (2010). Qu\u00e9 hace Lazarillo Glial? Pregunt\u00e9mosle a las Ataxias Espinocerebelosas, Instituto de Biolog\u00eda y Gen\u00e9tica Molecular-Departamento de Bioqu\u00edmica y Biolog\u00eda Molecular y Fisiolog\u00eda."},{"key":"ref_9","unstructured":"Piccardi, M. (2015, January 10\u201313). Background subtraction techniques: A review. Proceedings of the 2004 IEEE International Conference on Systems, Man and Cybernetics, The Hague, The Netherlands."},{"key":"ref_10","unstructured":"Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer Vision with the OpenCV Library, O\u2019Reilly Media, Inc."},{"key":"ref_11","first-page":"2330","article-title":"Robust background subtraction with foreground validation for Urban Traffic Video","volume":"14","author":"Cheung","year":"2005","journal-title":"J. Appl. Signal Proc."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MRA.2005.1411416","article-title":"Tracking all traffic: computer vision algorithms for monitoring vehicles, individuals, and crowds","volume":"12","author":"Maurin","year":"2005","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1145\/882262.882309","article-title":"Free-Viewpoint Video of Human Actors","volume":"22","author":"Carranza","year":"2003","journal-title":"ACM Trans. Graph."},{"key":"ref_14","unstructured":"Horprasert, T., Haritaoglu, I., Wren, C., Harwood, D., Davis, L., and Pentland, A. (1998, January 5\u20136). Real-time 3D motion capture. Proceedings of the Workshop on Perceptual User Interfaces, San Francisco, CA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/S0260-8774(03)00183-3","article-title":"Improving quality inspection of food products by computer vision\u2014A review","volume":"61","author":"Brosnan","year":"2004","journal-title":"J. Food Eng."},{"key":"ref_16","unstructured":"Warren, J. (2003). Unencumbered Full Body Interaction in Video Games. [Master\u2019s Thesis, MFA Design and Technology, Parsons School of Design]. (Unpublished)."},{"key":"ref_17","unstructured":"Semani, D., Bouwmans, T., Fr\u00e9licot, C., and Courtellemont, P. (2002, January 14\u201318). Automatic fish recognition in interactive live videos. Proceedings of the IVRCIA2002, Orlando, FL, USA."},{"key":"ref_18","unstructured":"Lee, B., and Hedley, M. (2002, January 22\u201328). Background estimation for video surveillance. Proceedings of the Image and Vision Computing New Zealand (IVCNZ 2002), Auckland, New Zealand."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1177\/0361198106194400111","article-title":"Extracting roadway background image: A mode based approach","volume":"1944","author":"Zheng","year":"2006","journal-title":"J. Transp. Res. Rep."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"El Baf, F., Bouwmans, T., and Vachon, B. (2008, January 1\u20136). Fuzzy integral for moving object detection. Proceedings of the IEEE International Conference on Fuzzy Systems (FUZZ-IEEE2008), Hong Kong, China.","DOI":"10.1109\/FUZZY.2008.4630604"},{"key":"ref_21","first-page":"138","article-title":"Fuzzy running average and fuzzy background subtraction: Concepts and application","volume":"8","author":"Sigari","year":"2008","journal-title":"Int. J. Comput. Sci. Netw. Secur."},{"key":"ref_22","unstructured":"Messelodi, S., Modena, C.M., Segata, N., and Zanin, M. (2005). Image Analysis and Processing\u2013ICIAP 2005, Springer."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1109\/TPAMI.2003.1233909","article-title":"Detecting Moving Objects, Ghosts, and Shadows in Video Streams","volume":"25","author":"Cucchiara","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","unstructured":"Wang, H., and Suter, D. (2006). Computer Vision\u2013ACCV 2006, Springer."},{"key":"ref_25","unstructured":"Porikli, F., and Tuzel, O. (, January October). Human body tracking by adaptive background models and mean-shift analysis. Proceedings of the IEEE International Workshop on Performance Evaluation of Tracking and Surveillance, Nice, France."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Porikli, F., and Tuzel, O. (2005, January 1\u20132). Bayesian background modeling for foreground detection. Proceedings of the Third ACM International Workshop on Video Surveillance & Sensor networks, New York, NY, USA.","DOI":"10.1145\/1099396.1099407"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1536","DOI":"10.1109\/MPRV.2010.86","article-title":"Toward Mobile Eye-Based Human-Computer Interaction","volume":"9","author":"Bulling","year":"2010","journal-title":"IEEE Pervasive Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1038\/nmeth.1328","article-title":"High-Throughput ethomics in large groups of Drosophila","volume":"6","author":"Branson","year":"2009","journal-title":"Nat. Methods"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1145\/1177352.1177355","article-title":"Object tracking: A survey","volume":"38","author":"Yilmaz","year":"2006","journal-title":"ACM Comput. Surv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/34.868683","article-title":"W 4: Real-time surveillance of people and their activities","volume":"22","author":"Haritaoglu","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Comaniciu, D., and Meer, P. (1999, January 20\u201327). Mean shift analysis and applications. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790416"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1023\/A:1007939232436","article-title":"Eigentracking: Robust matching and tracking of articulated objects using a view-based representation","volume":"26","author":"Black","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/34.899946","article-title":"Resolving motion correspondence for densely moving points","volume":"23","author":"Veenman","year":"2001","journal-title":"IEEE Trans. Patt. Analy. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1002\/rob.21402","article-title":"The Multi-Iterative Closest Point Tracker: An online algorithm for tracking multiple interacting targets","volume":"29","author":"Feldman","year":"2012","journal-title":"J. Field Robot."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1038\/nmeth.2994","article-title":"idTracker: Tracking individuals in a group by automatic identification of unmarked animals","volume":"11","author":"Hinz","year":"2014","journal-title":"Nat. Methods"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.beproc.2004.04.003","article-title":"A portrait of locomotor behaviour in Drosophila determined by a video-tracking paradigm","volume":"67","author":"Martin","year":"2004","journal-title":"Behav. Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.jneumeth.2007.01.005","article-title":"Computer automated movement detection for the analysis of behavior","volume":"162","author":"Ramazani","year":"2007","journal-title":"J. Neurosci. Methods"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"e1083","DOI":"10.1371\/journal.pone.0001083","article-title":"Analysis of the Trajectory of Drosophila melanogaster in a Circular Open Field Arena","volume":"2","author":"Valente","year":"2007","journal-title":"PLoS ONE"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1038\/nmeth.1310","article-title":"Automated monitoring and analysis of social behavior in Drosophila","volume":"6","author":"Dankert","year":"2009","journal-title":"Nat. Methods"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e37250","DOI":"10.1371\/journal.pone.0037250","article-title":"High-Resolution Positional Tracking for Long-Term Analysis of Drosophila Sleep and Locomotion Using the \u201cTracker\u201d Program","volume":"7","author":"Donelson","year":"2012","journal-title":"PLoS ONE"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"995","DOI":"10.1038\/nprot.2012.041","article-title":"Video tracking and analysis of sleep in Drosophila melanogaster","volume":"7","author":"Gilestro","year":"2012","journal-title":"Nat. Protoc."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"20120547","DOI":"10.1098\/rsif.2012.0547","article-title":"Three-Dimensional tracking and behaviour monitoring of multiple fruit flies","volume":"10","author":"Ardekani","year":"2013","journal-title":"J. R. Soc. Interface"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1186\/1756-0500-2-58","article-title":"Simultaneous tracking of movement and gene expression in multiple Drosophila melanogaster flies using GFP and DsRED fluorescent reporter transgenes","volume":"2","author":"Grover","year":"2009","journal-title":"BMC Res. Notes"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1038\/nmeth.2973","article-title":"FlyMAD: Rapid thermogenetic control of neuronal activity in freely walking Drosoph","volume":"11","author":"Bath","year":"2014","journal-title":"Nat. Methods"},{"key":"ref_45","unstructured":"Noldus Ethnovisi\u00f3n. Available online: http:\/\/www.noldus.com\/animal-behavior-research\/products\/."},{"key":"ref_46","unstructured":"Biotrack. Available online: http:\/\/www.bio-tracking.org\/category\/software\/."},{"key":"ref_47","unstructured":"idTracker. Available online: http:\/\/www.idtracker.es."},{"key":"ref_48","unstructured":"C-Trax. Available online: http:\/\/ctrax.sourceforge.net\/."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A computational approach to edge detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","first-page":"120","article-title":"Finding circles by an array of accumulators","volume":"18","author":"Kimme","year":"1975","journal-title":"Commun. Assoc. Comput. Mach."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1080\/01621459.1993.10476408","article-title":"Alternatives to the median absolute deviation","volume":"88","author":"Rousseeuw","year":"1993","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/TPAMI.1986.4767755","article-title":"Estimation of object motion parameters from noisy images","volume":"8","author":"Broida","year":"1986","journal-title":"IEEE Trans. Patt. Analy. Mach. Intell."},{"key":"ref_53","unstructured":"Greg, W., and Gary, B. (2005). An Introduction to the Kalman Filter, Department of Computer Science, University of North Carolina at Chapel Hill."},{"key":"ref_54","unstructured":"Maybeck, P.S. (1982). Stochastic Models, Estimation, and Control, Academic Press."},{"key":"ref_55","unstructured":"Perez, M. (2009). M\u00e9todo de cuantificaci\u00f3n del ruido en el Filtro de Kalman, Observadores de Estado en Proceso Estoc\u00e1sticos."},{"key":"ref_56","unstructured":"Papadimitriou, C.H., and Steiglitz, K. (1982). Combinatorial Optimization: Algorithms and Complexity, Prentice Hall."},{"key":"ref_57","unstructured":"Supplementary Downloads. Available online: http:\/\/www.eii.uva.es\/%7Eeduzal\/Drosophila\/."},{"key":"ref_58","unstructured":"DTrack. Available online: https:\/\/github.com\/RubenChao\/tracking-drosophila."},{"key":"ref_59","unstructured":"Video demonstration. Available online: https:\/\/www.youtube.com\/watch?v=ANLpvIK59Qc."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/8\/19369\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:50:19Z","timestamp":1760215819000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/8\/19369"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,8,6]]},"references-count":59,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2015,8]]}},"alternative-id":["s150819369"],"URL":"https:\/\/doi.org\/10.3390\/s150819369","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2015,8,6]]}}}