{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T09:43:58Z","timestamp":1774950238462,"version":"3.50.1"},"reference-count":70,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T00:00:00Z","timestamp":1694563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Mid-level vision is the intermediate visual processing stage for generating representations of shapes and partial geometries of objects. Our mechanistic understanding of these operations is limited, in part, by a lack of computational tools for analyzing image properties at these levels of representation. We introduce the Mid-Level Vision (MLV) Toolbox, an open-source software that automatically processes low- and mid-level contour features and perceptual grouping cues from real-world images. The MLV toolbox takes vectorized line drawings of scenes as input and extracts structural contour properties. We also include tools for contour detection and tracing for the automatic generation of vectorized line drawings from photographs. Various statistical properties of the contours are computed: the distributions of orientations, contour curvature, and contour lengths, as well as counts and types of contour junctions. The toolbox includes an efficient algorithm for computing the medial axis transform of contour drawings and photographs. Based on the medial axis transform, we compute several scores for local mirror symmetry, local parallelism, and local contour separation. All properties are summarized in histograms that can serve as input into statistical models to relate image properties to human behavioral measures, such as esthetic pleasure, memorability, affective processing, and scene categorization. In addition to measuring contour properties, we include functions for manipulating drawings by separating contours according to their statistical properties, randomly shifting contours, or rotating drawings behind a circular aperture. Finally, the MLV Toolbox offers visualization functions for contour orientations, lengths, curvature, junctions, and medial axis properties on computer-generated and artist-generated line drawings. We include artist-generated vectorized drawings of the Toronto Scenes image set, the International Affective Picture System, and the Snodgrass and Vanderwart object images, as well as automatically traced vectorized drawings of set architectural scenes and the Open Affective Standardized Image Set (OASIS).<\/jats:p>","DOI":"10.3389\/fcomp.2023.1140723","type":"journal-article","created":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T19:44:36Z","timestamp":1694634276000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["The mid-level vision toolbox for computing structural properties of real-world images"],"prefix":"10.3389","volume":"5","author":[{"given":"Dirk B.","family":"Walther","sequence":"first","affiliation":[]},{"given":"Delaram","family":"Farzanfar","sequence":"additional","affiliation":[]},{"given":"Seohee","family":"Han","sequence":"additional","affiliation":[]},{"given":"Morteza","family":"Rezanejad","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"key":"ref1","volume-title":"Art and visual perception: A psychology of the creative eye","author":"Arnheim","year":"1965"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"108092","DOI":"10.1016\/j.neuropsychologia.2021.108092","article-title":"Skeletal representations of shape in the human visual cortex","volume":"164","author":"Ayzenberg","year":"2022","journal-title":"Neuropsychologia"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"9359","DOI":"10.1038\/s41598-019-45268-y","article-title":"Skeletal descriptions of shape provide unique perceptual information for object recognition","volume":"9","author":"Ayzenberg","year":"2019","journal-title":"Sci. Rep."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1037\/0033-295X.94.2.115","article-title":"Recognition-by-components: a theory of human image understanding","volume":"94","author":"Biederman","year":"1987","journal-title":"Psychol. Rev."},{"key":"ref5","volume-title":"A transformation for extracting new descriptions of shape","author":"Blum","year":"1967"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1523\/JNEUROSCI.3733-14.2015","article-title":"The causal role of the occipital face area (OFA) and lateral occipital (LO) cortex in symmetry perception","volume":"35","author":"Bona","year":"2015","journal-title":"J. Neurosci."},{"key":"ref7","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/j.cortex.2013.11.004","article-title":"The causal role of the lateral occipital complex in visual mirror symmetry detection and grouping: an fMRI-guided TMS study","volume":"51","author":"Bona","year":"2014","journal-title":"Cortex"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S0140525X22002813","article-title":"Deep problems with neural network models of human vision","volume":"1","author":"Bowers","year":"2022","journal-title":"Behav. Brain Sci."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"e1003963","DOI":"10.1371\/journal.pcbi.1003963","article-title":"Deep neural networks rival the representation of primate IT cortex for core visual object recognition","volume":"10","author":"Cadieu","year":"2014","journal-title":"PLoS Comput. Biol."},{"key":"ref10","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780197513620.003.0001","article-title":"An early framework for a cognitive neuroscience of visual aesthetics","volume-title":"Brain, beauty, & art","author":"Chatterjee","year":"2022"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.neuroimage.2016.04.021","article-title":"Contour junctions underlie neural representations of scene categories in high-level human visual cortex","volume":"135","author":"Choo","year":"2016","journal-title":"NeuroImage"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-021-99044-y","article-title":"Contour features predict valence and threat judgements in scenes","volume":"11","author":"Damiano","year":"","journal-title":"Sci. Rep."},{"key":"ref13","doi-asserted-by":"publisher","first-page":"35","DOI":"10.3758\/s13414-018-1594-8","article-title":"Mid-level feature contributions to category-specific gaze guidance","volume":"81","author":"Damiano","year":"2019","journal-title":"Atten. Percept. Psychophys."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1037\/aca0000398","article-title":"The role of local and global symmetry in pleasure, interest, and complexity judgments of natural scenes","volume":"17","author":"Damiano","year":"","journal-title":"Psychol. Aesthet. Creat. Arts"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.cognition.2005.03.004","article-title":"Segmentation of object outlines into parts: a large-scale integrative study","volume":"99","author":"De Winter","year":"2006","journal-title":"Cognition"},{"key":"ref16","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/1-4020-2081-3_4","article-title":"Gestalt theory and computer vision","author":"Desolneux","year":"2004","journal-title":"Seeing, thinking and knowing: Meaning and self-organisation in visual cognition and thought"},{"key":"ref17","volume-title":"From gestalt theory to image analysis: A probabilistic approach","author":"Desolneux","year":"2007"},{"key":"ref18","first-page":"1841","article-title":"Structured forests for fast edge detection","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Doll\u00e1r","year":"2013"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"1558","DOI":"10.1109\/TPAMI.2014.2377715","article-title":"Fast edge detection using structured forests","volume":"37","author":"Doll\u00e1r","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref20","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1167\/2.4.5","article-title":"Ecological statistics of gestalt laws for the perceptual organization of contours","volume":"2","author":"Elder","year":"2002","journal-title":"J. Vis."},{"key":"ref21","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1016\/0042-6989(93)90080-G","article-title":"The effect of contour closure on the rapid discrimination of two-dimensional shapes","volume":"33","author":"Elder","year":"1993","journal-title":"Vis. Res."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1080\/02643290125929","article-title":"Neuropsychological evidence for a topographical learning mechanism in parahippocampal cortex","volume":"18","author":"Epstein","year":"2001","journal-title":"Cogn. Neuropsychol."},{"key":"ref23","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1038\/33402","article-title":"A cortical representation of the local visual environment","volume":"392","author":"Epstein","year":"1998","journal-title":"Nature"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1177\/09567976231190546","article-title":"Changing What You Like: Modifying Contour Properties Shifts Aesthetic Valuations of Scenes","author":"Farzanfar","year":"2023","journal-title":"Psychol. Sci."},{"key":"ref25","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1037\/0033-295X.112.1.243","article-title":"Information along contours and object boundaries","volume":"112","author":"Feldman","year":"2005","journal-title":"Psychol. Rev."},{"key":"ref26","doi-asserted-by":"publisher","first-page":"18014","DOI":"10.1073\/pnas.0608811103","article-title":"Bayesian estimation of the shape skeleton","volume":"103","author":"Feldman","year":"2006","journal-title":"Proc. Natl. Acad. Sci."},{"key":"ref27","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1016\/0042-6989(93)90156-Q","article-title":"Contour integration by the human visual system: evidence for a local \u201cassociation field\u201d","volume":"33","author":"Field","year":"1993","journal-title":"Vis. Res."},{"key":"ref28","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1177\/0956797613507584","article-title":"\u201cPlease tap the shape, anywhere you like\u201d shape skeletons in human vision revealed by an exceedingly simple measure","volume":"25","author":"Firestone","year":"2014","journal-title":"Psychol. Sci."},{"key":"ref29","doi-asserted-by":"publisher","first-page":"2718","DOI":"10.1152\/jn.1996.76.4.2718","article-title":"Neural responses to polar, hyperbolic, and Cartesian gratings in area V4 of the macaque monkey","volume":"76","author":"Gallant","year":"1996","journal-title":"J. Neurophysiol."},{"key":"ref30","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1016\/S0042-6989(00)00277-7","article-title":"Edge co-occurrence in natural images predicts contour grouping performance","volume":"41","author":"Geisler","year":"2001","journal-title":"Vis. Res."},{"key":"ref31","doi-asserted-by":"publisher","first-page":"10005","DOI":"10.1523\/JNEUROSCI.5023-14.2015","article-title":"Deep neural networks reveal a gradient in the complexity of neural representations across the ventral stream","volume":"35","author":"G\u00fc\u00e7l\u00fc","year":"2015","journal-title":"J. Neurosci."},{"key":"ref32","first-page":"5494","article-title":"Making memorability of scenes better or worse by manipulating their contour properties","volume-title":"J. Vis.","author":"Han","year":"2023"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1113\/jphysiol.1962.sp006837","article-title":"Receptive fields, binocular interaction and functional architecture in the cat\u2019s visual cortex","volume":"160","author":"Hubel","year":"1962","journal-title":"J. Physiol."},{"key":"ref34","doi-asserted-by":"publisher","first-page":"e1003915","DOI":"10.1371\/journal.pcbi.1003915","article-title":"Deep supervised, but not unsupervised, models may explain IT cortical representation","volume":"10","author":"Khaligh-Razavi","year":"2014","journal-title":"PLoS Comput. Biol."},{"key":"ref35","volume-title":"Principles of gestalt psychology","author":"Koffka","year":"1935"},{"key":"ref36","article-title":"ImageNet classification with deep convolutional neural networks","volume-title":"Advances in neural information processing systems","author":"Krizhevsky","year":"2012"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"182","DOI":"10.3758\/bf03200772","article-title":"The perceptual organization of dot lattices","volume":"1","author":"Kubovy","year":"1994","journal-title":"Psychon B Rev"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"457","DOI":"10.3758\/s13428-016-0715-3","article-title":"Introducing the open affective standardized image set (OASIS)","volume":"49","author":"Kurdi","year":"2017","journal-title":"Behav. Res. Methods"},{"key":"ref39","volume-title":"International affective picture system (IAPS): Affective ratings of pictures and instruction manual","author":"Lang","year":"2008"},{"key":"ref40","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1348\/0007126042369811","article-title":"A model of aesthetic appreciation and aesthetic judgments","volume":"95","author":"Leder","year":"2004","journal-title":"Brit J Psychol"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1016\/0004-3702(87)90070-1","article-title":"Three-dimensional object recognition from single two-dimensional images","volume":"31","author":"Lowe","year":"1987","journal-title":"Artif. Intell."},{"key":"ref42","volume-title":"Perceptual organization and visual recognition","author":"Lowe","year":"2012"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1167\/9.12.11","article-title":"The role of vertical mirror symmetry in visual shape detection","volume":"9","author":"Machilsen","year":"2009","journal-title":"J. Vis."},{"key":"ref44","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1016\/j.tics.2016.09.003","article-title":"Making sense of real-world scenes","volume":"20","author":"Malcolm","year":"2016","journal-title":"Trends Cogn. Sci."},{"key":"ref45","volume-title":"Vision: A computational investigation into the human representation and processing of visual information","author":"Marr","year":"1982"},{"key":"ref46","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1098\/rspb.1978.0020","article-title":"Representation and recognition of the spatial organization of three-diemnsional shapes","volume":"200","author":"Marr","year":"1978","journal-title":"Proccedings of the Royal Soc London B."},{"key":"ref47","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-04040-6","volume-title":"Hierarchical perceptual grouping for object recognition","author":"Michaelsen","year":"2019"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1167\/2.2.1","article-title":"Temporal dynamics of the human response to symmetry","volume":"2","author":"Norcia","year":"2002","journal-title":"J. Vis."},{"key":"ref49","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1038\/381607a0","article-title":"Emergence of simple-cell receptive field properties by learning a sparse code for natural images","volume":"381","author":"Olshausen","year":"1996","journal-title":"Nature"},{"key":"ref50","doi-asserted-by":"publisher","first-page":"1332","DOI":"10.1038\/972","article-title":"Population coding of shape in area V4","volume":"5","author":"Pasupathy","year":"2002","journal-title":"Nat. Neurosci."},{"key":"ref51","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1167\/15.7.5","article-title":"Understanding mid-level representations in visual processing","volume":"15","author":"Peirce","year":"2015","journal-title":"J. Vis."},{"key":"ref52","doi-asserted-by":"publisher","first-page":"1749","DOI":"10.1523\/JNEUROSCI.09-05-01749.1989","article-title":"Mechanisms of contour perception in monkey visual cortex. II. Contours bridging gaps","volume":"9","author":"Peterhans","year":"1989","journal-title":"J. Neurosci."},{"key":"ref53","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199922543.001.0001","volume-title":"Making a machine that sees like us","author":"Pizlo","year":"2014"},{"key":"ref54","volume-title":"Medial measures for recognition, mapping and categorization","author":"Rezanejad","year":"2020"},{"key":"ref55","first-page":"4116","article-title":"Scene categorization from contours: medial Axis based salience measures","author":"Rezanejad","year":"2019","journal-title":"Proc. IEEE Conf. Comput. Vis. Pattern Recognit."},{"key":"ref56","doi-asserted-by":"crossref","DOI":"10.1109\/TPAMI.2023.3333352","article-title":"Shape Based Measures Improve Scene Categorization. under review","author":"Rezanejad","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref57","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.conb.2007.03.003","article-title":"Processing local signals into global patterns","volume":"17","author":"Sasaki","year":"2007","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref58","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1016\/j.neuron.2020.07.040","article-title":"Integrative benchmarking to advance Neurally mechanistic models of human intelligence","volume":"108","author":"Schrimpf","year":"2020","journal-title":"Neuron"},{"key":"ref59","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1037\/0278-7393.6.2.174","article-title":"A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity","volume":"6","author":"Snodgrass","year":"1980","journal-title":"J. Exp. Psychol."},{"key":"ref60","doi-asserted-by":"publisher","first-page":"904","DOI":"10.1177\/03010066221124872","article-title":"Beautiful on the inside: aesthetic preferences and the skeletal complexity of shapes","volume":"51","author":"Sun","year":"2022","journal-title":"Perception"},{"key":"ref61","doi-asserted-by":"publisher","first-page":"10446","DOI":"10.1073\/pnas.1301227110","article-title":"Impact of contour on aesthetic judgments and approach-avoidance decisions in architecture","volume":"110","author":"Vartanian","year":"2013","journal-title":"Proc National Acad Sci"},{"key":"ref62","doi-asserted-by":"publisher","first-page":"1273","DOI":"10.1126\/science.287.5456.1273","article-title":"Sparse coding and decorrelation in primary visual cortex during natural vision","volume":"287","author":"Vinje","year":"2000","journal-title":"Science"},{"key":"ref63","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1037\/0096-1523.19.2.364","article-title":"Skewed symmetry: a nonaccidental property used to perceive visual forms","volume":"19","author":"Wagemans","year":"1993","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"ref64","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1016\/s1364-6613(97)01105-4","article-title":"Characteristics and models of human symmetry detection","volume":"1","author":"Wagemans","year":"1997","journal-title":"Trends Cogn. Sci."},{"key":"ref65","doi-asserted-by":"publisher","first-page":"1172","DOI":"10.1037\/a0029333","article-title":"A century of gestalt psychology in visual perception: I. perceptual grouping and figure\u2013ground organization","volume":"138","author":"Wagemans","year":"2012","journal-title":"Psychol. Bull."},{"key":"ref66","doi-asserted-by":"publisher","first-page":"851","DOI":"10.1177\/0956797613512662","article-title":"Nonaccidental properties underlie human categorization of complex natural scenes","volume":"25","author":"Walther","year":"2014","journal-title":"Psychol. Sci."},{"key":"ref67","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1007\/BF00410385","article-title":"Untersuchungen zur Lehre von der Gestalt, I: Prinzipielle Bemerkungen [Investigations in Gestalt theory: I. The general theoretical situation]","volume":"1","author":"Wertheimer","year":"1922","journal-title":"Psychol. Forsch."},{"key":"ref68","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1167\/18.8.1","article-title":"Spatial relationships between contours impact rapid scene classification","volume":"18","author":"Wilder","year":"2018","journal-title":"J. Vis."},{"key":"ref69","doi-asserted-by":"publisher","first-page":"e0260266","DOI":"10.1371\/journal.pone.0260266","article-title":"Neural correlates of local parallelism during naturalistic vision","volume":"17","author":"Wilder","year":"2022","journal-title":"PLoS One"},{"key":"ref70","doi-asserted-by":"publisher","first-page":"8619","DOI":"10.1073\/pnas.1403112111","article-title":"Performance-optimized hierarchical models predict neural responses in higher visual cortex","volume":"111","author":"Yamins","year":"2014","journal-title":"Proc. Natl. Acad. Sci."}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1140723\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,21]],"date-time":"2023-12-21T18:59:52Z","timestamp":1703185192000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1140723\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,13]]},"references-count":70,"alternative-id":["10.3389\/fcomp.2023.1140723"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2023.1140723","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,13]]},"article-number":"1140723"}}