{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:20:37Z","timestamp":1750306837277,"version":"3.41.0"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,2,24]],"date-time":"2015-02-24T00:00:00Z","timestamp":1424736000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2015,2,24]]},"abstract":"<jats:p>This article concerns the design of effective computer vision programming exercises and presents a novel means of designing these assignments. We describe three recent case studies designed to evaluate the effectiveness of assigning graduate-level computer vision students with publicly available research benchmarks as competitive assignments. This was done rather than assigning more traditional exercises that require students to implement specific algorithms or applications. We allowed our students the freedom of designing or choosing their own methods, with the goal of obtaining the best performance on the benchmark chosen for each assignment. Students, therefore, competed against each other, as well as published state of the art. We detail the design, application, and results of these benchmark exercises. We show that not only are these benchmarks easily adapted for the classroom, but also that in some cases, student assignments matched published state-of-the-art performance. This observation provides strong evidence to support the effectiveness of the proposed exercise design. We conclude by discussing the benefits and drawbacks of these exercises compared to those traditionally employed in computer vision classrooms.<\/jats:p>","DOI":"10.1145\/2597627","type":"journal-article","created":{"date-parts":[[2015,3,3]],"date-time":"2015-03-03T14:08:19Z","timestamp":1425391699000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Teaching Computer Vision"],"prefix":"10.1145","volume":"14","author":[{"given":"Tal","family":"Hassner","sequence":"first","affiliation":[{"name":"The Open University of Israel, Israel"}]},{"given":"Itzik","family":"Bayaz","sequence":"additional","affiliation":[{"name":"The Open University of Israel, Israel"}]}],"member":"320","published-online":{"date-parts":[[2015,2,24]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2010.10.006"},{"volume-title":"Proceedings of the International Conference on Image Processing. IEEE","author":"Ballan L.","key":"e_1_2_1_2_1"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2002.808280"},{"key":"e_1_2_1_4_1","unstructured":"C. M. Bishop. 2006. Pattern Recognition and Machine Learning (Vol. 4). Springer New York NY. C. M. Bishop. 2006. Pattern Recognition and Machine Learning (Vol. 4). Springer New York NY."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.28"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2010.02.018"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"volume-title":"Retrieved","year":"2012","author":"Columbia University","key":"e_1_2_1_8_1"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022627411411"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2011.6142904"},{"volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition.","author":"Deng J.","key":"e_1_2_1_11_1"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/11736790_8"},{"volume-title":"Retrieved","year":"2013","author":"Homepage Face Recognition","key":"e_1_2_1_13_1"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2005.09.012"},{"key":"e_1_2_1_15_1","volume-title":"Computer Vision: A Modern Approach","author":"Forsyth D. A.","year":"2011","edition":"2"},{"volume-title":"Proceedings of the 11th European Conference on Computer Vision: Part IV. 1--14","author":"Gao S.","key":"e_1_2_1_16_1"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.927464"},{"volume-title":"Proceedings of the Workshop on Education and Practice in Artificial Vision. 101--104","author":"Gonzalez Y.","key":"e_1_2_1_18_1"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70711"},{"key":"e_1_2_1_20_1","unstructured":"G. Griffin A. Holub and P. Perona. 2007. Caltech-256 object category dataset. G. Griffin A. Holub and P. Perona. 2007. Caltech-256 object category dataset."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2009.08.002"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2013.43"},{"volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition Workshops. IEEE","author":"Hassner T.","key":"e_1_2_1_23_1"},{"volume-title":"Proceedings of the 11th International Conference on Computer Vision. IEEE","author":"Huang G. B","key":"e_1_2_1_24_1"},{"volume-title":"Wild: A Database for Studying Face Recognition in Unconstrained Environments. Technical Report 07-49","year":"2007","author":"Huang G. B.","key":"e_1_2_1_25_1"},{"key":"e_1_2_1_26_1","unstructured":"D. W. Johnson and R. T. Johnson. 1987. Learning Together and Alone: Cooperative Competitive and Individualistic Learning. Prentice Hall. D. W. Johnson and R. T. Johnson. 1987. Learning Together and Alone: Cooperative Competitive and Individualistic Learning. Prentice Hall."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.209"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2012.01.007"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/1059888.1059955"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2004.825053"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.68"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2010.2048215"},{"volume-title":"Proceedings of the International Conference on Computer Vision. IEEE","author":"Li L. J.","key":"e_1_2_1_33_1"},{"volume-title":"Visual Analysis of Humans","author":"Liu H.","key":"e_1_2_1_34_1"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001498000580"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218001401001131"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/566522.566526"},{"volume":"6493","volume-title":"Lecture Notes in Computer Science","author":"Nguyen H. V.","key":"e_1_2_1_39_1"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140123.1140192"},{"volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition.","author":"Philbin J.","key":"e_1_2_1_41_1"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.268"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2008.928198"},{"volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition. IEEE","author":"Rohrbach M.","key":"e_1_2_1_44_1"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2007.906778"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018429.1020906"},{"volume-title":"Retrieved","year":"2011","author":"Ranking Shanghai","key":"e_1_2_1_47_1"},{"volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition Workshops. IEEE","author":"Sun X.","key":"e_1_2_1_48_1"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"R. Szeliski. 2010. Computer Vision: Algorithms and Applications. Springer-Verlag. R. Szeliski. 2010. Computer Vision: Algorithms and Applications. Springer-Verlag.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2007.04.006"},{"volume-title":"Retrieved","year":"2011","author":"Universities Top","key":"e_1_2_1_51_1"},{"volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition. 586--591","author":"Turk M. A.","key":"e_1_2_1_52_1"},{"volume-title":"VLFeat: An Open and Portable Library of Computer Vision Algorithms. Retrieved","year":"2014","author":"Vedaldi A.","key":"e_1_2_1_53_1"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.43"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.07.013"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995566"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12304-7_9"},{"volume-title":"Proceedings of the Conference on Computer Vision Pattern Recognition. IEEE","author":"Xiao J.","key":"e_1_2_1_58_1"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.07.017"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2010.2052461"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2597627","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2597627","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:09:58Z","timestamp":1750234198000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2597627"}},"subtitle":["Bringing Research Benchmarks to the Classroom"],"short-title":[],"issued":{"date-parts":[[2015,2,24]]},"references-count":60,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,2,24]]}},"alternative-id":["10.1145\/2597627"],"URL":"https:\/\/doi.org\/10.1145\/2597627","relation":{},"ISSN":["1946-6226"],"issn-type":[{"type":"electronic","value":"1946-6226"}],"subject":[],"published":{"date-parts":[[2015,2,24]]},"assertion":[{"value":"2013-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-02-24","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}