{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T07:00:59Z","timestamp":1758265259762,"version":"3.41.0"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2006,4,1]],"date-time":"2006-04-01T00:00:00Z","timestamp":1143849600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Comput. Entertain."],"published-print":{"date-parts":[[2006,4]]},"abstract":"<jats:p>This work presents the results from a joint usability study concerning the LEGO programming environment \"RoboLab\". LEGO has already performed numerous evaluations on various usability aspects, aimed to enhance the overall usability and utility of the product. This study focuses on a more academic parameter; namely, the combination of different evaluation methods on the same software piece, as well as on their combined results. Therefore, two expert-based methods have been applied at the Department of Informatics of Aristotle University: a cognitive graphical walkthrough and a heuristic evaluation. The results of the study unveiled some deficiencies of the interface and some limitations of the employed methods as well.<\/jats:p>","DOI":"10.1145\/1129006.1129017","type":"journal-article","created":{"date-parts":[[2006,5,8]],"date-time":"2006-05-08T16:09:20Z","timestamp":1147104560000},"page":"6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Evaluating the LEGO--RoboLab interface with experts"],"prefix":"10.1145","volume":"4","author":[{"given":"Athanasis","family":"Karoulis","sequence":"first","affiliation":[{"name":"Aristotle University of Thessaloniki, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2006,4]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"29","volume-title":"Proceedings of the 9th EuroLOGO Conference","author":"Ackermann E.","year":"2003"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.5555\/228067.228071"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/248739.248744"},{"key":"e_1_2_1_4_1","unstructured":"ISO\n\n  \n   (1998) ISO 9241. International Standarization Organization. Ergonomic requirements for office work with visual display terminals (VDT's) Part 10 Dialogue Principles.  ISO (1998) ISO 9241. International Standarization Organization. Ergonomic requirements for office work with visual display terminals (VDT's) Part 10 Dialogue Principles."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142873"},{"first-page":"369","volume-title":"Proceedings of the Applied Informatics 2000 Conference","author":"Karoulis A.","key":"e_1_2_1_6_1"},{"volume-title":"Proceedings of the EDEN 4th Open Classroom Conference","author":"Karoulis A.","key":"e_1_2_1_7_1"},{"key":"e_1_2_1_8_1","first-page":"89","article-title":"Heuristic evaluation of web-based ODL programs. In Usability Evaluation of On-Line Learning Programs, Claude Ghaoui (ed.). Information Science, Hershey","author":"Karoulis A.","year":"2002","journal-title":"PA"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Karoulis A. Demetriades S. and Pombortsis A. 2005a. Cognitive graphical walkthrough: An interface evaluation method. In Encyclopedia of HCI. IDEA Group (to appear).  Karoulis A. Demetriades S. and Pombortsis A. 2005a. Cognitive graphical walkthrough: An interface evaluation method. In Encyclopedia of HCI. IDEA Group (to appear).","DOI":"10.4018\/978-1-59140-562-7.ch012"},{"key":"e_1_2_1_10_1","unstructured":"Lewis C. and Rieman J. 1994. Task-centered user interface design - A practical introduction. Retrieved Sept.9 2003 from ftp:\/\/ftp.cs.colorado.edu\/pub\/cs\/distribs\/clewis\/HCI-Design-Book\/  Lewis C. and Rieman J. 1994. Task-centered user interface design - A practical introduction. Retrieved Sept.9 2003 from ftp:\/\/ftp.cs.colorado.edu\/pub\/cs\/distribs\/clewis\/HCI-Design-Book\/"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97279"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0071361"},{"key":"e_1_2_1_13_1","unstructured":"Mindell D. Beland C. Wesley C. Clarke D. Park R. and Trupiano M. 2000. LEGO mindstorms the structure of an engineering (r)evolution 6.933J Structure of Engineering Revolutions http:\/\/web.mit.edu\/6.933\/www\/Fall2000\/LegoMindstorms.pdf.  Mindell D. Beland C. Wesley C. Clarke D. Park R. and Trupiano M. 2000. LEGO mindstorms the structure of an engineering (r)evolution 6.933J Structure of Engineering Revolutions http:\/\/web.mit.edu\/6.933\/www\/Fall2000\/LegoMindstorms.pdf."},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Nielsen J. 1993. Usability Engineering. Academic Press San Diego CA.   Nielsen J. 1993. Usability Engineering. Academic Press San Diego CA.","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"e_1_2_1_15_1","unstructured":"Nielsen J. 1994. Heuristic evaluation. In Usability Inspection Methods J. Nielsen and R.L. Mack (eds.) John Wiley & Sons New York.   Nielsen J. 1994. Heuristic evaluation. In Usability Inspection Methods J. Nielsen and R.L. Mack (eds.) John Wiley & Sons New York."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97281"},{"volume-title":"Mindstorms: Children, Computers and Powerful Ideas","year":"1980","author":"Papert S.","key":"e_1_2_1_17_1"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Piaget J. 1952. The Origins of Intelligence in Children. International University Press New York.  Piaget J. 1952. The Origins of Intelligence in Children. International University Press New York.","DOI":"10.1037\/11494-000"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(92)90039-N"},{"key":"e_1_2_1_20_1","unstructured":"Preece J. Rogers Y. Sharp H. Benyon D. Holland S. and Carey T. 1994. Human-Computer Interaction. Addison-Wesley Reading MA.   Preece J. Rogers Y. Sharp H. Benyon D. Holland S. and Carey T. 1994. Human-Computer Interaction. Addison-Wesley Reading MA."},{"key":"e_1_2_1_21_1","first-page":"1","article-title":"Evaluating technology-based learning. In The ASTD Handbook of Instructional Technology, G.M. Piskurich (ed). McGraw-Hill","volume":"15","author":"Reeves T.C.","year":"1993","journal-title":"New York."},{"key":"e_1_2_1_22_1","unstructured":"Resnick M. Berg R. Eisenberg M. and Turkle S. 1997. Beyond black boxes: Bringing transparency and aesthetics back to scientific instruments. http:\/\/el.www.media.mit.edu\/groups\/el\/papers\/mres\/blackbox\/proposal.html.  Resnick M. Berg R. Eisenberg M. and Turkle S. 1997. Beyond black boxes: Bringing transparency and aesthetics back to scientific instruments. http:\/\/el.www.media.mit.edu\/groups\/el\/papers\/mres\/blackbox\/proposal.html."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/223355.223735"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142869"},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Smith S. and Mosier J. 1986. Design guidelines for designing user interface software. The MITRE Corp. ftp:\/\/ftp.cis.ohio-state.edu\/pub\/hci\/Guidelines.  Smith S. and Mosier J. 1986. Design guidelines for designing user interface software. The MITRE Corp. ftp:\/\/ftp.cis.ohio-state.edu\/pub\/hci\/Guidelines.","DOI":"10.21236\/ADA177198"},{"key":"e_1_2_1_26_1","first-page":"39","article-title":"Understanding iconic representations of complex programming structures in graphical programming language for tweens and teenagers. In Interaction between learner's internal and external representations in multimedia environments, res.REP","author":"Timcenko O.","year":"2005","journal-title":"Kaleidoscope NoE JEIRP"},{"key":"e_1_2_1_27_1","unstructured":"Vygotsky L.S. 1936\/1978. Mind and Society: The Development of Higher Mental Processes. Harvard University Press Cambridge MA.  Vygotsky L.S. 1936\/1978. Mind and Society: The Development of Higher Mental Processes. Harvard University Press Cambridge MA."},{"key":"e_1_2_1_28_1","first-page":"105","article-title":"The cognitive walkthrough: A practitioner's guide. In Usability Inspection Methods, J. Nielsen and R.L. Mack (eds). John Wiley & Sons","author":"Wharton C.","year":"1994","journal-title":"New York"}],"container-title":["Computers in Entertainment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1129006.1129017","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1129006.1129017","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T15:06:16Z","timestamp":1750259176000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1129006.1129017"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,4]]},"references-count":28,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2006,4]]}},"alternative-id":["10.1145\/1129006.1129017"],"URL":"https:\/\/doi.org\/10.1145\/1129006.1129017","relation":{},"ISSN":["1544-3574"],"issn-type":[{"type":"electronic","value":"1544-3574"}],"subject":[],"published":{"date-parts":[[2006,4]]},"assertion":[{"value":"2006-04-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}