{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T06:33:38Z","timestamp":1773988418462,"version":"3.50.1"},"reference-count":15,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2015,12,18]],"date-time":"2015-12-18T00:00:00Z","timestamp":1450396800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Current-generation assessment tools used in K-12 and post-secondary education are limited in the type of questions they support; this limitation makes it difficult for instructors to navigate their assessment engines. Furthermore, the question types tend to score low on Bloom\u2019s Taxonomy. Dedicated learning management systems (LMS) such as Blackboard, Moodle and Canvas are somewhat better than informal tools as they offer more question types and some randomization. Still, question types in all the major LMS assessment engines are limited. Additionally, LMSs place a heavy burden on teachers to generate online assessments. In this study we analyzed the top three LMS providers to identify inefficiencies. These inefficiencies in LMS design, point us to ways to ask better questions. Our findings show that teachers have not adopted current tools because they do not offer definitive improvements in productivity. Therefore, we developed LiquiZ, a design for a next-generation assessment engine that reduces user effort and provides more advanced question types that allow teachers to ask questions that can currently only be asked in one-on-one demonstration. The initial LiquiZ project is targeted toward STEM subjects, so the question types are particularly advantageous in math or science subjects.<\/jats:p>","DOI":"10.3390\/fi7040484","type":"journal-article","created":{"date-parts":[[2015,12,18]],"date-time":"2015-12-18T10:15:04Z","timestamp":1450433704000},"page":"484-499","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Improving Teacher Effectiveness: Designing Better Assessment Tools in Learning Management Systems"],"prefix":"10.3390","volume":"7","author":[{"given":"Dov","family":"Kruger","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah","family":"Inman","sequence":"additional","affiliation":[{"name":"Instructional Technology, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiyu","family":"Ding","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yijin","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Poornima","family":"Kuna","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yujie","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiakun","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Oro","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yingzhu","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,12,18]]},"reference":[{"key":"ref_1","unstructured":"Medved, J.P. LMS Industry User Research Report. Available online: http:\/\/www.capterra.com\/learning-management-system-software\/user-research."},{"key":"ref_2","unstructured":"E-Learning Market Trends and Forecast 2014\u20132016 Report. A report by Docebo. Available online: http:\/\/www.docebo.com\/landing\/contactform\/elearning-market-trends-and-forecast-2014-2016-docebo-report.pdf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1037\/0003-066X.34.10.906","article-title":"Metacognition and cognitive monitoring","volume":"34","author":"Flavell","year":"1979","journal-title":"Am. Psychol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s11409-006-6893-0","article-title":"Metacognition and learning: Conceptual and methodological considerations","volume":"1","author":"Veenman","year":"2006","journal-title":"Metacognit. Learn."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"77","DOI":"10.2190\/JE7W-VL6W-RNYF-RD4M","article-title":"The influence of metacognitive skills on learners\u2019 memory of information in a hypermedia environment","volume":"31","author":"Schwartz","year":"2004","journal-title":"J. Educ. Comput. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/S1096-7516(01)00071-9","article-title":"Successful implementation of e-learning pedagogical considerations","volume":"4","author":"Govindasamy","year":"2002","journal-title":"Internet High. Educ."},{"key":"ref_7","first-page":"29","article-title":"Web-based courseware tools: Where is the pedagogy?","volume":"39","author":"Firdiyiyek","year":"1999","journal-title":"Educ. Technol."},{"key":"ref_8","unstructured":"IMS Question & Test Interoperability Specification Overview. (n.d.). Available online: https:\/\/www.imsglobal.org\/question\/index.html."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1023\/A:1023967026413","article-title":"Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice","volume":"45","author":"Yorke","year":"2003","journal-title":"High. Educ."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/BF00117714","article-title":"Formative assessment and the design of instructional systems","volume":"18","author":"Sadler","year":"1989","journal-title":"Instr. Sci."},{"key":"ref_11","first-page":"643","article-title":"A metacognitive decision-making model for dynamic assessment and intervention","volume":"Volume 6","author":"Lidz","year":"2000","journal-title":"Advances in Cognition and Educational Practice: Dynamic Assessment: Prevailing Models and Applications"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Krathwohl, D. (2002). A revision of bloom\u2019s taxonomy: An overview. Theory Pract., 41.","DOI":"10.1207\/s15430421tip4104_2"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gilbert, J.K. (2005). Visualization in Science Education, Springer.","DOI":"10.1007\/1-4020-3613-2"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"MacEchren, A.M., and Taylor, D.R.F. (1994). Visualization in Modern Cartography, Pergammon Press Ltd.","DOI":"10.1016\/B978-0-08-042415-6.50008-9"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"235","DOI":"10.14742\/ajet.1152","article-title":"A strategic assessment of audience response systems used in higher education","volume":"25","author":"Kay","year":"2009","journal-title":"Australas. J. Educ. Technol."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/7\/4\/484\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:54:22Z","timestamp":1760216062000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/7\/4\/484"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,12,18]]},"references-count":15,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,12]]}},"alternative-id":["fi7040484"],"URL":"https:\/\/doi.org\/10.3390\/fi7040484","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,12,18]]}}}