{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T08:37:28Z","timestamp":1783413448777,"version":"3.54.6"},"reference-count":32,"publisher":"Public Library of Science (PLoS)","issue":"4","license":[{"start":{"date-parts":[[2025,4,15]],"date-time":"2025-04-15T00:00:00Z","timestamp":1744675200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Vetenskapsr\u00e5det","doi-asserted-by":"publisher","award":["VR-M 2016-06301"],"award-info":[{"award-number":["VR-M 2016-06301"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009244","name":"Stockholms Universitet","doi-asserted-by":"publisher","award":["Dnr SU FV-1.1.9-0314-15"],"award-info":[{"award-number":["Dnr SU FV-1.1.9-0314-15"]}],"id":[{"id":"10.13039\/501100009244","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Introductory bioinformatics courses can be challenging to teach. Students with a biological background may have never encountered computer science, and computer science students are likely to have minimal knowledge of biology. To improve learning, we implemented a flipped spaced-repetition course. We repeated the topics through various activities across different days while applying an unusually high number of examinations. The examinations were synergistic with the flipped classroom, encouraging reading and watching recorded lectures before in-person discussions. Additionally, they helped us structure and assess laboratory practicals. We analyzed grades, pass rates, student satisfaction, and student comments qualitatively and quantitatively over 7 years of the course, documenting progress as well as the effect of disruptions such as COVID-19 and changes in teaching staff. We share our results and insights into the opportunities and challenges of this pedagogical approach. An open online version of this course is freely provided for students and teachers.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012863","type":"journal-article","created":{"date-parts":[[2025,4,15]],"date-time":"2025-04-15T17:21:37Z","timestamp":1744737697000},"page":"e1012863","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Combining flipped-classroom and spaced-repetition learning in a master-level bioinformatics course"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4303-9939","authenticated-orcid":true,"given":"Gabriele","family":"Pozzati","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3869-8147","authenticated-orcid":true,"given":"Samuel Coulbourn","family":"Flores","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,4,15]]},"reference":[{"issue":"1","key":"pcbi.1012863.ref001","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/07294360.2014.934336","article-title":"Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research","volume":"34","author":"L Abeysekera","year":"2014","journal-title":"High Educ Res Dev"},{"issue":"1","key":"pcbi.1012863.ref002","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40594-021-00270-7","article-title":"Instructor strategies to aid implementation of active learning: a systematic literature review","volume":"8","author":"KA Nguyen","year":"2021","journal-title":"Int J STEM Educ"},{"issue":"2","key":"pcbi.1012863.ref003","first-page":"5","article-title":"Rich environments for active learning","volume":"1","author":"RS Grabinger","year":"2016","journal-title":"Res Learn Technol"},{"key":"pcbi.1012863.ref004","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1111\/j.1751-228X.2007.00004.x","article-title":"We feel, therefore we learn: The relevance of affective and social neuroscience to education","volume":"1","author":"M Immordino-Yang","year":"2007","journal-title":"Mind Brain Educ"},{"key":"pcbi.1012863.ref005","doi-asserted-by":"crossref","DOI":"10.4324\/9780367198459-REPRW163-1","volume-title":"Zone of proximal development","author":"K Sage","year":"2022"},{"issue":"1","key":"pcbi.1012863.ref006","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1111\/medu.13830","article-title":"The stress paradox: how stress can be good for learning","volume":"54","author":"JR Rudland","year":"2020","journal-title":"Med Educ"},{"key":"pcbi.1012863.ref007","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.compedu.2018.07.021","article-title":"The flipped classroom: a review of its advantages and challenges","volume":"126","author":"G Ak\u00e7ay\u0131r","year":"2018","journal-title":"Comput Educ"},{"issue":"6","key":"pcbi.1012863.ref008","doi-asserted-by":"crossref","first-page":"e1006746","DOI":"10.1371\/journal.pcbi.1006746","article-title":"Problem-based learning in clinical bioinformatics education: does it help to create communities of practice?","volume":"15","author":"AC Davies","year":"2019","journal-title":"PLoS Comput Biol"},{"issue":"5","key":"pcbi.1012863.ref009","doi-asserted-by":"crossref","first-page":"e1006764","DOI":"10.1371\/journal.pcbi.1006764","article-title":"Establishing a computational biology flipped classroom","volume":"15","author":"P Compeau","year":"2019","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pcbi.1012863.ref010","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1177\/2372732215624708","article-title":"Spaced repetition promotes efficient and effective learning","volume":"3","author":"SHK Kang","year":"2016","journal-title":"Policy Insights Behav Brain Sci"},{"issue":"2","key":"pcbi.1012863.ref011","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1038\/nrn.2015.18","article-title":"The right time to learn: mechanisms and optimization of spaced learning","volume":"17","author":"P Smolen","year":"2016","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1012863.ref012","doi-asserted-by":"crossref","first-page":"e57760","DOI":"10.2196\/57760","article-title":"Spaced digital education for health professionals: systematic review and meta-analysis","volume":"26","author":"L Martinengo","year":"2024","journal-title":"J Med Internet Res"},{"issue":"3","key":"pcbi.1012863.ref013","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1037\/0033-2909.132.3.354","article-title":"Distributed practice in verbal recall tasks: a review and quantitative synthesis","volume":"132","author":"NJ Cepeda","year":"2006","journal-title":"Psychol Bull"},{"issue":"1","key":"pcbi.1012863.ref014","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.tics.2005.11.006","article-title":"Repetition and the brain: neural models of stimulus-specific effects","volume":"10","author":"K Grill-Spector","year":"2006","journal-title":"Trends Cogn Sci"},{"issue":"7","key":"pcbi.1012863.ref015","doi-asserted-by":"crossref","first-page":"1624","DOI":"10.1162\/jocn.2010.21532","article-title":"Spaced learning enhances subsequent recognition memory by reducing neural repetition suppression","volume":"23","author":"G Xue","year":"2011","journal-title":"J Cogn Neurosci"},{"issue":"1705","key":"pcbi.1012863.ref016","doi-asserted-by":"crossref","first-page":"20150355","DOI":"10.1098\/rstb.2015.0355","article-title":"Repetition suppression: a means to index neural representations using BOLD?","volume":"371","author":"HC Barron","year":"2016","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"key":"pcbi.1012863.ref017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1037\/10011-000","volume-title":"Memory: a contribution to experimental psychology","author":"H Ebbinghaus","year":"1913"},{"issue":"7","key":"pcbi.1012863.ref018","doi-asserted-by":"crossref","first-page":"e0120644","DOI":"10.1371\/journal.pone.0120644","article-title":"Replication and analysis of ebbinghaus\u2019 forgetting curve","volume":"10","author":"JMJ Murre","year":"2015","journal-title":"PLoS One"},{"issue":"12","key":"pcbi.1012863.ref019","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1111\/j.1365-2923.2009.03518.x","article-title":"Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial","volume":"43","author":"DP Larsen","year":"2009","journal-title":"Med Educ"},{"issue":"3","key":"pcbi.1012863.ref020","doi-asserted-by":"crossref","first-page":"476","DOI":"10.3758\/s13421-023-01477-5","article-title":"The influence of repeated study and repeated testing on the testing effect and the transfer effect over time","volume":"52","author":"L Wang","year":"2024","journal-title":"Mem Cognit"},{"issue":"3","key":"pcbi.1012863.ref021","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.profnurs.2017.08.008","article-title":"Testing enhances learning: a review of the literature","volume":"34","author":"S Binks","year":"2018","journal-title":"J Prof Nurs"},{"issue":"9","key":"pcbi.1012863.ref022","doi-asserted-by":"crossref","first-page":"7324","DOI":"10.5688\/ajpe7324","article-title":"Using testing as a learning tool","volume":"83","author":"BW Yang","year":"2019","journal-title":"Am J Pharm Educ"},{"issue":"1","key":"pcbi.1012863.ref023","first-page":"1","article-title":"Single-paper meta-analyses of the effects of spaced retrieval practice in nine introductory STEM courses: is the glass half full or half empty?","volume":"11","author":"CR Bego","year":"2024","journal-title":"Int J STEM Educ"},{"issue":"1","key":"pcbi.1012863.ref024","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1186\/s12909-024-05479-y","article-title":"Effectiveness of spaced repetition for clinical problem solving amongst undergraduate medical students studying paediatrics in Pakistan","volume":"24","author":"SF Durrani","year":"2024","journal-title":"BMC Med Educ"},{"key":"pcbi.1012863.ref025","first-page":"1","article-title":"A spaced repetition approach to presenting autonomic nervous system pharmacology curricula in medical education","author":"S Desai","year":"2024","journal-title":"Med Sci Educ"},{"issue":"6","key":"pcbi.1012863.ref026","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1093\/bib\/bbq024","article-title":"Multi-stage learning aids applied to hands-on software training","volume":"11","author":"K Rother","year":"2010","journal-title":"Brief Bioinform"},{"key":"pcbi.1012863.ref027","doi-asserted-by":"crossref","first-page":"219","DOI":"10.3991\/ijet.v12i03.6587","article-title":"Attentional control and other executive functions","volume":"12","author":"A Drigas","year":"2017","journal-title":"Int J Emerg Technol Learn"},{"issue":"3","key":"pcbi.1012863.ref028","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1038\/nrn755","article-title":"Control of goal-directed and stimulus-driven attention in the brain","volume":"3","author":"M Corbetta","year":"2002","journal-title":"Nat Rev Neurosci"},{"issue":"2","key":"pcbi.1012863.ref029","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1037\/1528-3542.7.2.336","article-title":"Anxiety and cognitive performance: attentional control theory","volume":"7","author":"MW Eysenck","year":"2007","journal-title":"Emotion"},{"key":"pcbi.1012863.ref030","doi-asserted-by":"crossref","DOI":"10.4324\/9780203771587","volume-title":"Statistical power analysis for the behavioral sciences","author":"J Cohen","year":"2013"},{"key":"pcbi.1012863.ref031","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1016\/j.ijnurstu.2011.09.012","article-title":"QUAGOL: a guide for qualitative data analysis","volume":"49","author":"B Dierckx de Casterl\u00e9","year":"2012","journal-title":"Int J Nurs Stud"},{"issue":"7873","key":"pcbi.1012863.ref032","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"J Jumper","year":"2021","journal-title":"Nature"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012863","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,15]],"date-time":"2025-04-15T17:21:52Z","timestamp":1744737712000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012863"}},"subtitle":[],"editor":[{"given":"Patricia M","family":"Palagi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,4,15]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4,15]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012863","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,15]]}}}