{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T16:12:25Z","timestamp":1774455145663,"version":"3.50.1"},"reference-count":71,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T00:00:00Z","timestamp":1679529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"<jats:p>Various interpretations of the literature detailing the neural basis of learning have in part led to disagreements concerning how consciousness arises. Further, artificial learning model design has suffered in replicating intelligence as it occurs in the human brain. Here, we present a novel learning model, which we term the \u201cRecommendation Architecture (RA) Model\u201d from prior theoretical works proposed by Coward, using a dual-learning approach featuring both consequence feedback and non-consequence feedback. The RA model is tested on a categorical learning task where no two inputs are the same throughout training and\/or testing. We compare this to three consequence feedback only models based on backpropagation and reinforcement learning. Results indicate that the RA model learns novelty more efficiently and can accurately return to prior learning after new learning with less computational resources expenditure. The final results of the study show that consequence feedback as interpretation, not creation, of cortical activity creates a learning style more similar to human learning in terms of resource efficiency. Stable information meanings underlie conscious experiences. The work provided here attempts to link the neural basis of nonconscious and conscious learning while providing early results for a learning protocol more similar to human brains than is currently available.<\/jats:p>","DOI":"10.3389\/fncom.2023.1090126","type":"journal-article","created":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T05:30:06Z","timestamp":1679549406000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Leveraging conscious and nonconscious learning for efficient AI"],"prefix":"10.3389","volume":"17","author":[{"given":"Rachel","family":"St. Clair","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"L. Andrew","family":"Coward","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susan","family":"Schneider","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,3,23]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1037\/a0015000","article-title":"Priming and authorship ascription: when nonconscious goals turn into conscious experiences of self-agency","volume":"96","author":"Aarts","year":"2009","journal-title":"J. Pers. Soc. Psychol"},{"key":"B2","doi-asserted-by":"publisher","first-page":"872","DOI":"10.1016\/j.cub.2010.03.050","article-title":"Robust selectivity to two-object images in human visual cortex","volume":"20","author":"Agam","year":"2010","journal-title":"Curr. Biol"},{"key":"B3","unstructured":"BiewaldL.\n          Experiment Tracking With Weights and Biases2020"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10539-020-09772-0","article-title":"Unlimited associative learning and the origins of consciousness: a primer and some predictions","volume":"35","author":"Birch","year":"2020","journal-title":"Biol. Philos"},{"key":"B5","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1038\/241467a0","article-title":"Environmental modification of the visual cortex and the neural basis of learning and memory","volume":"241","author":"Blakemore","year":"1973","journal-title":"Nature"},{"key":"B6","unstructured":"Language models are few-shot learners18771901\n            BrownT.\n            MannB.\n            RyderN.\n            SubbiahM.\n            KaplanJ. D.\n            DhariwalP.\n          35785085Adv. Neural Inf. Process. Syst332020"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.4324\/9780203763247","author":"Chauvin","year":"2013","journal-title":"Backpropagation: Theory, Architectures, and Applications"},{"key":"B8","unstructured":"ClairR. S.\n          Ph.D. thesisPreserving Knowledge in Simulated Behavioral Action Loops2022"},{"key":"B9","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/S0079-6123(05)50007-4","article-title":"Computational correlates of consciousness","volume":"150","author":"Cleeremans","year":"2005","journal-title":"Prog. Brain Res"},{"key":"B10","unstructured":"CleeremansA.\n            FrithC.\n          The Unity of Consciousness. Oxford: Oxford University Press2003"},{"key":"B11","first-page":"1","article-title":"Implicit learning and consciousness: a graded, dynamic perspective","volume":"2002","author":"Cleeremans","year":"2002","journal-title":"Implicit Learn. Consciousness"},{"key":"B12","unstructured":"CowardA.\n          Synapses Define Receptive Fields and Recommendation Weights2021"},{"key":"B13","first-page":"159","article-title":"\u201cPattern thinking and reality,\u201d","volume-title":"Pattern Thinking","author":"Coward","year":"1990"},{"key":"B14","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1016\/S0732-118X(99)00028-8","article-title":"A physiologically based approach to consciousness","volume":"17","author":"Coward","year":"","journal-title":"New Ideas Psychol"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-585-29605-0_11","article-title":"\u201cThe recommendation architecture: Relating cognition to physiology,\u201d","author":"Coward","year":"","journal-title":"Understanding Representation in the Cognitive Sciences"},{"key":"B16","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/S1389-0417(01)00024-9","article-title":"The recommendation architecture: lessons from large-scale electronic systems applied to cognition","volume":"2","author":"Coward","year":"2001","journal-title":"Cogn. Syst. Res"},{"key":"B17","article-title":"\u201cThe recommendation architecture model for human cognition,\u201d","volume-title":"Proceedings of the Conference on Brain Inspired Cognitive Systems, Vol. 7","author":"Coward","year":""},{"key":"B18","unstructured":"CowardL. A.\n          22086351Simulation of a Proposed Binding Model. Brain Inspired Cognitive Systems"},{"key":"B19","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1007\/978-0-387-79100-5_18","article-title":"The hippocampal system as the Cortical Resource Manager: A model connecting psychology, anatomy and physiology","volume":"657","author":"Coward","year":"2009","journal-title":"Adv. Exper. Med. Biol."},{"key":"B20","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1007\/978-1-4419-1452-1_3","article-title":"\u201cModelling memory and learning consistently from psychology to physiology,\u201d","author":"Coward","year":"2010","journal-title":"Perception-Action Cycle"},{"key":"B21","doi-asserted-by":"crossref","DOI":"10.1007\/978-94-007-7107-9_11","article-title":"\u201cUnderstanding complex cognitive phenomena,\u201d","volume-title":"Towards a Theoretical Neuroscience: from Cell Chemistry to Cognition. Springer Series in Cognitive and Neural Systems, Vol. 8","author":"Coward","year":"2013"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-007-7107-9_8","article-title":"\u201cAppearance of architectural constraints in the brain,\u201d","author":"Coward","year":"2013","journal-title":"Towards a Theoretical Neuroscience: from Cell Chemistry to Cognition. Springer Series in Cognitive and Neural Systems, Vol. 8"},{"key":"B23","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1016\/j.neucom.2008.06.015","article-title":"Implications of resource limitations for a conscious machine","volume":"72","author":"Coward","year":"2009","journal-title":"Neurocomputing"},{"key":"B24","unstructured":"EffectiveA.\n          Deepmind's Generalist ai, Gato: A Non-Technical Explainer2022"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1910.06591","article-title":"Seed rl: Scalable and efficient deep-rl with accelerated central inference","author":"Espeholt","year":"2019","journal-title":"arXiv preprint"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.1098\/rstb.2008.0300","article-title":"Predictive coding under the free-energy principle","volume":"364","author":"Friston","year":"2009","journal-title":"Philos. Trans. R. Soc. B Biol. Sci"},{"key":"B27","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/ICONIP.1999.843965","article-title":"\u201cResults of simulations of a system with the recommendation architecture,\u201d","volume-title":"ICONIP'99. ANZIIS'99 &ANNES'99 and ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No. 99EX378), Vol. 1","author":"Gedeon","year":"1999"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10539-021-09820-3","article-title":"Learning and the biology of consciousness: a commentary on birch, ginsburg, and jablonka","volume":"36","author":"Godfrey-Smith","year":"2021","journal-title":"Biol. Philos"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1312.6211","article-title":"An empirical investigation of catastrophic forgetting in gradient-based neural networks","author":"Goodfellow","year":"2013","journal-title":"arXiv preprint"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2103.01988","article-title":"Self-supervised pretraining of visual features in the wild","author":"Goyal","year":"2021","journal-title":"arXiv preprint"},{"key":"B31","first-page":"1644","article-title":"\u201cState of the art: Reproducibility in artificial intelligence,\u201d","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32","author":"Gundersen","year":"2018"},{"key":"B32","first-page":"770","article-title":"\u201cDeep residual learning for image recognition,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"He","year":"2016"},{"key":"B33","article-title":"Measuring the algorithmic efficiency of neural networks","author":"Hernandez","year":"2020","journal-title":"arXiv [Preprint]"},{"key":"B34","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1038\/nrn915","article-title":"The cognitive neuroscience of sleep: neuronal systems, consciousness and learning","volume":"3","author":"Hobson","year":"2002","journal-title":"Nat. Rev. Neurosci"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"B36","doi-asserted-by":"publisher","first-page":"3521","DOI":"10.1073\/pnas.1611835114","article-title":"Overcoming catastrophic forgetting in neural networks","volume":"114","author":"Kirkpatrick","year":"2017","journal-title":"Proc. Natl. Acad. Sci. U.S.A"},{"key":"B37","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1007\/s10571-017-0510-4","article-title":"Bdnf: a key factor with multipotent impact on brain signaling and synaptic plasticity","volume":"38","author":"Kowia\u0144ski","year":"2018","journal-title":"Cell. Mol. Neurobiol"},{"key":"B38","author":"Laird","year":"2022","journal-title":"Introduction to the soar cognitive architecture"},{"key":"B39","author":"Levy","year":"2016","journal-title":"An Exclusive Look at How AI and Machine Learning Work at Apple"},{"key":"B40","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1037\/0003-066x.47.6.796","article-title":"Nonconscious acquisition of information","volume":"47","author":"Lewicki","year":"1992","journal-title":"Am. Psychol."},{"key":"B41","unstructured":"LiC.\n          OpenAI's GPT-3 Language Model: A Technical Overview. GPU Cloud, Workstations, Servers, Laptops for Deep Learning2022"},{"key":"B42","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1038\/s41583-020-0277-3","article-title":"Backpropagation and the brain","volume":"21","author":"Lillicrap","year":"2020","journal-title":"Nat. Rev. Neurosci"},{"key":"B43","doi-asserted-by":"publisher","first-page":"100837","DOI":"10.1016\/j.newideapsych.2020.100837","article-title":"Is predictive processing a theory of perceptual consciousness?","volume":"61","author":"Marvan","year":"2021","journal-title":"New Ideas Psychol"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1312.5602","article-title":"Playing atari with deep reinforcement learning","author":"Mnih","year":"2013","journal-title":"arXiv preprint"},{"key":"B45","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"B46","doi-asserted-by":"publisher","first-page":"49","DOI":"10.3389\/fnsys.2018.00049","article-title":"Sensory processing across conscious and nonconscious brain states: from single neurons to distributed networks for inferential representation","volume":"12","author":"Olcese","year":"2018","journal-title":"Front. Syst. Neurosci"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41398-020-0814-x","article-title":"Dopamine: from prediction error to psychotherapy","volume":"10","author":"Papalini","year":"2020","journal-title":"Transl. Psychiatry"},{"key":"B48","first-page":"811","article-title":"\u201cLearning from complex rule-governed environments: On the proper functions of nonconscious and conscious processes,\u201d","author":"Perruchet","year":"1994","journal-title":"Attention and Performance 15: Conscious and Nonconscious Information Processing"},{"key":"B49","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1080\/09515089708573221","article-title":"A constructivist and connectionist view on conscious and nonconscious processes","volume":"10","author":"Phaf","year":"1997","journal-title":"Philos. Psychol"},{"key":"B50","doi-asserted-by":"publisher","first-page":"2026","DOI":"10.1016\/j.neuropsychologia.2013.06.019","article-title":"The neural basis of implicit learning and memory: a review of neuropsychological and neuroimaging research","volume":"51","author":"Reber","year":"2013","journal-title":"Neuropsychologia"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2205.06175","article-title":"A generalist agent","author":"Reed","year":"2022","journal-title":"arXiv preprint"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.1488","article-title":"Act-r: a cognitive architecture for modeling cognition","author":"Ritter","year":"2019","journal-title":"Wiley Interdisc. Rev. Cogn. Sci"},{"key":"B53","unstructured":"Predicting stock prices using lstm17541756\n            RoondiwalaM.\n            PatelH.\n            VarmaS.\n          Int. J. Sci. Res62017"},{"key":"B54","first-page":"4548","article-title":"\u201cOvercoming catastrophic forgetting with hard attention to the task,\u201d","volume-title":"International Conference on Machine Learning","author":"Serra","year":"2018"},{"key":"B55","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1007\/s12559-009-9007-x","article-title":"Explanatory correlates of consciousness: theoretical and computational challenges","volume":"1","author":"Seth","year":"2009","journal-title":"Cognit. Comput"},{"key":"B56","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1038\/s41583-022-00587-4","article-title":"Theories of consciousness","volume":"23","author":"Seth","year":"2022","journal-title":"Nat. Rev. Neurosci"},{"key":"B57","first-page":"3400","article-title":"\u201cIncremental learning of object detectors without catastrophic forgetting,\u201d","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Shmelkov","year":"2017"},{"key":"B58","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nature16961","article-title":"Mastering the game of go with deep neural networks and tree search","volume":"529","author":"Silver","year":"2016","journal-title":"Nature"},{"key":"B59","unstructured":"St. ClairR.\n          Understanding Consciousness From a Physiological Perspective a Dialogue2020"},{"key":"B60","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1016\/S0893-6080(97)00050-6","article-title":"Learning, action and consciousness: a hybrid approach toward modelling consciousness","volume":"10","author":"Sun","year":"1997","journal-title":"Neural Networks"},{"key":"B61","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton","year":"2018"},{"key":"B62","first-page":"1","article-title":"\u201cZeroCap: Zero-shot image-to-text generation for visual-semantic arithmetic,\u201d","volume-title":"2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Tewel","year":"2022"},{"key":"B63","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1038\/nrn.2016.44","article-title":"Integrated information theory: from consciousness to its physical substrate","volume":"17","author":"Tononi","year":"2016","journal-title":"Nat. Rev. Neurosci"},{"key":"B64","volume-title":"Learning From Experience: Toward Consciousness","author":"Torbert","year":"1972"},{"key":"B65","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/ADPRL.2009.4927542","article-title":"\u201cA theoretical and empirical analysis of expected sarsa,\u201d","volume-title":"2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning","author":"Van Seijen","year":"2009"},{"key":"B66","doi-asserted-by":"publisher","first-page":"692","DOI":"10.1016\/j.tins.2021.04.005","article-title":"Deep learning and the global workspace theory","volume":"44","author":"VanRullen","year":"2021","journal-title":"Trends Neurosci"},{"key":"B67","doi-asserted-by":"crossref","DOI":"10.1111\/b.9781405120197.2007.x","volume-title":"The Blackwell Companion to Consciousness.","author":"Velmans","year":"2007"},{"key":"B68","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3386252","article-title":"Generalizing from a few examples: a survey on few-shot learning","volume":"53","author":"Wang","year":"2020","journal-title":"ACM Comput. Surveys"},{"key":"B69","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1016\/j.tics.2018.12.005","article-title":"Theories of error back-propagation in the brain","volume":"23","author":"Whittington","year":"2019","journal-title":"Trends Cogn. Sci"},{"key":"B70","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1016\/j.patcog.2017.07.031","article-title":"Scalable lifelong reinforcement learning","volume":"72","author":"Zhan","year":"2017","journal-title":"Pattern Recognit"},{"key":"B71","doi-asserted-by":"publisher","first-page":"100224","DOI":"10.1016\/j.jii.2021.100224","article-title":"Study on artificial intelligence: the state of the art and future prospects","volume":"23","author":"Zhang","year":"2021","journal-title":"J. Ind. Inf. Integrat"}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2023.1090126\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,23]],"date-time":"2023-03-23T05:30:27Z","timestamp":1679549427000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2023.1090126\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,23]]},"references-count":71,"alternative-id":["10.3389\/fncom.2023.1090126"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2023.1090126","relation":{},"ISSN":["1662-5188"],"issn-type":[{"value":"1662-5188","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,23]]},"article-number":"1090126"}}