{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T23:15:58Z","timestamp":1773789358955,"version":"3.50.1"},"reference-count":106,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2001,12,1]],"date-time":"2001-12-01T00:00:00Z","timestamp":1007164800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2001,12]]},"abstract":"<jats:p> The aviation community has invested great amounts of money and effort into crew resource management (CRM) training. Using D. L. Kirkpatrick's (1976) framework for evaluating training, we reviewed 58 published accounts of CRM training to determine its effectiveness within aviation. Results indicated that CRM training generally produced positive reactions, enhanced learning, and promoted desired behavioral changes. However, we cannot ascertain whether CRM has an effect on an organization's bottom line (i.e., safety). We discuss the state of the literature with regard to evaluation of CRM training programs and, as a result, call for the need to conduct systematic, multilevel evaluation efforts that will show the true effectiveness of CRM training. As many evaluations do not collect data across levels (as suggested by D. L. Kirkpatrick, 1976, and by G. M. Alliger, S. I. Tannenbaum, W. Bennett, Jr., &amp; H. Traver, 1997), the impact of CRM cannot be truly determined; thus more and better evaluations are needed and should be demanded. <\/jats:p>","DOI":"10.1518\/001872001775870386","type":"journal-article","created":{"date-parts":[[2007,7,4]],"date-time":"2007-07-04T23:12:03Z","timestamp":1183590723000},"page":"641-674","source":"Crossref","is-referenced-by-count":260,"title":["Team Training in the Skies: Does Crew Resource Management (CRM) Training Work?"],"prefix":"10.1177","volume":"43","author":[{"given":"Eduardo","family":"Salas","sequence":"first","affiliation":[{"name":"University of Central Florida, Orlando, Florida"}]},{"given":"C. Shawn","family":"Burke","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando, Florida"}]},{"given":"Clint A.","family":"Bowers","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando, Florida"}]},{"given":"Katherine A.","family":"Wilson","sequence":"additional","affiliation":[{"name":"University of Central Florida, Orlando, Florida"}]}],"member":"179","published-online":{"date-parts":[[2001,12,1]]},"reference":[{"key":"atypb1","first-page":"368","volume-title":"Proceedings of the 6th International Symposium on Aviation Psychology","author":"Alkov, R. A.","year":"1991"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0103_5"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1989.tb00661.x"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1997.tb00911.x"},{"key":"atypb5","unstructured":"Arnold, R. L. & Jackson, D. L. (1985). Recurrent cockpit resource management training at United Airlines. In R. S. Jensen, & J. Adrion (Eds.), Proceedings of the 3rd Symposium on Aviation Psychology (pp. 345\u2013351). Columbus: Ohio State University."},{"key":"atypb6","unstructured":"Baker, D. P., Bauman, M. & Zalesny, M. D. (1991). Development of aircrew coordination exercises to facilitate transfer. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 314\u2013319). Columbus: Ohio State University."},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0302_4"},{"issue":"1","key":"atypb8","first-page":"3","volume":"67","author":"Barker, J. M.","year":"1996","journal-title":"Aviation, Space, and Environmental Medicine"},{"key":"atypb9","first-page":"141","volume-title":"Aviation psychology: Training and selection. Proceedings of the 21st Conference of the European Association for Aviation Psychology","author":"Besco, R. O.","year":"1995"},{"key":"atypb10","unstructured":"Besco, R. O. (1997). The need for operational validation of human relations-centered CRM training assumptions. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 9th International Symposium on Aviation Psychology (pp. 536\u2013540). Columbus: Ohio State University."},{"key":"atypb11","unstructured":"Besco, R. O. (1998). Crew resource management training: What to teach and how to teach it! Unpublished manuscript."},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.3758\/BF03203594"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1518\/001872095779049372"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.4324\/9781410602053"},{"key":"atypb15","unstructured":"Butler, R. E. (1991). Lessons from cross-fleet\/cross-airline observations: Evaluating the impact of CRM\/LOFT training. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 326\u2013331). Columbus: Ohio State University."},{"key":"atypb16","first-page":"231","volume-title":"Cockpit resource management","author":"Butler, R. E.","year":"1993"},{"key":"atypb17","first-page":"421","volume-title":"Cockpit resource management","author":"Byrnes, R. E.","year":"1993"},{"key":"atypb18","volume-title":"Paper presented at the 11th Inter-service\/Industry Training Systems Conference","author":"Cannon-Bowers, J. A."},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0101_3"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0503_2"},{"key":"atypb21","unstructured":"Clark, R. E., Nielsen, R. A. & Wood, R. L. (1991). The interactive effects of cockpit resource management, domestic stress, and information processing in commercial aviation. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 776\u2013781). Columbus: Ohio State University."},{"key":"atypb22","unstructured":"Clothier, C. C. (1991). Behavioral interactions across various aircraft types: Results of systematic observations of line operations and simulations. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 332\u2013337). Columbus: Ohio State University."},{"key":"atypb23","unstructured":"Connolly, T. J. & Blackwell, B. B. (1987). A simulator approach to training in aeronautical decision making. In R. S. Jensen (Ed.), Proceedings of the 4th International Symposium on Aviation Psychology (pp. 251\u2013258). Columbus: Ohio State University."},{"key":"atypb24","unstructured":"Diehl, A. (1991). The effectiveness of training programs for preventing aircrew \"error\". In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 640\u2013655). Columbus: Ohio State University."},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1108\/03090599510096617"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1207\/s15327876mp0601_3"},{"key":"atypb27","unstructured":"Fowlkes, J. E., Lane, N. E., Salas, E., Oser, R. L. & Prince, C. (1992). TARGETs for aircrew coordination training. In Proceedings of the 14th Interservice\/Industry Training Systems and Education Conference (pp. 344\u2013352). San Antonio, TX: National Security Industrial Association."},{"key":"atypb28","unstructured":"Freeman, C. & Simmon, D.A. (1991). Taxonomy of crew resource management: Information processing domain. In R. S. Jensen (Ed.), Proceedings of the 6th Annual International Symposium on Aviation Psychology (pp. 391\u2013397). Columbus: Ohio State University."},{"key":"atypb29","unstructured":"Geis, C. E. (1987). Changing attitudes through training: A formal evaluation of training effectiveness. In R. S. Jensen (Ed.), Proceedings of the 4th International Symposium on Aviation Psychology (pp. 392\u2013398). Columbus: Ohio State University."},{"key":"atypb30","first-page":"19","volume-title":"Improving training effectiveness in work organizations","author":"Goldsmith, T.","year":"1997"},{"key":"atypb31","volume-title":"Training in organizations: Needs assessment, development, and evaluation","author":"Goldstein, I. L.","year":"1993","edition":"3"},{"key":"atypb32","unstructured":"Grau, J. Y. & Valot, C. (1997). Evolvement of crew attitudes in military airlift operations after CRM course. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 9th International Symposium on Aviation Psychology (pp. 556\u2013561). Columbus: Ohio State University."},{"key":"atypb33","unstructured":"Gregorich, S. E. (1993). The dynamics of CRM attitude change: Attitude stability. In Proceedings of the 7th International Symposium on Aviation Psychology (pp. 509\u2013512). Columbus: Ohio State University."},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.75.6.682"},{"key":"atypb35","first-page":"173","volume-title":"Cockpit resource management","author":"Gregorich, S. E.","year":"1993"},{"key":"atypb36","unstructured":"Grubb, G., Morey, J. C. & Simon, R. (1999). Applications of the theory of reasoned action model of attitude assessment in the air force CRM program. In R. S. Jensen, B. Cox, J. D. Callister, & R. Lavis (Eds.), Proceedings of the 10th International Symposium on Aviation Psychology (pp. 298\u2013301). Columbus: Ohio State University."},{"key":"atypb37","volume-title":"Resource management training and cabin crew coordination.","author":"Hackman, J. R.","year":"1989"},{"key":"atypb38","unstructured":"Halliday, J. T., Biegalski, C. S. & Inzana, A. (1987). CRM training in the 349th Military Airlift Wing. In H. W. Orlady, & H. C. Foushee (Eds.), Proceedings of the NASA\/MAC Workshop on Conference Resource Management (NASA Conference Publication No. 2455, pp. 148\u2013158). Moffett Field, CA: NASA-Ames Research Center."},{"key":"atypb39","unstructured":"Hansberger, J. T., Holt, R. W. & Boehm-Davis, D. (1999). Instructor\/evaluator evaluations of ACRM effectiveness. In R. S. Jensen, B. Cox, J. D. Callister, & R. Lavis (Eds.), Proceedings of the 10th International Symposium on Aviation Psychology (pp. 279\u2013284). Columbus: Ohio State University."},{"key":"atypb40","unstructured":"Hayward, B. & Alston, N. (1991). Team building following a pilot labour dispute: Extending the CRM envelope. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 377\u2013383). Columbus: Ohio State University."},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1177\/001872088402600510"},{"key":"atypb42","unstructured":"Helmreich, R. L. (1991). Strategies for the study of flightcrew behavior. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 338\u2013343). Columbus: Ohio State University."},{"key":"atypb43","first-page":"1","author":"Helmreich, R. L.","year":"1990","journal-title":"Flight Safety Digest"},{"key":"atypb44","first-page":"3","volume-title":"Cockpit resource management","author":"Helmreich, R. L.","year":"1993"},{"key":"atypb45","volume-title":"Culture at work in aviation and medicine: National, organizational, and professional influences.","author":"Helmreich, R. L.","year":"1998"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0901_2"},{"key":"atypb47","unstructured":"Helmreich, R. L. & Wilhelm, J. A. (1987). Evaluating cockpit resource management training. In R. S. Jensen (Ed.), Proceedings of the 4th International Symposium on Aviation Psychology (pp. 440\u2013446). Columbus: Ohio State University."},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0104_3"},{"key":"atypb49","first-page":"586","volume":"61","author":"Helmreich, R. L.","year":"1990","journal-title":"Aviation, Space, and Environmental Medicine"},{"key":"atypb50","first-page":"305","volume-title":"Improving teamwork in organizations: Applications of resource management","author":"Helmreich, R. L.","year":"2001"},{"key":"atypb51","first-page":"304","volume-title":"Social values and development: Asian perspectives","author":"Hofstede, G.","year":"1988"},{"key":"atypb52","unstructured":"Holt, R. W., Boehm-Davis, D. A. & Hansberger, J. T. (1999). Evaluating the effectiveness of ACRM using LOE and line-check data. In R. S. Jensen, B. Cox, J. D. Callister, & R. Lavis (Eds.), Proceedings of the 10th International Symposium on Aviation Psychology (pp. 273\u2013278). Columbus: Ohio State University."},{"key":"atypb53","unstructured":"H\u00f6rmann, H. J., Goeters, K. M., Maschke, P. & Schiewe, A. (1995). Implementation and initial evaluation of DLR\/LH CRM-training. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 8th International Symposium on Aviation Psychology (pp. 591\u2013596). Columbus: Ohio State University."},{"key":"atypb54","first-page":"763","volume":"63","author":"Howard, S.","year":"1992","journal-title":"Aviation, Space, and Environmental Medicine"},{"key":"atypb55","unstructured":"Ikomi, P. A., Boehm-Davis, D. A., Holt, R. W. & Incalcaterra, K. A. (1999). Jump seat observations of advanced crew resource management (ACRM) effectiveness. In R. S. Jensen, B. Cox, J. D. Callister, & R. Lavis (Eds.), Proceedings of the 10th International Symposium on Aviation Psychology (pp. 292\u2013297). Columbus: Ohio State University."},{"key":"atypb56","unstructured":"Incalcaterra, K. A. & Holt, R. W. (1999). Pilot evaluations of ACRM programs. In R. S. Jensen, B. Cox, J. D. Callister, & R. Lavis (Eds.), Proceedings of the 10th International Symposium on Aviation Psychology (pp. 285\u2013291). Columbus: Ohio State University."},{"key":"atypb57","unstructured":"Irwin, C. M. (1991). The impact of initial and recurrent cockpit resource management training on attitudes. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 344\u2013349). Columbus: Ohio State University."},{"key":"atypb58","unstructured":"Jackson, D. L. (1983). United Airlines' cockpit resource management training. In R. S. Jensen (Ed.), Proceedings of the 2nd International Symposium on Aviation Psychology (pp. 131\u2013137). Columbus: Ohio State University."},{"key":"atypb59","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0803_5"},{"key":"atypb60","unstructured":"Jentsch, F., Bowers, C. A. & Holmes, J. B. (1995). The acquisition and decay of aircrew coordination skills. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 8th International Symposium on Aviation Psychology (pp. 1063\u20131068). Columbus: Ohio State University."},{"key":"atypb61","first-page":"283","volume-title":"Cockpit resource management","author":"Kayten, P. J.","year":"1993"},{"key":"atypb62","first-page":"18.1","volume-title":"Training and development handbook: A guide to human resources development","author":"Kirkpatrick, D. L.","year":"1976"},{"key":"atypb63","unstructured":"Komich, J. (1997). CRM training: Which crossroads to take now? In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 9th International Symposium on Aviation Psychology (pp. 541\u2013546). Columbus: Ohio State University."},{"key":"atypb64","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.78.2.311"},{"key":"atypb65","first-page":"804","volume":"37","author":"Kraiger, K.","year":"1995","journal-title":"Human Performance"},{"key":"atypb66","doi-asserted-by":"crossref","unstructured":"Lassiter, D. L., Vaughn, J. S., Smaltz, V. E., Morgan, B. B., Jr. & Salas, E. (1990). A comparison of two types of training interventions on team communication performance. In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 1372\u20131376). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193129003401815"},{"key":"atypb67","doi-asserted-by":"publisher","DOI":"10.1207\/s15327876mp0702_5"},{"issue":"2","key":"atypb68","first-page":"38","volume":"41","author":"Margerison, C.","year":"1987","journal-title":"Training and Development Journal"},{"key":"atypb69","first-page":"23","volume-title":"Aviation psychology: Training and selection. Proceedings of the 21st Conference of the European Association for Aviation Psychology","author":"Maschke, P.","year":"1995"},{"key":"atypb70","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0402_5"},{"key":"atypb71","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0904_7"},{"key":"atypb72","unstructured":"Merritt, A. C. & Helmreich, R. L. (1995a). CRM in 1995: Where to from here? In B. J. Hayward, & A. R. Lowe (Eds.), Applied aviation psychology: Achievement, change, and challenge. Proceedings of the 3rd Australian Aviation Psychology Symposium (pp. 111\u2013126). Aldershot, England: Avebury Aviation."},{"key":"atypb73","unstructured":"Merritt, A. C. & Helmreich, R. L. (1995b). Culture in the cockpit: A multi-airline study of pilot attitudes and values. In Proceedings of the 8th International Symposium on Aviation Psychology (pp. 676\u2013681). Columbus: Ohio State University."},{"key":"atypb74","unstructured":"Morey, J. C., Grubb, G. & Simon, R. (1997). Towards a new measurement approach for cockpit resource management attitudes. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 9th International Symposium on Aviation Psychology (pp. 478\u2013483). Columbus: Ohio State University."},{"key":"atypb75","unstructured":"Mudge, R. W. (1983). Cockpit management training for the professional pilot. In R. S. Jensen (Ed.), Proceedings of the 2nd Symposium on Aviation Psychology (pp. 165\u2013172). Columbus: Ohio State University."},{"key":"atypb76","unstructured":"Naef, W. (1995). Practical application of CRM concepts: Swissair's human aspects development program (HAD). In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 8th International Symposium on Aviation Psychology (pp. 597\u2013602). Columbus: Ohio State University."},{"key":"atypb77","author":"Nullmeyer, R. T.","journal-title":"Military Psychology"},{"key":"atypb78","volume-title":"Cockpit resource management training","author":"Orlady, H. W.","year":"1987"},{"key":"atypb79","unstructured":"Predmore, S. C. (1991). Microcoding communication in accident investigation: Crew coordination in the United 811 and United 232. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 350\u2013355). Columbus: Ohio State University."},{"key":"atypb80","first-page":"289","volume-title":"Team performance assessment and measurement: Theory, methods, and applications","author":"Prince, C.","year":"1997"},{"key":"atypb81","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0301_5"},{"key":"atypb82","first-page":"193","volume-title":"Handbook of aviation human factors","author":"Prince, C.","year":"1999"},{"key":"atypb83","unstructured":"Robertson, M. M., Taylor, J. C., Stelly, J. W. & Wagner, R. (1995). A systematic training evaluation model applied to measure the effectiveness of an aviation maintenance team training program. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 8th International Symposium on Aviation Psychology (pp. 631\u2013636). Columbus: Ohio State University."},{"key":"atypb84","first-page":"45","volume-title":"Aviation psychology: Training and selection.","author":"Rollins, M. L.","year":"1995"},{"key":"atypb85","doi-asserted-by":"publisher","DOI":"10.1201\/b12465"},{"key":"atypb86","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.52.1.471"},{"key":"atypb87","doi-asserted-by":"publisher","DOI":"10.1518\/001872099779591169"},{"key":"atypb88","doi-asserted-by":"publisher","DOI":"10.1518\/001872099779577255"},{"key":"atypb89","doi-asserted-by":"publisher","DOI":"10.1518\/001872000779698196"},{"key":"atypb90","unstructured":"Schiewe, A. (1995). On the acceptance of CRM-methods by pilots: Results of a cluster analysis. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 8th International Symposium on Aviation Psychology (pp. 540\u2013545). Columbus: Ohio State University."},{"key":"atypb91","volume-title":"Paper presented at the 19th Annual Interservice\/Industry Training, Simulation and Education Conference","author":"Silverman, D. R."},{"key":"atypb92","unstructured":"Simmon, D. A. (1997). How to fix CRM. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 9th International Symposium on Aviation Psychology (pp. 550\u2013553). Columbus: Ohio State University."},{"key":"atypb93","first-page":"185","volume-title":"Applied aviation psychology: Achievement, change, and challenge","author":"Simpson, P.","year":"1995"},{"key":"atypb94","first-page":"17","volume-title":"Aviation psychology: Training and selection","author":"Smith, G. M.","year":"1994"},{"key":"atypb95","doi-asserted-by":"publisher","DOI":"10.21236\/ADA353096"},{"key":"atypb96","doi-asserted-by":"publisher","DOI":"10.1037\/e400702004-001"},{"key":"atypb97","volume-title":"Symposium conducted at the 104th Annual Meeting of the American Psychological Association","author":"Stout, R. J."},{"key":"atypb98","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2699.1.2.169"},{"key":"atypb99","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0703_4"},{"key":"atypb100","first-page":"309","volume-title":"Aviation psychology in practice","author":"Taggart, W. R.","year":"1994"},{"key":"atypb101","volume-title":"Human factors: FAA's guidance and oversight of pilot crew resource management training can be improved","author":"U.S. General Accounting Office.","year":"1997"},{"key":"atypb102","doi-asserted-by":"publisher","DOI":"10.1207\/s15327108ijap0101_7"},{"key":"atypb103","volume-title":"Cockpit resource management.","author":"Wiener, E. L.","year":"1993"},{"key":"atypb104","unstructured":"Wilhelm, J. (1991). Crew member and instructor evaluations of line orientated flight training. In R. S. Jensen (Ed.), Proceedings of the 6th International Symposium on Aviation Psychology (pp. 362\u2013367). Columbus: Ohio State University."},{"key":"atypb105","first-page":"399","volume-title":"Cockpit resource management","author":"Yamamori, H.","year":"1993"},{"key":"atypb106","unstructured":"Young, J. P. (1995). Using group dynamics to reinforce CRM concepts in a collegiate course. In R. S. Jensen, & L. A. Rakovan (Eds.), Proceedings of the 8th International Symposium on Aviation Psychology (pp. 1189\u20131191). Columbus: Ohio State University."}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1518\/001872001775870386","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1518\/001872001775870386","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T14:03:36Z","timestamp":1741615416000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1518\/001872001775870386"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2001,12]]},"references-count":106,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2001,12]]}},"alternative-id":["10.1518\/001872001775870386"],"URL":"https:\/\/doi.org\/10.1518\/001872001775870386","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2001,12]]}}}