{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T10:16:44Z","timestamp":1780481804223,"version":"3.54.1"},"reference-count":40,"publisher":"The Angle Orthodontist (EH Angle Education & Research Foundation)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,7]]},"abstract":"ABSTRACT<\/jats:title>\n \n Objective:\u2002<\/jats:title>\n (1) To perform a prospective study using a new set of data to test the validity of a new soft tissue prediction method developed for Class II surgery patients and (2) to propose a better validation method that can be applied to a validation study.<\/jats:p>\n <\/jats:sec>\n \n Materials and Methods:\u2002<\/jats:title>\n Subjects were composed of two subgroups: training subjects and validation subjects. Eighty Class II surgery patients provided the training data set that was used to build the prediction algorithm. The validation data set of 34 new patients was used for evaluating the prospective performance of the prediction algorithm. The validation was conducted using four validation methods: (1) simple validation and (2) fivefold, (3) 10-fold, and (4) leave-one-out cross-validation (LOO).<\/jats:p>\n <\/jats:sec>\n \n Results:\u2002<\/jats:title>\n The characteristics between the training and validation subjects did not differ. The multivariate partial least squares regression returned more accurate prediction results than the conventional method did. During the prospective validation, all of the cross-validation methods (fivefold, 10-fold, and LOO) demonstrated fewer prediction errors and more stable results than the simple validation method did. No significant difference was noted among the three cross-validation methods themselves.<\/jats:p>\n <\/jats:sec>\n \n Conclusion:\u2002<\/jats:title>\n After conducting a prospective study using a new data set, this new prediction method again performed well. In addition, a cross-validation technique may be considered a better option than simple validation when constructing a prediction algorithm.<\/jats:p>\n <\/jats:sec>","DOI":"10.2319\/052514-370.1","type":"journal-article","created":{"date-parts":[[2014,10,2]],"date-time":"2014-10-02T12:43:06Z","timestamp":1412253786000},"page":"597-603","source":"Crossref","is-referenced-by-count":5,"title":["Testing a better method of predicting postsurgery soft tissue response in Class II patients: A prospective study and validity assessment"],"prefix":"10.2319","volume":"85","author":[{"given":"Kyoung-Sik","family":"Yoon","sequence":"first","affiliation":[{"name":"Graduate student, Department of Orthodontics, Seoul National University School of Dentistry, Seoul, Korea."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ho-Jin","family":"Lee","sequence":"additional","affiliation":[{"name":"Graduate student, Department of Orthodontics, Seoul National University School of Dentistry, Seoul, Korea."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shin-Jae","family":"Lee","sequence":"additional","affiliation":[{"name":"Professor and Chair, Department of Orthodontics, Seoul National University School of Dentistry, and Dental Research Institute, Seoul, Korea."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard E.","family":"Donatelli","sequence":"additional","affiliation":[{"name":"Clinical Assistant Professor, Department of Orthodontics, University of Florida College of Dentistry, Gainesville, Fla."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1164","reference":[{"key":"r1","series-title":"Angle Orthod","first-page":"322","article-title":"A better statistical method of predicting postsurgery soft tissue response in Class II patients","volume":"84","author":"Lee\n HJ,","year":"2014","unstructured":"Lee\n HJ, \n \n Suh\n HY, \n \n Lee\n YS, \n et al. \n A better statistical method of predicting postsurgery soft tissue response in Class II patients. Angle Orthod. 2014;84:322\u2013328."},{"key":"r2","series-title":"Stat Surveys","first-page":"40","article-title":"A survey of cross-validation procedures for model selection","volume":"4","author":"Arlot\n S,","year":"2010","unstructured":"Arlot\n S, \n \n Celisse\n A. \n \n A survey of cross-validation procedures for model selection. Stat Surveys. 2010;4:40\u201379."},{"key":"r3","series-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed","author":"Hastie\n T,","year":"2009","unstructured":"Hastie\n T, \n \n Tibshirani\n R, \n \n Friedman\n J. \n \n The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. New York, NY:Springer Verlag; 2009."},{"key":"r4","series-title":"J Am Stat Assoc","first-page":"486","article-title":"Linear-model selection by cross-validation","volume":"88","author":"Shao\n J.","year":"1993","unstructured":"Shao\n J. \n \n Linear-model selection by cross-validation. J Am Stat Assoc. 1993;88:486\u2013494."},{"key":"r5","series-title":"J R Stat Soc B Stat Methodol","first-page":"111","article-title":"Cross-validatory choice and assessment of statistical predictions","volume":"36","author":"Stone\n M.","year":"1974","unstructured":"Stone\n M. \n \n Cross-validatory choice and assessment of statistical predictions. J R Stat Soc B Stat Methodol. 1974;36:111\u2013147."},{"key":"r6","series-title":"J R Stat Soc B Met","first-page":"237","article-title":"Continuum regression\u2013cross-validated sequentially constructed prediction embracing ordinary least-squares, partial least-squares and principal components regression","volume":"52","author":"Stone\n M,","year":"1990","unstructured":"Stone\n M, \n \n Brooks\n RJ. \n \n Continuum regression\u2013cross-validated sequentially constructed prediction embracing ordinary least-squares, partial least-squares and principal components regression. J R Stat Soc B Met. 1990;52:237\u2013269."},{"key":"r7","series-title":"J Oral Maxillofac Surg","first-page":"e553","article-title":"A more accurate method of predicting soft tissue changes after mandibular setback surgery","volume":"70","author":"Suh\n HY,","year":"2012","unstructured":"Suh\n HY, \n \n Lee\n SJ, \n \n Lee\n YS, \n et al. \n A more accurate method of predicting soft tissue changes after mandibular setback surgery. J Oral Maxillofac Surg. 2012;70:e553\u2013e562."},{"key":"r8","series-title":"Am J Orthod Dentofacial Orthop","first-page":"156","article-title":"How to report reliability in orthodontic research: part 1","volume":"144","author":"Donatelli\n RE,","year":"2013","unstructured":"Donatelli\n RE, \n \n Lee\n SJ. \n \n How to report reliability in orthodontic research: part 1. Am J Orthod Dentofacial Orthop. 2013;144:156\u2013161."},{"key":"r9","series-title":"Am J Orthod Dentofacial Orthop","first-page":"315","article-title":"How to report reliability in orthodontic research: part 2","volume":"144","author":"Donatelli\n RE,","year":"2013","unstructured":"Donatelli\n RE, \n \n Lee\n SJ. \n \n How to report reliability in orthodontic research: part 2. Am J Orthod Dentofacial Orthop. 2013;144:315\u2013318."},{"key":"r10","series-title":"R: A Language and Environment for Statistical Computing","year":"2014","unstructured":"R Development Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria:R Foundation for Statistical Computing; 2014."},{"key":"r11","series-title":"Am J Orthod Dentofacial Orthop","first-page":"7e1","article-title":"A cephalometric study of Class II malocclusions treated with mandibular surgery","volume":"131","author":"Burden\n D,","year":"2007","unstructured":"Burden\n D, \n \n Johnston\n C, \n \n Kennedy\n D, \n \n Harradine\n N, \n \n Stevenson\n M. \n \n A cephalometric study of Class II malocclusions treated with mandibular surgery. Am J Orthod Dentofacial Orthop. 2007;131:7e1\u20138."},{"key":"r12","series-title":"Korean J Orthod","first-page":"80","article-title":"Age, extraction rate and jaw surgery rate in Korean orthodontic clinics and small dental hospitals","volume":"42","author":"Jung\n MH.","year":"2012","unstructured":"Jung\n MH. \n \n Age, extraction rate and jaw surgery rate in Korean orthodontic clinics and small dental hospitals. Korean J Orthod. 2012;42:80\u201386."},{"key":"r13","series-title":"J Oral Maxillofac Surg","first-page":"751","article-title":"Accuracy of computer programs in predicting orthognathic surgery soft tissue response","volume":"67","author":"Kaipatur\n NR,","year":"2009","unstructured":"Kaipatur\n NR, \n \n Flores-Mir\n C. \n \n Accuracy of computer programs in predicting orthognathic surgery soft tissue response. J Oral Maxillofac Surg. 2009;67:751\u2013759."},{"key":"r14","series-title":"Angle Orthod","first-page":"216","article-title":"Factors influencing the predictability of soft tissue profile changes following mandibular setback surgery","volume":"71","author":"Mobarak\n KA,","year":"2001","unstructured":"Mobarak\n KA, \n \n Krogstad\n O, \n \n Espeland\n L, \n \n Lyberg\n T. \n \n Factors influencing the predictability of soft tissue profile changes following mandibular setback surgery. Angle Orthod. 2001;71:216\u2013227."},{"key":"r15","series-title":"Angle Orthod","first-page":"347","article-title":"Predicting soft tissue changes in maxillary impaction surgery: a comparison of two video imaging systems","volume":"67","author":"Sameshima\n GT,","year":"1997","unstructured":"Sameshima\n GT, \n \n Kawakami\n RK, \n \n Kaminishi\n RM, \n \n Sinclair\n PM. \n \n Predicting soft tissue changes in maxillary impaction surgery: a comparison of two video imaging systems. Angle Orthod. 1997;67:347\u2013354."},{"key":"r16","series-title":"Korean J Orthod","first-page":"279","article-title":"The predictability of dentoskeletal factors for soft-tissue chin strain during lip closure","volume":"43","author":"Yu\n YH,","year":"2013","unstructured":"Yu\n YH, \n \n Kim\n YJ, \n \n Lee\n DY, \n \n Lim\n YK. \n \n The predictability of dentoskeletal factors for soft-tissue chin strain during lip closure. Korean J Orthod. 2013;43:279\u2013287."},{"key":"r17","series-title":"An Introduction to Partial Least Squares: TS-509","author":"Tobias\n RD.","year":"2006","unstructured":"Tobias\n RD. \n \n An Introduction to Partial Least Squares: TS-509. Cary, NC:SAS Institute Inc; 2006."},{"key":"r18","series-title":"Neuroimage","first-page":"455","article-title":"Partial least squares (PLS) methods for neuroimaging: a tutorial and review","volume":"56","author":"Krishnan\n A,","year":"2011","unstructured":"Krishnan\n A, \n \n Williams\n LJ, \n \n McIntosh\n AR, \n \n Abdi\n H. \n \n Partial least squares (PLS) methods for neuroimaging: a tutorial and review. Neuroimage. 2011;56:455\u2013475."},{"key":"r19","series-title":"Chemometric With R: Multivariate Data Analysis in the Natural Sciences and Life Sciences. 1st ed","author":"Wehrens\n R.","year":"2011","unstructured":"Wehrens\n R. \n \n Chemometric With R: Multivariate Data Analysis in the Natural Sciences and Life Sciences. 1st ed. Heidelberg, Germany:Springer; 2011."},{"key":"r20","series-title":"Analyzing Microarray Gene Expression Data","author":"McLachlan\n GJ,","year":"2004","unstructured":"McLachlan\n GJ, \n \n Do\n KA, \n \n Ambroise\n C. \n \n Analyzing Microarray Gene Expression Data. Hoboken, NJ, USA:Wiley-Interscience; 2004."},{"key":"r1","series-title":"Angle Orthod","first-page":"322","article-title":"A better statistical method of predicting postsurgery soft tissue response in Class II patients","volume":"84","author":"Lee\n HJ,","year":"2014","unstructured":"Lee\n HJ, \n \n Suh\n HY, \n \n Lee\n YS, \n et al. \n A better statistical method of predicting postsurgery soft tissue response in Class II patients. Angle Orthod. 2014;84:322\u2013328."},{"key":"r2","series-title":"Stat Surveys","first-page":"40","article-title":"A survey of cross-validation procedures for model selection","volume":"4","author":"Arlot\n S,","year":"2010","unstructured":"Arlot\n S, \n \n Celisse\n A. \n \n A survey of cross-validation procedures for model selection. Stat Surveys. 2010;4:40\u201379."},{"key":"r3","series-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed","author":"Hastie\n T,","year":"2009","unstructured":"Hastie\n T, \n \n Tibshirani\n R, \n \n Friedman\n J. \n \n The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. New York, NY:Springer Verlag; 2009."},{"key":"r4","series-title":"J Am Stat Assoc","first-page":"486","article-title":"Linear-model selection by cross-validation","volume":"88","author":"Shao\n J.","year":"1993","unstructured":"Shao\n J. \n \n Linear-model selection by cross-validation. J Am Stat Assoc. 1993;88:486\u2013494."},{"key":"r5","series-title":"J R Stat Soc B Stat Methodol","first-page":"111","article-title":"Cross-validatory choice and assessment of statistical predictions","volume":"36","author":"Stone\n M.","year":"1974","unstructured":"Stone\n M. \n \n Cross-validatory choice and assessment of statistical predictions. J R Stat Soc B Stat Methodol. 1974;36:111\u2013147."},{"key":"r6","series-title":"J R Stat Soc B Met","first-page":"237","article-title":"Continuum regression\u2013cross-validated sequentially constructed prediction embracing ordinary least-squares, partial least-squares and principal components regression","volume":"52","author":"Stone\n M,","year":"1990","unstructured":"Stone\n M, \n \n Brooks\n RJ. \n \n Continuum regression\u2013cross-validated sequentially constructed prediction embracing ordinary least-squares, partial least-squares and principal components regression. J R Stat Soc B Met. 1990;52:237\u2013269."},{"key":"r7","series-title":"J Oral Maxillofac Surg","first-page":"e553","article-title":"A more accurate method of predicting soft tissue changes after mandibular setback surgery","volume":"70","author":"Suh\n HY,","year":"2012","unstructured":"Suh\n HY, \n \n Lee\n SJ, \n \n Lee\n YS, \n et al. \n A more accurate method of predicting soft tissue changes after mandibular setback surgery. J Oral Maxillofac Surg. 2012;70:e553\u2013e562."},{"key":"r8","series-title":"Am J Orthod Dentofacial Orthop","first-page":"156","article-title":"How to report reliability in orthodontic research: part 1","volume":"144","author":"Donatelli\n RE,","year":"2013","unstructured":"Donatelli\n RE, \n \n Lee\n SJ. \n \n How to report reliability in orthodontic research: part 1. Am J Orthod Dentofacial Orthop. 2013;144:156\u2013161."},{"key":"r9","series-title":"Am J Orthod Dentofacial Orthop","first-page":"315","article-title":"How to report reliability in orthodontic research: part 2","volume":"144","author":"Donatelli\n RE,","year":"2013","unstructured":"Donatelli\n RE, \n \n Lee\n SJ. \n \n How to report reliability in orthodontic research: part 2. Am J Orthod Dentofacial Orthop. 2013;144:315\u2013318."},{"key":"r10","series-title":"R: A Language and Environment for Statistical Computing","year":"2014","unstructured":"R Development Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria:R Foundation for Statistical Computing; 2014."},{"key":"r11","series-title":"Am J Orthod Dentofacial Orthop","first-page":"7e1","article-title":"A cephalometric study of Class II malocclusions treated with mandibular surgery","volume":"131","author":"Burden\n D,","year":"2007","unstructured":"Burden\n D, \n \n Johnston\n C, \n \n Kennedy\n D, \n \n Harradine\n N, \n \n Stevenson\n M. \n \n A cephalometric study of Class II malocclusions treated with mandibular surgery. Am J Orthod Dentofacial Orthop. 2007;131:7e1\u20138."},{"key":"r12","series-title":"Korean J Orthod","first-page":"80","article-title":"Age, extraction rate and jaw surgery rate in Korean orthodontic clinics and small dental hospitals","volume":"42","author":"Jung\n MH.","year":"2012","unstructured":"Jung\n MH. \n \n Age, extraction rate and jaw surgery rate in Korean orthodontic clinics and small dental hospitals. Korean J Orthod. 2012;42:80\u201386."},{"key":"r13","series-title":"J Oral Maxillofac Surg","first-page":"751","article-title":"Accuracy of computer programs in predicting orthognathic surgery soft tissue response","volume":"67","author":"Kaipatur\n NR,","year":"2009","unstructured":"Kaipatur\n NR, \n \n Flores-Mir\n C. \n \n Accuracy of computer programs in predicting orthognathic surgery soft tissue response. J Oral Maxillofac Surg. 2009;67:751\u2013759."},{"key":"r14","series-title":"Angle Orthod","first-page":"216","article-title":"Factors influencing the predictability of soft tissue profile changes following mandibular setback surgery","volume":"71","author":"Mobarak\n KA,","year":"2001","unstructured":"Mobarak\n KA, \n \n Krogstad\n O, \n \n Espeland\n L, \n \n Lyberg\n T. \n \n Factors influencing the predictability of soft tissue profile changes following mandibular setback surgery. Angle Orthod. 2001;71:216\u2013227."},{"key":"r15","series-title":"Angle Orthod","first-page":"347","article-title":"Predicting soft tissue changes in maxillary impaction surgery: a comparison of two video imaging systems","volume":"67","author":"Sameshima\n GT,","year":"1997","unstructured":"Sameshima\n GT, \n \n Kawakami\n RK, \n \n Kaminishi\n RM, \n \n Sinclair\n PM. \n \n Predicting soft tissue changes in maxillary impaction surgery: a comparison of two video imaging systems. Angle Orthod. 1997;67:347\u2013354."},{"key":"r16","series-title":"Korean J Orthod","first-page":"279","article-title":"The predictability of dentoskeletal factors for soft-tissue chin strain during lip closure","volume":"43","author":"Yu\n YH,","year":"2013","unstructured":"Yu\n YH, \n \n Kim\n YJ, \n \n Lee\n DY, \n \n Lim\n YK. \n \n The predictability of dentoskeletal factors for soft-tissue chin strain during lip closure. Korean J Orthod. 2013;43:279\u2013287."},{"key":"r17","series-title":"An Introduction to Partial Least Squares: TS-509","author":"Tobias\n RD.","year":"2006","unstructured":"Tobias\n RD. \n \n An Introduction to Partial Least Squares: TS-509. Cary, NC:SAS Institute Inc; 2006."},{"key":"r18","series-title":"Neuroimage","first-page":"455","article-title":"Partial least squares (PLS) methods for neuroimaging: a tutorial and review","volume":"56","author":"Krishnan\n A,","year":"2011","unstructured":"Krishnan\n A, \n \n Williams\n LJ, \n \n McIntosh\n AR, \n \n Abdi\n H. \n \n Partial least squares (PLS) methods for neuroimaging: a tutorial and review. Neuroimage. 2011;56:455\u2013475."},{"key":"r19","series-title":"Chemometric With R: Multivariate Data Analysis in the Natural Sciences and Life Sciences. 1st ed","author":"Wehrens\n R.","year":"2011","unstructured":"Wehrens\n R. \n \n Chemometric With R: Multivariate Data Analysis in the Natural Sciences and Life Sciences. 1st ed. Heidelberg, Germany:Springer; 2011."},{"key":"r20","series-title":"Analyzing Microarray Gene Expression Data","author":"McLachlan\n GJ,","year":"2004","unstructured":"McLachlan\n GJ, \n \n Do\n KA, \n \n Ambroise\n C. \n \n Analyzing Microarray Gene Expression Data. Hoboken, NJ, USA:Wiley-Interscience; 2004."}],"container-title":["The Angle Orthodontist"],"original-title":[],"link":[{"URL":"https:\/\/angle-orthodontist.kglmeridian.com\/view\/journals\/angl\/85\/4\/article-p597.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/meridian.allenpress.com\/angle-orthodontist\/article-pdf\/85\/4\/597\/1391672\/052514-370_1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/angle-orthodontist.kglmeridian.com\/downloadpdf\/journals\/angl\/85\/4\/article-p597.xml","content-type":"text\/html","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/angle-orthodontist.kglmeridian.com\/downloadpdf\/journals\/angl\/85\/4\/article-p597.xml","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T15:00:11Z","timestamp":1780066811000},"score":1,"resource":{"primary":{"URL":"https:\/\/angle-orthodontist.kglmeridian.com\/view\/journals\/angl\/85\/4\/article-p597.xml"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7]]},"references-count":40,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.2319\/052514-370.1","relation":{},"ISSN":["0003-3219"],"issn-type":[{"value":"0003-3219","type":"print"}],"subject":[],"published":{"date-parts":[[2015,7]]}}}