{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T04:27:44Z","timestamp":1767673664689,"version":"3.48.0"},"reference-count":62,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T00:00:00Z","timestamp":1548979200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Model Assisted Statistics and Applications"],"published-print":{"date-parts":[[2019,2]]},"abstract":"<jats:p>The aim of this research was to investigate statistical learning techniques to predict gender based upon psychological constructs (measuring motivations to participate in masters sports). Motivations of marathoners scales (MOMS) sports psychological data for 3928 masters athletes (2,010 males) from the World Masters Games (the largest sporting event in the world by participant numbers) was investigated using the regularized linear modelling methodologies ridge regression, the lasso and the elastic net. Comparison was made between previously published research utilizing logistic regression, discriminate function analysis, radial basis functions, multilayer perceptrons and a selection of boosted decision tree based models. It was hypothesized that the regularized linear models would perform better than other models except the boosted decision trees, however ensembles of the regularized linear models and gradient boosted machines would result in improved accuracy over any prior models in the literature. Implementing modern regression methods with regularization provided improvements in classification accuracy based on gender compared to non-regularized linear models, however not boosted trees such as a gradient boosted machine (GBM). Models that were solely or partially based on L2 regularization (including a penalty term to reduce the sum of squares of the parameters) performed better than those than relied solely or primarily on L1 regularization (including a penalty term to reduce the sum of the absolute values of the parameters) or subset selection. This finding had implications for analysis of MOMS data in general with respect to using the 56 questions in MOMS as opposed to the underlying nine constructs for analysis in order to compensate for multicollinearity. Ensemble methods stacking ridge regression and GBMs with out-of-sample prediction further improved accuracy, giving higher accuracy scores (0.7236) than obtained in any preceding literature. This demonstrates the potential benefits from such an ensemble approach in terms of developing models with improved accuracy, as well as increasing the likelihood of developing practical applications from predictions using MOMS psychometric data.<\/jats:p>","DOI":"10.3233\/mas-180454","type":"journal-article","created":{"date-parts":[[2019,5,3]],"date-time":"2019-05-03T10:08:58Z","timestamp":1556878138000},"page":"47-64","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Regularized linear and gradient boosted ensemble methods to predict athletes\u2019 gender based on a survey of masters athletes"],"prefix":"10.1177","volume":"14","author":[{"given":"Joe","family":"Walsh","sequence":"first","affiliation":[{"name":"Charles Darwin University","place":["Australia"]}]},{"given":"Ian Timothy","family":"Heazlewood","sequence":"additional","affiliation":[{"name":"Charles Darwin University","place":["Australia"]}]},{"given":"Mike","family":"Climstein","sequence":"additional","affiliation":[{"name":"The University of Sydney","place":["Australia"]},{"name":"Bond University","place":["Australia"]},{"name":"Southern Cross University","place":["Australia"]}]}],"member":"179","published-online":{"date-parts":[[2019,2]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsams.2011.11.168"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1080\/03610918.2016.1224348"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.3233\/MAS-2008-3304"},{"key":"e_1_3_2_5_2","unstructured":"Bergstra J.S. Bardenet R. Bengio Y. & K\u00e9gl B. (2011). Algorithms for hyper-parameter optimization. In Advances in Neural Information Processing Systems pp. 2546-2554."},{"key":"e_1_3_2_6_2","article-title":"Random search for hyper-parameter optimization","volume":"13","author":"Bergstra, J.","year":"2012","unstructured":"Bergstra,J., & Bengio,Y. (2012). Random search for hyper-parameter optimization. Journal of Machine Learning Research, 13(Feb), 281-305.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1177\/106169341602500106"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.3233\/MAS-140310"},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"e80","DOI":"10.1016\/j.jsams.2011.11.165","article-title":"Physiological demographics of the Sydney World Masters Games competitors","volume":"14","author":"Climstein, M.","year":"2011","unstructured":"Climstein,M. Walsh,J. Burke,S. Adams,K. DeBeliso,M. Kettunen,J., & Heazlewood,I. (2011). Physiological demographics of the Sydney World Masters Games competitors. Journal of Science and Medicine in Sport, 14, e80.","journal-title":"Journal of Science and Medicine in Sport"},{"key":"e_1_3_2_10_2","article-title":"Cardiovascular risk profiles of world masters games participants","volume":"2016","author":"Climstein, M.","year":"2016","unstructured":"Climstein,M. Walsh,J. DeBeliso,M. Heazlewood,T. Sevene,T., & Adams,K. (2016). Cardiovascular risk profiles of world masters games participants. The Journal of Sports Medicine and Physical Fitness, 2016(October).","journal-title":"The Journal of Sports Medicine and Physical Fitness"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1958.tb00292.x"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsams.2011.11.164"},{"key":"e_1_3_2_14_2","article-title":"World Masters Games: North American participant medical and health history survey","volume":"19","author":"DeBeliso, M.","year":"2014","unstructured":"DeBeliso,M. Walsh,J. Climstein,M. Heazlewood,I.T. Kettunen,J. Sevene,T., & Adams,K. (2014). World Masters Games: North American participant medical and health history survey. The Sport Journal, 19.","journal-title":"The Sport Journal"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1249\/01.mss.0000517617.33401.f6"},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"Dietterich T.G. (2000). Ensemble methods in machine learning. In International Workshop on Multiple Classifier Systems pp. 1-15. Springer Berlin Heidelberg.","DOI":"10.1007\/3-540-45014-9_1"},{"key":"e_1_3_2_17_2","unstructured":"Dietterich T.G. & Kong E.B. (1995). Machine learning bias statistical bias and statistical variance of decision tree algorithms. Technical report Department of Computer Science Oregon State University. Retrieved March 2018 from http:\/\/www.cems.uwe.ac.uk\/\u223cirjohnso\/coursenotes\/uqc832\/tr-bias.pdf."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02032.x"},{"key":"e_1_3_2_19_2","unstructured":"Dorogush A.V. Ershov V. & Gulin A. CatBoost: gradient boosting with categorical features support. Technical paper retrieved February 2018 from https:\/\/pdfs.semanticscholar.org\/9a85\/26132d3e05814dca7661b96b3f3208d676cc.pdf."},{"issue":"2","key":"e_1_3_2_20_2","first-page":"179","article-title":"The use of multiple measurements in taxonomic problems","volume":"7","author":"Fisher, R.A.","year":"1936","unstructured":"Fisher,R.A. (1936). The use of multiple measurements in taxonomic problems. Annals of Human Genetics, 7(2), 179-188.","journal-title":"Annals of Human Genetics"},{"key":"e_1_3_2_21_2","first-page":"102","article-title":"Discussion of boosting papers","volume":"32","author":"Friedman, J.","year":"2004","unstructured":"Friedman,J. Hastie,T. Rosset,S. Tibshirani,R., & Zhu,J. (2004). Discussion of boosting papers. Ann. Statist, 32, 102-107.","journal-title":"Ann. Statist"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v033.i01"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.58871"},{"issue":"3","key":"e_1_3_2_24_2","article-title":"Differences in participation motives of first-time marathon finishers and pre-race dropouts","volume":"30","author":"Havenar, J.","year":"2007","unstructured":"Havenar,J., & Lochbaum,M. (2007). Differences in participation motives of first-time marathon finishers and pre-race dropouts. Journal of Sport Behavior, 30(3), 270.13.","journal-title":"Journal of Sport Behavior"},{"key":"e_1_3_2_25_2","first-page":"2027","article-title":"Sport psychological constructs related to participation in the 2009 World Masters Games","volume":"7","author":"Heazlewood, I.T.","year":"2011","unstructured":"Heazlewood,I.T. Walsh,J. Climstein,M. Burke,S. Kettunen,J. Adams,K.J., & DeBeliso,M. (2011). Sport psychological constructs related to participation in the 2009 World Masters Games. World Academy of Science, Engineering and Technology, 7, 2027-2032.","journal-title":"World Academy of Science, Engineering and Technology"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsams.2012.11.331"},{"key":"e_1_3_2_27_2","first-page":"236","article-title":"23 Gender differences in participant motivation in masters football at the 2010 Pan Pacific Masters Games","author":"Heazlewood, I.T.","year":"2015","unstructured":"Heazlewood,I.T. Walsh,J. Climstein,M. Adams,K. Sevene,T. DeBeliso,M., & Kettunen,J. (2015). 23 Gender differences in participant motivation in masters football at the 2010 Pan Pacific Masters Games. International Research in Science and Soccer II, 236.","journal-title":"International Research in Science and Soccer II"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","unstructured":"Heazlewood I.T. Walsh J. Climstein M. Kettunen J. Adams K. & DeBeliso M. (2016a). A comparison of classification accuracy for gender using neural networks multilayer perceptron (MLP) radial basis function (RBF) procedures compared to discriminant function analysis and logistic regression based on nine sports psychological constructs to measure motivations to participate in masters sports competing at the 2009 World Masters Games. In Proceedings of the 10th International Symposium on Computer Science in Sports (ISCSS) pp. 93-101. Springer Cham.","DOI":"10.1007\/978-3-319-24560-7_12"},{"key":"e_1_3_2_29_2","doi-asserted-by":"crossref","unstructured":"Heazlewood I.T. Walsh J. Climstein M. Adams K. Sevene T. DeBeliso M. & Kettunen J.J. (2016b). Participant motivation: A comparison of male and female athletes competing at the 2009 World Masters Games. In Montague J.M. & Tan L.M. (Eds.) Applied Psychology \u2013 proceedings of the 2015 Asian congress pp. 291-297. World Scientific Publishers.","DOI":"10.1142\/9789814723398_0016"},{"key":"e_1_3_2_30_2","doi-asserted-by":"crossref","unstructured":"Heazlewood I.T. Walsh J. Climstein M. Adams K. Sevene T. & DeBeliso M. (2016c). Participant Motivation Predicting Training Sessions and Training Type in Male and Female Athletes Competing at 2010 Pan Pacific Masters Games. In Singapore Conference of Applied Psychology pp. 137-146. Springer Singapore.","DOI":"10.1007\/978-981-10-2796-3_10"},{"key":"e_1_3_2_31_2","doi-asserted-by":"crossref","unstructured":"Heazlewood I.T. Walsh J. Climstein M. Adams K. Sevene T. & DeBeliso M. (2016d). Differences in Participant Motivation Based on Category of Body Mass Index and Gender. In Singapore Conference of Applied Psychology pp. 125-135. Springer Singapore.","DOI":"10.1007\/978-981-10-2796-3_9"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsams.2017.01.139"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1970.10488634"},{"key":"e_1_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Jiang W. (2000). Some results on weakly accurate base learners for boosting regression and classification. In International Workshop on Multiple Classifier Systems pp. 87-96. Springer Berlin Heidelberg.","DOI":"10.1007\/3-540-45014-9_8"},{"issue":"22","key":"e_1_3_2_35_2","first-page":"5","article-title":"A technique for the measurement of attitudes","volume":"140","author":"Likert, R.","year":"1932","unstructured":"Likert,R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 140(22), 5-55.","journal-title":"Archives of Psychology"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/asmb.603"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcm.2006.01.017"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcm.2009.12.028"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02295996"},{"key":"e_1_3_2_40_2","doi-asserted-by":"crossref","unstructured":"Ng A.Y. (2004). Feature selection L1 vs. L2 regularization and rotational invariance. In Proceedings of the Twenty-First International Conference on Machine Learning p. 78. ACM.","DOI":"10.1145\/1015330.1015435"},{"issue":"1","key":"e_1_3_2_41_2","first-page":"69","article-title":"A typology of marathon runners based on cluster analysis of motivations","volume":"26","author":"Ogles, B.M.","year":"2003","unstructured":"Ogles,B.M., & Masters,K.S. (2003). A typology of marathon runners based on cluster analysis of motivations. Journal of Sport Behavior, 26(1), 69.","journal-title":"Journal of Sport Behavior"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1080\/14786440009463897"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022643204877"},{"key":"e_1_3_2_44_2","unstructured":"Quinlan R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11556-008-0029-2"},{"issue":"1","key":"e_1_3_2_46_2","first-page":"139","article-title":"Validation of the Spanish version of the Motivations of Marathoners Scales (MOMS)","volume":"43","author":"Ruiz, F.","year":"2011","unstructured":"Ruiz,F., & Zarauz Sancho,A. (2011). Validation of the Spanish version of the Motivations of Marathoners Scales (MOMS). Revista Latinoamericana de Psicolog\u00eda, 43(1), 139-156.","journal-title":"Revista Latinoamericana de Psicolog\u00eda"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsams.2012.11.869"},{"key":"e_1_3_2_48_2","unstructured":"Snoek J. Larochelle H. & Adams R.P. (2012). Practical Bayesian optimization of machine learning algorithms. In Advances in neural information processing systems pp. 2951-2959."},{"key":"e_1_3_2_49_2","first-page":"465","article-title":"Gauss and the invention of least squares","author":"Stigler, S.M.","year":"1981","unstructured":"Stigler,S.M. (1981). Gauss and the invention of least squares. The Annals of Statistics, 465-474.","journal-title":"The Annals of Statistics"},{"key":"e_1_3_2_50_2","unstructured":"Sydney 2009 World Masters Games Committee. (2009). Sydney 2009 World Masters Games Final Report."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2011.00771.x"},{"key":"e_1_3_2_53_2","first-page":"501","article-title":"O \u0440\u0435\u0448\u0435\u043d\u0438\u0438 \u043d\u0435\u043a\u043e\u0440\u0440\u0435\u043a\u0442\u043d\u043e \u043f\u043e\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u044b\u0445 \u0437\u0430\u0434\u0430\u0447 \u0438 \u043c\u0435\u0442\u043e\u0434\u0435 \u0440\u0435\u0433\u0443\u043b\u044f\u0440\u0438\u0437\u0430\u0446\u0438\u0438 [Solution of incorrectly formulated problems and the regularization method]","volume":"151","author":"Tikhonov, A.N.","year":"1963","unstructured":"Tikhonov,A.N. (1963). O \u0440\u0435\u0448\u0435\u043d\u0438\u0438 \u043d\u0435\u043a\u043e\u0440\u0440\u0435\u043a\u0442\u043d\u043e \u043f\u043e\u0441\u0442\u0430\u0432\u043b\u0435\u043d\u043d\u044b\u0445 \u0437\u0430\u0434\u0430\u0447 \u0438 \u043c\u0435\u0442\u043e\u0434\u0435 \u0440\u0435\u0433\u0443\u043b\u044f\u0440\u0438\u0437\u0430\u0446\u0438\u0438 [Solution of incorrectly formulated problems and the regularization method]. Doklady Akademii Nauk SSSR, 151, 501-504.","journal-title":"Doklady Akademii Nauk SSSR"},{"key":"e_1_3_2_54_2","unstructured":"Tikhonov A.N. Arsenin V.I. & John F. (1977). Solutions of ill-posed problems (Vol. 14). Washington DC: Winston."},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.3233\/MAS-2011-0215"},{"issue":"1","key":"e_1_3_2_56_2","first-page":"33","article-title":"The loess regression relationship between age and BMI for both Sydney World Masters Games athletes and the Australian national population","volume":"1","author":"Walsh, J.","year":"2011","unstructured":"Walsh,J. Climstein,M. Heazlewood,I.T. Burke,S. Kettunen,J. Adams,K., & DeBeliso,M. (2011a). The loess regression relationship between age and BMI for both Sydney World Masters Games athletes and the Australian national population. International Journal of Biological and Medical Sciences, 1(1), 33.","journal-title":"International Journal of Biological and Medical Sciences"},{"issue":"77","key":"e_1_3_2_57_2","first-page":"1119","article-title":"Body mass index for Australian athletes participating in rugby union, soccer and touch football at the World Masters Games","volume":"7","author":"Walsh, J.","year":"2011","unstructured":"Walsh,J. Heazlewood,I.T. Climstein,M. Burke,S. Adams,K. DeBeliso,M., & Kettunen,J. (2011b). Body mass index for Australian athletes participating in rugby union, soccer and touch football at the World Masters Games. Journal of the World Academy of Science, Engineering and Technology, 7(77), 1119-23.","journal-title":"Journal of the World Academy of Science, Engineering and Technology"},{"key":"e_1_3_2_58_2","first-page":"e76","article-title":"Rugby union, soccer, touch football: Injury classification (masters athletes)","volume":"14","author":"Walsh, J.","year":"2011","unstructured":"Walsh,J. Climstein,M. Heazlewood,I.T. Adams,K. DeBeliso,M. Burke,S., & Kettunen,J. (2011c). Rugby union, soccer, touch football: Injury classification (masters athletes). Journal of Science and Medicine in Sport, 14, e76.","journal-title":"Journal of Science and Medicine in Sport"},{"key":"e_1_3_2_59_2","first-page":"e76","article-title":"Masters athletes: Are they hurt more often? (rugby union, soccer and touch football)","volume":"14","author":"Walsh, J.","year":"2011","unstructured":"Walsh,J. Climstein,M. Heazlewood,I.T. Adams,K. DeBeliso,M. Burke,S., & Kettunen,J. (2011d). Masters athletes: Are they hurt more often? (rugby union, soccer and touch football). Journal of Science and Medicine in Sport, 14, e76-e77.","journal-title":"Journal of Science and Medicine in Sport"},{"issue":"2","key":"e_1_3_2_60_2","first-page":"76","article-title":"Obesity prevalence for athletes participating in soccer at the World Masters Games","volume":"13","author":"Walsh, J.","year":"2012","unstructured":"Walsh,J. Burke,S. Climstein,M. Kettunen,J. Heazlewood,I.T. DeBeliso,M., & Adams,K. (2012). Obesity prevalence for athletes participating in soccer at the World Masters Games. International SportMed Journal, 13(2), 76-84.","journal-title":"International SportMed Journal"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.3233\/MAS-180438"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729840"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"}],"container-title":["Model Assisted Statistics and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/MAS-180454","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/MAS-180454","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/MAS-180454","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T04:24:27Z","timestamp":1767673467000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/MAS-180454"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,2]]}},"alternative-id":["10.3233\/MAS-180454"],"URL":"https:\/\/doi.org\/10.3233\/mas-180454","relation":{},"ISSN":["1574-1699","1875-9068"],"issn-type":[{"type":"print","value":"1574-1699"},{"type":"electronic","value":"1875-9068"}],"subject":[],"published":{"date-parts":[[2019,2]]}}}