{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T18:03:23Z","timestamp":1790791403665,"version":"4.1.0"},"reference-count":34,"publisher":"Human Kinetics","issue":"9","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,9,1]]},"abstract":"<jats:p>\n                    Recent methodological recommendations suggest the use of the \u201c3-step method,\u201d consisting of calendar-based counting, urinary ovulation testing, and serum blood sampling, for the identification of subtle menstrual disturbances (SMDs). However, the use of the 3-step method is not always feasible, so a less demanding combination of calendar-based counting and urinary ovulation testing, that is, the 2-step method, may be a viable alternative.\n                    <jats:italic>\n                      <jats:bold>Purpose<\/jats:bold>\n                      :\n                    <\/jats:italic>\n                    To investigate the agreement between the 2- and 3-step methods for the detection of SMDs.\n                    <jats:italic>\n                      <jats:bold>Methods<\/jats:bold>\n                      :\n                    <\/jats:italic>\n                    Menstrual cycles (MCs, 98) of 59 athletes were assessed using the 2- and 3-step methods. Regular-length MCs (ie,\u00a0\u226521 and \u226435\u00a0d) were classified as either having no SMD (luteal phase length \u226510\u00a0d, midluteal progesterone concentration \u226516\u00a0nmol\u00b7L\n                    <jats:sup>\u22121<\/jats:sup>\n                    , and being ovulatory) or having an SMD (eg,\u00a0short luteal phase [&lt;10\u00a0d], inadequate luteal phase [midluteal progesterone concentration &lt;16\u00a0nmol\u00b7L\n                    <jats:sup>\u22121<\/jats:sup>\n                    ], or being anovulatory). Method agreement was assessed using the\u00a0McNemar test and Cohen kappa (\n                    <jats:italic>\u03ba<\/jats:italic>\n                    ).\n                    <jats:italic>\n                      <jats:bold>Results<\/jats:bold>\n                      :\n                    <\/jats:italic>\n                    Substantial agreement was observed between methods (\n                    <jats:italic>\u03ba<\/jats:italic>\n                    \u2009=\u2009.72; 95% CI, .53\u2013.91), but the 2-step method did not detect all MCs with an SMD, resulting in evidence of systematic bias (\n                    <jats:italic>\u03c7<\/jats:italic>\n                    <jats:sup>2<\/jats:sup>\n                    \u2009=\u20095.14;\n                    <jats:italic>P<\/jats:italic>\n                    \u2009=\u2009.023). The 2-step method detected 61.1% of MCs that had an SMD ([51.4, 70.8]), as verified using the 3-step method, and correctly identified 100% of MCs without an SMD.\n                    <jats:italic>\n                      <jats:bold>Conclusions<\/jats:bold>\n                      :\n                    <\/jats:italic>\n                    MCs classified as being disturbed using the 2-step method could be considered valid evidence of SMDs. However, MCs classified without SMDs do not definitively confirm their absence, due to the proven underdetection via the 2-step method.\n                  <\/jats:p>","DOI":"10.1123\/ijspp.2024-0057","type":"journal-article","created":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T19:01:18Z","timestamp":1721761278000},"page":"953-957","source":"Crossref","is-referenced-by-count":20,"title":["Agreement Between the 2- and 3-Step Methods for Identifying Subtle Menstrual Disturbances"],"prefix":"10.1123","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1630-4696","authenticated-orcid":true,"given":"Dionne A.","family":"Noordhof","sequence":"first","affiliation":[{"name":"Department of Neuromedicine and Movement Science, Center for Elite Sports Research, Norwegian University of Science and Technology, Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4241-3004","authenticated-orcid":true,"given":"Madison Y.","family":"Taylor","sequence":"additional","affiliation":[{"name":"School of Sport Sciences, UiT the Arctic University of Norway, Troms\u00f8, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8123-0841","authenticated-orcid":true,"given":"Virginia","family":"De Martin Topranin","sequence":"additional","affiliation":[{"name":"Department of Neuromedicine and Movement Science, Center for Elite Sports Research, Norwegian University of Science and Technology, Trondheim, Norway"},{"name":"Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1823-7087","authenticated-orcid":true,"given":"Tina P.","family":"Engseth","sequence":"additional","affiliation":[{"name":"School of Sport Sciences, UiT the Arctic University of Norway, Troms\u00f8, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9014-5152","authenticated-orcid":true,"given":"\u00d8yvind","family":"Sandbakk","sequence":"additional","affiliation":[{"name":"Department of Neuromedicine and Movement Science, Center for Elite Sports Research, Norwegian University of Science and Technology, Trondheim, Norway"},{"name":"School of Sport Sciences, UiT the Arctic University of Norway, Troms\u00f8, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8681-8521","authenticated-orcid":true,"given":"John O.","family":"Osborne","sequence":"additional","affiliation":[{"name":"School of Sport Sciences, UiT the Arctic University of Norway, Troms\u00f8, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"100","reference":[{"issue":"5","key":"r1","series-title":"Sports Med","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1007\/s40279-021-01435-8","article-title":"Methodological considerations for studies in sport and exercise science with women as participants: a working guide for standards of practice for research on women","volume":"51","author":"Elliott-Sale KJ","year":"2021","unstructured":"Elliott-Sale KJ, Minahan CL, de Jonge XAKJ, et\u00a0al. Methodological considerations for studies in sport and exercise science with women as participants: a working guide for standards of practice for research on women. Sports Med. 2021;51(5):843\u2013861. doi:10.1007\/s40279-021-01435-8"},{"issue":"12","key":"r2","series-title":"Med Sci Sports Exerc","doi-asserted-by":"publisher","first-page":"2610","DOI":"10.1249\/MSS.0000000000002073","article-title":"Methodological recommendations for menstrual cycle research in sports and exercise","volume":"51","author":"Janse de Jonge X","year":"2019","unstructured":"Janse de Jonge X, Thompson B, Han A. Methodological recommendations for menstrual cycle research in sports and exercise. Med Sci Sports Exerc. 2019;51(12):2610\u20132617. doi:10.1249\/MSS.0000000000002073"},{"issue":"2","key":"r3","series-title":"Hum Reprod","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1093\/humrep\/dep411","article-title":"High prevalence of subtle and severe menstrual disturbances in exercising women: confirmation using daily hormone measures","volume":"25","author":"De Souza MJ","year":"2010","unstructured":"De Souza MJ, Toombs RJ, Scheid JL, O\u2019Donnell E, West SL, Williams NI. High prevalence of subtle and severe menstrual disturbances in exercising women: confirmation using daily hormone measures. Hum Reprod. 2010;25(2):491\u2013503. doi:10.1093\/humrep\/dep411"},{"key":"r4","series-title":"Front Endocrinol","article-title":"Adaptive, reversible, hypothalamic reproductive suppression: more than functional hypothalamic amenorrhea","volume":"13","author":"Prior JC","year":"2022","unstructured":"Prior JC. Adaptive, reversible, hypothalamic reproductive suppression: more than functional hypothalamic amenorrhea. Front Endocrinol. 2022;13:889. https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2022.893889. Accessed January 18, 2024."},{"issue":"6","key":"r5","series-title":"J Clin Endocrinol Metab","doi-asserted-by":"publisher","first-page":"E1007","DOI":"10.1210\/jc.2013-3534","article-title":"Luteal phase deficiency in regularly menstruating women: prevalence and overlap in identification based on clinical and biochemical diagnostic criteria","volume":"99","author":"Schliep KC","year":"2014","unstructured":"Schliep KC, Mumford SL, Hammoud AO, et\u00a0al. Luteal phase deficiency in regularly menstruating women: prevalence and overlap in identification based on clinical and biochemical diagnostic criteria. J Clin Endocrinol Metab. 2014;99(6):E1007\u2013E1014. doi:10.1210\/jc.2013-3534"},{"issue":"11","key":"r6","series-title":"J Sci Med Sport","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1016\/j.jsams.2016.08.013","article-title":"Three-step method for menstrual and oral contraceptive cycle verification","volume":"20","author":"Schaumberg MA","year":"2017","unstructured":"Schaumberg MA, Jenkins DG, Janse de Jonge XAK, Emmerton LM, Skinner TL. Three-step method for menstrual and oral contraceptive cycle verification. J Sci Med Sport. 2017;20(11):965\u2013969. doi:10.1016\/j.jsams.2016.08.013"},{"issue":"10","key":"r7","series-title":"Sports Med","doi-asserted-by":"publisher","first-page":"1963","DOI":"10.1007\/s40279-023-01871-8","article-title":"The prevalence of menstrual cycle disorders and menstrual cycle-related symptoms in female athletes: a systematic literature review","volume":"53","author":"Taim BC","year":"2023","unstructured":"Taim BC, \u00d3 Cath\u00e1in C, Renard M, Elliot-Sale KJ, Madigan S, N\u00ed Ch\u00e9illeachair N. The prevalence of menstrual cycle disorders and menstrual cycle-related symptoms in female athletes: a systematic literature review. Sports Med. 2023;53(10):1963\u20131984. doi:10.1007\/s40279-023-01871-8"},{"issue":"17","key":"r8","series-title":"Br J Sports Med","doi-asserted-by":"publisher","first-page":"1073","DOI":"10.1136\/bjsports-2023-106994","article-title":"2023 International Olympic Committee\u2019s (IOC) consensus statement on relative energy deficiency in sport (REDs)","volume":"57","author":"Mountjoy M","year":"2023","unstructured":"Mountjoy M, Ackerman KE, Bailey DM, et\u00a0al. 2023 International Olympic Committee\u2019s (IOC) consensus statement on relative energy deficiency in sport (REDs). Br J Sports Med. 2023;57(17):1073\u20131097. doi:10.1136\/bjsports-2023-106994"},{"key":"r9","year":"2023","unstructured":"The FENDURA Research Project | UiT. 2023. https:\/\/uit.no\/research\/fendura?p_document_id=685241&Baseurl=%2Fresearch%2F. Accessed December 5, 2023."},{"issue":"2","key":"r10","series-title":"Int J Sports Physiol Perform","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1123\/ijspp.2021-0451","article-title":"Defining training and performance caliber: a participant classification framework","volume":"17","author":"McKay AKA","year":"2021","unstructured":"McKay AKA, Stellingwerff T, Smith ES, et\u00a0al. Defining training and performance caliber: a participant classification framework. Int J Sports Physiol Perform. 2021;17(2):317\u2013331. doi:10.1123\/ijspp.2021-0451"},{"key":"r11","article-title":"R: a language and environment for statistical computing","year":"2021","unstructured":"R Core Team. R: a language and environment for statistical computing. 2021. https:\/\/www.r-project.org\/"},{"key":"r12","year":"2023","unstructured":"RStudio: Integrated Development for R. 2023. https:\/\/www.rstudio.com\/"},{"issue":"9","key":"r13","series-title":"Theriogenology","doi-asserted-by":"publisher","first-page":"1167","DOI":"10.1016\/j.theriogenology.2010.01.003","article-title":"Method agreement analysis: a review of correct methodology","volume":"73","author":"Watson PF","year":"2010","unstructured":"Watson PF, Petrie A. Method agreement analysis: a review of correct methodology. Theriogenology. 2010;73(9):1167\u20131179. doi:10.1016\/j.theriogenology.2010.01.003"},{"issue":"1","key":"r14","series-title":"Biometrics","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis JR","year":"1977","unstructured":"Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159\u2013174. doi:10.2307\/2529310"},{"issue":"9","key":"r15","series-title":"Med Sci Sports Exerc","doi-asserted-by":"publisher","first-page":"1553","DOI":"10.1249\/01.MSS.0000084530.31478.DF","article-title":"Menstrual disturbances in athletes: a focus on luteal phase defects","volume":"35","author":"De Souza MJ","year":"2003","unstructured":"De Souza MJ. Menstrual disturbances in athletes: a focus on luteal phase defects. Med Sci Sports Exerc. 2003;35(9):1553\u20131563. doi:10.1249\/01.MSS.0000084530.31478.DF"},{"key":"r16","series-title":"Sex Hormones, Exercise and Women: Scientific and Clinical Aspects","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-21881-1","year":"2023","unstructured":"Hackney AC, ed. Sex Hormones, Exercise and Women: Scientific and Clinical Aspects. Springer International Publishing; 2023. doi:10.1007\/978-3-031-21881-1"},{"key":"r17","series-title":"Front Public Health","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2017.00307","article-title":"Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice","volume":"5","author":"Trevethan R","year":"2017","unstructured":"Trevethan R. Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice. Front Public Health. 2017;5:307. doi:10.3389\/fpubh.2017.00307"},{"issue":"5","key":"r1","series-title":"Sports Med","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1007\/s40279-021-01435-8","article-title":"Methodological considerations for studies in sport and exercise science with women as participants: a working guide for standards of practice for research on women","volume":"51","author":"Elliott-Sale KJ","year":"2021","unstructured":"Elliott-Sale KJ, Minahan CL, de Jonge XAKJ, et\u00a0al. Methodological considerations for studies in sport and exercise science with women as participants: a working guide for standards of practice for research on women. Sports Med. 2021;51(5):843\u2013861. doi:10.1007\/s40279-021-01435-8"},{"issue":"12","key":"r2","series-title":"Med Sci Sports Exerc","doi-asserted-by":"publisher","first-page":"2610","DOI":"10.1249\/MSS.0000000000002073","article-title":"Methodological recommendations for menstrual cycle research in sports and exercise","volume":"51","author":"Janse de Jonge X","year":"2019","unstructured":"Janse de Jonge X, Thompson B, Han A. Methodological recommendations for menstrual cycle research in sports and exercise. Med Sci Sports Exerc. 2019;51(12):2610\u20132617. doi:10.1249\/MSS.0000000000002073"},{"issue":"2","key":"r3","series-title":"Hum Reprod","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1093\/humrep\/dep411","article-title":"High prevalence of subtle and severe menstrual disturbances in exercising women: confirmation using daily hormone measures","volume":"25","author":"De Souza MJ","year":"2010","unstructured":"De Souza MJ, Toombs RJ, Scheid JL, O\u2019Donnell E, West SL, Williams NI. High prevalence of subtle and severe menstrual disturbances in exercising women: confirmation using daily hormone measures. Hum Reprod. 2010;25(2):491\u2013503. doi:10.1093\/humrep\/dep411"},{"key":"r4","series-title":"Front Endocrinol","article-title":"Adaptive, reversible, hypothalamic reproductive suppression: more than functional hypothalamic amenorrhea","volume":"13","author":"Prior JC","year":"2022","unstructured":"Prior JC. Adaptive, reversible, hypothalamic reproductive suppression: more than functional hypothalamic amenorrhea. Front Endocrinol. 2022;13:889. https:\/\/www.frontiersin.org\/articles\/10.3389\/fendo.2022.893889. Accessed January 18, 2024."},{"issue":"6","key":"r5","series-title":"J Clin Endocrinol Metab","doi-asserted-by":"publisher","first-page":"E1007","DOI":"10.1210\/jc.2013-3534","article-title":"Luteal phase deficiency in regularly menstruating women: prevalence and overlap in identification based on clinical and biochemical diagnostic criteria","volume":"99","author":"Schliep KC","year":"2014","unstructured":"Schliep KC, Mumford SL, Hammoud AO, et\u00a0al. Luteal phase deficiency in regularly menstruating women: prevalence and overlap in identification based on clinical and biochemical diagnostic criteria. J Clin Endocrinol Metab. 2014;99(6):E1007\u2013E1014. doi:10.1210\/jc.2013-3534"},{"issue":"11","key":"r6","series-title":"J Sci Med Sport","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1016\/j.jsams.2016.08.013","article-title":"Three-step method for menstrual and oral contraceptive cycle verification","volume":"20","author":"Schaumberg MA","year":"2017","unstructured":"Schaumberg MA, Jenkins DG, Janse de Jonge XAK, Emmerton LM, Skinner TL. Three-step method for menstrual and oral contraceptive cycle verification. J Sci Med Sport. 2017;20(11):965\u2013969. doi:10.1016\/j.jsams.2016.08.013"},{"issue":"10","key":"r7","series-title":"Sports Med","doi-asserted-by":"publisher","first-page":"1963","DOI":"10.1007\/s40279-023-01871-8","article-title":"The prevalence of menstrual cycle disorders and menstrual cycle-related symptoms in female athletes: a systematic literature review","volume":"53","author":"Taim BC","year":"2023","unstructured":"Taim BC, \u00d3 Cath\u00e1in C, Renard M, Elliot-Sale KJ, Madigan S, N\u00ed Ch\u00e9illeachair N. The prevalence of menstrual cycle disorders and menstrual cycle-related symptoms in female athletes: a systematic literature review. Sports Med. 2023;53(10):1963\u20131984. doi:10.1007\/s40279-023-01871-8"},{"issue":"17","key":"r8","series-title":"Br J Sports Med","doi-asserted-by":"publisher","first-page":"1073","DOI":"10.1136\/bjsports-2023-106994","article-title":"2023 International Olympic Committee\u2019s (IOC) consensus statement on relative energy deficiency in sport (REDs)","volume":"57","author":"Mountjoy M","year":"2023","unstructured":"Mountjoy M, Ackerman KE, Bailey DM, et\u00a0al. 2023 International Olympic Committee\u2019s (IOC) consensus statement on relative energy deficiency in sport (REDs). Br J Sports Med. 2023;57(17):1073\u20131097. doi:10.1136\/bjsports-2023-106994"},{"key":"r9","year":"2023","unstructured":"The FENDURA Research Project | UiT. 2023. https:\/\/uit.no\/research\/fendura?p_document_id=685241&Baseurl=%2Fresearch%2F. Accessed December 5, 2023."},{"issue":"2","key":"r10","series-title":"Int J Sports Physiol Perform","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1123\/ijspp.2021-0451","article-title":"Defining training and performance caliber: a participant classification framework","volume":"17","author":"McKay AKA","year":"2021","unstructured":"McKay AKA, Stellingwerff T, Smith ES, et\u00a0al. Defining training and performance caliber: a participant classification framework. Int J Sports Physiol Perform. 2021;17(2):317\u2013331. doi:10.1123\/ijspp.2021-0451"},{"key":"r11","article-title":"R: a language and environment for statistical computing","year":"2021","unstructured":"R Core Team. R: a language and environment for statistical computing. 2021. https:\/\/www.r-project.org\/"},{"key":"r12","year":"2023","unstructured":"RStudio: Integrated Development for R. 2023. https:\/\/www.rstudio.com\/"},{"issue":"9","key":"r13","series-title":"Theriogenology","doi-asserted-by":"publisher","first-page":"1167","DOI":"10.1016\/j.theriogenology.2010.01.003","article-title":"Method agreement analysis: a review of correct methodology","volume":"73","author":"Watson PF","year":"2010","unstructured":"Watson PF, Petrie A. Method agreement analysis: a review of correct methodology. Theriogenology. 2010;73(9):1167\u20131179. doi:10.1016\/j.theriogenology.2010.01.003"},{"issue":"1","key":"r14","series-title":"Biometrics","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data","volume":"33","author":"Landis JR","year":"1977","unstructured":"Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159\u2013174. doi:10.2307\/2529310"},{"issue":"9","key":"r15","series-title":"Med Sci Sports Exerc","doi-asserted-by":"publisher","first-page":"1553","DOI":"10.1249\/01.MSS.0000084530.31478.DF","article-title":"Menstrual disturbances in athletes: a focus on luteal phase defects","volume":"35","author":"De Souza MJ","year":"2003","unstructured":"De Souza MJ. Menstrual disturbances in athletes: a focus on luteal phase defects. Med Sci Sports Exerc. 2003;35(9):1553\u20131563. doi:10.1249\/01.MSS.0000084530.31478.DF"},{"key":"r16","series-title":"Sex Hormones, Exercise and Women: Scientific and Clinical Aspects","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-21881-1","year":"2023","unstructured":"Hackney AC, ed. Sex Hormones, Exercise and Women: Scientific and Clinical Aspects. Springer International Publishing; 2023. doi:10.1007\/978-3-031-21881-1"},{"key":"r17","series-title":"Front Public Health","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2017.00307","article-title":"Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice","volume":"5","author":"Trevethan R","year":"2017","unstructured":"Trevethan R. Sensitivity, specificity, and predictive values: foundations, pliabilities, and pitfalls in research and practice. Front Public Health. 2017;5:307. doi:10.3389\/fpubh.2017.00307"}],"container-title":["International Journal of Sports Physiology and Performance"],"original-title":[],"link":[{"URL":"https:\/\/journals.humankinetics.com\/view\/journals\/ijspp\/19\/9\/article-p953.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.humankinetics.com\/downloadpdf\/journals\/ijspp\/19\/9\/article-p953.xml","content-type":"text\/html","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/journals.humankinetics.com\/downloadpdf\/journals\/ijspp\/19\/9\/article-p953.xml","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T11:10:03Z","timestamp":1775905803000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.humankinetics.com\/view\/journals\/ijspp\/19\/9\/article-p953.xml"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,1]]},"references-count":34,"journal-issue":{"issue":"9"},"URL":"https:\/\/doi.org\/10.1123\/ijspp.2024-0057","relation":{},"ISSN":["1555-0265","1555-0273"],"issn-type":[{"value":"1555-0265","type":"print"},{"value":"1555-0273","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,1]]}}}