{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T00:08:44Z","timestamp":1780358924155,"version":"3.54.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,11,27]],"date-time":"2019-11-27T00:00:00Z","timestamp":1574812800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,11,27]],"date-time":"2019-11-27T00:00:00Z","timestamp":1574812800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Antiretroviral therapy (ART) has significantly reduced HIV-related morbidity and mortality. However, therapeutic benefit of ART is often limited by delayed drug-associated toxicity. Nucleoside reverse transcriptase inhibitors (NRTIs) are the backbone of ART regimens. NRTIs compete with endogenous deoxyribonucleotide triphosphates (dNTPs) in incorporation into elongating DNA chain resulting in their cytotoxic or antiviral effect. Thus, the efficacy of NRTIs could be affected by direct competition with endogenous dNTPs and\/or feedback inhibition of their metabolic enzymes. In this paper, we assessed whether the levels of ribonucleotides (RN) and dNTP pool sizes can be used as biomarkers in distinguishing between HIV-infected patients with ART-induced mitochondrial toxicity and HIV-infected patients without toxicity.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We used data collected through a case-control study from 50 subjects. Cases were defined as HIV-infected individuals with clinical and\/or laboratory evidence of mitochondrial toxicity. Each case was age, gender, and race matched with an HIV-positive without evidence of toxicity. We used a range of machine learning procedures to distinguish between patients with and without toxicity. Using resampling methods like Monte Carlo<jats:italic>k<\/jats:italic>-fold cross validation, we compared the accuracy of several machine learning algorithms applied to our data. We used the algorithm with highest classification accuracy rate in evaluating the diagnostic performance of 12 RN and 14 dNTP pool sizes as biomarkers of mitochondrial toxicity.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We used eight classification algorithms to assess the diagnostic performance of RN and dNTP pool sizes distinguishing HIV patients with and without NRTI-associated mitochondrial toxicity. The algorithms resulted in cross-validated classification rates of 0.65\u20130.76 for dNTP and 0.72\u20130.83 for RN, following reduction of the dimensionality of the input data. The reduction of input variables improved the classification performance of the algorithms, with the most pronounced improvement for RN. Complex tree-based methods worked the best for both the deoxyribose dataset (Random Forest) and the ribose dataset (Classification Tree and AdaBoost), but it is worth noting that simple methods such as Linear Discriminant Analysis and Logistic Regression were very competitive in terms of classification performance.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Our finding of changes in RN and dNTP pools in participants with mitochondrial toxicity validates the importance of dNTP pools in mitochondrial function. Hence, levels of RN and dNTP pools can be used as biomarkers of ART-induced mitochondrial toxicity.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12874-019-0848-z","type":"journal-article","created":{"date-parts":[[2019,11,27]],"date-time":"2019-11-27T13:02:34Z","timestamp":1574859754000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["A comparison of machine learning techniques for classification of HIV patients with antiretroviral therapy-induced mitochondrial toxicity from those without mitochondrial toxicity"],"prefix":"10.1186","volume":"19","author":[{"given":"Jong Soo","family":"Lee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elijah","family":"Paintsil","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vivek","family":"Gopalakrishnan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8572-1944","authenticated-orcid":false,"given":"Musie","family":"Ghebremichael","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,11,27]]},"reference":[{"key":"848_CR1","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1177\/0192623313503519","volume":"42","author":"K Gardner","year":"2014","unstructured":"Gardner K, Hall PA, Chinnery PF, Payne BAI. HIV treatment and associated mitochondrial pathology: review of 25 years of in vitro, animal, and human studies. Toxicol Pathol. 2014;42:811\u201322.","journal-title":"Toxicol Pathol"},{"key":"848_CR2","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1097\/QAI.0000000000000849","volume":"71","author":"A Di Biagio","year":"2016","unstructured":"Di Biagio A, Cozzi-Lepri A, Prinapori R, Angarano G, Gori A, Quirino T, et al. Discontinuation of initial antiretroviral therapy in clinical practice: moving toward individualized therapy. J Acquir Immune Defic Syndr. 2016;71:263\u201371.","journal-title":"J Acquir Immune Defic Syndr"},{"key":"848_CR3","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1097\/00002030-199814000-00004","volume":"12","author":"K Brinkman","year":"1998","unstructured":"Brinkman K, ter Hofstede HJ, Burger DM, Smeitink JA, Koopmans PP. Adverse effects of reverse transcriptase inhibitors: mitochondrial toxicity as common pathway. AIDS. 1998;12:1735\u201344.","journal-title":"AIDS."},{"key":"848_CR4","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1177\/135965350400900109","volume":"9","author":"S L\u00f3pez","year":"2004","unstructured":"L\u00f3pez S, Mir\u00f3 O, Mart\u00ednez E, Pedrol E, Rodr\u00edguez-Santiago B, Milinkovic A, et al. Mitochondrial effects of antiretroviral therapies in asymptomatic patients. Antivir Ther (Lond). 2004;9:47\u201355.","journal-title":"Antivir Ther (Lond)"},{"issue":"Suppl 2","key":"848_CR5","doi-asserted-by":"publisher","first-page":"S73","DOI":"10.1086\/381449","volume":"38","author":"JSG Montaner","year":"2004","unstructured":"Montaner JSG, C\u00f4t\u00e9 HCF, Harris M, Hogg RS, Yip B, Harrigan PR, et al. Nucleoside-related mitochondrial toxicity among HIV-infected patients receiving antiretroviral therapy: insights from the evaluation of venous lactic acid and peripheral blood mitochondrial DNA. Clin Infect Dis. 2004;38(Suppl 2):S73\u20139.","journal-title":"Clin Infect Dis"},{"key":"848_CR6","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1016\/S0149-2918(00)80064-8","volume":"22","author":"G Moyle","year":"2000","unstructured":"Moyle G. Clinical manifestations and management of antiretroviral nucleoside analog-related mitochondrial toxicity. Clin Ther. 2000;22:911\u201336 discussion 898.","journal-title":"Clin Ther"},{"key":"848_CR7","doi-asserted-by":"publisher","first-page":"746","DOI":"10.1016\/j.yjmcc.2010.08.013","volume":"49","author":"W Deng","year":"2010","unstructured":"Deng W, Baki L, Yin J, Zhou H, Baumgarten CM. HIV protease inhibitors elicit volume-sensitive cl\u2212 current in cardiac myocytes via mitochondrial ROS. J Mol Cell Cardiol. 2010;49:746\u201352.","journal-title":"J Mol Cell Cardiol"},{"key":"848_CR8","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1002\/hep.23647","volume":"52","author":"A Blas-Garc\u00eda","year":"2010","unstructured":"Blas-Garc\u00eda A, Apostolova N, Ballesteros D, Monle\u00f3n D, Morales JM, Rocha M, et al. Inhibition of mitochondrial function by efavirenz increases lipid content in hepatic cells. Hepatology. 2010;52:115\u201325.","journal-title":"Hepatology."},{"key":"848_CR9","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1038\/clpt.2014.64","volume":"96","author":"S Selvaraj","year":"2014","unstructured":"Selvaraj S, Ghebremichael M, Li M, Foli Y, Langs-Barlow A, Ogbuagu A, et al. Antiretroviral therapy-induced mitochondrial toxicity: potential mechanisms beyond polymerase-\u03b3 inhibition. Clin Pharmacol Ther. 2014;96:110\u201320.","journal-title":"Clin Pharmacol Ther"},{"key":"848_CR10","doi-asserted-by":"crossref","unstructured":"Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd edition. New York: Springer-Verlag; 2009. \/\/www.springer.com\/us\/book\/9780387848570. .","DOI":"10.1007\/978-0-387-84858-7"},{"key":"848_CR11","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1111\/j.1469-1809.1936.tb02137.x","volume":"7","author":"RA Fisher","year":"1936","unstructured":"Fisher RA. The use of multiple measurements in taxonomic problems. Ann Eugenics. 1936;7:179\u201388.","journal-title":"Ann Eugenics"},{"key":"848_CR12","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","volume":"13","author":"T Cover","year":"1967","unstructured":"Cover T, Hart P. Nearest neighbor pattern classification. IEEE Trans Inf Theory. 1967;13:21\u20137.","journal-title":"IEEE Trans Inf Theory"},{"key":"848_CR13","doi-asserted-by":"publisher","unstructured":"Hosmer D, Lemeshow S. Introduction to the Logistic Regression Model. In: Applied Logistic Regression. John Wiley & Sons, Ltd; 2005. p. 1\u201330. doi:https:\/\/doi.org\/10.1002\/0471722146.ch1.","DOI":"10.1002\/0471722146.ch1"},{"key":"848_CR14","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1093\/biomet\/80.1.27","volume":"1","author":"D Firth","year":"1993","unstructured":"Firth D. Bias reduction of maximum likelihood estimates. Biometrika. 1993;1:27\u201338.","journal-title":"Biometrika."},{"key":"848_CR15","doi-asserted-by":"publisher","DOI":"10.1201\/9781315139470","volume-title":"Classification And Regression Trees","author":"Leo Breiman","year":"2017","unstructured":"Breiman L. Classification and regression trees. Routledge. 2017. https:\/\/doi.org\/10.1201\/9781315139470."},{"key":"848_CR16","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","volume":"55","author":"Y Freund","year":"1997","unstructured":"Freund Y, Schapire RE. A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci. 1997;55:119\u201339.","journal-title":"J Comput Syst Sci"},{"key":"848_CR17","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-7138-7","volume-title":"An introduction to statistical learning with applications in R","author":"G James","year":"2013","unstructured":"James G, Witten D, Hastie T, Tibshirani R. An introduction to statistical learning with applications in R. New York: Springer; 2013."},{"key":"848_CR18","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman L. Random Forests Machine Learning. 2001;45:5\u201332.","journal-title":"Random Forests Machine Learning"},{"key":"848_CR19","series-title":"Wiley Series in Probability and Statistics","doi-asserted-by":"publisher","DOI":"10.1002\/9781118391686","volume-title":"Methods of Multivariate Analysis","author":"Alvin C. Rencher","year":"2012","unstructured":"Rencher AC, Christensen WF. Methods of multivariate analysis. Third ed. Hoboken, New Jersey: Wiley; 2012."},{"key":"848_CR20","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"R Tibshirani","year":"1996","unstructured":"Tibshirani R. Regression shrinkage and selection via the Lasso. J R Stat Soc Ser B Methodol. 1996;58:267\u201388.","journal-title":"J R Stat Soc Ser B Methodol"},{"issue":"2","key":"848_CR21","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","volume":"67","author":"Hui Zou","year":"2005","unstructured":"Zou H, Hastie T. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology). 2005;67:301\u201320.","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"848_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v033.i01","volume":"33","author":"J Friedman","year":"2010","unstructured":"Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. 2010;33:1\u201322.","journal-title":"J Stat Softw"},{"key":"848_CR23","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/S0163-7258(00)00048-6","volume":"87","author":"AR Van Rompay","year":"2000","unstructured":"Van Rompay AR, Johansson M, Karlsson A. Phosphorylation of nucleosides and nucleoside analogs by mammalian nucleoside monophosphate kinases. Pharmacol Ther. 2000;87:189\u201398.","journal-title":"Pharmacol Ther"},{"key":"848_CR24","doi-asserted-by":"publisher","first-page":"2294","DOI":"10.1096\/fj.06-7977rev","volume":"21","author":"CK Mathews","year":"2007","unstructured":"Mathews CK, Song S. Maintaining precursor pools for mitochondrial DNA replication. FASEB J. 2007;21:2294\u2013303.","journal-title":"FASEB J"},{"key":"848_CR25","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1146\/annurev.bi.57.070188.002025","volume":"57","author":"P Reichard","year":"1988","unstructured":"Reichard P. Interactions between deoxyribonucleotide and DNA synthesis. Annu Rev Biochem. 1988;57:349\u201374.","journal-title":"Annu Rev Biochem"},{"key":"848_CR26","doi-asserted-by":"publisher","first-page":"4990","DOI":"10.1073\/pnas.0500253102","volume":"102","author":"S Song","year":"2005","unstructured":"Song S, Pursell ZF, Copeland WC, Longley MJ, Kunkel TA, Mathews CK. DNA precursor asymmetries in mammalian tissue mitochondria and possible contribution to mutagenesis through reduced replication fidelity. Proc Natl Acad Sci U S A. 2005;102:4990\u20135.","journal-title":"Proc Natl Acad Sci U S A"},{"key":"848_CR27","doi-asserted-by":"publisher","first-page":"43893","DOI":"10.1074\/jbc.C300401200","volume":"278","author":"S Song","year":"2003","unstructured":"Song S, Wheeler LJ, Mathews CK. Deoxyribonucleotide pool imbalance stimulates deletions in HeLa cell mitochondrial DNA. J Biol Chem. 2003;278:43893\u20136.","journal-title":"J Biol Chem"},{"key":"848_CR28","doi-asserted-by":"publisher","first-page":"1300","DOI":"10.1096\/fj.06-5730rev","volume":"20","author":"CK Mathews","year":"2006","unstructured":"Mathews CK. DNA precursor metabolism and genomic stability. FASEB J. 2006;20:1300\u201314.","journal-title":"FASEB J"},{"key":"848_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0165-1110(94)90006-X","volume":"318","author":"BA Kunz","year":"1994","unstructured":"Kunz BA, Kohalmi SE, Kunkel TA, Mathews CK, McIntosh EM, Reidy JA. International Commission for Protection against Environmental Mutagens and Carcinogens. Deoxyribonucleoside triphosphate levels: a critical factor in the maintenance of genetic stability. Mutat Res. 1994;318:1\u201364.","journal-title":"Mutat Res"},{"key":"848_CR30","first-page":"921","volume":"34","author":"E Smitskamp-Wilms","year":"1998","unstructured":"Smitskamp-Wilms E, Pinedo HM, Veerman G. Ruiz van Haperen VW. Peters GJ Postconfluent multilayered cell line cultures for selective screening of gemcitabine Eur J Cancer. 1998;34:921\u20136.","journal-title":"Peters GJ Postconfluent multilayered cell line cultures for selective screening of gemcitabine Eur J Cancer"},{"key":"848_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/BF00928361","volume":"140","author":"TW Traut","year":"1994","unstructured":"Traut TW. Physiological concentrations of purines and pyrimidines. Mol Cell Biochem. 1994;140:1\u201322.","journal-title":"Mol Cell Biochem"},{"key":"848_CR32","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/S0304-4165(99)00209-3","volume":"1474","author":"CJ van Moorsel","year":"2000","unstructured":"van Moorsel CJ, Bergman AM, Veerman G, Voorn DA. Ruiz van Haperen VW, Kroep JR, et al. differential effects of gemcitabine on ribonucleotide pools of twenty-one solid tumour and leukaemia cell lines. Biochim Biophys Acta. 2000;1474:5\u201312.","journal-title":"Biochim Biophys Acta"},{"issue":"6","key":"848_CR33","doi-asserted-by":"publisher","first-page":"883","DOI":"10.1086\/432881","volume":"41","author":"M. Arnedo-Valero","year":"2005","unstructured":"Arnedo-Valero M, Garcia F, Gil C, Guila T, Fumero E, Castro P, et al. Risk of selecting de novo drug-resistance mutations during structured treatment interruptions in patients with chronic HIV infection. Clin Infect Dis. 2005;41(6):883\u201390.","journal-title":"Clinical Infectious Diseases"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-019-0848-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12874-019-0848-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-019-0848-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T20:14:24Z","timestamp":1722111264000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-019-0848-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,27]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["848"],"URL":"https:\/\/doi.org\/10.1186\/s12874-019-0848-z","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,27]]},"assertion":[{"value":"3 April 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 November 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The study protocol was approved by the Institutional Review Board of the Yale University School of Medicine. Informed and written consents were obtained from study participations prior to enrollment in the study.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors do not have a commercial or other association that might pose a conflict of interest, i.e., authors declare that they have no competing interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"216"}}