{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T12:47:08Z","timestamp":1781700428740,"version":"3.54.5"},"reference-count":33,"publisher":"BMJ","issue":"6","license":[{"start":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T00:00:00Z","timestamp":1693353600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union and Developing Countries Clinical Trials Partnership","award":["RIA2018D-2498; TB TRIAGE+"],"award-info":[{"award-number":["RIA2018D-2498; TB TRIAGE+"]}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ EBM"],"accepted":{"date-parts":[[2023,7,9]]},"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:sec><jats:title>Objectives<\/jats:title><jats:p>In clinical decision-making, physicians take actions such as prescribing treatment only when the probability of disease is sufficiently high. The lowest probability at which the action will be considered, is the action threshold. Such thresholds play an important role whenever decisions have to be taken under uncertainty. However, while several methods to estimate action thresholds exist, few methods give satisfactory results or have been adopted in clinical practice. We piloted the adapted nominal group technique (aNGT), a new prescriptive method based on a formal consensus technique adapted for use in clinical decision-making.<\/jats:p><\/jats:sec><jats:sec><jats:title>Design, setting and participants<\/jats:title><jats:p>We applied this method in groups of postgraduate students using three scenarios: treat for rifampicin-resistant tuberculosis (RR-TB), switch to second-line HIV treatment and isolate for SARS-CoV-2 infection.<\/jats:p><\/jats:sec><jats:sec><jats:title>Interventions<\/jats:title><jats:p>The participants first summarise all harms of wrongly taking action when none is required and wrongly not taking action when it would have been useful. Then they rate the statements on these harms, discuss their importance in the decision-making process, and finally weigh the statements against each other.<\/jats:p><\/jats:sec><jats:sec><jats:title>Main outcome measures<\/jats:title><jats:p>The resulting consensus threshold is estimated as the relative weights of the harms of the false positives divided by the total harm, and averaged out over participants. In some applications, the thresholds are compared with an existing method based on clinical vignettes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The resulting action thresholds were just over 50% for RR-TB treatment, between 20% and 50% for switching HIV treatment and 43% for COVID-19 isolation. These results were considered acceptable to all participants. Between sessions variation was low for RR-TB and moderate for HIV. Threshold estimates were moderately lower with the method based on clinical vignettes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The aNGT gives sensible results in our pilot and has the potential to estimate action thresholds, in an efficient manner, while involving all relevant stakeholders. Further research is needed to study the value of the method in clinical decision-making and its ability to generate acceptable thresholds that stakeholders can agree on.<\/jats:p><\/jats:sec>","DOI":"10.1136\/bmjebm-2023-112350","type":"journal-article","created":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T17:20:28Z","timestamp":1693416028000},"page":"392-398","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":3,"title":["Piloting a new method to estimate action thresholds in medicine through intuitive weighing"],"prefix":"10.1136","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4677-0911","authenticated-orcid":false,"given":"Bart K M","family":"Jacobs","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alfred Kipyegon","family":"Keter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aquiles Rodrigo","family":"Henriquez-Trujillo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paco","family":"Trinchan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Madeleine L","family":"de Rooij","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Decroo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lutgarde","family":"Lynen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2023,8,30]]},"reference":[{"key":"2024061407150961000_28.6.392.1","doi-asserted-by":"crossref","unstructured":"Sox HC , Higgins MC , Owens DK . Medical decision making. John Wiley and Sons, 2013.","DOI":"10.1002\/9781118341544"},{"key":"2024061407150961000_28.6.392.2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJM198005153022003"},{"key":"2024061407150961000_28.6.392.3","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1111\/jep.13091","article-title":"The threshold model revisited","volume":"25","author":"Djulbegovic","year":"2019","journal-title":"J Eval Clin Pract"},{"key":"2024061407150961000_28.6.392.4","doi-asserted-by":"crossref","unstructured":"de Rooij ML , Lynen L , Decroo T , et al . The therapeutic threshold in clinical decision-making for TB. Int Health 2023:ihad002. doi:10.1093\/inthealth\/ihad002","DOI":"10.1093\/inthealth\/ihad002"},{"key":"2024061407150961000_28.6.392.5","unstructured":"von Neumann J , Morgenstern O . Theory of games and economic behavior. Princeton University Press, 1944."},{"key":"2024061407150961000_28.6.392.6","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X08315249"},{"key":"2024061407150961000_28.6.392.7","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1111\/eci.12421","article-title":"When is rational to order a diagnostic test, or prescribe treatment: the threshold model as an explanation of practice variation","volume":"45","author":"Djulbegovic","year":"2015","journal-title":"Eur J Clin Invest"},{"key":"2024061407150961000_28.6.392.8","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X09334370"},{"key":"2024061407150961000_28.6.392.9","doi-asserted-by":"publisher","DOI":"10.1054\/mehy.1998.0020"},{"key":"2024061407150961000_28.6.392.10","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1912091116"},{"key":"2024061407150961000_28.6.392.11","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X8300300203"},{"key":"2024061407150961000_28.6.392.12","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.328.7436.360"},{"key":"2024061407150961000_28.6.392.13","doi-asserted-by":"crossref","DOI":"10.1186\/1472-6947-10-20","article-title":"A new method for determining physician decision thresholds using empiric, uncertain recommendations","volume":"10","author":"Boland","year":"2010","journal-title":"BMC Med Inform Decis Mak"},{"key":"2024061407150961000_28.6.392.14","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1136\/ebmed-2014-110140","article-title":"A novel approach to the determination of clinical decision thresholds","volume":"20","author":"Ebell","year":"2015","journal-title":"Evid Based Med"},{"key":"2024061407150961000_28.6.392.15","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1136\/ebmed-2017-110718","article-title":"Determining clinical decision thresholds for HIV-positive patients suspected of having tuberculosis","volume":"22","author":"Boyles","year":"2017","journal-title":"Evid Based Med"},{"key":"2024061407150961000_28.6.392.16","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1111\/jep.12486","article-title":"Rationality, practice variation and person-centred health policy: a threshold hypothesis","volume":"21","author":"Djulbegovic","year":"2015","journal-title":"J Eval Clin Pract"},{"key":"2024061407150961000_28.6.392.17","doi-asserted-by":"publisher","DOI":"10.1007\/s11096-016-0257-x"},{"key":"2024061407150961000_28.6.392.18","doi-asserted-by":"publisher","DOI":"10.1111\/j.1440-172X.2012.02017.x"},{"key":"2024061407150961000_28.6.392.19","doi-asserted-by":"publisher","DOI":"10.1097\/QAI.0b013e3181af6705"},{"key":"2024061407150961000_28.6.392.20","unstructured":"Mentimeter . Interactive presentation software."},{"key":"2024061407150961000_28.6.392.21","doi-asserted-by":"crossref","first-page":"1317","DOI":"10.4269\/ajtmh.20-0959","article-title":"Case report: therapeutic threshold for Rifampicin-resistant tuberculosis in a patient from Maputo, Mozambique","volume":"104","author":"Gonzaga","year":"2021","journal-title":"Am J Trop Med Hyg"},{"key":"2024061407150961000_28.6.392.22","unstructured":"WHO . The use of Antiretroviral drugs for treating and preventing HIV infection 2016, 402. World Health Organisation, 2015: 99\u2013152."},{"key":"2024061407150961000_28.6.392.23","doi-asserted-by":"crossref","DOI":"10.4178\/epih.e2020038","article-title":"Mental health outcomes of quarantine and isolation for infection prevention: a systematic umbrella review of the global evidence","volume":"42","author":"Hossain","year":"2020","journal-title":"Epidemiol Health"},{"key":"2024061407150961000_28.6.392.24","doi-asserted-by":"publisher","DOI":"10.1186\/s12879-021-06092-w"},{"key":"2024061407150961000_28.6.392.25","doi-asserted-by":"crossref","DOI":"10.1186\/s12889-022-14406-z","article-title":"Correction: to isolate or not to isolate: the impact of changing behavior on COVID-19 transmission","volume":"22","author":"Agusto","year":"2022","journal-title":"BMC Public Health"},{"key":"2024061407150961000_28.6.392.26","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1093\/aje\/kwab252","article-title":"Pressure on the health-care system and intensive care utilization during the COVID-19 outbreak in the Lombardy region of Italy: a retrospective observational study in 43,538 hospitalized patients","volume":"191","author":"Trentini","year":"2022","journal-title":"Am J Epidemiol"},{"key":"2024061407150961000_28.6.392.27","unstructured":"Canty A , Ripley B . Boot: bootstrap R (S-Plus) functions. R package version 1.3-25. 2000."},{"key":"2024061407150961000_28.6.392.28","article-title":"Potential short-term outcome of an uncontrolled COVID-19 epidemic in Lombardy","volume":"25","author":"Guzzetta","year":"2020","journal-title":"Euro Surveill"},{"key":"2024061407150961000_28.6.392.29","doi-asserted-by":"publisher","DOI":"10.9745\/GHSP-D-21-00172"},{"key":"2024061407150961000_28.6.392.30","doi-asserted-by":"crossref","first-page":"1510","DOI":"10.4269\/ajtmh.21-0899","article-title":"Original article: relative burdens of the COVID-19, malaria, tuberculosis, and HIV\/AIDS epidemics in sub-Saharan Africa","volume":"105","author":"Bell","year":"2021","journal-title":"Am J Trop Med Hyg"},{"key":"2024061407150961000_28.6.392.31","unstructured":"Teachout M , Zipfel C . The economic impact of COVID-19 lockdowns in sub-Saharan Africa policy brief; 2020."},{"key":"2024061407150961000_28.6.392.32","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1186\/s12913-016-1796-5","article-title":"The influence of power and actor relations on priority setting and resource allocation practices at the hospital level in Kenya: a case study","volume":"16","author":"Barasa","year":"2016","journal-title":"BMC Health Serv Res"},{"key":"2024061407150961000_28.6.392.33","unstructured":"Varga-Atkins T , Bunyan N , McIsaac J , et al . The nominal group technique \u2013 a practical guide for facilitators. written for the ELESIG small grants scheme, version 1.0. Liverpool: University of Liverpool, 2011."}],"container-title":["BMJ Evidence-Based Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjebm-2023-112350","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T14:16:27Z","timestamp":1718374587000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebm.bmj.com\/lookup\/doi\/10.1136\/bmjebm-2023-112350"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,30]]},"references-count":33,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,11,22]]},"published-print":{"date-parts":[[2023,12]]}},"alternative-id":["10.1136\/bmjebm-2023-112350"],"URL":"https:\/\/doi.org\/10.1136\/bmjebm-2023-112350","relation":{},"ISSN":["2515-446X","2515-4478"],"issn-type":[{"value":"2515-446X","type":"print"},{"value":"2515-4478","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,30]]}}}