Innovative perspectives on the value of diagnostic tests in clinical practice

  • Estrada-Orozco Kelly a. Clinical Epidemiology doctoral program, Clinical epidemiology and Biostatistics Department, Pontificia Universidad Javeriana. Bogotá, Colombia. b. Evidence Synthesis and Technology Management Unit, Health Technology Evaluation Institute (IETS). Bogotá, Colombia. c. Clinical Research Institute, Facultad de Medicina, Fundación Universitaria Sanitas. Bogotá, Colombia. https://orcid.org/0000-0001-5022-5572
  • Juliana Cuervo Clinical Epidemiology doctoral program, Clinical epidemiology and Biostatistics Department, Pontificia Universidad Javeriana. Bogotá, Colombia. https://orcid.org/0000-0001-8888-9411
Keywords: Diagnosis, Diagnostic test, Clinical value, Sensitivity and specificity, Clinical practice

Abstract

Diagnostic tests have intrinsic characteristics such as sensitivity, specificity, overall accuracy and likelihood ratios which define their operational performance. It is not uncommon to find in the literature that test value and clinical utility are defined based exclusively on those characteristics. This paper introduces several arguments aimed at prompting a reflection regarding the characteristics that define the true value of diagnostic tests in clinical practice.  It concludes with the view that the value of each diagnostic test needs to be established in accordance with the circumstances in which it is used, taking into account extrinsic characteristics such as in whom it is used, when, where and by who.

References

Bolboacă SD. Medical Diagnostic Tests: A review of test anatomy, phases, and statistical treatment of data. Comput Math Methods Med. 2019;1891569. doi: https://doi.org/10.1155/2019/1891569

Schünemann HJ, Mustafá RA, Brozek J, Steingart KR, Leeflang M, Murad MH, et al. GRADE guidelines: 21 part 1. Study design, risk of bias, and indirectness in rating the certainty across a body of evidence for test accuracy. J Clin Epidemiol. 2020;122:129-41. doi: https://doi.org/10.1016/j.jclinepi.2019.12.020

Šimundić AM. Measures of diagnostic accuracy: Basic definitions. EJIFCC. 2009;19(4):203-11.

Shreffler JHM. Diagnostic testing accuracy: Sensitivity, specificity, predictive values and likelihood ratios. StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing; 2024 [cited 16 Jan 2024]. Available at: https://www.ncbi.nlm.nih.gov/books/NBK557491/

Wong HB. Measures of diagnostic accuracy: Sensitivity, specificity, PPV and NPV. Proceed Singapore Healthc. 2001;20(4):316-8. doi: https://doi.org/10.1177/201010581102000411

Pluddemann A BA, O’Sullivan J. Spectrum bias: Sackett Catalogue Of Bias [internet]. 2019 [cited 16 Jan 2024]. Available at: https://catalogofbias.org/biases/spectrum-bias/

Buehler AM, Ascef BdO, Oliveira HAd, Ferri CP, Fernandes JG. Rational use of diagnostic tests for clinical decision making. Revista da Associação Médica Brasileira. 2019;65. doi: https://doi.org/10.1590/1806-9282.65.3.452

Schünemann HJ, Mustafá RA, Brozek J, Santesso N, Bossuyt PM, Steingart KR, et al. GRADE guidelines: 22. The GRADE approach for tests and strategies-from test accuracy to patient-important outcomes and recommendations. J Clin Epidemiol. 2019;111:69-82. doi: https://doi.org/10.1016/j.jclinepi.2019.02.003

Definición de Intrínseco [internet]. 2024 [cited 16 Jan 2024]. Available at: https://definicion.de/intrinseco/

Habibzadeh F, Yadollahie M. Number needed to misdiagnose: a measure of diagnostic test effectiveness. Epidemiology. 2013;24(1):170. doi: https://doi.org/10.1097/EDE.0b013e31827825f2

Mitchell AJ. The clinical significance of subjective memory complaints in the diagnosis of mild cognitive impairment and dementia: a meta-analysis. Int J Geriatr Psychiatry. 2008;23(11):1191-202. doi: https://doi.org/10.1002/gps.2053

Mitchell AJ. Sensitivity × PPV is a recognized test called the clinical utility index (CUI+). Eur J Epidemiol. 2011;26(3):251-2. doi: https://doi.org/10.1007/s10654-011-9561-x

Santé. Autotest VIH France [internet]. 2024 [cited 16 Jan 2024]. Available at: https://www.autotest-sante.com/en/autotest-VIH-par-AAZ-139.html

Ministerio de Salud y de Protección Social. Guía de práctica clínica basada en la evidencia para la atención de la infección por VIH/SIDA en personas adultas, gestantes y adolescentes. Colombia: Minsalud; 2022.

Josephson CB, White PM, Krishan A, Al-Shahi Salman R. Computed tomography angiography or magnetic resonance angiography for detection of intracranial vascular malformations in patients with intracerebral haemorrhage. Cochrane Database Syst Rev. 2014;2014(9):Cd009372. doi: https://doi.org/10.1002/14651858.CD009372.pub2

Linden A. Measuring diagnostic and predictive accuracy in disease management: an introduction to receiver operating characteristic (ROC) analysis. J Eval Clin Pract. 2006;12(2):132-9. doi: https://doi.org/10.1111/j.1365-2753.2005.00598.x

Leeflang MM, Rutjes AW, Reitsma JB, Hooft L, Bossuyt PM. Variation of a test's sensitivity and specificity with disease prevalence. CMAJ. 2013;185(11):E537-44. doi: https://doi.org/10.1503/cmaj.121286

Mulherin SA, Miller WC. Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002;137(7):598-602. doi: https://doi.org/10.7326/0003-4819-137-7-200210010-00011

Feinstein AR. Misguided efforts and future challenges for research on "diagnostic tests". J Epidemiol Community Health. 2002;56(5):330-2. doi: https://doi.org/10.1136/jech.56.5.330

Brenner H, Gefeller O. Variation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence. Stat Med. 1997;16(9):981-91. doi: https://doi.org/10.1002/(sici)1097-0258(19970515)16:9<981::aid-sim510>3.0.co;2-n.

Leeflang MM, Bossuyt PM, Irwig L. Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis. J Clin Epidemiol. 2009;62(1):5-12. doi: https://doi.org/10.1016/j.jclinepi.2008.04.007

Hultcrantz M, Mustafá RA, Leeflang MMG, Lavergne V, Estrada-Orozco K, Ansari MT, et al. Defining ranges for certainty ratings of diagnostic accuracy: a GRADE concept paper. J Clin Epidemiol. 2020;117:138-48. doi: https://doi.org/10.1016/j.jclinepi.2019.05.002

Jang TB, Ruggeri W, Kaji AH. The predictive value of specific emergency sonographic signs for cholecystitis. J Med Ultras. 2013;21(1):29-31. doi: https://doi.org/10.1016/j.jmu.2013.01.006

Zarate AJ. ÁM, King, I, Torrealba. A. Colecistitis aguda. Universidad Finis Terrae: Escuela de Medicina 2016;7.

Halpin V. Acute cholecystitis. BMJ Clin Evid. 2014;2014.

Gelaye B, Tadesse MG, Williams MA, Fann JR, Vander Stoep A, Andrew Zhou X-H. Assessing validity of a depression screening instrument in the absence of a gold standard. Ann Epidemiol. 2014;24(7):527-31. doi: https://doi.org/10.1016/j.annepidem.2014.04.009

Davison TE, McCabe MP, Mellor D. An examination of the "gold standard" diagnosis of major depression in aged-care settings. Am J Geriatr Psychiatry. 2009;17(5):359-67. doi: https://doi.org/10.1097/JGP.0b013e318190b901

Wood SJ, Yung AR. Diagnostic markers for schizophrenia: do we actually know what we're looking for? World Psychiatry. 2011;10(1):33-4. doi: https://doi.org/10.1002/j.2051-5545.2011.tb00006.x

van Os J, Tamminga C. Deconstructing psychosis. Schizophr Bull. 2007;33(4):861-2. doi: https://doi.org/10.1093/schbul/sbm066

Estrada-Orozco K. Diseño de una prueba para diagnóstico de trastorno cognitivo y validación en una cohorte de sujetos mayores de 50 años en Colombia en el 2016-2017. Bogotá, D.C: Universidad Nacional de Colombia; 2018.

Pietrzak K, Czarnecka K, Mikiciuk-Olasik E, Szymanski P. New perspectives of alzheimer disease diagnosis - the most popular and future methods. Med Chem. 2018;14(1):34-43. doi: https://doi.org/10.2174/1573406413666171002120847

Bossuyt PM, Irwig L, Craig J, Glasziou P. Comparative accuracy: assessing new tests against existing diagnostic pathways. BMJ (Clinical research ed). 2006;332(7549):1089-92. doi: https://doi.org/10.1136/bmj.332.7549.1089

Rutjes AW, Reitsma JB, Di Nisio M, Smidt N, van Rijn JC, Bossuyt PM. Evidence of bias and variation in diagnostic accuracy studies. CMAJ. 2006;174(4):469-76. doi: https://doi.org/10.1503/cmaj.050090

Mathes T, Pieper D. An algorithm for the classification of study designs to assess diagnostic, prognostic and predictive test accuracy in systematic reviews. Systematic Reviews. 2019;8(1):226. doi: https://doi.org/10.1186/s13643-019-1131-4.

Schmidt RL, Factor RE. Understanding sources of bias in diagnostic accuracy studies. Arch Pathol Lab Med. 2013;137(4):558-65. doi: https://doi.org/10.5858/arpa.2012-0198-RA

Whiting P, Rutjes A, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529-36. doi: https://doi.org/10.7326/0003-4819-155-8-201110180-00009

Bartlett JW, Frost C. Reliability, repeatability and reproducibility: analysis of measurement errors in continuous variables. Ultr Obstet Gynecol. 2008;31(4):466-75. doi: https://doi.org/10.1002/uog.5256

Mahajan A, Manchikanti L. Value and validity of coronavirus antibody testing. Pain Physician. 2020;23(4s):S381-s90. doi: https://doi.org/10.36076/ppj.2020/23/S381

Mercado M, Malagón-Rojas J, Delgado G, Rubio VV, Muñoz Galindo L, Parra Barrera EL, et al. Evaluation of nine serological rapid tests for the detection of SARS-CoV-2. Rev Panam Salud Pública. 2020;44:e149. doi: https://doi.org/10.26633/RPSP.2020.149

Deeks JJ, Dinnes J, Takwoingi Y, Davenport C, Spijker R, Taylor-Phillips S, et al. Antibody tests for identification of current and past infection with SARS‐CoV‐2. Cochrane Database of Systematic Reviews. 2020(6). doi: https://doi.org/10.1002/14651858.CD013652.pub2

Veiga S, Rodríguez-Martín A, García-Ribas G, Arribas I, Menacho-Román M, Calero M. Validation of a novel and accurate ApoE4 assay for automated chemistry analyzers. Scientific Reports. 2020;10(1):2138. doi: https://doi.org/10.1038/s41598-020-58841-7

Atkins ER, Panegyres PK. The clinical utility of gene testing for Alzheimer's disease. Neurol Int. 2011;3(1):e1-e. doi: https://doi.org/10.4081/ni.2011.e1

Bertram L, Tanzi RE. Genome-wide association studies in Alzheimer's disease. Hum Mol Genet. 2009;18(R2):R137-45. doi: https://doi.org/10.1093/hmg/ddp406

Kortela E, Kirjavainen V, Ahava MJ, Jokiranta ST, But A, Lindahl A, et al. Real-life clinical sensitivity of SARS-CoV-2 RT-PCR test in symptomatic patients. PloS One. 2021;16(5):e0251661-e. doi: https://doi.org/10.1371/journal.pone.0251661

Peeling RW, Olliaro PL, Boeras DI, Fongwen N. Scaling up COVID-19 rapid antigen tests: promises and challenges. The Lancet Infectious Diseases. 2021;21(9):E290-5. doi: https://doi.org/10.1016/S1473-3099(21)00048-7

World Health Organization. WHO provides one million antigen-detecting rapid diagnostic test kits to accelerate COVID-19 testing in Indonesia. World Health Organization [internet]. 2021 [cited 16 Jan 2024]. Available at: https://www.who.int/indonesia/news/detail/17-03-2021-who-provides-one-million-antigen-detecting-rapid-diagnostic-test-kits-to-accelerate-covid-19-testing-in-indonesia.

How to Cite
1.
Kelly E-O, Cuervo J. Innovative perspectives on the value of diagnostic tests in clinical practice. Colomb. J. Anesthesiol. [Internet]. 2024 Apr. 2 [cited 2024 Apr. 20];. Available from: https://www.revcolanest.com.co/index.php/rca/article/view/1108

Downloads

Download data is not yet available.
Published
2024-04-02
How to Cite
1.
Kelly E-O, Cuervo J. Innovative perspectives on the value of diagnostic tests in clinical practice. Colomb. J. Anesthesiol. [Internet]. 2024 Apr. 2 [cited 2024 Apr. 20];. Available from: https://www.revcolanest.com.co/index.php/rca/article/view/1108
Section
Essay

Altmetric

Article metrics
Abstract views
Galley vies
PDF Views
HTML views
Other views
QR Code

Some similar items: