Quality Assessment of Research Articles in Nuclear Medicine Using STARD and QUADAS-2 Tools

Document Type : Original Article

Authors

1 Surin Hospital, Surin, Thailand

2 Cyclotron and National PET center, Chulaborn Hospital, Bangkok, Thailand.

3 Department of Radiology, Faculty of Medicine, Khon Kaen University, Khon Kean, Thailand.

4 Department of Biostatistics and Demography, Faculty of Public Health, Khon Kaen University, Khon Kaen, Thailand.

Abstract

Objective(s): Diagnostic nuclear medicine is being increasingly employed in clinical practice with the advent of new technologies and radiopharmaceuticals. The report of the prevalence of a certain disease is important for assessing the quality of that article. Therefore, this study was performed to evaluate the quality of published nuclear medicine articles and determine the frequency of reporting the prevalence of studied diseases.
Methods: We used Standards for Reporting of Diagnostic Accuracy (STARD) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) checklists for evaluating the quality of articles published in five nuclear medicine journals with the highest impact factors in 2012. The articles were retrieved from Scopus database and were selected and assessed independently by two nuclear medicine physicians. Decision concerning equivocal data was made by consensus between the reviewers.
Results: The average STARD score was approximately 17 points, and the highest score was 17.19±2.38 obtained by the European Journal of Nuclear Medicine. QUADAS-2 tool showed that all journals had low bias regarding study population. The Journal of Nuclear Medicine had the highest score in terms of index test, reference standard, and time interval. Lack of clarity regarding the index test, reference standard, and time interval was frequently observed in all journals including Clinical Nuclear Medicine, in which 64% of the studies were unclear regarding the index test. Journal of Nuclear Cardiology had the highest number of articles with appropriate reference standard (83.3%), though it had the lowest frequency of reporting disease prevalence (zero reports). All five journals had the same STARD score, while index test, reference standard, and time interval were very unclear according to QUADAS-2 tool. Unfortunately, data were too limited to determine which journal had the lowest risk of bias. In fact, it is the author’s responsibility to provide details of research methodology so that the reader can assess the quality of research articles.
Conclusion: Five nuclear medicine journals with the highest impact factor were comparable in terms of STARD score, although they all showed lack of clarity regarding index test, reference standard, and time interval, according to QUADAS-2. The current data were too limited to determine the journal with the lowest bias. Thus, a comprehensive overview of the research methodology of each article is of paramount importance to enable the reader to assess the quality of articles.

Keywords

Main Subjects

References

1. Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS‐2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies. Ann Intern Med. 2011; 155(8):529–6.
2. Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Medical Research Methodology.2003; 3(1):25.
3. Selman TJ, Khan KS, Mann CH. An evidence‐based approach to test accuracy studiesin gynecologic oncology: the “STARD” checklist. Gynecol Oncol.2005; 96(3):575–.
4. Mahoney J, Ellison J. Assessing the Quality of Glucose Monitor Studies: A Critical Evaluation of Published Reports. Clinical Chemistry. 2007;53(6): 1122–8.
5. Lumbreras‐Lacarra B, Ramos‐Rincó JM, Hernádez‐Aguado I. Methodology in Diagnostic Laboratory Test Research in Clinical Chemistry and Clinical Chemistry and Laboratory Medicine. Clinical Chemistry. 2004; 50(3):530–6.
6. Coppus S, Vanderveen F, Bossuyt P, Mol B.Quality of reporting of test accuracy studies in reproductive medicine: impact of the Standards for Reporting of Diagnostic Accuracy (STARD) initiative. Fertility and Sterility. 2006; 86(5):1321–9.
7. Smidt N, Rutjes AWS, Windt DAWM van der, Ostelo RWJG, Bossuyt PM, Reitsma JB, et al. The quality of diagnostic accuracy studies since the STARD statement Has it improved? Neurology.2006; 67(5):792–7.
8. Siddiqui M a. R, Azuara‐Blanco A, Burr J. The quality of reporting of diagnostic accuracy studies published in ophthalmic journals. Br J Ophthalmol. 2005; 89(3):261–5.
9. Selman TJ, Morris RK, Zamora J, Khan KS. The quality of reporting of primary test accuracy studies in obstetrics and gynaecology: application of the STARD criteria. BMC Women’s Health. 2011; 11(1):8.
10. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration. Clinical Chemistry. 2003; 49(1):7–8.
11. Hollerwöer D. Methodological quality and outcomes of studies addressing manual cervical spine examinations: A review. Manual Therapy.2006; 11(2):93–.1.
12. Dros J, Wewerinke A, Bindels PJ, Weert HC van. Accuracy of Monofilament Testing to Diagnose Peripheral Neuropathy: A Systematic Review. Ann Fam Med. 2009; 7(6):555–8.
13. Worster A, Balion CM, Hill SA, Santaguida P, Ismaila A, McKelvie R, et al. Diagnostic accuracy of BNP and NT‐proBNP in patients presenting to acute care settings with dyspnea: A systematic review. Clinical Biochemistry. 2008; 41:250–9.
14. Schueler S, Walther S, Schuetz GM, Schlattmann P,Dewey M. Methodological quality of diagnostic accuracy studies on non‐invasive coronary CT angiography: influence of QUADAS (Quality Assessment of Diagnostic Accuracy Studies included in systematic reviews) items on sensitivity and specificity. EurRadiol. 2013; 23(6): 1603‐22.
15. Adams K, Shah PL, Edmonds L, Lim E. Test performance of endobronchial ultrasound and transbronchial needle aspiration biopsy for mediastinal staging in patients with lung cancer:systematic review and meta‐analysis. Thorax.2009; 64(9):757–2.
16. Cook C, Cleland J, Huijbregts P. Creation and Critique of Studies of Diagnostic Accuracy: Use of the STARD and QUADAS Methodological QualityAssessment Tools. J Man ManipTher. 2007; 15(2):93–02.
17. Shi H‐Z, Liang Q‐L, Jiang J, Qin X‐J, Yang H‐B.Diagnostic value of carcinoembryonic antigen in malignant pleural effusion: A meta‐analysis.Respirology. 2008; 13(4): 518–7.
18. Fontela PS, Pant Pai N, Schiller I, Dendukuri N, Ramsay A, Pai M. Quality and Reporting of Diagnostic Accuracy Studies in TB, HIV and Malaria: Evaluation Using QUADAS and STARD Standards. Marais B, editor. PLoS ONE. 2009;4(11): e7753.
Asia Oceania Journal of Nuclear Medicine and Biology
Volume 2, Issue 2 - Serial Number 2
October 2014
Pages 120-126

Files

Share

How to cite

Statistics