Observation Variation in Ultrasonography Assessment of Thyroid Nodules

Document Type : Original Article

Authors

1 Department of Medical Informatics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran

2 Nuclear Medicine Research Center, Mashhad University of Medical Sciences ,Mashhad, Iran

3 Department of Radiology, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran

4 Department of Radiology, Faculty of Medicine, Neyshabur University of Medical Sciences, Neyshabur, Iran

5 Pharmaceutical Research Center, Mashhad University of Medical Sciences, Mashhad, Iran

6 Department of Medical Informatics, Amsterdam UMC (location AMC), University of Amsterdam, Amsterdam, The Netherlands

Abstract

Objective(s): Accurate detection and competent management of thyroid nodules, as a common disease, basically depends on the reliability of the ultrasonography (US) report. In this research, we evaluated inter and intra-observer variation among ultrasonography reporters, based on ACR-TIRADS.
Methods: In this retrospective study, 345 thyroid US images of 150 patients were reviewed. Three clinicians with at least 6-year experience in thyroid US reviewed the images twice at 6-8 weeks’ intervals. Composition, echogenicity, shape, margin, and echogenic foci based on ACR-TIRADS were reported, independently. Inter and intra-observer variations were calculated based on Cohen’s Kappa statistics.
Results: 345 ultrasonography images of 150 patients with thyroid nodules (83 women and 67 men) with a mean age of 65 years were reviewed. Moderate to the substantial intra-observer agreement was achieved with the highest Kapa value in the category of shape (k=0.61-0.77). For TIRADS level, the moderate intra-observer agreement was observed (k=0.42-0.46). Inter-observer agreement for the US category of thyroid nodules was obtained slightly to moderate. Composition 
(k=0.42 and 0.51) and echogenicity (k=0.45 and 0.46) showed the highest overall agreement and margin showed the lowest overall agreement (k=0.18 and 0.19). In assessing TIRADS level of nodules, a fair agreement was obtained (k=0.23 and 0.29) .
Conclusion: Moderate to substantial intra-observer agreement and slight to moderate inter-observer variation for evaluation of thyroid nodules; shows the need for a computer-aided diagnosis system based on artificial intelligence to 
assist our physicians in differentiating thyroid nodule characteristics based on explicit image features. An additional training course based on ACR-TIRADS for physicians can be another useful recommendation.

Keywords

References

  1. Pitoia F, Miyauchi A. American Thyroid Association guidelines for thyroid nodules and differentiated thyroid cancer and their implementation in various care settings. Thyroid. 2016; 26(2):319-21.
  2. Pemayun TG. Current Diagnosis and Management of Thyroid Nodules. Acta medica Indonesiana. 2016; 48(3):247-57.
  3. Wong R, Farrell SG, Grossmann M. Thyroid nodules: diagnosis and management. The Medical journal of Australia. 2018; 209(2):92-8.
  4. Zakavi SR, ZARE NS, Shafiei S, Sadeghi R, Fekri N, Mazloum KZ, et al. Which complaint has the most clinical effect on quality of life of thyroid cancer survivors in long term follow up? Iranian Journal of Nuclear Medicine. 2015; 23(1):21-6.
  5. Zhuang Y, Li C, Hua Z, Chen K, Lin JL. A novel TIRADS of US classification. Biomedical engineering online. 2018; 17(1):82.
  6. Choi SH, Kim E-K, Kwak JY, Kim MJ, Son EJ. Interobserver and intraobserver variations in ultrasound assessment of thyroid nodules. Thyroid. 2010; 20(2):167-72.
  7. Zakavi SR, Ayati N, Zare S, Ayati A, Sadri K, Fekri N, et al. Prognostic value and optimal threshold of first thyroglobulin in low/intermediate risk DTC. The Quarterly Journal of Nuclear Medicine and Molecular Imaging: Official Publication of the Italian Association of Nuclear Medicine (AIMN) [and] the International Association of Radiopharmacology (IAR), [and] Section of the Society of. 2019; 65(1):64-71.
  8. Tessler FN, Middleton WD, Grant EG, Hoang JK, Berland LL, Teefey SA, et al. ACR thyroid imaging, reporting and data system (TI-RADS): white paper of the ACR TI-RADS committee. Journal of the American college of radiology. 2017; 14(5):587-95.
  9. Lamartina L, Deandreis D, Durante C, Filetti S. Imaging in the follow-up of differentiated thyroid cancer: current evidence and future perspectives for a risk-adapted approach. Eur J Endocrinol. 2016; 175(5):R185-R202.
  10. Grant EG, Tessler FN, Hoang JK, Langer JE, Beland MD, Berland LL, et al. Thyroid ultrasound reporting lexicon: white paper of the ACR thyroid imaging, reporting and data system (TIRADS) committee. Journal of the American college of radiology. 2015; 12(12):1272-9.
  11. Middleton WD, Teefey SA, Reading CC, Langer JE, Beland MD, Szabunio MM, et al. Comparison of performance characteristics of american college of radiology TI-RADS, Korean Society of thyroid radiology TIRADS, and American Thyroid Association American Journal of Roentgenology. 2018; 210(5):1148-54.
  12. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977:159-74.
  13. Chang Y, Paul AK, Kim N, Baek JH, Choi YJ, Ha EJ, et al. Computer‐aided diagnosis for classifying benign versus malignant thyroid nodules based on ultrasound images: a comparison with radiologist‐based assessments. Medical physics. 2016; 43(1): 554-67.
  14. Choi YJ, Baek JH, Park HS, Shim WH, Kim TY, Shong YK, et al. A computer-aided diagnosis system using artificial intelligence for the diagnosis and characterization of thyroid nodules on ultrasound: initial clinical assessment. Thyroid. 2017; 27(4):546-52.
Asia Oceania Journal of Nuclear Medicine and Biology
Volume 10, Issue 1
January 2022
Pages 28-35

Files

Share

How to cite

Statistics