Image Features-based Learning Effectively Improves Inter-Observer Agreement for Beginners in Evaluating Thyroid Nodule with Ultrasound

doi:10.37015/AUDT.2019.190801

Abstract

Abstract:

Objective: Thyroid nodules are a common medical problem in China and in other parts of the world. Many guidelines use ultrasound (US) as the first choice for evaluating thyroid nodules. A major limitation of US is operator dependency, resulting in a variety of discrepancies in diagnosing thyroid nodules in the literatures. Risk stratification of thyroid nodules is based on the patterns of US features in the 2015 American Thyroid Association (ATA) management guidelines for adult patients with thyroid nodules. We hypothesize that special training targeting features recognition may increase the inter-observer agreement.
Methods: The study was conducted on 52 participants from Peking Union Medical College Hospital (PUMCH) from March to May 2018.The participants were divided into two groups by their own decision for their convenience. Image featuresbased learning (IF-BL) was used to train the participants to learn special features including shape, margin, echo level, internal structure, calcification, vascularity through 10 standard images based on the 2015 ATA guideline. Group A (27 subjects) received IF-BL during the first month, and Group B (25 subjects) received IF-BL during the second month. All participants evaluated US features and risk stratification in 60 US images of 20 thyroid nodules before and after the training. The test results were graded by a teaching assistant according to the rule of 0.5 points assigned to every feature and 2 points assigned to risk stratification, with a total of 100 points. Inter-observer agreements of US features and risk stratification were assessed and compared before and after the training.
Results: After the first month, Group A had better scores than Group B, the control group of the month (75.4±9.4 vs 68.7±8.4, p = 0.01). At the end of the second month during which both groups were trained, there was no difference of scores between Group A and Group B (74.5±10.4 vs 75.1±7.4, P = 0.78). Scores of all participants were significantly higher than the initial (74.8±9.0 vs 65.8±13.6, P < 0.01). After the training, the kappa values of US features improved from 0.28-0.43 to 0.43-0.75, and those of risk stratification improved from 0.13 to 0.55.
Conclusion: IF-BL can effectively help trainees correctly recognize US features and evaluate the risk stratification of thyroid nodule and can improve the inter-observer agreement.

Key words: Thyroid nodule; Cancer; ATA; Training

Ying Wang, MD, Luying Gao, MD, Yuxin Jiang, MD, Hui Pan, MD, Jun Zhao, MA, Xin Zhou, MA, Qiong Wu, MM, Ruyu Liu, MM, Bo Zhang, MD. Image Features-based Learning Effectively Improves Inter-Observer Agreement for Beginners in Evaluating Thyroid Nodule with Ultrasound. Advanced Ultrasound in Diagnosis and Therapy, 2019, 3(1): 1-5.

References

[1]	Guo H, Sun M, He W, Chen H, Li W, Tang J, et al. The prevalence of thyroid nodules and its relationship with metabolic parameters in a Chinese community-based population aged over 40 years. Endocrine 2014; 45:230-5.
[2]	Hegedüs L. Clinical practice. The thyroid nodule. N Engl J Med 2014; 351:1764-71.
[3]	Tan GH, Gharib H. Thyroid incidentalomas: management approaches to nonpalpable nodules discovered incidentally on thyroid imaging. Ann Intern Med 1997; 126:226-31.
[4]	Leenhardt L, Erdogan MF, Hegedus L, Mandel SJ, Paschke R, Rago T, et al. 2013 European thyroid association guidelines for cervical ultrasound scan and ultrasound-guided techniques in the postoperative management of patients with thyroid cancer. Eur Thyroid J 2013; 2:147-59.
[5]	Perros P, Boelaert K, Colley S, Evans C, Evans RM, Gerrard Ba G, et al. Guidelines for the management of thyroid cancer. Clin Endocrinol (Oxf) 2014; 81:1-122.
[6]	Shin JH, Baek JH, Chung J, Ha EJ, Kim JH, Lee YH, et al. Ultrasonography diagnosis and imaging-based management of thyroid nodules: revised Korean society of thyroid radiology consensus statement and recommendations. Korean J Radiol 2016; 17:370-95.
[7]	Gharib H, Papini E, Paschke R, Duick DS, Valcavi R, Hegedüs L, et al. American Association of Clinical Endocrinologists, Associazione Medici Endocrinologi, and European Thyroid Association Medical guidelines for clinical practice for the diagnosis and management of thyroid nodules: executive summary of recommendations. EndocrPract 2016; 22:622-39.
[8]	Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid 2016; 26:1-133.
[9]	Moon WJ, Jung SL, Lee JH, Na DG, Baek JH, Lee YH, et al. Benign and malignant thyroid nodules: US differentiation--multicenter retrospective study. Radiology 2008; 247:762-70.
[10]	Park CS, Kim SH, Jung SL, Kang BJ, Kim JY, Choi JJ, et al. Observer variability in the sonographic evaluation of thyroid nodules. J Clin Ultrasound 2010; 38:287-93.
[11]	Choi SH, Kim EK, Kwak JY, Kim MJ, Son EJ. Interobserver and intraobserver variations in ultrasound assessment of thyroid nodules. Thyroid 2010; 20:167-72.
[12]	Srinivas MN, Amogh VN, Gautam MS, Prathyusha IS, Vikram NR, Retnam MK, et al. A prospective study to evaluate the reliability of thyroid imaging reporting and data system in differentiation between benign and malignant thyroid lesions. J Clin Image Sci 2016; 6:5.

[1]	Huolin Ye, MD, Qiannan Huang, MD, Qingjing Zeng, MD, Xuqi He, MD, Erjiao Xu, MD, Yinglin Long, MD, Kai Li, MD, Rongqin Zheng, MD. Contrast-enhanced Ultrasound for Evaluation of Active Needle Tract Bleeding during Thermal Ablation of Liver Cancer [J]. Advanced Ultrasound in Diagnosis and Therapy, 2022, 6(3): 104-111.
[2]	Srinivasan S, MD, Neeti Aggarwal, MD, Sushma Makhaik, MD, Anupam Jhobta, MD. Role of Lung Ultrasound in Diagnosing and Differentiating Transient Tachypnea of Newborn and Respiratory Distress Syndrome in Preterm Neonates [J]. Advanced Ultrasound in Diagnosis and Therapy, 2022, 6(3): 112-118.
[3]	Xuehong Diao, MD, Lin Chen, MD, Bo Yu, MS, Jiamei Jin, MS, Jia Zhan, MD, Yue Chen, BS. Follicular Thyroid Neoplasmon Conventional and Contrast-enhanced Ultrasound [J]. Advanced Ultrasound in Diagnosis and Therapy, 2022, 6(2): 48-57.
[4]	Shiyun Peng, MM, Pan Yang, MM, Jinzhou Wan, MM, Siyu Yue, MB, Ling Wang, MB, Xiyue Zhang, MB, Fan Yang, MD. Prenatal Ultrasound Diagnosis of Klippel-trenaunay Syndrome Associated with the Thickened Thigh and Dilated Inferior Vena Cava: A Case Report and Literature Review [J]. Advanced Ultrasound in Diagnosis and Therapy, 2021, 5(4): 313-316.
[5]	Chelsea Robb. BS, RDMS, RVT, Traci Fox, EdD, RT(R), RDMS, RVT. Sonographic Features of Urothelial Carcinoma: A Case Study [J]. Advanced Ultrasound in Diagnosis and Therapy, 2021, 5(2): 95-97.
[6]	Bing Mao, MD, Shaobo Duan, MD, Ruiqing Liu, MD, Na Li, PhD, Yaqiong Li, PhD, Lianzhong Zhang, MD. The Roles of Ultrasound-Based Radiomics In Precision Diagnosis and Treatment of Different Cancers: A Literature Review [J]. Advanced Ultrasound in Diagnosis and Therapy, 2020, 4(4): 291-296.
[7]	Ruiqing Liu, MD, Yaqiong Li, PhD, Bing Mao, MD, Na Li, PhD, Shaobo Duan, MD, Zhiyang Chang, MS, Ye Zhang, MS, Shuaiyang Wang, MS, Lianzhong Zhang, MD. Focal Ablation Therapy for Prostate Cancer: A Literature Review [J]. Advanced Ultrasound in Diagnosis and Therapy, 2020, 4(4): 308-314.
[8]	Ying Zhang, MD, Yifeng Zhang, MD, Hanxiang Wang, MD, Anqi Zhu, MD, Hui Shi, MD. A Novel Two-dimensional Quantitative Shear Wave Elastography Mode for Differential Diagnosis of Benign and Malignant Thyroid Nodules [J]. Advanced Ultrasound in Diagnosis and Therapy, 2020, 4(3): 195-203.
[9]	Lixue Zhai, MD, Xiaojuan Zhang, MD, Yuxiu Gao, MD, Zhaoyan Ding, MD, Haiyang Yu, MD, Cheng Zhao, MD. Progress in Imaging Diagnosis and Image-guided Puncture Biopsy of Prostate Cancer [J]. Advanced Ultrasound in Diagnosis and Therapy, 2019, 3(4): 175-181.
[10]	Lei Yan, MM, Jianquan Zhang, MD, Jianguo Sheng, MM, Hang Zhang, MM, Zongping Diao, MM, Jianming Zheng, PhD. The Significance of Heat Shock Protein 70 Expression in Benign Thyroid Nodules During Thermal Ablation [J]. Advanced Ultrasound in Diagnosis and Therapy, 2019, 3(3): 103-108.
[11]	Shengnan Huo, MD, Lin Yin, Lili Peng, MD, Zhao Wang, MD, Ming-an Yu, MD. Microwave Ablation of An Autonomous Functioning Thyroid Nodule in A Pregnant Patient: A Case Report [J]. Advanced Ultrasound in Diagnosis and Therapy, 2019, 3(3): 136-139.
[12]	Jianquan Zhang, MD, Lei Yan, MD, Zongping Diao, MD, Hongqiong Chen, MD, Jie Cheng, MD. Potential Threat of Tracheal Diverticulum to Thermal Ablation Treatment of Thyroid Nodule [J]. Advanced Ultrasound in Diagnosis and Therapy, 2019, 3(1): 6-11.
[13]	Ping Wang, MM, Junfan Li, Wensheng Yue, MM, Wenyan Li, MM, Yuqun Luo, MM. The Correlation between Traditional Ultrasound Features and the Expression of Estrogen Receptor, Progesterone Receptor, Human Epidermal Growth Factor Receptor-2, and Ki-67 in Breast Carcinoma [J]. Advanced Ultrasound in Diagnosis and Therapy, 2018, 2(3): 173-177.
[14]	Mengna He, MD, Tian’an Jiang, MD. Acute Transient Thyroid Swelling after Fine-needle Aspiration Biopsy: Case Report and Review of the Literature [J]. Advanced Ultrasound in Diagnosis and Therapy, 2018, 2(3): 178-180.
[15]	Jinlian Ma, PhD, Dexing Kong, PhD. Deep Learning Models for Segmentation of Lesion Based on Ultrasound Images [J]. Advanced Ultrasound in Diagnosis and Therapy, 2018, 2(2): 82-93.