Image Features-based Learning Effectively Improves Inter-Observer Agreement for Beginners in Evaluating Thyroid Nodule with Ultrasound

doi:10.37015/AUDT.2019.190801

Abstract

Abstract:

Objective: Thyroid nodules are a common medical problem in China and in other parts of the world. Many guidelines use ultrasound (US) as the first choice for evaluating thyroid nodules. A major limitation of US is operator dependency, resulting in a variety of discrepancies in diagnosing thyroid nodules in the literatures. Risk stratification of thyroid nodules is based on the patterns of US features in the 2015 American Thyroid Association (ATA) management guidelines for adult patients with thyroid nodules. We hypothesize that special training targeting features recognition may increase the inter-observer agreement.
Methods: The study was conducted on 52 participants from Peking Union Medical College Hospital (PUMCH) from March to May 2018.The participants were divided into two groups by their own decision for their convenience. Image featuresbased learning (IF-BL) was used to train the participants to learn special features including shape, margin, echo level, internal structure, calcification, vascularity through 10 standard images based on the 2015 ATA guideline. Group A (27 subjects) received IF-BL during the first month, and Group B (25 subjects) received IF-BL during the second month. All participants evaluated US features and risk stratification in 60 US images of 20 thyroid nodules before and after the training. The test results were graded by a teaching assistant according to the rule of 0.5 points assigned to every feature and 2 points assigned to risk stratification, with a total of 100 points. Inter-observer agreements of US features and risk stratification were assessed and compared before and after the training.
Results: After the first month, Group A had better scores than Group B, the control group of the month (75.4±9.4 vs 68.7±8.4, p = 0.01). At the end of the second month during which both groups were trained, there was no difference of scores between Group A and Group B (74.5±10.4 vs 75.1±7.4, P = 0.78). Scores of all participants were significantly higher than the initial (74.8±9.0 vs 65.8±13.6, P < 0.01). After the training, the kappa values of US features improved from 0.28-0.43 to 0.43-0.75, and those of risk stratification improved from 0.13 to 0.55.
Conclusion: IF-BL can effectively help trainees correctly recognize US features and evaluate the risk stratification of thyroid nodule and can improve the inter-observer agreement.

Key words: Thyroid nodule; Cancer; ATA; Training

Ying Wang, MD, Luying Gao, MD, Yuxin Jiang, MD, Hui Pan, MD, Jun Zhao, MA, Xin Zhou, MA, Qiong Wu, MM, Ruyu Liu, MM, Bo Zhang, MD. Image Features-based Learning Effectively Improves Inter-Observer Agreement for Beginners in Evaluating Thyroid Nodule with Ultrasound. Advanced Ultrasound in Diagnosis and Therapy, 2019, 3(1): 1-5.

References

[1]	Guo H, Sun M, He W, Chen H, Li W, Tang J, et al. The prevalence of thyroid nodules and its relationship with metabolic parameters in a Chinese community-based population aged over 40 years. Endocrine 2014; 45:230-5.
[2]	Hegedüs L. Clinical practice. The thyroid nodule. N Engl J Med 2014; 351:1764-71.
[3]	Tan GH, Gharib H. Thyroid incidentalomas: management approaches to nonpalpable nodules discovered incidentally on thyroid imaging. Ann Intern Med 1997; 126:226-31.
[4]	Leenhardt L, Erdogan MF, Hegedus L, Mandel SJ, Paschke R, Rago T, et al. 2013 European thyroid association guidelines for cervical ultrasound scan and ultrasound-guided techniques in the postoperative management of patients with thyroid cancer. Eur Thyroid J 2013; 2:147-59.
[5]	Perros P, Boelaert K, Colley S, Evans C, Evans RM, Gerrard Ba G, et al. Guidelines for the management of thyroid cancer. Clin Endocrinol (Oxf) 2014; 81:1-122.
[6]	Shin JH, Baek JH, Chung J, Ha EJ, Kim JH, Lee YH, et al. Ultrasonography diagnosis and imaging-based management of thyroid nodules: revised Korean society of thyroid radiology consensus statement and recommendations. Korean J Radiol 2016; 17:370-95.
[7]	Gharib H, Papini E, Paschke R, Duick DS, Valcavi R, Hegedüs L, et al. American Association of Clinical Endocrinologists, Associazione Medici Endocrinologi, and European Thyroid Association Medical guidelines for clinical practice for the diagnosis and management of thyroid nodules: executive summary of recommendations. EndocrPract 2016; 22:622-39.
[8]	Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid 2016; 26:1-133.
[9]	Moon WJ, Jung SL, Lee JH, Na DG, Baek JH, Lee YH, et al. Benign and malignant thyroid nodules: US differentiation--multicenter retrospective study. Radiology 2008; 247:762-70.
[10]	Park CS, Kim SH, Jung SL, Kang BJ, Kim JY, Choi JJ, et al. Observer variability in the sonographic evaluation of thyroid nodules. J Clin Ultrasound 2010; 38:287-93.
[11]	Choi SH, Kim EK, Kwak JY, Kim MJ, Son EJ. Interobserver and intraobserver variations in ultrasound assessment of thyroid nodules. Thyroid 2010; 20:167-72.
[12]	Srinivas MN, Amogh VN, Gautam MS, Prathyusha IS, Vikram NR, Retnam MK, et al. A prospective study to evaluate the reliability of thyroid imaging reporting and data system in differentiation between benign and malignant thyroid lesions. J Clin Image Sci 2016; 6:5.

[1]	Jian-Quan Zhang, PhD, Lei Yan, MD. Systematic Approaches and Designs for the Optimal Diagnosis and Treatment of Thyroid Nodules via Fine Needle Aspiration [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(3): 254-259.
[2]	Rui Chen, MM, Fangqi Guo, MM, Jia Guo, MD, Jiaqi Zhao, MD. Application and Prospect of AI and ABVS-based in Breast Ultrasound Diagnosis [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(2): 130-135.
[3]	Jiaojiao Ma, MD, Xinying Jia, MD, Guanghan Li, MD, Dandan Guo, MD, Xuehua Xi, MD, Tongtong Zhou, MD, Ji-Bin Liu, MD, Bo Zhang, MD. Development of 5G-based Remote Ultrasound Education: Current Status and Future Trends [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(2): 197-203.
[4]	Rendong Chen, PhD, Xiaoqian Wang, BS, Ping Liang, MD, Xiaoping Ouyang, PhD, Dexing Kong, PhD. Intelligent Ultrasonic Diagnosis and Clinical Application: Technical Development and Prospectives [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(2): 73-81.
[5]	Wenjia Guo, MM, Shengli Li, MM, Xing Yu, MD, Huaxuan Wen, BM, Ying Yuan, MM, Xia Yang, MM. Artificial Intelligence in Prenatal Ultrasound: Clinical Application and Prospect [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(2): 82-90.
[6]	Changyan Wang, BS, Haobo Chen, MS, Jieyi Liu, BS, Changchun Li, BS, Weiwei Jiao, BS, Qihui Guo, BS, Qi Zhang, PhD. Deep Learning on Ultrasound Imaging for Breast Cancer Diagnosis and Treatment: Current Applications and Future Perspectives [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(2): 91-113.
[7]	Priscilla Machado, MD, Ji-Bin Liu, MD, Flemming Forsberg, PhD. Sentinel Lymph Node Identification Using Contrast Lymphosonography: A Systematic Review [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(1): 1-7.
[8]	Jingfang Dong, MD, Jianyun Wang, MD, Xiangzhu Wang, MD. Predicting Malignancy in Sonographic Features of Thyroid Nodules Using Convolutional Neural Networks ResNet50 Model [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(1): 16-22.
[9]	Yixin Zhang, MS, Yuli Zhao, MS, Yuwen Su, MS, Sen Wang, MS, Li Feng, MD. Prenatal Ultrasound Diagnosis of Giant Cystic Meconium Peritonitis in Fetus Following in Vitro Fertilization: A Case Report [J]. Advanced Ultrasound in Diagnosis and Therapy, 2023, 7(1): 42-46.
[10]	Huolin Ye, MD, Qiannan Huang, MD, Qingjing Zeng, MD, Xuqi He, MD, Erjiao Xu, MD, Yinglin Long, MD, Kai Li, MD, Rongqin Zheng, MD. Contrast-enhanced Ultrasound for Evaluation of Active Needle Tract Bleeding during Thermal Ablation of Liver Cancer [J]. Advanced Ultrasound in Diagnosis and Therapy, 2022, 6(3): 104-111.
[11]	Srinivasan S, MD, Neeti Aggarwal, MD, Sushma Makhaik, MD, Anupam Jhobta, MD. Role of Lung Ultrasound in Diagnosing and Differentiating Transient Tachypnea of Newborn and Respiratory Distress Syndrome in Preterm Neonates [J]. Advanced Ultrasound in Diagnosis and Therapy, 2022, 6(3): 112-118.
[12]	Xuehong Diao, MD, Lin Chen, MD, Bo Yu, MS, Jiamei Jin, MS, Jia Zhan, MD, Yue Chen, BS. Follicular Thyroid Neoplasmon Conventional and Contrast-enhanced Ultrasound [J]. Advanced Ultrasound in Diagnosis and Therapy, 2022, 6(2): 48-57.
[13]	Shiyun Peng, MM, Pan Yang, MM, Jinzhou Wan, MM, Siyu Yue, MB, Ling Wang, MB, Xiyue Zhang, MB, Fan Yang, MD. Prenatal Ultrasound Diagnosis of Klippel-trenaunay Syndrome Associated with the Thickened Thigh and Dilated Inferior Vena Cava: A Case Report and Literature Review [J]. Advanced Ultrasound in Diagnosis and Therapy, 2021, 5(4): 313-316.
[14]	Chelsea Robb. BS, RDMS, RVT, Traci Fox, EdD, RT(R), RDMS, RVT. Sonographic Features of Urothelial Carcinoma: A Case Study [J]. Advanced Ultrasound in Diagnosis and Therapy, 2021, 5(2): 95-97.
[15]	Bing Mao, MD, Shaobo Duan, MD, Ruiqing Liu, MD, Na Li, PhD, Yaqiong Li, PhD, Lianzhong Zhang, MD. The Roles of Ultrasound-Based Radiomics In Precision Diagnosis and Treatment of Different Cancers: A Literature Review [J]. Advanced Ultrasound in Diagnosis and Therapy, 2020, 4(4): 291-296.