- Original research article
- Open Access
Is fluorine-18 fluorodeoxyglucose positron emission tomography useful for the thyroid nodules with indeterminate fine needle aspiration biopsy? a meta-analysis of the literature
Journal of Otolaryngology - Head & Neck Surgery volume 42, Article number: 38 (2013)
The Erratum to this article has been published in Journal of Otolaryngology - Head & Neck Surgery 2014 43:43
The indeterminate fine needle aspiration biopsy (FNAB) results present a clinical dilemma for physicians. The aim of this study was to evaluate the diagnostic accuracy of fluorine-18 fluorodeoxyglucose positron emission tomography (18 F-FDG PET) in the detection of these indeterminate lesions.
Seven studies (involving a total of 267 patients) published before November 2012 were reviewed. Systematic methods were used to identify, select, and evaluate the methodological quality of the studies as well as to summarize the overall findings of sensitivity and specificity.
A total number of 70 patients were confirmed to have malignant lesions, with a cancer prevalence of 26.2% (70/267; ranging from 19.6% to 40.0% in these studies). The pooled sensitivity and specificity of PET or PET/CT for the detection of cancer was 89.0% (95% CI: 79.0% ~ 95.0%) and 55.0% (95% CI: 48.0% ~ 62.0%), respectively. There was no evidence of threshold effects or publication bias. The area [±standard error (±SE)] under the symmetrical sROC curve was 0.7207 ± 0.1041. Although SUVmax was higher in malignant lesions (P < 0.01), there was still a great overlap. The best cut-off value of SUVmax for differentiation was 2.05; but with a high sensitivity of 89.8% and low specificity of 42.0%.
F-FDG PET or PET/CT showed a high sensitivity in detecting thyroid cancers in patients with indeterminate FNAB results. Further examination was strongly recommended when an FDG-avid lesion was detected.
Thyroid cancer is the most common endocrine malignancy. It represents approximately 1% of all cancers, corresponding to an incidence of up to 56, 460 new cases per year in the United States, with increasing incidence over the last decades . Early identification and diagnosis is important in appropriate treatment of thyroid cancer, as delays in the diagnosis are associated with increased mortality . The major diagnostic challenge in the work-up of the large number of patients with thyroid nodules is to select for surgery only those patients with malignant nodules.
Current guidelines recommend performing fine needle aspiration biopsy (FNAB) for nodules with a diameter larger than 5 mm to 20 mm, depending on patient clinical history and presence of suspicious ultrasonographic findings . FNAB is safe, easily performed, without major complications, and cost-effective. However, a number of reports have shown that between 11% and 42% of FNABs of thyroid lesions are reported as indeterminate [4–6]. These cytological indeterminate nodules present a clinical dilemma to the evaluating clinician. Therefore, patients with indeterminate or suspicious FNAB results have to undergo diagnostic hemithyroidectomy to exclude malignancy . Because only 20% to 30% of these nodules are malignant , most patients are undergoing unnecessary thyroid surgery with the potential risk of irreversible complications.
Unfortunately, at present, there is no alternative algorithm for a more conservative management of patients with thyroid nodules of indeterminate cytopathology. As a molecular image modality, Fluorine-18 Fluorodeoxyglucose (18 F-FDG) PET can detect a wide variety of tumor sites . Several studies have reported the role of PET in assessing cytological indeterminate nodules [10–18]. Nevertheless, the reduced number of patients in these studies and the existence of conflicting or non-conclusion results make it impossible to draw a definite conclusion. The purpose of this study was to meta-analyze published data on the diagnostic performance of 18 F-FDG PET or PET/CT in predicting the correct diagnosis of cytological indeterminate thyroid nodules.
This project was approved by the institutional review board at Shanghai Ninth People’s Hospital Affiliated to Shanghai Jiaotong University School of Medicine. Studies were identified in the following electronic databases: PubMed/MEDLINE and Embase databases. The search was updated until November 2012 and no beginning date limit was used. We searched articles by using the key words: “PET”; “PET/CT”; “thyroid nodule”; “thyroid incidentaloma”; “FDG”; “FNA”; “FNAB”; “indeterminate”; “unsuspicious” or “non-conclusion”. Only English-language was considered because the investigators were not familiar with other languages. To expand our search, bibliographies of articles that finally remained after the selection process were screened for potentially suitable references.
Two investigators independently evaluated potential studies for inclusion and subsequently resolved disagreements by discussion. Reviewers of the studies were blinded to journal, author, institutional affiliation, and date of publication. The selection criteria were: (i) adult patients with thyroid nodule with indeterminate FNAB; (ii) definite histological or follow up outcome; (iii) using 18 F-FDG PET or PET/CT for further diagnosis; (iv) a study population of at least ten patients and (v) the reported primary data were sufficient to allow calculation of both sensitivity and specificity. When data were presented in more than one article, the article with the largest number of patients or the article with the most details was chosen.
Exclusion criteria were: (i) studies that presented results from a combination of different imaging modalities that could not be differentiated for the assessment of a single test date; (ii) animal studies and (iii) abstracts, reviews, editorials, letters and comments.
Quality appraisal of retrieved full-text articles was all graded independently by 2 investigators for quality and applicability according to the Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS). This widely used tool consists of 14 items that cover patient spectrum, reference standard, disease progression bias, verification and review bias, clinical review bias, incorporation bias, test execution, study withdrawals, and intermediate results [19, 20]. Disagreements were resolved by consensus after a re-evaluation of the references.
Data were reported according to the guidelines for meta-analysis evaluating diagnostic tests. For each study, the sensitivity, specificity and their 95% confidence intervals (CI) were calculated from the original data. Positive likelihood ratio (LR+), negative likelihood ratio (LR-), and diagnostic odds ratio (DOR) were also reported. To avoid calculation problems by having zero values, 0.5 was added to each cell of the respective contingency table, which is a common method .
Because sensitivity and specificity often are related inversely because of the threshold effect, study heterogeneity in these diagnostic test characteristics was observed using a summary receiver operating characteristic (sROC) curve for which the area under the curve (AUC) was calculated.
All meta-analyses (pooling and sROC analysis) were performed using Meta-DiSc (version 1.4; Unit of Clinical Biostatistics, Ramon y Cajal Hospital, Madrid, Spain) .
The Mann–Whitney U test were used to compare PET findings between benign and malignant lesions. We utilized ROC curve analysis to find the best cut-off value of SUVmax for differentiation. Data was analyzed by SPSS 13.0 software. All analyses were two-sided. A P value less than 0.05 was taken to indicate a significant difference.
From the computer search and after extensive crosschecking of reference lists, 283 abstracts were retrieved. Reviewing titles and abstracts revealed 18 articles potentially eligible for inclusion. Thus, these 18 articles were retrieved in full text version. Screening of the references of these articles did not bring up new articles. Eleven articles were excluded from meta-analysis because: (i) researchers in the articles did not use histopathologic analysis and/or follow-up as the reference standard (n = 6); (ii) researchers in the articles did not report data that could be applied to construct or calculate true-positive, false-positive, true-negative, and/or false-negative results (n = 3); (iii) lesion by lesion analysis only (n = 1) and (iv) no FDG negative results (n = 1). Therefore, 7 studies with 267 patients were finally included in the meta-analysis.
The characteristics of these 7 studies were demonstrated in Table 1. The selected studies were performed in Austria , Netherland , Brazil , America [13–15] and France . The age of the patients included in the selected studies ranged from 18 to 84 years, with an average age ranging from 45.3 to 55.1 years. The sex distribution was described in all of the 7 studies, and the men-to-women ratio was 0.21 (46/221).
Among 7 studies, 4 were evaluated by PET [10–12, 14], 2 were evaluated by PET/CT [13, 16] and the other 1 was evaluated by either PET or PET/CT . Most of these studies were prospective [11, 13–16], and the type of two studies was not specified [10, 12].
In all but 1 study , all patients had thyroid-stimulating hormone (TSH) levels within the normal range. 18 F-FDG PET studies were obtained from all patients at least 2 weeks after FNAB [11, 12] while the other 5 studies did not mention this interval [10, 13–16].
The inclusion, exclusion criteria and definition of FDG-PET positivity of these 7 studies were shown in Table 2.
Among the 7 studies, none of them reported the interval between PET and surgery (QUADAS Item 4). Besides, none of the reviewed articles interpreted the 18 F-FDG PET and histology data in combination with other clinical data that would be available in practice (QUADAS Item 12). Only 2 articles described the methodology of reference test in sufficient detail to permit replication (QUADAS Item 9) [14, 16], and only 1 article mentioned blinding of the pathologist to the PET findings (QUADAS Item 11) .
Quantitative analysis (Meta-Analysis)
7 studies evaluated 267 patients with indeterminate FNAB results. The pooled sensitivity of PET or PET/CT for the detection of thyroid cancer was 89.0% (95% CI: 79.0% ~ 95.0%; I2 = 0.442; chi-square test with 6 degrees of freedom [df] = 10.76; P = 0.0962). The pooled specificity was 55.0% (95% CI: 48.0% ~ 62.0%; I2 = 0.309; chi-square test with 6 df = 8.68; P = 0.1925). There was no significant inconsistency among these studies (Figures 1, 2). Therefore, a fixed-effects model was used to calculate these pooled data. The overall LR+, LR- and DOR were 1.87 (95% CI: 1.57 ~ 2.23), 0.24 (95% CI: 0.13 ~ 0.45) and 8.15 (95% CI: 3.89 ~ 17.08), respectively. Besides, the LR+, LR- and DOR for each of the studies were presented in Table 3.
The sROC curve revealed no “shoulder-arm” plot, suggesting no threshold effect. The area [±standard error (±SE)] under the symmetrical sROC curve was 0.7207 ± 0.1041 (Figure 3).
A total number of 70 patients were confirmed to have malignant lesions, with a cancer prevalence of 26.2% (70/267; ranging from 19.6%  to 40.0% [13, 16]). Among them, 36 (51.4%) lesions were confirmed to be papillary cancers, 16 (22.9%) lesions were follicular cancers, the rest were other types of malignant tumors. 18 F-FDG PET or PET/CT correctly detected 62 lesions (88.6%). There were 8 false negative cases: 5 papillary cancers and 3 tumors of uncertain malignant potential (TUMP).
197 patients were confirmed to have benign lesions. 107 (54.3%) lesions were diagnosed as adenomas (follicular adenoma: 83, Hürthle cell adenoma: 12 and oxyphilic adenoma: 12), 55 (27.9%) as nodular hyperplasia, 29 (14.7%) as multinodular goiters and the other 6 (3.1%) as thyroiditis. PET or PET/CT only correctly judged 108 lesions (54.8%). There were considerable false positive cases: 48 adenomas (follicular adenoma: 28, Hürthle cell adenoma: 12 and oxyphilic adenoma: 8), 19 nodular hyperplasia, 18 multinodular goiters and 4 thyroiditis.
The differentiation of malignant and benign lesions
6 studies described age and gender in detail [10–13, 15, 16]. We found there was no statistical difference of age or sex between malignant and benign lesions (P > 0.05). 5 studies analyzed diameters, and the diameter could not be used to differentiate malignant and benign lesions, either (P > 0.05) [10, 12, 13, 15, 16]. 4 studies listed SUV in detail [10, 12, 13, 16]. Although SUVmax was higher in malignant lesions (8.6 ± 7.0 vs 5.0 ± 4.3; P < 0.01), there was still a great overlap. The best cut-off value of SUVmax for differentiation was 2.05, yet with a high sensitivity of 89.8% and low specificity of 42.0%.
FDG-avid thyroid nodules detected on PET scan are at a high risk of malignancy but the utility of 18 F-FDG PET in the presurgical characterization of indeterminate thyroid nodules at cytology is controversial, due to discordant results in the literature . The most recent American Thyroid Association (ATA) guidelines recommend exploring any FDG-avid nodule by FNAB (recommendation A1: Strongly recommends) but do not recommend the routine presurgical use of PET to detect malignancy (recommendation E: Recommends against) .
In our meta-analysis, 18 F-FDG PET or PET/CT correctly detected 62/70 malignant lesions, with a very high pooled sensitivity of 89.0%. Furthermore, SUV showed valuable in differentiating malignant lesions from benign ones (P < 0.01). We considered that PET was a useful tool to predict malignancy.
Vriens et al. has already meta-analyzed the utility of 18 F-FDG PET in detecting patient with indeterminate FNAB results . Our pooled sensitivity and specificity were similar to theirs. Compared with their analysis, our study was more up-dated and included more patients in order to enhance our statistical accuracy. Besides, we deleted one study with no FDG negative results ; because LR- could not be calculated under this circumstance, and with a specificity of 0%, which would lead to inconsistency between studies.
Previous systemical study concluded that a false negative PET result only occurred in nodules with a greatest histologic dimension <1.5 cm . In our analysis, there were 8 false negative cases, and 5 lesions with a dimension ≥ 2.0 cm. Therefore, we thought the size was not the sufficient reason to explain false negative phenomena. Further studies should be performed to better demonstrate it. Moreover, we noted that the majority of false negative results occurred in one study ; but in this study, the investigators regarded TUMP as malignant lesions, we thought it may cause bias and consequently make more FDG false negative cases. We suggested whether these patients had true malignant lesion should be further investigated.
Variable physiologic FDG uptake, and asymmetric FDG distribution in the neck can confound image interpretation. As a consequence, false positive is inevitable . We detected a considerable number of false positive cases in the analysis. The pooled specificity was only 55.0%. Therefore, we still should be very cautious when making a conclusion of malignancy. Yang et al. once demonstrated that the presence of focal uptake with high SUVmax and calcification detected on CT images correlates with a high likelihood of thyroid malignancy . Hence, we considered that sometimes we could utilize CT imaging for reference in order to ameliorate the diagnostic accuracy.
Currently, the cost of PET is relatively high; some studies did not encourage it before thyroid surgery [26, 27]. However, there remained other reasons to consider despite this cost-effectiveness. As in larger lesions, the complication rates can be higher (because of extension toward the large vessels, trachea, or recurrent laryngeal nerve), and these patients may benefit most from reassurance of a true-negative PET .
According to our analysis, PET correctly diagnosed 63.7% (170/267) of patients with indeterminate FNAB results. Although there were some false positive cases, over half patients (108/197) could avoid unnecessary surgery after PET. We believed that PET was useful in assisting treatment.
However, there are several limitations that are worth mentioning, including publication bias, selector bias, or diagnostic workup bias. For example, different studies used different definition of FDG PET positivity and malignancy. Besides, some studies were evaluated by PET while others were evaluated by PET/CT. Furthermore, the heterogeneity of the population still existed, particularly the vast variation in the prevalence of malignancy in different parts of the world with both endemic goiter areas and iodine-sufficient areas.
Our comprehensive meta-analysis of the literature revealed that 18 F-FDG PET or PET/CT showed a high sensitivity in detecting cancers in patients with indeterminate FNAB results. Further examination, such as hemithyroidectomy, was strongly recommended when an FDG-avid lesion was detected.
Siegel R, Naishadham D, Jemal A: Cancer statistics, 2012. CA Cancer J Clin. 2012, 62: 10-29. 10.3322/caac.20138.
Sipos JA, Mazzaferri EL: Thyroid cancer epidemiology and prognostic variables. Clin Oncol (R Coll Radiol). 2010, 22: 395-404. 10.1016/j.clon.2010.05.004.
Cooper DS, Doherty GM, Haugen BR, Kloos RT, Lee SL, Mandel SJ, Mazzaferri EL, McIver B, Pacini F, Schlumberger M, Sherman SI, Steward DL, Tuttle RM, American Thyroid Association (ATA) Guidelines Taskforce on Thyroid Nodules and Differentiated Thyroid Cancer: Revised American Thyroid Association management guidelines for patients with thyroid nodules and differentiated thyroid cancer. Thyroid. 2009, 19: 1167-1214. 10.1089/thy.2009.0110.
Alexander EK, Heering JP, Benson CB, Frates MC, Doubilet PM, Cibas ES, Marqusee E: Assessment of nondiagnostic ultrasound-guided fine needle aspirations of thyroid nodules. J Clin Endocrinol Metab. 2002, 87: 4924-4927. 10.1210/jc.2002-020865.
Miller B, Burkey S, Lindberg G, Snyder WH, Nwariaku FE: Prevalence of malignancy within cytologically indeterminate thyroid nodules. Am J Surg. 2004, 188: 459-462. 10.1016/j.amjsurg.2004.07.006.
Sclabas GM, Staerkel GA, Shapiro SE, Fornage BD, Sherman SI, Vassillopoulou-Sellin R, Lee JE, Evans DB: Fine-needle aspiration of the thyroid and correlation with histopathology in a contemporary series of 240 patients. Am J Surg. 2003, 186: 702-709. 10.1016/j.amjsurg.2003.08.015. discussion 709–710
Hegedüs L: The thyroid nodule. N Engl J Med. 2004, 351: 1764-1771. 10.1056/NEJMcp031436.
Baloch ZW, LiVolsi VA, Asa SL, Rosai J, Merino MJ, Randolph G, Vielh P, DeMay RM, Sidawy MK, Frable WJ: Diagnostic terminology and morphologic criteria for cytologic diagnosis of thyroid lesions: a synopsis of the National Cancer Institute Thyroid Fine-Needle Aspiration State of the Science Conference. Diagn Cytopathol. 2008, 36: 425-437. 10.1002/dc.20830.
Podoloff DA, Ball DW, Ben-Josef E, et al.: NCCN task force: clinical utility of PET in a variety of tumor types. J Natl Compr Canc Netw. 2009, 11 (Suppl 2): S1-26.
Kresnik E, Gallowitsch HJ, Mikosch P, Stettner H, Igerc I, Gomez I, Kumnig G, Lind P: Fluorine-18-fluorodeoxyglucose positron emission tomography in the preoperative assessment of thyroid nodules in an endemic goiter area. Surgery. 2003, 133: 294-299. 10.1067/msy.2003.71.
De Geus-Oei LF, Pieters GF, Bonenkamp JJ, Mudde AH, Bleeker-Rovers CP, Corstens FH, Oyen WJ: 18 F-FDG PET reduces unnecessary hemithyroidectomies for thyroid nodules with inconclusive cytologic results. J Nucl Med. 2006, 47: 770-775.
Sebastianes FM, Cerci JJ, Zanoni PH, Soares J, Chibana LK, Tomimori EK, De Camargo RY, Izaki M, Giorgi MC, Eluf-Neto J, Meneghetti JC, Pereira MA: Role of 18 F-fluorodeoxyglucose positron emission tomography in preoperative assessment of cytologically indeterminate thyroid nodules. J Clin Endocrinol Metab. 2007, 92: 4485-4488. 10.1210/jc.2007-1043.
Hales NW, Krempl GA, Medina JE: Is there a role for fluorodeoxyglucose positron emission tomography/computed tomography in cytologically indeterminate thyroid nodules?. Am J Otolaryngol. 2008, 29: 113-8. 10.1016/j.amjoto.2007.04.006.
Smith RB, Robinson RA, Hoffman HT, Graham MM: Preoperative FDG-PET imaging to assess the malignant potential of follicular neoplasms of the thyroid. Otolaryngol Head Neck Surg. 2008, 138: 101-106. 10.1016/j.otohns.2007.09.008.
Traugott AL, Dehdashti F, Trinkaus K, Cohen M, Fialkowski E, Quayle F, Hussain H, Davila R, Ylagan L, Moley JF: Exclusion of malignancy in thyroid nodules with indeterminate fine-needle aspiration cytology after negative 18 F-fluorodeoxyglucose positron emission tomography: interim analysis. World J Surg. 2010, 34: 1247-1253. 10.1007/s00268-010-0398-3.
Deandreis D, Al Ghuzlan A, Auperin A, Vielh P, Caillou B, Chami L, Lumbroso J, Travagli JP, Hartl D, Baudin E, Schlumberger M, Leboulleux S: Is (18)F-fluorodeoxyglucose-PET/CT useful for the presurgical characterization of thyroid nodules with indeterminate fine needle aspiration cytology?. Thyroid. 2012, 22: 165-172. 10.1089/thy.2011.0255.
Mitchell JC, Grant F, Evenson AR, Parker JA, Hasselgren PO, Parangi S: Preoperative evaluation of thyroid nodules with 18FDG-PET/CT. Surgery. 2005, 138: 1166-1174. 10.1016/j.surg.2005.08.031. discussion 1174–1175
Kim JM, Ryu JS, Kim TY, Kim WB, Kwon GY, Gong G, Moon DH, Kim SC, Hong SJ, Shong YK: 18 F-fluorodeoxyglucose positron emission tomography does not predict malignancy in thyroid nodules cytologically diagnosed as follicular neoplasm. J Clin Endocrinol Metab. 2007, 92: 1630-1634. 10.1210/jc.2006-2311.
Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003, 3: 25-10.1186/1471-2288-3-25.
Whiting PF, Weswood ME, Rutjes AW, Reitsma JB, Bossuyt PN, Kleijnen J: Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Med Res Methodol. 2006, 6: 9-10.1186/1471-2288-6-9.
Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM: The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003, 56: 1129-1135. 10.1016/S0895-4356(03)00177-X.
Zamora J, Abraira V, Muriel A, Khan K, Coomarasamy A: Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol. 2006, 6: 31-10.1186/1471-2288-6-31.
Vriens D, De Wilt JH, Van der Wilt GJ, Netea-Maier RT, Oyen WJ, De Geus-Oei LF: The role of [18 F]-2-fluoro-2-deoxy-d-glucose-positron emission tomography in thyroid nodules with indeterminate fine-needle aspiration biopsy: systematic review and meta-analysis of the literature. Cancer. 2011, 117: 4582-4594. 10.1002/cncr.26085.
Fukui MB, Blodgett TM, Snyderman CH, Johnson JJ, Myers EN, Townsend DW, Meltzer CC: Combined PET-CT in the head and neck: part 2. Diagnostic uses and pitfalls of oncologic imaging. Radiographics. 2005, 25: 913-930.
Yang Z, Shi W, Zhu B, Hu S, Zhang Y, Wang M, Zhang J, Yao Z, Zhang Y: Prevalence and risk of cancer of thyroid incidentaloma identified by fluorine-18 fluorodeoxyglucose positron emission tomography/computed tomography. J Otolaryngol Head Neck Surg. 2012, 41: 327-233.
Krug B, Van Zanten A, Pirson AS, Crott R, Borght TV: Activity-based costing evaluation of a [(18)F]-fludeoxyglucose positron emission tomography study. Health Policy. 2009, 92: 234-243. 10.1016/j.healthpol.2009.04.002.
Hooft L, Hoekstra OS, Boers M, Van Tulder MW, Van Diest P, Lips P: Practice, efficacy, and costs of thyroid nodule evaluation: a retrospective study in a Dutch university hospital. Thyroid. 2004, 14: 287-293. 10.1089/105072504323030942.
The authors’ declare that they have no competing interest.
Conception and design: NW and YL, Acquiring data, or analyzing and interpreting data: NW and HZ, Drafting the manuscript: NW, Revising the manuscript and enhancing its intellectual: Y L. All authors’ read and approved the final manuscript.
An erratum to this article is available at http://dx.doi.org/10.1186/s40463-014-0043-5.
About this article
- Fluorine-18 fluorodeoxyglucose
- Positron emission tomography
- Thyroid nodule
- Fine needle aspiration biopsy