A study of SPECT/CT camera stability for quantitative imaging
© McDougald et al. 2016
Received: 7 May 2016
Accepted: 28 June 2016
Published: 29 July 2016
The purpose of this study was twofold: to evaluate the quantitative stability of a SPECT/CT gamma camera over time and to determine if daily flood acquisitions can reliably serve as calibration factors for quantitative SPECT. Using a cylindrical water phantom filled with measured amounts of 99mTc, factors were calculated to convert counts/cc to activity/cps. Measurements were made over an 18-month period. System sensitivity data calculated from 57Co daily quality assurance (DQA) flood acquisitions were then compared to the 99mTc calibration factors to determine the relationship of the factors.
The coefficient of variation is 2.7 % for the 99mTc cylinder conversion factors and 2.6 % for the 57Co DQA flood data. The greatest difference between the cylinder conversion factors and the flood data is less than 3 %.
Based on the results, the camera was stable within 3 % over an 18-month time period. The daily flood source acquisitions can be a reliable source for tracking camera stability and may provide information on updating the calibration factor for quantitative imaging.
KeywordsSingle photon emission tomography with computer tomography (SPECT/CT) quantitation Conversion factor SUV accuracy
For years, the concept of single photon emission tomography (SPECT) and now, SPECT integrated with X-ray computerized tomography (SPECT/CT) being used as a quantitative imaging tool has been pursued. Recently, partially due to improved technologies and vendor interest, fully quantitative SPECT/CT as a standard clinical tool is close to becoming a reality. While positron emission tomography with X-ray computerized tomography (PET/CT) has seen increased usage as a quantitative diagnostic and staging tool, one drawback is that it is limited to only a few FDA-approved radiopharmaceuticals. SPECT/CT is advantageous as a fully quantitative tool since it can be performed with a substantially larger list of approved radiopharmaceuticals.
With this in mind, research continues on the accuracy/validation of SPECT/CT image reconstruction, scatter correction, collimator response, and attenuation correction. For example, several studies have assessed quantitative SPECT/CT for 111In agents [1–3], 99mTc in lung perfusion, 201Tl in myocardial perfusion [4, 5] and brain imaging , 123I for DAT scans , or 177Lu and 131I for dosimetry calculations [8, 9].
However, in attempting to obtain quantitative information from images, such as the standard uptake value as used in PET/CT, one factor to first consider is the stability of the SPECT/CT camera. The overall consistent performance of the camera becomes an important issue regarding the accuracy, precision, or even the reproducibility of clinical trials or serial studies. If the goal of activity quantification is to enable diagnostic or therapeutic decisions based on estimates of activity in objects or regions in the body , then not only the individual components need scrutiny but the camera’s performance as a whole unit needs to be evaluated for continuity and consistency.
In order to investigate the camera’s stability, we obtained images of the same cylindrical phantom filled with a known amount of activity approximately once a week over an 18-month period. This allowed us to analyze the accuracy and precision of scanner-estimated activity concentrations for numerous data points over that time period. It also allowed us to more closely evaluate issues that arose, identifying sources of potential errors or biases.
Manufacturers recommend obtaining flood phantom images of a sheet source for daily quality assurance (DQA). For the camera used in this study, we evaluated daily 57Co flood phantom images taken as part of our clinic’s DQA. The DQA scans were acquired over the same time period as the cylindrical phantom studies were reviewed. The detection efficiency for the DQA scans were analyzed and compared to the cylindrical phantom results, noting any time varying behavior or scanner variability.
To evaluate the stability of the SPECT/CT scanner and determine a calibration factor for quantitative SPECT/CT, the measured activity concentration of a water-filled phantom injected with a radionuclide along with the counting rate from the DQA 57Co flood phantom was measured and tracked for approximately a year and a half. The study was done on a Philips Precedence, dual-head SPECT with a 16-slice helical CT system (Philips Healthcare, Cleveland, OH).
Vendor-recommended quality assurance testing on the Philips Precedence was conducted on a daily basis prior to scanning. For monitoring the extrinsic integral and differential uniformity, the DQA was completed on the gamma camera detector component using the 57Co flood phantom. The camera’s spatial resolution, linearity, and the center of rotation (COR) were extrinsically tested weekly. The CT component’s DQA requirements were also conducted prior to scanning. This process required scanning the manufacturer’s CT quality control phantom for verification of Hounsfield units and visually inspecting the images for uniformity and artifacts. The Philips Precedence SPECT/CT system is accredited by the American College of Radiology Imaging Network (ACRIN), which requires passing extensive annual quality assurance testing on the SPECT and CT components.
Scans of all the phantoms were performed using a basic patient torso protocol: step and shoot parameters of 20s per view, 128 × 128 matrix, non-circular orbit, 64 views over 180°; and the accompanying helical CT image: 120 kVp, 50 mAs, and 0.94 pitch. An energy window of 20 % centered around 140 keV (energy window peak checked/centered for each acquisition), low energy effectivity at 126 keV, and high energy effectivity at 154 keV was used.
The low-energy high-resolution (LEHR) collimator was used for all the 99mTc-filled phantoms and the majority of the 57Co flood phantoms. Occasionally, a medium- or high-energy general purpose collimator was used during the acquisition of the DQA flood scan: for consistency, these have not been used in our analysis.
In order to consider possible attenuation and scatter correction biases, some scans were performed with adipose tissue equivalent material (TEM; which has absorption and scattering properties within 1 % of living tissue)—3 cm thick, 30 × 30 cm2 wrapped around the 20-cm cylinder phantom.
Twenty-centimeter-diameter right circular cylinder phantom, volume of 6730 cc, filled with water injected with 10 mCi [9–11 ± 1 mCi] of 99mTc
NEMA image quality phantom, volume 10,490 cc, filled with water injected with 1 mCi of 99mTc
ACR SPECT phantom, volume 5743 cc, water filled, injected with 5 mCi of 99mTc
One-, two-, or four-liter bottle, water filled and injected with 5 mCi of 99mTc
National Institute of Standards and Technology (NIST) traceable standard 57Co solid phantom 20 mCi flood source, with an activity matrix of 16.25 ± 0.04 by 23.92 ± 0.04 in.
The vendor-supplied Astonish ordered subsets expectation maximization (OSEM) iterative algorithm was used; it incorporates depth-dependent resolution recovery, attenuation, and scatter correction [11, 12]. For scatter correction, Astonish uses a version of the effective source scatter estimation (ESSE) method which corrects for scatter by first estimating an effective scatter source that is then projected using an attenuated projection operation . The OSEM reconstruction was done with six iterations and eight subsets and with a Hanning filter with a cutoff frequency of 1 included in the reconstruction loop.
99mTc phantom data
After injecting a phantom with a measured amount of 99mTc, it was scanned using the standard patient protocol mentioned above. The collimator/detector heads are moved in as close as possible to the phantom, with a radius range of 24 cm right and left lateral, 20 cm anterior, and 22 cm posterior. A volume of interest (VOI) was drawn on the reconstructed image in order to obtain counts per second per volume (cc). The activity concentration (AC) was calculated based on the decay-corrected activity per phantom volume (cc) in units of cps per microcurie as shown in Eq. 1.
57Co flood phantom data
The DQA scans were taken with the manufacturer’s recommended protocol; acquiring 15 million counts per detector head, energy window of ±10 % at 122 keV, with the NIST 57Co flood phantom placed directly on detector head 2 and detector head 1 positioned close to the phantom.
Time periods for the different DQA 57Co flood phantoms used over the course of the study
57Co flood phantom’s activity source reference year
Time period flood(s) used
Flood A: 2011
Flood B: 2010 + 2011
Flood C: 2011 + 2012
It should be noted that the 57Co flood phantoms are used consistently every weekday morning for the DQA throughout the year. The time periods shown above only reflect times that directly coincide with when the 20-cm phantom or liter bottle scans were performed.
All the 57Co flood data were decay corrected using the standard half-life of 271.9 days for 57Co. Total counts per second from each detector head, with an area of approximately 54,500 mm2, were recorded.
Counts per second from the DQA 57Co flood scans taken on the same days as the 99mTc scans were used for the comparison with the conversion factors. For each day, the flood sensitivity (FS) was calculated using the mean of detector 1 plus detector 2 counts, then decay corrected. The decay-corrected values were then normalized to the mean of flood A, then to 1 for scaling. The conversion factor values were divided by the flood sensitivity values (CF/FS) and compared to the conversion factor values, in order to assess the use of DQA data to compute the calibration factor.
The vendor’s software generates an attenuation map, per pixel value, from the CT images. Based on the CT Hounsfield (HU) numbers, the values are converted to the linear attenuation coefficients. Therefore, regions of interest (ROIs) where drawn on several of the corresponding CT images for a visual inspection, validation, and stability of the HU numbers.
Precedence 99mTc conversion factors
As seen in Fig. 3, during the first couple of months of the study, the conversion factors remained just above the mean, and then started to drift below. Calibrations and preventive maintenance (PM) were performed on the scanner on 5 October 2012, after which there was a decrease of approximately 4 % in conversion factors derived from the cylindrical phantom for that month. The conversion factors then began a slight shift upward. Prior to and up to the PM, there was an overall increase in the conversion factors of 4 %. In April of 2013, the center of rotation calibration (COR) and adjustments were made along with a second PM. Following the COR and PM, the conversion factors then remained relatively constant. With a few exceptions, the conversion factors remained below the mean staying within 1.5 %. However, for example, on 17 January 2013, four studies of the same ACR cylindrical phantom were taken at different time periods and all were above the mean. In these instances, the increase in conversion factors may be due to the use of the ACR phantom or may have been influenced by other constituents. Unfortunately, only one set of data was collected with the ACR phantom and on 17 January 2013, the option of obtaining the 20-cm cylinder phantom for a direct comparison was not available.
It is possible that room temperature fluctuations caused part of the small variations in the conversion factors. We did not measure the scanner room temperature during the study; however, it is kept within the manufacturer’s specifications, set with controls to alert the hospital’s engineering and operations for any high spikes or increased room temperature. No temperature issues were reported over the entire time period of the study.
Analysis of the conversion factor for different data sets, separating out the 20-cm cylinder phantom from the liter bottles scans. The 20-cm cylinder phantom is also analyzed with and without the tissue equivalent material. The 1-L results are also analyzed separately
Coefficient of variation (%)
99mTc complete cylinder data set
99mTc 20-cm cylinder data (no TEM)
99mTc 1-L data only
99mTc combined liter data set
T test for individual two-group comparisons
20-cm phantom mean
Comparison mean (1 L, 20 cm/TEM, and complete liter data set)
95 % confidence interval for difference
20-cm phantom vs 1-L bottle
20-cm phantom vs 20 cm phantom/TEM
20 cm phantom vs complete liter data set
The comparisons did not indicate any significant differences in the mean CF values.
The complete 20 cm cylinder data set consisted of 55 scans, 4 of which are with the TEM material. The complete liter bottle data set contained 17 scans, of which 14 are 1-L bottle scans, 2 are 2-L bottle scans, and 1 is a 4-L bottle scan. The mean conversion factors for the full data set, cylinder data set, and the liter data set only vary by approximately 2 to 3 %, indicating stability.
Precedence 57Co daily flood phantom
Flood A: 2011 alone
Flood B: 2010 used with 2011
Flood C: 2011 used with 2012
The greatest variation is seen in the time period for flood B, where detector 1 and 2 count rates vary as much as 6 %. Regarding flood A results alone and flood C alone, the detector heads vary by only approximately 3 %.
Precedence 99mTc conversion factors compared to the 57Co daily flood phantom
After separating out the data based on the time periods (flood A, flood B, flood C) for the different floods used, the conversion factors and conversion factors/flood sensitivity values vary by less than 3 %, less than 2 %, and approximately 2 %, respectively.
The statistical analysis of the conversion factors/flood sensitivity data set
Coefficient of variation (%)
99mTc conversion factors/flood sensitivity
A review of the CT images and drawn ROIs clearly indicated that the CT numbers were stable over the course of the study, eliminating the CT as a contributing factor to the CF variability.
We find that the scanner is relatively stable, with consistent conversion factors over the duration of the study. The maximum difference between a single conversion factor and the average conversion factor was 5 %, with the coefficient of variation of 2.76 % in the 99mTc 20-cm cylinder phantom data set and a coefficient of variation of 2.67 in the 99mTc conversion factors/flood sensitivity as seen in Tables 2 and 4 and Fig. 7.
In reference to Fig. 4, breaking the data down into smaller components/elements, variability in the scanner’s performance between the calculated conversion factors of the 1-L bottle compared to the 20-cm cylinder show the greatest difference to be within 10 %. Considering only the 1-L bottle and the 20-cm phantom scans that were performed on the same day, the greatest difference between the two drops to within 6 %. Conversion factors from the 2-L bottle and the 20-cm cylinder fall within 11 % of each other, while the difference between the single 4-L bottle and the 20-cm cylinder conversion factors is less than 3 %. And indicated in Table 3, the comparisons between the 20-cm phantom and the liter bottles signified that there are no significant differences in the measured mean CF values. The variability seen between the different sizes of liter bottles and the 20-cm phantom are most likely not a spatial resolution issue but can more likely be attributed to different levels of bias after scatter correction.
Furthermore, as seen in Fig. 5 and commented on below, the DQA scans were also comparatively stable with some of the variation explained by inconsistencies in the measurement process. However, the variations seen in the water-filled phantoms, displayed in Fig. 3, were greater than the variations seen in the DQA, which brings the process of filling phantoms under suspicion given that the DQA and the 20-cm phantoms were scanned under the same protocol on the same scanner. This variation is consistent with our earlier work in PET using a 20-cm water-filled phantom injected with 18F and a solid 20 cm 68Ge/68Ga phantom, which demonstrated that the water-filled phantom may have accounted for 1–3 % of the overall variability .
As a cursory check, the calculated median conversion factor value was used to recover the decay-corrected activity concentration for the 20-cm cylinder data. This check produced values in which the average percent error was within less than 3 %. Similar results were obtained with the 1-L bottle for an average percent error of less than 3 %. However, for both data sets, a few data points gave percent errors of up to 7 % between the decay-corrected activity (injected) and the recovered (measured) activity.
Figure 6a, b, the 57Co DQA, reveals potential areas of concern, requiring further research. First, Fig. 7 clearly shows an upward trend within all the flood data (flood A, B, and C). It is possible that the 57Co flood phantoms contain a longer-lived contaminant, but a more likely scenario is in the DQA protocol itself. Currently, dead-time corrections are not done in the DQA, which could help explain the upward trend seen. The other issue is the variations in sensitivity between detector heads 1 and 2. This underlying global bias from head to head will need to be corrected/accounted for in quantitative imaging.
The fundamental concept of measuring/deriving the estimated amount of activity in the tissue with SPECT/CT is the same as measuring the standardized uptake value (SUV) with PET/CT. However, we feel more work needs to be done to determine the accuracy and precision of such measurements in SPECT/CT. In particular, potential errors due to scatter correction, system dead-time, collimator detector response, attenuation correction, and partial volume need further exploration. In addition, other radioisotopes, geometries, and the manufacturer’s calibration procedures need to be considered. While this paper focuses on the overall stability and calibration factors of SPECT/CT using 99mTc and the DQA flood 57Co phantom, in order to tackle these other issues, we are currently collecting data using 131I, 123I, 111In, 67Ga, 90Y, and 201Tl, along with continued 99mTc scans. These studies are being done with a variety of phantoms including an anthropomorphic phantom and varying sizes of liter cylinders with and without TEM. Furthermore, we are also looking into the validity of conversation factors for quantification along with reconstruction methods/algorithms through continued studies in a lung phantom including regions with and without injected activity.
This study demonstrates the stability of only one manufacturer’s SPECT/CT camera. Similar studies will be repeated on the other manufacturers’ SPECT/CT gamma cameras available within the University of Washington Associated Hospitals.
Especially with complexity and variability of the phantoms used, there is a greater probability that some of the inconsistencies can be attributed to human error. Both the DQA and the activity-filled phantom require human interaction. Measuring activity from a syringe injected into a water-filled phantom creates the potential for error, from assaying pre-injection to post-injection activity levels.
Another inconsistency not usually noted is the time differences that can and do occur between the dose calibrator clock and the scanner clocks. This time difference was seen to vary from just a few minutes to as much as 10 min. For this study, clocks synced and connected to the timeserver Seiko were used.
The DQA protocol calls for a static scan using a 57Co flood phantom placed as close as possible to the LEHR collimators, per manufacturer’s recommendations. During this study, it was noted that the DQAs performed in our clinic involved three different phantoms and three different collimators. We also noted that the placement of the phantoms, in particular, the stacking order when using two phantoms, could result in biases. We are working on standards for a more uniform DQA, with protocols, addressing the collimators used, phantom activity and placement, energy window verification, and detector distance.
This study would suggest not only that the overall performance and sensitivity of the camera are stable but also that the flood data measurements could be used to indicate when calibration factors need to be updated.
We suggest possible new protocols to augment the DQA, clearly indicating collimator usage, flood phantom placement, and distance of detectors from the phantoms and/or the development/design of a 57Co cylindrical phantom for placement on a stationary holder for DQA. Also, corrections during the DQA acquisition, such as dead-time corrections and the head-to-head bias, need to be addressed.
While this study demonstrated the stability of one SPECT/CT camera, more research is needed to determine the limits of quantitation for ROIs in more complex phantoms. For example, the comparisons of the results for the 1- and 2-L bottles to the larger phantoms suggest the possibility that the scatter correction for this particular image reconstruction implementation might be introducing bias in some situations.
ACR, American College of Radiology phantom; ACRIN, American College of Radiology Imaging Network; CF, conversion factor; COR, center of rotation; DQA, daily quality assurance; ESSE, effective source scatter estimation; FDA, Food and Drug Administration (USA); FS, flood sensitivity; IQ, image quality cylinder phantoms; LEHR, low-energy high-resolution; OSEM, ordered subsets expectation maximization; PET/CT, positron emission computer tomography/computer tomography; PM, preventive maintenance; SPECT/CT, single photon emission computer tomography/computer tomography; SUV, standardized uptake value; TEM, tissue equivalent material; VOI, volume of interest
This study was supported by SimSET, NIH grant CA042593.
WM created the image acquisition protocols, acquired images, carried out the data collection and analysis, and drafted manuscript. RM assisted in the interpretation of the data and the revising of the manuscript. AA assisted in the interpretation of the data, data analysis of the Cobalt 57 data, and the revising of the manuscript. RH assisted in the revising of the manuscript. TL assisted in the CT data analysis and the revising of the manuscript. All authors participated in the conception of the study and design. All authors read and approved the final manuscript.
Disclosure forms are attached, and all authors declare that they have no competing interests.
This article does not contain any studies with human participants or animals performed by any of the authors.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Assie K, Dieudonne A, Gardin I, et al. A preliminary study of quantitative protocols in Indium 111 SPECT using computational simulations and phantoms. IEEE Trans Nucl Sci. 2010;57(3):1096–104.View ArticleGoogle Scholar
- Dewaraja YK, Wilderman SJ, Ljungberg M, Koral KF, Zasadny K, Kaminiski MS. Accurate dosimetry in I-131 radionuclide therapy using patient-specific, 3- dimensional methods for SPECT reconstruction and absorbed dose calculation. J Nucl Med. 2005;46(5):840–9.PubMedPubMed CentralGoogle Scholar
- He B, Frey EC. Comparison of conventional, model-based quantitative planar, and quantitative SPECT image processing methods for organ activity estimation using In-111 agents. Phys Med Biol. 2006;51(16):3967–81.View ArticlePubMedGoogle Scholar
- Backus, Verburg BE, Romijn FA, Leo R, et al. Intra-patient reproducibility of myocardial SPECT imaging with (201)Tl. J Nucl Cardiol. 2009;16(1):97–104.View ArticlePubMedGoogle Scholar
- Ficaro EP, Corbett JR. Advances in quantitative perfusion SPECT imaging. J Nucl Cardiol. 2004;11:62–70.View ArticlePubMedGoogle Scholar
- Matsunaga S, Shuto T, Takase H, et al. Semiquantitative analysis using Thallium-201 SPECT for differential diagnosis between tumor recurrence and radiation necrosis after gamma knife surgery for malignant brain tumors. Int J Radiat Oncol Biol Phys. 2013;85(1):47–52.View ArticlePubMedGoogle Scholar
- Koch W, Bartenstein P, la Fougere C. Radius dependence of FP-CIT quantification: a Monte Carlo-based simulation study. Ann Nucl Med. 2014;28(2):103–11.View ArticlePubMedGoogle Scholar
- de Nijs R, Lagerburg V, Klausen TL, et al. Improving quantitative dosimetry in 177 Lu-DOTATATE SPECT by energy window-based scatter corrections. Nucl Med Commun. 2014;35(5):522–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Song Y, Du G, Sgouros A, Prideaux E, Frey, Wahl RL. Therapeutic potential of Y-90- and I-131-labeled anti-CD20 monoclonal antibody in treating non-Hodgkin’s lymphoma with pulmonary involvement: a Monte Carlo-based dosimetric analysis. J Nucl Med. 2007;48:150–7.PubMedPubMed CentralGoogle Scholar
- Frey EC, Jl H, Ljungberg M. Accuracy and precision of radioactivity quantification in nuclear medicine images. Semin Nucl Med. 2012;42:208–18.View ArticlePubMedPubMed CentralGoogle Scholar
- Heller GV, Bateman TM, Cullom SJ, Hines HH, Da Silva AJ. Improved clinical performance of myocardial perfusion SPECT imaging using Astonish iterative reconstruction. Philips MedicaMundi. 2009; 53(3):43–9.Google Scholar
- Jinghan Ye, Xiyun Song, Mary K. Durbin, et al. SPECT image quality improvement with Astonish software. Milpitas: Philips Clinical Netforum Healthcare; 2006.Google Scholar
- Frey EC, Tsui BMW. Modeling the scatter response function in inhomogeneous scattering media for SPECT. IEEE Trans Nucl Sci. 1994;41(4):1585–93.View ArticleGoogle Scholar
- Lockhart CM, Macdonald LR, Alessio AM, McDougald WA, Doot RK, Kinahan PE. Quantifying and reducing the effect of calibration error on variability of PET/CT standardized uptake value measurements. J Nucl Med. 2011;52:218–24.View ArticlePubMedPubMed CentralGoogle Scholar