Skip to main content

An international multi-center investigation on the accuracy of radionuclide calibrators in nuclear medicine theragnostics

Abstract

Background

Personalized molecular radiotherapy based on theragnostics requires accurate quantification of the amount of radiopharmaceutical activity administered to patients both in diagnostic and therapeutic applications. This international multi-center study aims to investigate the clinical measurement accuracy of radionuclide calibrators for 7 radionuclides used in theragnostics: 99mTc, 111In, 123I, 124I, 131I, 177Lu, and 90Y.

Methods

In total, 32 radionuclide calibrators from 8 hospitals located in the Netherlands, Belgium, and Germany were tested. For each radionuclide, a set of four samples comprising two clinical containers (10-mL glass vial and 3-mL syringe) with two filling volumes were measured. The reference value of each sample was determined by two certified radioactivity calibration centers (SCK CEN and JRC) using two secondary standard ionization chambers. The deviation in measured activity with respect to the reference value was determined for each radionuclide and each measurement geometry. In addition, the combined systematic deviation of activity measurements in a theragnostic setting was evaluated for 5 clinically relevant theragnostic pairs: 131I/123I, 131I/124I, 177Lu/111In, 90Y/99mTc, and 90Y/111In.

Results

For 99mTc, 131I, and 177Lu, a small minority of measurements were not within ± 5% range from the reference activity (percentage of measurements not within range: 99mTc, 6%; 131I, 14%; 177Lu, 24%) and almost none were outside ± 10% range. However, for 111In, 123I, 124I, and 90Y, more than half of all measurements were not accurate within ± 5% range (111In, 51%; 123I, 83%; 124I, 63%; 90Y, 61%) and not all were within ± 10% margin (111In, 22%; 123I, 35%; 124I, 15%; 90Y, 25%). A large variability in measurement accuracy was observed between radionuclide calibrator systems, type of sample container (vial vs syringe), and source-geometry calibration/correction settings used. Consequently, we observed large combined deviations (percentage deviation > ± 10%) for the investigated theragnostic pairs, in particular for 90Y/111In, 131I/123I, and 90Y/99mTc.

Conclusions

Our study shows that substantial over- or underestimation of therapeutic patient doses is likely to occur in a theragnostic setting due to errors in the assessment of radioactivity with radionuclide calibrators. These findings underline the importance of thorough validation of radionuclide calibrator systems for each clinically relevant radionuclide and sample geometry.

Introduction

In the last decades, the application of personalized molecular radiotherapy using theragnostics has gained a lot of interest in nuclear medicine [1, 2]. Theragnostic approaches aim to optimize molecular radiotherapy for individual patients using pre-therapeutic diagnostic imaging. In particular, assessment of the therapeutic absorbed dose to malignant tissue and to organs at risk based on these images facilitates a personalized therapeutic activity approach. These approaches require accurate quantification of the activity administered to patients both in diagnostic and therapeutic applications. Accurate activity calibration of radionuclide imaging equipment such as SPECT and PET cameras is also essential in theragnostics, to enable an accurate estimation of radiopharmaceutical uptake in patient tissues.

In practice, radionuclide activity calibrators are used to measure the radiopharmaceutical activity to be administered to patients and are often the reference instrument for calibrating SPECT and PET systems. Radionuclide calibrators are typically provided with factory-set calibration factors for a variety of clinically relevant radionuclides. Usually, the calibration factors are calculated from energy-dependent sensitivity curves, determined experimentally on a dedicated reference device using well-calibrated traceable sources in standard containers [3]. In-factory calibration of medical devices is usually limited to a small subset of (long-lived) radionuclides to ensure proper response of each device with respect to the reference device. However, due to manufacturing tolerances in device specifications, variations in response among radionuclide calibrators of same model can occur, particularly in the low photon-energy range, which is generally not tested in the factory. Moreover, sample geometries used in clinical practice differ in shape, size, material, and filling volume from the standard container geometries used for activity calibrations. Since radionuclide calibrator measurements are sensitive to changes in system and sample measurement geometry [4, 5], the validity of generic factory-set calibration factors is not guaranteed for clinically used radionuclides and sample geometries.

Therefore, several international guidelines recommend a thorough validation of radionuclide calibrator accuracy for all clinically used radionuclides and sample geometries during acceptance testing [6,7,8]. These guidelines typically recommend a measurement accuracy of ± 5–10% for diagnostic and ± 5% for therapeutic radionuclides. However, although practice varies widely across Europe, more often than not radionuclide calibrators are clinically implemented without such validation due to a lack of available certified activity standards of (short-lived) clinically used radionuclides, expertise, and time/costs required to perform this validation. In fact, a multi-center study investigating the radionuclide calibrator measurement accuracy among 15 Belgian hospitals performed between 2013 and 2015 revealed that none of the participating centers assessed the accuracy of clinically used radionuclides [9].

Several studies [9,10,11,12,13,14,15] have reported on the measurement accuracy of various individual diagnostic and therapeutic radionuclides, and demonstrated large measurement deviations (> ± 10%), particularly for 111In, 68Ga, 123I, and 90Y. However, no study has reported on the combined error of radiopharmaceutical activity measurements with radionuclide calibrators in the increasing application of personalized molecular radiotherapy based on a theragnostic approach. Therefore, we performed an international multi-center study on the clinical measurement accuracy of 32 radionuclide calibrators (7 different types from 4 vendors) for a comprehensive set of theragnostic radionuclides: imaging tracers 99mTc, 111In, 123I, and 124I, and their therapeutic companions 90Y, 177Lu, and 131I. Additionally, the combined deviation of activity measurements in a theragnostic setting was evaluated for 5 clinically relevant theragnostic pairs: 131I/123I and 131I/124I, which are used mostly for treatment of thyroid disorders such as differentiated thyroid cancer and hyperthyroidism; 177Lu/111In and 90Y/111In, used for peptide receptor radionuclide therapy of neuroendocrine neoplasms and prostate cancer; and 90Y/99mTc, used in the treatment of liver tumors and metastases with 90Y microspheres [1, 2, 16].

Methods

Stock solution preparation

The radionuclides were obtained from various suppliers: [99mTc]-NaTcO4, [123I]-NaI, and [131I]-NaI from GE Healthcare (Eindhoven, The Netherlands); [124I]-NaI from BV Cyclotron VU (Amsterdam, The Netherlands); [177Lu]-LuCl3 from IDB Holland (Baarle-Nassau, The Netherlands); and [111In]-InCl3 and [90Y]-YCl3 from Curium (Petten, The Netherlands).

[177Lu]-LuCl3, [111In]-InCl3, [90Y]-YCl3, [131I]-NaI, and [124I]-NaI stock solutions and samples were prepared within 24 h of the first day of the intercomparison measurements, which took place over three consecutive days. Due to their shorter half-life, [99mTc]-NaTcO4 and [123I]-NaI solutions were prepared at each measurement day. For each radionuclide, a stock solution was prepared with approximately 10 MBq mL−1 on the first measurement day. Stock solutions were prepared using sterile water (Baxter, The Netherlands) in a borosilicate glass container and immediately after preparation dispensed into samples to avoid precipitations.

Evaluation of radionuclidic impurities

Each stock solution was checked for radionuclidic impurities by high-resolution gamma-ray spectrometry using a high-purity germanium detector (GR1018; Mirion Technologies, Georgia, USA) as described in the supplemental material. No short- or long-lived radionuclidic impurities were found for 99mTc, 111In, 131I, and 90Y. For 123I and 124I, trace amounts of 125I were observed with a maximum radionuclidic impurity of 0.030% and 0.037%, respectively. For 177Lu, trace amounts of 177mLu were observed with a maximum radionuclidic impurity of 0.017%. Minimum detectable activities of potential impurities not detected (99Mo, 114mIn, 121Te, 88Y) and the effect of (potential) impurities on a radionuclide calibrator are reported in the supplemental material (Table S1) [17].

Determination of reference activity

The reference (true) activity concentration of each stock solution was determined by the Belgian Nuclear Research Centre (SCK CEN) (Mol, Belgium) in collaboration with the Joint Research Centre (Geel, Belgium), which is specialized in primary and secondary standardization of radioactivity [18]. Reference activity measurements were performed using two secondary standard ionization chambers: a Fidelis (Southern-Scientific, Henfield, UK) and an ISOCAL-III (Vinten Instruments, UK). The latter is consistent with radioactivity standards from the JRC [9]. Both chambers are of the same design and use calibration factors traceable to the primary standards of activity of the UK National Physical Laboratory (NPL).

From each stock solution, three 10-mL type 1+ Schott vials (SCHOTT AG Pharmaceutical Systems, Mainz, Germany) [19] were filled with 4 mL of solution (calibration geometry specified for the Fidelis), and their activities were assayed in both reference chambers. With the exception of 90Y, the reference activity of each Schott vial was determined from the mean of the activities measured with both the Fidelis and the ISOCAL, and the gravimetrically determined mass of stock solution in the vial. All activity measurements were corrected for background signal and for radioactive decay to a common reference time using the half-life values published in the NuDat database version 2.8 [20]. Additionally, before determination of the average value, the activity measurements were corrected for linearity, radionuclide impurities (significant only for (177mLu/)177Lu measurements), and deviations in response against the NPL master chamber (see supplementary Table S2). For the latter correction, radionuclide- and chamber-dependent correction factors were estimated from the NPL acceptance testing data of each system (corrections < 1.1% for the gamma emitters and 14.5% for the 90Y Fidelis measurements), as described in the supplementary data [21].

With the exception of 90Y, the Fidelis and ISOCAL systems agreed within ± 0.7% in Schott vial activity measurements. For 90Y, however, a difference in response of approximately 10% was observed between both systems. On the basis of this discrepancy and the lack of experimental data to correct the response of the ISOCAL against the NPL master chamber for pure beta emitters, the reference activity concentration of the 90Y stock solution was derived from activity measurements with the Fidelis only. The reference activity concentration of the radionuclide stock solution was then determined as the mean of the activity concentrations from the three Schott vials. The expanded uncertainty (95% confidence level) in the reference activity concentrations of the stock solutions was 2.0% for 99mTc, 1.7% for 111In, 2.2% for 123I, 2.0% for 124I, 1.1% for 131I, 1.2% for 177Lu, and 6.9% for 90Y (see supplementary Table S3).

Sample preparation

From each stock solution, a set of four samples comprising two different clinical containers each with two filling volumes were prepared: two 3-mL Luer-lock syringes (Terumo Europe, Leuven, Belgium) filled with 1 mL and 3 mL of solution, and two 11-mL TechneVial glass vials (Curium, Petten, The Netherlands) filled with 1 mL and 10 mL of solution. Each syringe was sealed with a combi-stopper (Braun, The Netherlands). The content mass of each sample was verified gravimetrically, by weighing the sample before and after filling with an analytical balance (XS105DU/M; Mettler-Toledo, Tiel, The Netherlands). The reference activity (Aref) of each sample was calculated by multiplying the content mass with the stock solution reference activity concentration. As the uncertainty in sample mass measurements was negligible compared to the uncertainty in radioactivity concentration, the relative uncertainty of the sample reference activity (uref) was approximately equal to the relative uncertainty of the stock solution activity concentration.

Due to transport logistics, for one hospital, separate sets of samples (a 3-mL syringe filled with 3 mL and a TechneVial filled with 10 mL of stock solution) were prepared for all radionuclides.

Clinical activity measurements

Sample measurements were performed on a total of 32 radionuclide calibrator systems of 8 university hospitals located in the Netherlands, Belgium, and Germany. Of all systems, 4 were manufactured by Capintec Inc (Florham Park, USA), 11 by former MED Nuklear-Medizintechnik (now Nuvia Instruments, Dresden, Germany), 1 by PTW-Freiburg (Freiburg, Germany), and 16 by former Veenstra Instruments (now Comecer Netherlands, Joure, The Netherlands) (see supplemental Table S4).

If applicable, measurements were performed using hospital-specific calibration settings and sample geometry corrections. Otherwise, standard factory settings were used (see supplementary Tables S5-S11). The standard (automatic) measurement (averaging) time of the calibrator was used. Three activity readings (n = 3) were taken sequentially, without moving the sample, at intervals of several seconds (dependent on observed system response time). The calibrator reading was left to settle (typically for about 15 to 30 s) before the first reading was taken. The range of the sample activities at the moment of clinical measurements is indicated in Table 1. Each measurement was corrected for background signal and radioactive decay. For each measurement triplet, the average net activity (Ām) and standard deviation (SD) were calculated. The statistical measurement uncertainty (um) was estimated at the 95% confidence level (coverage factor k = 4.30 for a t-distribution with two (n − 1) degrees of freedom), as follows:

$$ {u}_m=\frac{k\bullet SD}{{\overline{A}}_m\bullet \sqrt{n}} $$
(1)
Table 1 Sample reference activities (minimum–maximum (25th percentile)) at the moment of clinical activity measurements

Net activities were not corrected for the presence of radionuclidic impurities (if any).

Evaluation of performance

Individual radionuclides

The radionuclide calibrator measurement accuracy was determined as the percentage deviation of the average measured activity Ām with respect to the sample reference activity Aref.

For each radionuclide and sample geometry, the typical accuracy and reliability of activity measurements were described in terms of the median and the inter-quartile range (IQR) values of the measurement percentage deviations of all systems pooled together. Similarly, these metrics were used to assess the manufacturer dependence of measurement accuracy and inter-system variability. Sample geometry effects were evaluated by comparing the measurement deviations of the syringe and vial samples with similar filling volume (syringe 1 mL vs vial 1 mL, syringe 3 mL vs vial 10 mL).

Theragnostic pairs

Finally, since patient tissue doses are proportional to the amount of therapeutic activity administered and in a theragnostic approach the amount of therapeutic activity is based on diagnostic imaging, the combined systematic percentage deviation (bias) that would be associated to therapeutic doses (ED) was calculated for the theragnostic pairs 131I/123I, 131I/124I, 177Lu/111In, 90Y/99mTc, and 90Y/111In, as follows:

$$ {E}_D=\left[\frac{{\left({\overline{A}}_m/{A}_{\mathrm{ref}}\right)}_{\mathrm{therapy}}}{{\left({\overline{A}}_m/{A}_{\mathrm{ref}}\right)}_{\mathrm{imaging}}}-1\right]\bullet 100\% $$
(2)

Results

Data analysis

In total, 32 radionuclide calibrator systems were investigated. If no calibration setting was available for a specific radionuclide (see supplemental Tables S4-S10), that radionuclide was not measured on that system. One system (E1) appeared defective as it systematically underestimated the activity (typically by more than 10%) of all samples (see Fig. 1). Therefore, this system was excluded from further analysis. This resulted in a total of 745 activity measurement datasets for further analysis.

Fig. 1
figure1

Box-whisker plots and mean values of the percentage deviations of all activity measurements used for analysis, for each radionuclide sample configuration tested (90Y whisker limits not shown: syringe 1 mL 423.9%, syringe 3 mL -383.6%). Additionally, the percentage deviations from defective measurements excluded from the analysis and box-whisker plots are shown as data points

An overview of the intercomparison results is provided in Fig. 1 as box-whisker plots of the percentage deviations from all analyzed radionuclide calibrator measurements. Figures 2 and 3 show the individual percentage deviations grouped per manufacturer (excluding defective/invalid measurements), for the diagnostic and therapeutic radionuclides, respectively. Table 2 indicates the percentage of activity measurements that exceeded a given range of deviation from the reference activity.

Fig. 2
figure2

Percentage deviations of all the activity measurements used for analysis, for each system tested, for the diagnostic radionuclides. a 99mTc, b 111In, c 123I, d 124I. Systems using sample geometry calibration/correction factors are labeled with an asterisk (*)

Fig. 3
figure3

Percentage deviations of all the activity measurements used for analysis, for each system tested, for the therapeutic radionuclides. a 131I, b 177Lu, c 90Y (data not shown: D1 syringe 1 mL 158.2%, D1 syringe 3 mL 94.0%, H2 syringe 1 mL 423.9%, H2 syringe 3 mL 383.6%). Systems using sample geometry calibration/correction factors are labeled with an asterisk (*)

Table 2 Percentage of activity measurements that exceed a given deviation from the reference activity

Diagnostic radionuclides

99mTc

For 99mTc, only 6% (7/110) of all measurements were not within ± 5% of the reference value. No dataset showed deviations larger than ± 10%. For all sample configurations, the median deviation was within 3.2% from the reference value and there was little spread in measurement deviations (largest IQR 4%), indicating a good and reproducible measurement accuracy for 99mTc.

With a median difference of less than ± 2% in measurement deviations between syringes and vials (IQR 3%), the dependency on container type was mostly small.

111In

A substantial amount of the 111In measurements did not meet the recommended accuracy of ± 5% (51%; 53/104), nor the less strict limit of ± 10% (22%; 23/104). Although the median deviation of all systems was within 3.5% from the reference value for all sample types, the IQR ranged up to 12%.

Additionally, the measurement accuracy often depended on sample container, with a median difference between syringes and vials of ± 8% (IQR 14%). Typically, this was most pronounced for systems that did not incorporate any correction for measurement geometry (i.e., Capintec systems, D3, E3, E4, G1–G3). However, even systems with sample geometry calibration/correction settings were not always accurate within ± 5% or ± 10% (Isomed F3–F6).

123I

The majority of the 123I measurements did not meet the recommended ± 5% accuracy limit (83%; 88/106). Moreover, a substantial amount of measurements did not meet the ± 10% limit either (35%; 37/106). For all the samples, the median deviation of all systems was within 7.4% from the reference value, and the largest IQR was 30%. Furthermore, we observed a large dependence on sample type with a median difference between syringes and vials of ± 17% (IQR 16%).

Typically, systems without sample geometry corrections tended to overestimate the activity in syringes but underestimate the activity in vials, whereas the opposite trend was observed for systems that did incorporate sample geometry corrections.

124I

A substantial amount of the 124I measurements did not meet the recommended ± 5% (63%; 59/94) nor the less strict limit of ± 10% (15%; 14/94). For all the samples, the median deviation of all systems was within 4.9% from the reference value, and the largest IQR was 16%. Additionally, with a median difference between syringes and vials of ± 10% (IQR 8%), 124I showed a substantial sensitivity to sample geometry. Syringe measurements showed a rather small overestimation in measured activity (largest median deviation of 4.8%) with a relatively small IQR (maximum 6%). For vials, however, the accuracy typically depended on whether the system used sample-specific calibration/correction settings (median deviation of all vial measurements of 9.1%) or not (− 6.3%).

Therapeutic radionuclides

131I

For 131I, 14% (16/111) and 3% (3/111) of all activity measurements were not within ± 5% and ± 10% of the reference values, respectively. For all the samples, the median deviation of all systems was within 1.1% from the reference value, and the largest IQR was 7%. Furthermore, with a median difference of less than ± 2% between the deviations of syringes and vials (IQR 3%), sample geometry effects were mostly small.

177Lu

A substantial amount of all 177Lu measurements did not meet the recommended ± 5% (24%; 26/110) criterion. However, no dataset showed deviations exceeding the ± 10% limit. For all the samples, the median deviation was within 3.7% from the reference value. All IQR values were within 4%, indicating a fair to good reproducible measurement accuracy. Moreover, with a median difference of approximately ± 1% between the deviations of syringes and vials (IQR 2%), sample geometry effects were small.

90Y

The majority of the 90Y measurements did not meet the recommended ± 5% accuracy limit (61%; 67/110). Moreover, a substantial amount of measurements did not meet the ± 10% limit (26%; 28/110). We observed a large variability in measurement accuracy depending on the system (type) and manufacturer.

Isomed systems, using specific calibration settings for each sample configuration, often showed very large underestimation (> 30%) of the 90Y reference activity, most pronounced for syringes, with IQR values up to 45%. Additionally, we found a large variability in performance between systems of the same type using identical calibration factors (e.g., A1 vs F1). Moreover, with a median difference between the deviations for syringes and vials of ± 33% (IQR 30%), geometry effects were very large.

Instead, the other radionuclide systems typically performed better, particularly for vials. For all sample configurations, the mean deviations were within 3.5%, and the largest IQR was 12%. With a median difference in measurement deviations between syringes and vials of ± 6% (IQR 8%), geometry effects were much smaller compared to the Isomed systems.

Interestingly, two systems resulted in unexpectedly high deviations from the reference activity: Isomed D1 (maximum deviation 158%) and Veenstra H2 (maximum deviation 424%).

Theragnostic pairs

Figure 4 shows the combined systematic percentage deviations for the theragnostic pairs considered (131I/123I, 131I/124I, 177Lu/111In, 90Y/99mTc, 90Y/111In), when both radionuclides are measured on the same device with the same sample geometry.

Fig. 4
figure4

Percentage combined deviations for the theragnostic radionuclide pairs considered, when both radionuclides are measured on the same device and using the same sample geometry. a 131I/123I, b 131I/124I, c 177Lu/111In, d 90Y/111In, e 90Y/99mTc

The combined deviations of the theragnostic pairs show substantial variability in measurement accuracy between systems and manufacturers with a dependency on calibration/correction setting and sample geometry. Generally speaking, roughly half of all investigated theragnostic combinations would introduce a bias in the therapeutic dose larger than ± 5%, and for one quarter of these combinations in a bias larger than ± 10% (Table 3). This performance is even worse when activity measurements in different containers are combined: of all administrations, two thirds would introduce a bias larger than ± 5% and one third larger than ± 10% (data not shown).

Table 3 Percentage of theragnostic activity measurements that exceed a given deviation from the reference activities

Discussion

Administering the correct amount of therapeutic activity to patients is of utmost importance in personalized molecular radiotherapy. Typically, (inter)national guidelines recommend stricter accuracy demands (± 5%) for therapeutic than for diagnostic radionuclides (± 5–10%) [6,7,8]. However, in case of theragnostics, where the therapeutic activity is optimized based on pre-therapeutic dosimetry/uptake calculations using diagnostic imaging, accurate quantification of the diagnostic activity is of equal importance as accurate therapeutic activity quantification. Therefore, to prevent introducing a substantial error in the therapeutic doses delivered to patients, we advocate to apply the ± 5% accuracy limit also for diagnostic radionuclides in a theragnostic setting.

In our study, we found one radionuclide calibrator (E1) that showed large deviations (> 10% underestimations) for all radionuclides, therefore appearing to be malfunctioning. This system was recently installed and was not yet (fully) validated nor released for clinical use. These observations indicate that extensive validation of all clinically used radionuclides is of vital importance.

Individual radionuclides

This intercomparison shows that radionuclide calibrator measurements of 99mTc, still the workhorse of nuclear medicine, are (nearly) always correct, in agreement with values reported in literature [9, 14]. The same cannot be said for the other diagnostic radionuclides evaluated. For 111In, 123I, and 124I, measurement deviations frequently exceeded the ± 5% and often even the ± 10% limits. This is in agreement with values reported in literature for 111In and 123I [9, 10, 12]. To the best of our knowledge, no multi-center data are available on the typical accuracy of 124I clinical activity measurements. In particular, these radionuclides (111In, 123I, and 124I) show a large dependence on sample geometry (particularly sample container) caused by self-absorption of the emitted low-energy X-rays within the sample itself. Consequently, accurate activity measurement of these radionuclides requires specific calibration or correction factors for the sample geometry [22, 23]. When factory settings dedicated to specific sample configurations are available, they must be experimentally verified prior to clinical use, as they might not be accurate for the specific containers used locally. This was the case for many activity measurements of 123I, 111In, and 124I. Alternatively, selective absorption of low-energy X-rays using a copper/aluminum filter is an effective method to minimize the variability in activity measurements caused by sample geometry [23, 24]. In this intercomparison, a copper filter was available for two systems, but appropriate calibration factors for measurements with filter had yet to be determined.

Regarding the therapeutic radionuclides, 177Lu measurements were almost always within ± 5% from the reference activity, and never deviated by more than ± 10%, in agreement with values previously reported for Capintec systems [13]. A tendency to overestimate the reference activity values by typically a few percent was observed, which might (partially) be attributed to the calibrators being sensitive to the presence of the 177mLu impurity. Our study presents new data for 177Lu, particularly on the accuracy of medical calibrators from different suppliers, and using clinical sample configurations. Similar as for 177Lu, the majority of calibrators were accurate for measuring 131I albeit with a slightly higher deviation (sometimes > ± 5%, rarely > ± 10%). This is in agreement with values reported in literature [15]. In contrast, for 90Y, some systems showed incorrect measurements to an unacceptable level: the deviation ranged from a 72% underestimation to a 424% overestimation. Indeed, in literature, large measurement errors up to ± 50% have been reported [13]. In particular, although all Isomed devices used factory-set corrections for sample geometry, they were highly sensitive to the sample container and volume of solution and large measurement deviations were observed. Also, two systems (D1 and H2) showed extremely high overestimations for the syringe measurements, but not for the vials. Interestingly, this effect was not observed for other systems of the same type and with the same (factory-set) calibration factors. Most likely, in these two systems, high-energy beta radiation was able to reach the ionization chamber in the syringe samples but not in the vial samples. Indeed, the radionuclide calibrator response to high-energy beta particles is highly sensitive to even small variations in the material and design specifications of the measurement set-up [4]. This clearly indicates the importance of extensive validation of each individual system for each radionuclide and clinically used sample geometry.

Theragnostic applications

The present study sets the first reference on typical combined errors associated to clinical radiopharmaceutical activity measurements in a theragnostic setting. Considering 5 clinically relevant theragnostic pairs (131I/123I, 131I/124I, 177Lu/111In, 90Y/99mTc, 90Y/111In), this intercomparison study showed that poor accuracy in radionuclide calibrator activity measurements of therapeutic and diagnostic radionuclides can introduce a relatively large (> ± 10%) bias in the therapeutic doses delivered to patients in theragnostic applications. Such errors should be minimized as much as practically possible, therefore the recommendation to apply a standard ± 5% accuracy limit to calibrator activity measurements of both therapeutic and diagnostic radionuclides.

The best way to limit the error in the administration of activity is to ensure accurate and reproducible activity measurements of both radionuclides involved in the theragnostic application. This can be achieved by proper evaluation of the accuracy of the measurement settings of the calibrators for the radionuclides and sample configurations found in clinical practice, together with an assessment of other sources of uncertainty in the activity measurements and proper maintenance through a quality assurance program [6]. These procedures may lead to re-calibration of the device or determination of appropriate correction factors, and optimization of the source configurations (e.g., choice of container) or other measurement settings or procedures used for activity measurements. After all, the error in the assessment of patient administered activities is only one of the several sources of uncertainty in the dosimetry process [25]. Minimizing its contribution to the overall uncertainty is the best starting point towards patient treatment optimization in molecular radiotherapy.

Uncertainties in the clinical activity measurements of this study

As reported in detail by Gadd et al. [5], radioactivity measurements using radionuclide calibrators are affected by different sources of uncertainty, including the accuracy of calibration factors, sample geometry effects, photon-emitting radionuclide impurities, background variability, system non-linear response, short-term response variability, reproducibility of sample position, and influence of external shielding. These uncertainty components are dependent on the specific measurement set-up (calibrator unit and its accessories, shielding, local background field), the radionuclide, and/or the level of activity (ionization current) being measured.

In this study, the clinical measurement accuracy of radionuclide calibrators was tested for 7 radionuclides used in theragnostics, each in 4 sample configurations.

The effect of the sample type of container (syringe vs vial) was evaluated. As previously addressed, this effect was a significant source of variability in the activity measurements of all the radionuclides, with the magnitude of the effect (median) being large (> ± 5%) for 90Y, 123I, 111In, and 124I; mostly small (± 2%) for 131I and 99mTc; and small (± 1%) for 177Lu.

The influence of the short-term response variability in the activity measurements was reduced by taking the average of three consecutive activity readings. Although the measurement statistical uncertainty um was within 0.7% for the large majority (> 75%) of the activity datasets, which indicates a good short-term measurement reproducibility, it is not negligible and in a clinical setting (where an average value is generally not estimated) would cause a spread in the activity assessment.

The background reading was subtracted from all activity measurements. Yet, the uncertainty due to background variability was not assessed. This uncertainty can have an important bearing in the measurement of low activities and radionuclides with a low response per unit activity, such as 90Y. In this study, the highest background-to-sample reading ratios were obtained, as expected, with the vials with 1 mL (samples with low activity), and were ≤ 3.7% for 90Y, 1.7% for 177Lu, and 0.9% for the other radionuclides. For the vials filled with 10 mL (samples with the highest activity), background fractions were considerably lower (less or equal to 0.6% for 90Y and 0.2% for the other radionuclides). Assuming a high uncertainty of 10% in the background measurement, the potential error introduced in the estimated net activities of the low-activity vial samples of this study would be ≤ ± 0.38% (90Y), ± 0.17% (177Lu), and ± 0.09% (other radionuclides). Although such potential error is not negligible for 90Y and 177Lu, it is much lower compared to the measurement deviations observed in this intercomparison for the vial and syringe samples with 1–3 mL, suggesting that it is not the main cause of the spread in 90Y and 177Lu measurements of the samples with the lowest activities. For the other samples and radionuclides, the potential error from the background uncertainty is negligible.

All radionuclide solutions were checked for the presence of photon-emitting impurities by high-resolution gamma spectrometry. Impurities were detected only in 123I (125I), 124I (125I), and 177Lu (177mLu). From these impurities, only the 177mLu impurity has a significant effect on activity measurements in a radionuclide calibrator (0.51% overresponse for the Fidelis). Since the activities measured with the hospital calibrators were not corrected for this effect, this remains a source of uncertainty in the 177Lu intercomparison results.

Information regarding other sources of uncertainty was not gathered from the participating hospitals. Yet, hospitals were encouraged to make a more detailed uncertainty assessment for their activity measurements, since this is essential to evaluate the agreement with the reference values and determine which corrective actions are needed to improve the accuracy and reliability of their activity measurements. In general, that assessment should be within the practical reach of hospitals, since most of the sources of error mentioned above can be quantified by following a thorough quality control program [5, 6, 8].

Study limitations

It should be noted that not all the calibrator systems tested were clinically used to measure all the radionuclides considered in this study. Since hospitals may validate a device only for the specific radionuclides used in their clinical practice, some specific results of this study may not fully represent the local (hospital) measurement capability.

Clinical activity measurements can bear additional uncertainties beyond those accounted in this study. The amounts of activities administered to patients in nuclear medicine theragnostics are in the range of tens to several hundred megabecquerels for imaging studies and a couple to several gigabecquerels for therapeutic purposes, whereas in this study the sample activities were in the range of 4–162 MBq for diagnostic radionuclides and 9–312 MBq for therapeutic radionuclides (see values per radionuclide in Table 1). Linearity effects, which are typically in the range of ± 1% to few percent [3, 5], become more important for the much broader range of activities measured in clinical applications. Also, in clinical practice, therapeutic and diagnostic radionuclides are often not measured using the same (sample) measurement geometry. For instance, 90Y is often assayed using manufacturer-supplied vials and/or acrylic shields. Indeed, the (combined) errors in theragnostic activity measurements will depend on the specific measurement settings used for each radionuclide. Moreover, the response of a radionuclide calibrator to 90Y also depends on the physicochemical form of the 90Y compound [26]. In this study, 90Y samples were prepared based on a 90Y chloride aqueous solution. Yet, in liver radioembolization procedures, which represent the main clinical application of the theragnostic pair 90Y/99mTc, 90Y is administered to patients in the form of suspensions of resin/glass microspheres. Activity measurements of 90Y microspheres may require the use of different calibration factors and present further challenges whose associated errors might not be reflected in the overall measurement performance obtained here using 90Y chloride.

Conclusion

This intercomparison showed that, while 99mTc, 131I, and 177Lu activity measurements are mostly accurate, there is still significant room for improvement for 111In, 123I, 124I, and 90Y. For these radionuclides, the radionuclide calibrator response is particularly sensitive to the sample and detector geometry. Consequently, substantial over- or underdosing (> ± 10%) of therapeutic administrations is likely to occur in a theragnostic setting. A key message from this intercomparison is that, prior to clinical release, radionuclide calibration factors and sample geometry correction factors should be verified for each radionuclide and sample configuration used in practice. A unified international standard for testing and calibrating medical radionuclide calibrators is pressingly needed to boost the implementation of quantitative accuracy in nuclear medicine theragnostics.

Availability of data and materials

The data that support the findings of this study are available from the corresponding author RW upon reasonable request and with permission of the institution where measurement data was acquired.

Abbreviations

IQR:

Inter-quartile range

JRC:

Joint Research Centre

NPL:

National Physical Laboratory

PET:

Positron emission tomography

SCK CEN:

Belgian Nuclear Research Centre

SD:

Standard deviation

SPECT:

Single photon emission computed tomography

References

  1. 1.

    Eberlein U, Cremonesi M, Lassmann M. Individualized dosimetry for theragnostics: necessary, nice to have, or counterproductive? J Nucl Med. 2017;58:97S–103S.

    CAS  Article  Google Scholar 

  2. 2.

    Herrmann K, Schwaiger M, Lewis JS, Solomon SB, McNeil BJ, Baumann M, et al. Radiotheranostics: a roadmap for future development. Lancet Oncol. 2020;21(3):e146–56. https://doi.org/10.1016/S1470-2045(19)30821-6.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  3. 3.

    Capintec. CRC-25R owner’s manual. Florham Park: Capintec Inc; 2017.

  4. 4.

    Laedermann JP, Valley JF, Bulling S, Bochud FO. Monte Carlo calculation of the sensitivity of a commercial dose calibrator to gamma and beta radiation. Med Phys. 2004;31(6):1614–22.

    CAS  Article  Google Scholar 

  5. 5.

    Gadd R, Baker M, Nijran KS, Owens S, Thomson W, Woods MJ, et al. Protocol for establishing and maintaining the calibration of medical radionuclide calibrators and their quality control, measurement good practice guide no. 93. National Physical Laboratory: Teddington; 2006.

    Google Scholar 

  6. 6.

    IAEA. Quality assurance for radioactivity measurement in nuclear medicine, Technical reports series no 454. Vienna: International Atomic Energy Agency; 2006.

    Google Scholar 

  7. 7.

    Busemann Sokole E, Plachcínska A, Britten A. EANM Physics Committee. Acceptance testing for nuclear medicine instrumentation. Eur J Nucl Med Mol Imaging. 2010;37:672–81.

    Article  Google Scholar 

  8. 8.

    AAPM. The selection, use, calibration and quality assurance of radionuclide calibrators used in nuclear medicine, Report of AAPM Task Group 181. College Park: American Association of Physicists in Medicine; 2012.

  9. 9.

    Saldarriaga Vargas C, Rodríguez Pérez S, Baete K, Pommé S, Paepen J, Van Ammel R, et al. Intercomparison of 99mTc, 18F and 111In activity measurements with radionuclide calibrators in Belgian hospitals. Phys Med. 2018;45:134–42.

    Article  Google Scholar 

  10. 10.

    Bauwens M, Pooters I, Cobben R, Vissera M, Schnerra R, Mottaghy F, et al. A comparison of four radionuclide dose calibrators using various radionuclides and measurement geometries clinically used in nuclear medicine. Phys Med. 2019;60:14–21.

    Article  Google Scholar 

  11. 11.

    Bailey DL, Hofman MS, Forwood NJ, O’Keefe GJ, Scott AM, van Wyngaardt WM, et al. Accuracy of dose calibrators for 68Ga PET imaging: unexpected findings in a multicenter clinical pretrial assessment. J Nucl Med. 2018;59(4):636–8.

    CAS  Article  Google Scholar 

  12. 12.

    Ferreira KM, Fenwick AJ. 123I intercomparison exercises: assessment of measurement capabilities in UK hospitals. Appl Radiat Isot. 2018;134:108–11.

    CAS  Article  Google Scholar 

  13. 13.

    Fenwick A, Baker M, Ferreira K, Keightley J. Comparison of 90Y and 177Lu measurement capability in UK and European hospitals. Appl Radiat Isot. 2014;87:10–3.

    CAS  Article  Google Scholar 

  14. 14.

    MacMahon D, Townley J, Bakhshandeiar E, Harms AV. Comparison of Tc-99 m measurements in UK hospitals, 2006, NPL Report DQL-RN 018. National Physical Laboratory: Teddington; 2007.

    Google Scholar 

  15. 15.

    Ciocanel M, Keightley JD, Scott CJ, Woods MJ. Intercomparisons of 131I solution and capsule sources in UK hospitals, 1999, NPL report CIRM 31. National Physical Laboratory: Teddington; 1999.

    Google Scholar 

  16. 16.

    Stokke C, Minguez Gabiña P, Solný P, Cicone F, Sandström M, Sjögreen Gleisner K, et al. Dosimetry-based treatment planning for molecular radiotherapy: a summary of the 2017 report from the Internal Dosimetry Task Force. EJNMMI Phys. 2017;4(1):27. https://doi.org/10.1186/s40658-017-0194-3.

    Article  PubMed  PubMed Central  Google Scholar 

  17. 17.

    ISO. Determination of the detection limit and decision threshold for ionizing radiation measurements — part 3: fundamentals and application to counting measurements by high resolution gamma spectrometry, without the influence of sample treatment, EN ISO 11929-3:2000. Geneva: International Organization for Standardization; 2000.

  18. 18.

    Pommé S. Methods from primary standardization of activity. Metrologia. 2007;44:17–26.

    Article  Google Scholar 

  19. 19.

    ISO. Injection Containers and Accessories. Injection Vials Made of Glass Tubing, EN ISO 8362-1:2009. Geneva: International Organization for Standardization; 2010.

  20. 20.

    Brookhaven National Laboratory, https://www.nndc.bnl.gov/nudat2/. Accessed 15 October 2020.

  21. 21.

    Townson R, Tessier F, Galea R. EGSnrc calculation of activity calibration factors for the Vinten ionization chamber. Appl Radiat Isot. 2018;134:100–4.

    CAS  Article  Google Scholar 

  22. 22.

    Peitl PK, Tomse P, Kroseli M, Socana A, Hojkera S, Pecar S, et al. Influence of radiation source geometry on determination of 111In and 90Y activity of radiopharmaceuticals. Nucl Med Commun. 2009;30(10):807-814.

  23. 23.

    Beattie BJ, Pentlow KS, O'Donoghue J, Humm JL. A recommendation for revised dose calibrator measurement procedures for 89Zr and 124I. PLoS One. 2014;9(9):e106868.

    Article  Google Scholar 

  24. 24.

    Kowalsky RJ, Johnston RE. Dose calibrator assay of iodine-123 and indium-111 with a copper filter. J Nucl Med Technol. 1998;26(2):94–8.

    CAS  PubMed  Google Scholar 

  25. 25.

    Gear JI, Cox MG, Gustafsson J, Sjögreen Gleisner K, Murray I, Glatting G, et al. EANM practical guidance on uncertainty analysis for molecular radiotherapy absorbed dose calculations. Eur J Nucl Med Mol Imaging. 2018;45(13):2456–74.

    CAS  Article  Google Scholar 

  26. 26.

    Ferreira KM, Fenwick AJ, Arinc A, Johansson LC. Standardization of 90Y and determination of calibration factors for 90Y microspheres (resin) for the NPL secondary ionization chamber and a Capintec CRC-25R. Appl Radiat Isot. 2016;109:226–30.

    CAS  Article  Google Scholar 

Download references

Acknowledgements

The authors kindly thank IDB Holland for providing 177Lu without charge, Andrew Fenwick (NPL) for the helpful discussions regarding the activity standardizations, Reid Townson (National Research Council Canada) for providing simulation data on the reference chambers’ energy dependence, Mikael Hult (JRC) for logistic support, and GE Healthcare for providing packing materials without charge.

Funding

This study was funded by Maastricht University Medical Center and the Belgian Nuclear Research Centre.

Author information

Affiliations

Authors

Contributions

RW, MB, CSV, MG, FMM, and JEW contributed to the conception and design of the study. RW, CSV, INAP, SMBP, MS, WJ, AV, FHPV, SLMV, and PC acquired (part of) the radionuclide calibrator data. CSV and SP determined the reference activity of the samples. CSV, RW, and MB analyzed and interpreted the intercomparison data and drafted the manuscript. All authors critically revised the manuscript. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Roel Wierts.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplemental data

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Saldarriaga Vargas, C., Bauwens, M., Pooters, I.N.A. et al. An international multi-center investigation on the accuracy of radionuclide calibrators in nuclear medicine theragnostics. EJNMMI Phys 7, 69 (2020). https://doi.org/10.1186/s40658-020-00338-3

Download citation

Keywords

  • Activity measurement
  • Radionuclide calibrator
  • Accuracy
  • Theragnostics