Ralph
Fingerhut
* and
Toni
Torresani
Swiss Newborn Screening Laboratory, Children's Research Center (CRC), University Children's Hospital of Zurich, Steinwiesstr. 75, CH-8032 Zürich, Switzerland. E-mail: ralph.fingerhut@kispi.uzh.ch; Fax: +41 44 266 8110; Tel: +41 44 266 7732
First published on 11th July 2013
The new genetic screening processor for newborn screening (GSP™) from PerkinElmer was extensively tested under routine conditions. The GSP is intended to fully process all newborn screening tests, apart from tandem mass spectrometry. For our evaluation we used all so far available tests for the GSP (TSH, 17-OHP, IRT, total-T4 and GALT). For all 5 tests we have determined specificity, limit of detection (LOD), limit of quantitation (LOQ), intra- and inter-assay variation, recovery, influence of EDTA and on-board stability of the reagents. Results were also compared with AutoDelfia and the Astoria Pacific Spot Check System (GALT). LOD and LOQ were 0.38 and 0.45 mU L−1 (blood) for TSH, 1.30 and 3.25 nmol L−1 (serum) for T4, 0.35 and 0.55 nmol L−1 (blood) for 17-OHP, 0.85 and 1.58 ng mL−1 (blood) for IRT and 2.6 and 3.6 U dL−1 (blood) for GALT. Mean recovery was 97.8–107.1%: intra-assay CVs 2.5–8.9; inter-assay CVs 5.7–11.0. On board stability was >37 days for the immunoassay. The dissolved GALT reagent is not stable at 4 °C, however if the reagent is removed from the GSP and stored at −18 °C, it is stable for 11 days. On board stability of the inducer is >140 days. The GSP is suitable for routine newborn screening. Compared to AutoDelfia, additional control procedures were included which increase the reliability of the system.
The new integrated screening plate processor GSP™ from PerkinElmer overcomes most of these drawbacks. The GSP can be continuously loaded with up to 24 MTP for various assays (to date: TSH, T4, 17-OHP, IRT, and GALT). It has several integrated safety checks to avoid FP or FN results such as a “sample-elution check” in all assays and “check for floating disks” in the wet chemistry assays (e.g. GALT). A major and crucial improvement was achieved with the immunoassays. In the Delfia assays lanthanides (for NBS mainly europium) are bound to the respective antibodies or substrates with diethylenetriaminetetraacetate (DTTA) as Ln–DTTA chelates. After the final washing step these chelates are dissociated at pH 3.2 with the enhancement solution which also contains 2-naphthoyltrifluoroacetone (2-NTA), a β-diketone which will form a highly fluorescent Ln–2-NTA complex. However high concentrations of EDTA, citrate, Cu2+, Ca2+, and Zn2+ interfere with the Ln–DTTA chelates, releasing the Ln-label already in the primary reaction step (before the washer-step). The GSP-kits use different chelating agents. Diethylenetriaminepentaacetic acid is used to bind the Ln-label to the antibody as Ln–DTPA chelates. These complexes are more stable than the Ln–DTTA chelates and are not influenced by EDTA, citrate, Cu2+, Ca2+, or Zn2+. However these complexes dissociate only slowly at pH 3.2 which is impractical for rapid high throughput analysis. Dissociation of the Ln–DTPA chelates is quick at pH 2.3, but 2-NTA does not form stable complexes with the Ln at this pH. Therefore a different fluorescence enhancer (now called “inducer”), 1-(2-benzofuryl)-4,4,5,5,5-pentafluoro-1,3-pentadione (BFPP), is used.4 We had the opportunity to test all available kits on the GSP and compare them either with the AutoDELFIA-kits or with the Astoria Pacific continuous flow analyzer (GALT). In addition all test specifications that could be investigated under routine conditions were verified.
Besides the chemistry, the GSP has some more novelties concerning the handling of test-kits and reagents that might be unnecessary and perhaps even obstructive in the routine newborn screening process. Apart from the expiry dates of each kit component every kit-lot itself has an expiry date, mainly that of the least durable kit component. Apart from that the expiry date changes dramatically once the reagents are loaded into the refrigerated reagent cassette of the GSP. Initially, this so-called on-board stability was 5 days, but was subsequently extended to 14 days for the immunoassays. Further, although every kit-component has certain specifications such as concentrations for the calibrators and controls etc., it is not possible to interchange components from different kit-lots. These restrictions led us also to investigate their validity.
All concentrations are related to whole blood except for total T4 which is related to serum. Units are as follows: TSH mU L−1 blood; 17-OHP nmol L−1 blood; IRT ng mL−1 blood; GALT U dL−1 blood; T4 nmol L−1 serum.
The GSP Neonatal test kits contain all necessary components ready to use except for the GALT substrate reagent which has to be reconstituted with 2.8 mL of GALT-assay buffer. The only materials not provided with the kits are high- and low-volume pipette tips, wash concentrate and inducer.
For the determination of the limit of detection (LOD) the statistical approach was used. A sample without the analyte was measured repeatedly (n = 12) and the mean value + 3 SD was defined as the LOD. The determination of the limit of quantitation (LOQ) is not so straightforward. Statistical approaches using the mean value + 6 SD or mean value + 10 SD and an empirical approach whereby a sample of known analyte concentration is consecutively diluted and assayed until the SD exceeds 20% are described. That concentration for which an accuracy of less than 20% is still achieved is the empirical LOQ. The statistical approach often overestimates LOQs5 but even for different analytes measured with the same method, statistical and empirical LOQs may be nearly identical or differ by a factor of up to 10.6 We provide data on both statistical and empirical methods. For the statistical method either the lowest calibrator, if the respective analyte concentration was 0, was used (i.e. for 17-OHP, T4, IRT, GALT) or a blank filter paper was used (i.e. for TSH). Since dilution of DBS is difficult and the preparation of the whole series of DBS from a dilution series is extremely labor intensive, we used a rather unconventional approach. The respective kit-calibrators were taken with the lowest concentration different from 0. This calibrator was measured repeatedly (n = 12 to 48). If the SD was <20% then 12 DBS of this calibrator were cut into halves and these 24 halves were measured. If the SD was still <20%, 12 DBS were then cut into quarters, or even into eighths. Since the cutting of 3 mm DBS into equal halves, quarters, or eighths is extremely difficult we have calculated the SD, if necessary, from the sum of 2 quarters of the same half of one DBS or 4 eighths of the same half of one DBS. For statistical analysis SPSS 16.0 was used. The t-test for independent samples was used to calculate the significance of the signal differences between blanks and analytes. We also used halves, quarters, and eighths of calibrator A of the TSH-kit, and plain filter paper to evaluate the possibility of measuring decreased TSH concentrations. For the determination of recovery the respective kit calibrators were used. The assigned values from the quality control certificates were used as target values.
To measure the stability of the inducer at RT we diluted 10 μL of the TSH tracer with 2.6 mL of the inducer stored at RT. Then 200 μL of the diluted tracer was transferred into 12 wells of a microtiter plate and measurements made after shaking for 5 minutes using an orbital shaker. In addition the CVs of the kit-controls of the T4-assay were used to estimate the stability of the inducer at RT.
Analyte | Values from kit-inserts | Values determined | ||||||
---|---|---|---|---|---|---|---|---|
LOBa | LODb | LOQc | Linearity | LODd | LOQe | LOQf | LOQg | |
a LOB = limit of blank; defined as the 95th centile of a distribution of blank samples. b LOD = limit of detection; according to NCCLS document EP17-A. c LOQ = limit of quantitation; defined as the lowest concentration with a total CV equal to or less than 20%. d LOD = limit of detection; defined as the mean of a sample without analyte + 3 SD. e LOQ = limit of quantitation; defined as the mean of a sample without analyte + 6 SD. f LOQ = limit of quantitation; defined as the mean of a sample without analyte + 10 SD. g LOQ = limit of quantitation; defined as the lowest concentration with a total CV equal to or less than 20%. | ||||||||
TSH [mU L−1] | 0.96 | 1.31 | 1.31 | 0.7–252 | 0.38 | 0.45 | 0.54 | <0.09 |
T4 [nmol L−1] | 2.97 | 6.44 | 10.47 | 1.89–204 | 1.30 | 3.25 | 5.13 | <13.55 |
17-OHP [nmol L−1] | 0.58 | 1.2 | 1.2 | 1.2–314 | 0.35 | 0.55 | 0.81 | <0.58 |
IRT [ng mL−1] | 0.76 | 2.2 | 2.2 | 9–500 | 0.85 | 1.58 | 2.56 | <3.0 |
GALT [U dL−1] | 1.6 | 2.5 | 2.5 | 0.7–16.5 | 2.6 | 3.6 | 6.0 | <3.1 |
![]() | ||
Fig. 1 Calibration curve of TSH with kit-calibrators A–F (0.7–252 mU L−1), A/2 (0.35 mU L−1), A/4 (0.175 mU L−1), A/8 (0.0875 mU L−1), and blank (0 mU L−1). A/2 = kit-calibrator A cut into halves, A/4 = kit-calibrator A cut into quarters, A/8 = kit-calibrator A cut into eighths. |
Analyte | Intra-assay variation (CV) | Inter-assay variation (CV) | Mean recovery [%] |
---|---|---|---|
TSH | 8.9 (at 15.0 mU L−1; n = 12) | 8.1 (at 15.0 mU L−1; n = 30) | 98.5 |
4.9 (at 59.6 mU L−1; n = 12) | 8.3 (at 59.6 mU L−1; n = 30) | ||
T4 | 8.2 (at 44.5 nmol L−1; n = 12) | 11.0 (at 44.5 nmol L−1; n = 30) | 101.7 |
4.8 (at 97.0 nmol L−1; n = 12) | 8.9 (at 97.0 nmol L−1; n = 30) | ||
3.4 (at 169.8 nmol L−1; n = 12) | 8.9 (at 169.8 nmol L−1; n = 30) | ||
17-OHP | 3.1 (at 18.6 nmol L−1; n = 8) | 8.7 (at 18.6 nmol L−1; n = 30) | 107.1 |
4.9 (at 56.4 nmol L−1; n = 8) | 7.5 (at 56.4 nmol L−1; n = 30) | ||
5.0 (at 117.2 nmol L−1; n = 8) | 5.9 (at 117.2 nmol L−1; n = 30) | ||
IRT | 3.5 (at 31.6 ng mL−1; n = 12) | 6.1 (at 31.6 ng mL−1; n = 30) | 97.8 |
5.0 (at 67.6 ng mL−1; n = 12) | 5.8 (at 67.6 ng mL−1; n = 30) | ||
2.7 (at 100.0 ng mL−1; n = 12) | 5.7 (at 100.0 ng mL−1; n = 30) | ||
GALT | 5.1 (at 3.8 U dL−1; n = 12) | 8.1 (at 3.8 U dL−1; n = 30) | 101.9 |
2.5 (at 15.5 U dL−1; n = 12) | 6.3 (at 15.5 U dL−1; n = 30) |
Mean counts and (CV) | |||||||
---|---|---|---|---|---|---|---|
Calibrator A | Calibrator B | Calibrator C | Calibrator D | Calibrator E | Calibrator F | ||
TSH | n = 16 over 96 days | 718 (8.0) | 5722 (6.1) | 14![]() |
26![]() |
54![]() |
129![]() |
T4 | n = 16 over 109 days | 148![]() |
119![]() |
97![]() |
66![]() |
38![]() |
22![]() |
17-OHP | n = 16 over 91 days | 106![]() |
63![]() |
44![]() |
26![]() |
11![]() |
5193 (16.5) |
IRT | n = 16 over 37 days | 1068 (32.7) | 33![]() |
69![]() |
140![]() |
437![]() |
928![]() |
![]() | ||
Fig. 2 Calibration curves of 16 measurements from the same reagent vials, stored over 96 days (TSH and 17-OHP), 109 days (T4), and 37 days (IRT) inside the refrigerated cassette of the GSP (![]() ![]() ![]() |
Analyte | N | Time period | Expected | Mean | CV |
---|---|---|---|---|---|
TSH [mU L−1] | 163 | 16 months | 15.7 | 15.1 | 9.4 |
64.4 | 60.5 | 8.1 | |||
T4 [nmol L−1] | 65 | 11 months | 43.9 | 39.7 | 12.2 |
98.0 | 93.4 | 8.1 | |||
166.4 | 161.0 | 7.7 | |||
17-OHP [nmol L−1] | 82 | 7 months | 18.6 | 20.9 | 10.3 |
56.4 | 64.5 | 7.9 | |||
117.2 | 135.9 | 8.6 | |||
IRT [ng mL−1] | 85 | 3 months | 30.8 | 27.5 | 6.7 |
64.2 | 63.9 | 6.1 | |||
96.4 | 96.4 | 4.8 |
In contrast to the AD-assays, EDTA (up to 100 mmol L−1) had no influence on the determination of TSH, T4, 17-OHP, and IRT (Fig. 3a–d). However the determination of GALT activity is still influenced by EDTA (Fig. 3e), as previously described for a manual method.3
![]() | ||
Fig. 3 Influence of EDTA contamination on TSH (a), T4 (b), IRT (c), 17-OHP (d), and GALT activity (e). For all tests, punches from the same control blood sample were used and spiked with EDTA to the indicated final concentration. For the immuno-assays (a–d) the influence of EDTA on the GSP-assays (![]() ![]() |
The performance of the GSP under routine conditions has also been compared to the AutoDelfia system for the immunoassays and to the SpotCheck system from AstoriaPacific for the GALT-assay. Results of linear regression for the different assays are listed in Table 5:
Analyte | a | b | r 2 | n |
---|---|---|---|---|
17-OHP | 0.978 | 0.298 | 0.975 | 9766 |
IRT | 0.796 | 3.203 | 0.907 | 517 |
T4 | 0.809 | 15.302 | 0.816 | 701 |
TSH | 0.787 | 0.374 | 0.961 | 5963 |
For TSH we were also able to compare two GSP kit lots: TSH(503104) = 0.978 × TSH(594747) − 0.116, r2 = 0.980, n = 4159. A good agreement was found for 17-OHP between GSP and AD over the whole concentration range (Fig. 4a). The assays for total T4 showed a higher variation although values were evenly distributed around the mean concentrations without suspicion of a systematic aberration (Fig. 4b). For IRT and TSH there was less agreement between GSP and AD. Although the mean difference of the concentrations was close to zero there are significant differences between these two methods. The GSP gives higher values in the low range, up to 2 mU L−1 for TSH and 20 ng mL−1 for IRT, respectively. Above these values the GSP measures lower values (Fig. 4c and d). For the GALT assay there was no good correlation between the GSP and the SpotCheck assay either with a linear regression [GALT(GSP) = 0.022 × GALT(SC) + 8.992; r2 = 0.166], or with a logarithmic curve fit [GALT(GSP) = −7.67 + 4.03 × log(x); r2 = 0.192] (Fig. 5).
![]() | ||
Fig. 4 Comparison of different analyte determinations by the GSP with AD. The difference in analyte concentration is plotted against the average analyte concentration determined by the two methods (17-OHP, (a); T4 (b); TSH, (c); IRT, (d)). |
![]() | ||
Fig. 5 Comparison of GALT determination by GSP (expressed as U dL−1) and SpotCheck (expressed as NADPH formation in μmol L−1). Cut-off for GSP, horizontal line (![]() ![]() ![]() ![]() ![]() ![]() ![]() |
Reconstituted GALT reagent is not stable in the refrigerated cassette (“on board”). There is already a decline of 5% per day during the first 2 days of shelf-life (Fig. 6a). However when the reconstituted GALT reagent was removed from the GSP after each run, stored at −20 °C and thawed just before the next run, it was stable for 11 days (Fig. 6b).
![]() | ||
Fig. 6 Stability of GALT reagent after reconstitution, stored inside the GSP in the refrigerated cassette (a), and stored at −20 °C between the runs (b). Counts of calibrators a–f are plotted against the time of storage after reconstitution. |
The well known problems with the determination of LOB, LOD, and LOQ5,6 remain and could not be totally solved by our investigation. For the IRT and 17-OHP assays the data provided by the manufacturer and our data are quite plausible (see Table 1) and since decreased values of IRT and 17-OHP have no clinical relevance for NBS there is no need for further evaluation. For the other three assays the situation is not so clear-cut (see Table 1). Linearity of the assays, as stated by the manufacturer, exceeds the limit of blank (LOB). However our data are also incongruent for TSH and GALT. For the TSH assay this is explained by the fact that even plain white filter paper, measured with the routine GSP-kit using a linear curve fit, results in a finite TSH-concentration of 0.32 mU L−1 with a CV of 6.9. Therefore the recommendation of the kit manufacturer that “Samples that result in values below 1.31 mU L−1 blood are recommended to be reported as ‘<1.31 mU L−1 blood’.” is supported by our data, although the limit of detection could better be set to the concentration of the lowest calibrator (≈0.7 mU L−1). This implies that decreased levels of TSH are not detectable with this method. For total T4 the slightly discrepant results for linearity, LOD and LOQ, do not pose a problem since the lower cut-offs for newborns and even older children (114 nmol L−1 and 65 nmol L−1, respectively) are well within the linear range of the assay. The GALT assay however is a challenge since although the LOD is 2.5–2.6 U dL−1, 18 samples of 4 different patients with confirmed classical galactosemia showed a mean GALT activity of 1.06 U dL−1 (range: 0.50–2.03 U dL−1). It is clear that it is uncertain whether these are true values or just erratic values below the LOD/LOQ. Despite these problems the GALT assay, especially in combination with the measurement of total galactose, is a suitable method for galactosemia newborn screening.
The GSP Neonatal 17-OHP assay and the GSP Neonatal total T4 assay showed very good correlation with the AutoDelfia assays and although every laboratory has to check its cut-offs regularly, it seems that the cut-offs for 17-OHP and total T4 can be readily assigned from the AutoDelfia method. For IRT and TSH, cut-offs have to be checked in advance since there seems to be a difference in calibration. For the TSH assay this is not quite comprehensible since there is a WHO standard preparation available.
Otherwise the high stability of immunoassays on the GSP would allow assays with kit-lot specific master-curves which would save approximately 5% of the total reagent costs. We were also not able to confirm the manufacturer's constraints that components from different kit-lots of the same assay are not interchangeable. This was clearly demonstrated by the use of AutoDelfia microtiter strips, within the GSP-tests. Again the separate distribution of test-specific components (coated microtiter plates, elution buffer, tracer and antiserum), rather than test-kits with a large amount of surplus elution buffer, tracer, and antiserum would save monetary resources and would additionally protect the environment.
For smaller newborn screening laboratories that still run the manual Delfia assays the installation of the GSP-instrument might not be cost-effective. However they can still benefit from the advantages of the GSP-kit chemistry. The GSP-reagents can be easily used as a manual test-kit and employed with the same Multicalc-protocols on the Victor plate readers from PerkinElmer, as with the Delfia kits. For manually processed TSH, the interassay CVs (n = 5) were 5.19 and 5.05 at 15 and 59.6 mU L−1 respectively.
This journal is © The Royal Society of Chemistry 2013 |