Thomas W. S.
Pang
a and
Martin
Harper
b
aRyerson University, School of Public and Occupational Health, Room 249A350, Victoria St., Toronto, ON M5B 2K3, Canada
bNational Institute for Occupational Safety and Health, Exposure Assessment Branch, Health Effects Laboratory Division, 1095 Willowdale Rd. MS-3030, Morgantown, WV 26505, USA
First published on 31st October 2007
A parameter based on discrepancies between reported fibers and verified fibers of relocatable slides is shown to be effective in monitoring the quality of airborne fiber counts. Analysts report only the fibers in each field examined. The verified fibers were determined by two experienced analysts, and are here considered as a “true” value. Most of the verified fibers were confirmed by the reported fibers, and the disputed fibers or fiber counting errors were all located and accounted for. In this study, reference (REF) slides were manufactured from proficiency analytical test (PAT) filter samples from the American Industrial Hygiene Association containing chrysotile or amosite. The slides were made using coverglasses bearing a grid pattern to allow accurate re-examinations. These coverglasses are an improved version of those used in previous studies. Seventy-four out of 85 amosite results and 51 out of 60 chrysotile results of REF slides were within their PAT proficiency ranges. When all reported fibers were normalized against their respective verified fibers, the average fiber count was over-estimated for amosite by 38.3% and under-estimated for chrysotile by 30.4%. The error from counting short fibers (sizing-extra) was 82.6% of the extra fibers and accounted for the 38% over-estimation of amosite fibers. For chrysotile fibers, sizing-extra errors were 74.0% of the extra fibers, but by far the larger errors were oversight-missing errors, which were 96.7% of the missing fibers and accounted for the 30% under-estimation of the chrysotile fibers. The discrepancies were found to be linearly related to counting errors as had been noted in a previous study, giving further weight to a proposed score, calculated from the discrepancy parameter (∑D+ + |∑D–|)/VFtotal, for evaluating the proficiencies of analysts. If a proficiency score = 60 is selected, 48 out of 85 amosite results and 17 out of 60 chrysotile results satisfied this criterion in this study. The number of fiber counting errors in this study was larger than could be expected by PAT proficiency criteria. It may be useful to complement existing proficiency test programs with these REF slides. At the end of each proficiency testing round, detailed reports of discrepancies can be provided to participants so that they can improve on their skills in searching and sizing fibers and minimize their counting errors. In addition, the internal quality control program of each laboratory could include counting REF slides regularly by all analysts with control charts of (∑D+/VFtotal), (∑D–/VFtotal), (∑D+ + |∑D–|)/VFtotal and RFtotal/VFtotal maintained to monitor errors, proficiencies and intercounter variations. Ten percent of relocatable slides of routine samples could also be recounted to monitor intracounter variation.
In order for the AIHA asbestos PAT to be as realistic as possible, they are generated from filter-sampling of an asbestos aerosol, either chrysotile or amosite. The filters are distributed to participants, who analyze a small portion of each filter. The analyst calculates the density of fibers per area of filter. There is variation of loading between filters, and of loading across each filter, which adds greatly to the total variation. Thus, using the consensus mean fiber density across all filters gives rise to a very large standard deviation. The standard deviation at times can become so large that it needs to be artificially limited so as to appear rational. The current AIHA asbestos PAT program thus has two drawbacks: a wide range of variation in the reported “true” value, and an inability to determine the real recognition error rate of the analyst, or the source of the errors, and hence it cannot provide feedback to assist in improvement.
Several previous studies of the quality of asbestos fiber counting5,6 have used relocatable reference (REF) slides, which allow accurate re-examination of selected fields of view. In the prior studies involving REF slides, they were prepared with gridded coverglasses that imprinted square relocatable fields on to cleared filter wedges. Although the viewing fields were well defined, the variation of the coating, from 2.5 to 5.0 nm thick, may have affected the fiber images. Because of the effects of the metal coating on the fiber images, widespread adoption of these REF slides may first have required a test of equivalency in order to compare fiber counts obtained from viewing through the gridded coverglasses to those using ordinary coverglasses. Hence, a new gridded coverglass has been designed to overcome the above problem. It consists of two grids of circular viewing fields of 100 µm in diameter and without a metal coating. In each grid, as shown in Fig. 1, there are 14 columns of viewing fields denoted by the alphabet from A to N. Within each column, there are 10 viewing fields denoted by numbers from 1 to 10. Thus, each viewing field is identified. By placing the Walton–Beckett graticule within each viewing field, one proceeds to count the fibers by phase contrast microscopy. Using these new gridded coverglasses, new REF slides were prepared from AIHA amosite and chrysotile asbestos PAT samples, and these were distributed to participants drawn from laboratories currently enrolled in the IHLAP asbestos PAT or in the Asbestos Analytics Registry (AAR) proficiency testing (PT) programs. Laboratories and microscopists were solicited by the AIHA to be volunteer participants. The identities of the participants and their specific results have not been reported to the AIHA or to NIOSH. The purpose of the present study is to evaluate the effectiveness of these new REF slides and to determine whether it is possible to more accurately assess the proficiency of analysts by means of the discrepancy parameter developed in a recent study of Canadian microscopists.7 Two experienced analysts were used to determine the “verified” fibers in the viewing fields of the relocatable slides. Most of the verified fibers were confirmed by the reported fibers, resulting in the average ratio of reported fibers to verified fibers being 1.01 for amosite fibers and 0.776 for chrysotile fibers. The disputed fibers were all located and accounted for, indicating the errors were due to the analysts under test.
![]() | ||
Fig. 1 Phase contrast micrograph showing a grid of relocatable fields, photographed originally at 65×. |
For each viewing field,
VF = RF – E + M or RF = VF + E – M |
In a field with RF ≥ VF, RF = RF+, VF = VF+
D+ = RF+ – VF+ = E+ – M+ = E+ – δ+ |
In a field with RF < VF, RF = RF–, VF = VF–
D– = RF– – VF– = E– – M– = δ– – M– |
It has been shown that when all designated fields of the slide are summed,7
RFtotal = VFtotal + Etotal – Mtotal | (1) |
∑D+ = Etotal – δtotal | (2) |
∑D– = δtotal – Mtotal | (3) |
∑D+ + |∑D–| = Etotal + Mtotal – 2δtotal | (4) |
The underestimation of errors by the discrepancies, δtotal, is related to the extra fibers and missing fibers occurring simultaneously in the same fields. If δtotal is relatively small and stable, and with the sum of absolute discrepancies, (∑D+ + |∑D–|), being linearly related to (Etotal + Mtotal) as in eqn (4), then that equation may provide a simplified and cost effective basis assessing the quality of fiber counts on the reference slides and thus the proficiency of analysts. The analysts are only required to report the fibers in each field examined.
![]() | ||
Fig. 2 Phase contrast micrograph showing a chrysotile fiber crossing the boundary of a circular viewing field, photographed originally at 400×. |
Table 3† shows reported fiber count densities (fibers mm–2) of amosite slides in addition to the number of reported fibers and the ratios to the respective verified values. Seventy-four out of 85 amosite reported fiber counts are within the PAT fiber count density proficiency ranges given in Table 1.† The fiber counts of 10 analysts, #12, #21, #42, #44, #46, #55, #59, #64, #65 and #85 are above their respective upper proficiency range limits and the fiber count of analyst #30 is below the lower proficiency range limit. The ratios of reported fibers : verified fibers (RFtotal : VFtotal) range from 0.714 to 3.785, with a mean of 1.383±0.447. This indicates that the analysts had overestimated amosite fibers by an average of 38.3%. While it is common practice to compare ratios on a logarithmic scale, VFtotal had only small variance, so the use of arithmetic means and standard deviations is justified.
Table 4† shows reported fiber counts of chrysotile slides and the ratios to their respective verified values. Fifty-one out of 60 reported results are within the PAT proficiency ranges given in Table 2.† The fiber counts of #8 and #25 are above their respective upper proficiency ranges and the fiber counts of 7 analysts, #15, #16, #17, #40, #41, #56, and #57, are lower than their respective upper proficiency ranges. The ratios of reported fibers : verified fibers (RFtotal : VFtotal) ranges from 0.128 to 1.290, with a mean of 0.696±0.306. This indicates that the analysts had underestimated chrysotile fibers by an average of 30.4%. Again, VFtotal had only small variance so the use of arithmetic means and standard deviations is justified.
Consequently, the amosite fibers were over-estimated because of the significant number of extra fibers counted due to sizing errors.
Fig. 3 shows the relationships of eqns (2) and (3) to the positive discrepancies, extra fibers, negative discrepancies and missing fibers. All values are normalized against their respective verified fibers. For amosite fibers, Fig. 3a shows the plots of eqn (2) with δtotal = 0.022, positive discrepancies and extra fibers. Fig. 3b shows the plots of eqn (3) with δtotal = 0.022, negative discrepancies and missing fibers. Similarly, Fig. 3c and Fig. 3d are for chrysotile fibers with δtotal = 0.047. The δtotal values obtained in the present study show excellent agreement with the δtotal for amosite fibers (0.022±0.015) and δtotal for chrysotile fibers (0.045±0.034) of the previous study.1 It is also possible to compare the log-scale mean and standard deviation values of the two data sets with similarly good agreement: chrysotile (present study) –1.521 ± 0.579 vs. –1.521±0.506 (previous study); amosite (present study) –1.997±0.776 vs. –1.950±0.769 (previous study).
![]() | ||
Fig. 3 Relatioships of normalized extra fibers, missing fibers, positive discrepancies and negative discrepancies of fiber counts of amosite and chrysotile slides to eqns (2) and (3) with δtotal = 0.022 for amosite fibers and δtotal = 0.047 for chrysotile fibers. |
For each type of asbestos, the excellent fit of the positive discrepancies and extra fibers, and the negative discrepancies and missing fibers to their respective linear equations, shows that the δtotal values of the analysts are relatively small and comparable with each other. Consequently, the sum of absolute discrepancies provides a direct measure of total extra and missing fibers, as shown in eqn (4).
Fig. 4 shows the plots of positive and negative discrepancies against major counting errors in examining the REF slides. All values are normalized against their respective verified fibers. For amosite fibers, Fig. 4a shows positive discrepancies having good correlation with size-extra errors (R = 0.97) and poor correlation with oversight-extra errors. Fig. 4b shows negative discrepancies having good correlations with the sum of size-missing and oversight-missing errors with (R = 0.94) and poor correlation with either subcategory. These two plots indicate that for amosite fibers, positive discrepancies are due to the size-extra errors, and negative discrepancies are due to size-missing and oversight-missing errors. For the chrysotile fibers, Fig. 4c shows positive discrepancies having good correlation with size-extra errors (R = 0.96) and poor co-relation with oversight-extra errors. Fig. 4d shows negative discrepancies having good linear correlation oversight-missing errors (R = 0.98) and poor correlation with size-missing errors. These two plots suggest that positive discrepancies are due to size-extra errors, and negative discrepancies are due to oversight-missing errors. Hence, the sum of absolute discrepancies can be used to assess the quality of fiber counts of these reference slides and the proficiency of analysts. The positive and negative discrepancies can each provide indications of the types of fiber counting errors.
![]() | ||
Fig. 4 Relationships of normalized discrepancies of amosite and chrysotile fiber counts and their major counting errors. |
Although the relocatable REF slides in the previous study were prepared using the older gridded coverglasses and they were analyzed by a different group of analysts, the present study and the previous study7 show many similarities. The same major counting errors were committed, even though there were significantly more counting errors in this study (note that in the Canadian Proficiency Test program, relocatable slides have been in use for some time, while this is the first exposure of most of the AIHA participants; a learning curve was anticipated). The under-estimations of errors by discrepancies, δtotal, in each study agree very well with each other, which is to say that there were relatively few extra fibers or missing fibers occurring simultaneously in the same fields. (Note that for samples with a density of about 250 fibers per mm2 the average number of fibers counted per counting field i.e. in the 100 µm diameter graticule, is 2. Many of the samples used in this study have densities of the order of 100 to 400 fibres mm–2, so the average number of fibers per field is low enough that it is perhaps not surprising that there were relatively few missing fibers and extra fibers occurring on the same fields.) The discrepancies show similar linear relationships with extra fibers, missing fibers and counting errors. Hence, the same proficiency criterion could be used to evaluate and compare the quality of fiber counts of the 2 studies. The criterion of (∑D+ + |∑D–|)/VFtotal ≤ 0.40 is equivalent to a score of 60 according to the following equation.
When the proficiency score of 60 is selected, there were 37 failures out of 85 amosite results, as shown in Table 7.† With these results excluded, the average ratio of reported fibers : verified fibers is 1.113, with an intercounter variation of 0.144. The over-estimation of amosite fibers is reduced to 0.113. Table 8† shows that there are 43 failures out of 60 chrysotile results. With these results excluded, the average ratio of reported fibers : verified fibers is 0.832, with an intercounter variation of 0.096. The underestimation of chrysotile fibers is reduced to 0.168. When those results with scores less than 60 are removed, the remaining ratios of RFtotal : VFtotal of amosite and chrysotile slides lie within the range of 0.60 to 1.40. The REF samples could serve as a diagnostic tool to help analysts or laboratories that are not achieving counts consistent with the reference values in PT schemes.
The present study has a significant number of analysts failing to meet the criterion of (∑D+ + |∑D–|)/VFtotal ≤ 0.40, or the score of 60, in counting amosite and chrysotile fibers. It may be useful to complement existing PT programs with REF slides. At the end of each PT round, detailed reports of discrepancies can be provided to participants so that they can improve on their skills in searching and sizing fibers and minimize their counting errors. In addition, the internal quality control program of each laboratory could include counting REF slides regularly by all analysts and control charts of (∑D+/VFtotal), (∑D–/VFtotal), (∑D+ + |∑D–|)/VFtotal and RFtotal : VFtotal could be maintained to monitor their errors, proficiencies and intercounter variations. Ten percent of relocatable slides of routine samples could also recounted to monitor their intracounter variation.7
RF = RF+, VF = VF+, E = E+, M = M+, RF+ ≥ VF+, |
D+ = RF+ – VF+ = E+ –M+ = E+ – δ+ |
Similarly, in a field with a D–,
D– = RF– – VF– = E– – M– = δ– – M– |
Also, D– is set at 0 for those fields with RF ≥ VF and D+ is set at 0 for those fields with RF < VF.
Summing all designated fields of the slide,
Etotal = ∑E+ + ∑E–, Mtotal = ∑M+ + ∑M–, VFtotal = ∑VF+ + ∑VF–, RFtotal = ∑RF+ + ∑RF–, δtotal = ∑δ+ + ∑δ– |
∑D+ = ∑RF+ – ∑VF+ = ∑E+ – ∑M+ = ∑E+ – ∑δ+ (since RF ≥ VF) = (Etotal – ∑E–) – ∑δ+ (since Etotal = ∑E+ + ∑E–) = (Etotal – Σδ–)– Σδ+. Since E– = δ– for negative discrepancies, ∑D+ = Etotal – δtotal | (2) |
∑D– = ∑RF–– ∑VF– = ∑E– – ∑M– = ∑δ– – ∑M– (since RF < VF) = ∑δ– – (Mtotal –∑M+) (since Mtotal = ∑M+ + ∑M–) = ∑δ– – (Mtotal – ∑δ+). Since M+ = δ+ for positive discrepancies, ∑D– = δtotal – Mtotal | (3) |
|∑D– | = Mtotal – δtotal |
∑D+ + |∑D– | = Etotal + Mtotal – 2δtotal | (4) |
Footnote |
† Electronic supplementary information (ESI) available: All tabular information, Tables 1–8. See DOI: 10.1039/b712323j |
This journal is © The Royal Society of Chemistry 2008 |