Natalie G.
Exum‡
*a,
Steven J.
Chow‡
a,
Caroline
Coulter
a,
Christopher D.
Gocke
b,
Andrew
Pekosz
ac,
Roanna
Kessler
d and
Kellogg J.
Schwab
a
aDepartment of Environmental Health and Engineering, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA. E-mail: nexum1@jhu.edu
bDepartment of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA
cDepartment of Molecular Microbiology and Immunology, John Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
dStudent Health and Well-Being, Johns Hopkins University, Baltimore, MD, USA
First published on 6th January 2025
The COVID-19 pandemic presented an opportunity to collect wastewater (WW) from a defined population of individuals within a building and monitor the sewage for viral RNA as a leading indicator of COVID-19 infections. The evaluation of the effectiveness of building-level WW surveillance programs as an early warning system has been limited by a lack of frequent asymptomatic surveillance of the defined residential population under WW surveillance. In this study we present the epidemiologic diagnostics of WW surveillance (sensitivity (Se), specificity (Sp), positive predictive value (PPV) and negative predictive value (NPV)) from university residence halls. WW surveillance was layered on top of a rigorous asymptomatic testing program (three times per week) and serves as the gold standard for comparison. This study also spanned across both the Spring 2021 semester when students were unvaccinated and the Fall 2021 semester when >95% of students were vaccinated for COVID-19 to understand how increased immunity may affect viral detection in WW. We analyzed composite WW samples from nine residential buildings that were collected twice weekly. The overall positive WW sample detection rate was 5.5% indicating the low-incidence context of this study population to allow for evaluation of WW surveillance as an early warning system. WW surveillance showed the best performance as a leading indicator of an infected individual when compared in a time inclusive of 1–2 days prior to the date of a clinical positive. The building-level WW surveillance sensitivity and specificity was found to be 60% and 94.9% (PPV: 47.4%; NPV: 96.9%), respectively in the Spring 2021; in the Fall 2021 sensitivity was reduced to 6.3% and specificity remained at a similar level of 97.5% (PPV: 14.3%; NPV: 94.1%). Combined for both semesters, the overall sensitivity and specificity were 32.3% and 96.4% (PPV: 38.5%; NPV: 95.3%). Convalescent shedding may explain up to 31% of false positive WW samples, contributing to decreased surveillance performance. This study demonstrates the greater effectiveness of building-level WW surveillance as an early warning system at the beginning of the COVID-19 pandemic when population-level immunity was naïve and fecal shedding of SARS-CoV-2 was likely more prevalent.
Water impactThe field of building-level wastewater surveillance is in its nascent stages and much remains to be understood about its effectiveness as a tool for outbreak prevention. This paper advances understanding of the lead-time ability of building-level wastewater surveillance by comparing thrice weekly asymptomatic surveillance of a closed residential population with monitoring wastewater from buildings twice per week. |
Building-level WW surveillance, also called “near-source tracking”, is the most upstream point of the sewershed to measure SARS-CoV-2 in the waste stream.7 The fecal shedding dynamics of SARS-CoV-2 in infected individuals are critical to understand the utility of WW surveillance in near-source tracking. The virus has been found to be shed in approximately 39–65% of feces, from studies conducted with mostly symptomatic individuals.8–10 Sequencing of SARS-CoV-2 from WW has demonstrated unique mutations in the viral genome, suggesting that there are cryptic sites of virus replication in the intestinal track that may lead to the emergence of novel variants resistant to naturally acquired or vaccine-induced immunity.11,12 Fecal shedding prior to symptom onset, or for asymptomatic cases, is less well understood. One study found that two of three household contacts that contributed pre-symptomatic fecal samples were positive for SARS-CoV-2 RNA.13 Virus shedding in stool correlates well with viral replication in the upper respiratory tract post-onset of symptoms, making SARS-CoV-2 RNA detection in stool a good proxy for detection in nasal samples.9,10,13
There is vast experience across colleges and universities to demonstrate the utility of WW surveillance as a leading indicator of COVID-19 prevalence. As explained in Olesen et al., the meaning of “leading indicator” depends on the specific application of WW surveillance.14 The applications can be described in three main categories: i) qualitative detection of disease presence or absence (otherwise known as an “early warning” system); ii) independent, quantitative estimate of community-level disease prevalence and trends; and iii) quantitative estimate of rapid changes in disease incidence. Building-level WW surveillance in the university setting was often implemented on campuses during the COVID-19 pandemic to gain a quantitative estimate of community-level disease prevalence and trends (application #2). Table 1 categorizes the existing studies from the university setting into these three applications to demonstrate the wide use of WW surveillance to understand community-level disease on prevalence and trends. Settings that have applied building-level WW surveillance systems, other than institutions of higher education, include correctional facilities,15 nursing homes,16 commercial aircrafts,17 military settings,18 and Olympic and Paralympic Villages.19
Application type | Building-level WW surveillance article in university setting | Frequency of WW testing | Frequency of asymptomatic testing | Clinical surveillance independent of WW |
---|---|---|---|---|
#1 Qualitative detection of disease presence/absence | ||||
Betancourt et al., 2021 (ref. 20) | • • | None | No | |
Colosi et al., 2021 (ref. 21) | • | + | Yes | |
Kotay et al., 2022 (ref. 22) | ||||
Gibas et al., 2021 (ref. 23) | • • • | None | No | |
Godinez et al., 2022 (ref. 24) | • • | None | Yes | |
Solo-Gabriele et al., 2023 (ref. 25) | • • • • | None | No | |
Mangwana et al., 2022 (ref. 26) | • • | None | No | |
Welling et al., 2022 (ref. 27) | • • • • | + + | Yes | |
Landstrom et al., 2022 (ref. 28) | • • | None | Yes | |
Rondeau et al., 2023 (ref. 29) | • • • | + + | Yes |
#2 Independent, quantitative estimate of community-level disease prevalence and trends | ||||
---|---|---|---|---|
Johnson et al., 2022 (ref. 30) | • • • • | None | Yes | |
Reeves et al., 2021 (ref. 31) | ||||
Scott et al., 2021 (ref. 32) | • | + + | Yes | |
Fahrenfeld et al., 2022 (ref. 33) | • | + | Yes | |
Wang et al., 2022 (ref. 34) | • | + | Yes | |
Karthikeyan et al., 2021 (ref. 6) | • • • • | + | Yes | |
Anderson-Coughlin et al., 2022 (ref. 35) | ||||
Zambrana et al., 2022 (ref. 36) | • | + | Yes | |
Rainey et al., 2023 (ref. 37) | • | None | Yes | |
Ash et al., 2023 (ref. 38) | • | None | No | |
Sharkey et al., 2021 (ref. 39) | • | + | Yes | |
Amirali et al., 2024 (ref. 40) | ||||
Bivins et al., 2021 (ref. 41) | • | + | Yes | |
Lee et al., 2023 (ref. 42) | • • | None | Yes | |
Cohen et al., 2022 (ref. 43) | • • | None | Yes | |
Lu et al., 2022 (ref. 44) | • • | None | Yes | |
Kazenelson et al., 2023 (ref. 45) | • | None | Yes | |
Sellers et al., 2022 (ref. 46) | • • | None | Yes | |
Haskell et al., 2024 (ref. 47) | • • • | None | Yes |
#3 Quantitative estimate of rapid changes in disease incidence | ||||
---|---|---|---|---|
• • • • 7 days per week. • • • 3 days per week. • • 2 days per week. • 1 or less days per week. + + + + 7 days per week. + + + 3 days per week. + + 2 days per week. + 1 or less days per week.a Frequency not provided. | ||||
Brooks et al., 2021 (ref. 48) | • | + | No | |
Bitter et al., 2022 (ref. 49) | • • | None | No | |
Corchis-Scott et al., 2023 (ref. 50) | • • | None | No |
To assess whether building-level WW surveillance can be used as a more timely replacement for surveillance based on upper respiratory or saliva samples, the time lag between WW sample collection and analysis must be short. Clinical assessment by nasal or saliva samples during the COVID-19 pandemic was often used to prevent outbreaks in congregate living settings. The frequency of this mass asymptomatic testing of building residents ideally occurred at the shortest interval possible; however, this type of clinical surveillance is resource intensive. To achieve more frequent testing with limited resources, pooling of clinical samples often occurs prior to laboratory analysis.51 Comparatively, WW surveillance is a naturally pooled sample and can be collected at very short timescales, often hourly. Prior studies have estimated that building-level WW surveillance is able to detect SARS-CoV-2 positivity prior to clinical reporting. However, reported estimates of lead time have been variable, ranging from a 0 to 2 day lead.5,52,53 The context of these studies is also highly variable with clinical testing occurring en masse in a building only after a positive WW detection occurs.20 This highlights the need to measure clinical symptomatic and asymptomatic surveillance of all building residents in parallel with frequent WW sampling.
This study describes the results of a collaborative, rapid-response effort to implement a comprehensive WW surveillance program for SARS-CoV-2 at the sanitary outflows of residential facilities at the Johns Hopkins University campus complementary to clinical surveillance. The aim of this study was to conduct building-level WW surveillance in the context of multi-layered COVID-19 mitigation strategies to achieve low-incidence of disease. WW surveillance data is compared with high-frequency asymptomatic clinical testing data to understand its ability to detect a positive case in a low-incidence setting, also known as an “early warning system”.
Building code | Sanitary line access | Estimated building sewage coverage | Spring semester (1/25–5/11/2021) | Fall semester (9/5–12/14-2021) | ||||||
---|---|---|---|---|---|---|---|---|---|---|
# student residents | # clinical positives detected/# unique Pos case dates | # positive WW samples | # WW samples collected | # student residents | # clinical positives detected/# unique Pos case dates | # positive WW samples | # WW samples collected | |||
a Sampler was moved to a different cleanout location within the building between Spring and Fall. b Building was unoccupied and not sampled in Spring. Sampling began in Fall 2021. c Sampling began later in Spring semester – 03/07/2021. d Number of student residents reported as a combined number for buildings D and E, which were part of a connected complex but with separate sewer connections. | ||||||||||
A | Cleanout | Full | 136 | 1/1 | 1 | 32 | 136 | 0 | 0 | 23 |
Ba | Cleanout | Partial | 199 | 2/2 | 2 | 31 | 205 | 0 | 0 | 24 |
C | Cleanout | Full | 253 | 2/2 | 4 | 30 | 474 | 7/6 | 2 | 23 |
D | Cleanout | Partial | 606d | 36/9 | 6 | 29 | 606d | 4/3 | 1 | 28 |
E1 | Cleanout | Partial → full | 4/2 | 2 | 30 | 4/4 | 0 | 28 | ||
E2 | Cleanout | Partial → full | 0 | 6 | 2 | 26 | ||||
Fb | Cleanout | Full | — | NA | NA | NA | 509 | 4/3 | 1 | 27 |
Gc | Manhole | Full | 93 | 0 | 2 | 18 | 191 | 0 | 0 | 27 |
Hc | Manhole | Full | 132 | 0 | 2 | 17 | 324 | 3/3 | 0 | 27 |
Ic | Manhole | Full | 49 | 0 | 0 | 18 | 184 | 1/1 | 0 | 27 |
Total | 1468 | 45/16 | 19 | 211 | 2629 | 23/20 | 7 | 260 |
For each building, the amount of WW conveyed through the outlet sampled was estimated as a percentage of student rooms. Personal communication with facilities personnel and referencing of available building schematics ensured that each building outlet or manhole sampled from only a single residential building of interest. Five buildings were estimated to have 100% coverage. Building D and B were estimated to cover 50% and 25% of student rooms due to the presence of multiple mains connecting to city sewer lines. Building E covered 50% through the first 3 months of study (site E1) and reached 100% coverage upon installation of a second sampler (E2) in the building's secondary WW effluent pipe (Table 2).
WW samples were collected using ISCO 6712 portable autosamplers (Teledyne ISCO; Lincoln, NE) to pull composite samples through stainless steel strainers (Teledyne ISCO) positioned in the bottom interior of pipes. WW collections were performed twice per week at each tested site by composite sampling over a 15-hour period from 7 AM to 10 PM every Sunday (to capture cases over the weekend) and Tuesday (to deliver timely reports by Friday), with occasional schedule modifications in the event of university holidays. The autosamplers were programmed to draw semi-continuously at discrete 10–20 minute intervals. The following morning after collection, composite sample containers were manually agitated to mix the contents, dispensed into autoclaved 1 L polypropylene screw-cap bottles and delivered to the laboratory for same day processing. Samples were collected on 32 different dates in the Spring and 28 in the Fall, totaling 60 sampling days for this study. Further details describing the WW sampling protocol are presented in the ESI.†
WW aliquots of 50 mL, decreased from 100 mL in the original sample protocol,56 were filtered under vacuum through 47 mm 0.2 μm mixed cellulose ester HA membrane filters (Millipore, Billerica, MA). A lower filtrate volume was necessary to minimize filter clogging, which frequently occurred due to high solid content of raw sewage. In 19% of samples (n = 88), the entire 50 mL could not be filtered. In these cases, the filter was used with the volume of WW filtered after 2 hours (average 40 mL). In infrequent cases (n = 10) when less than 20 mL could be filtered (either due to fouling or low sampled volume), 1 mL aliquots of WW were directly extracted. Filters were folded and placed directly into 2 mL bead-beating tubes after filtration. Synthetic WW (Table S2†) unspiked and spiked with BCoV were processed as extraction blanks and internal standard recovery controls respectively following the same protocols. All the samples were stored at −80 °C until RNA extraction.
Sample RNA was extracted from frozen filters and WW aliquots to produce a 100 μL extract using an RNeasy PowerMicrobiome kit (Qiagen; Germantown, MD) with a QIAcube Connect automated extraction system (Qiagen) following the manufacturer's protocol. During extraction, DNase I was applied to remove genomic DNA from the extract. Sample extraction, reaction prep, amplification, and disposal each occurred in separate laboratory spaces to minimize the possibility of cross-contamination.
SARS-CoV-2 detection was based on the CDC 2019-nCoV real-Time RT-PCR diagnostic panel for human specimens (CDC-006-00019, Revision: 06) with modifications. The N1 coding gene coding was exclusively used for SARS-CoV-2 detection. BCoV RNA detection utilized primers and probes described elsewhere.56 All primers and probes were obtained from IDT (Coralville, IA) and are listed in Table S1 of the ESI.† RT-qPCR assays were performed as 20 μL (5 μL template) one-step RT-PCR reactions using a QuantStudio 5 thermocycler (Thermo Fisher). PCR reactions were amplified separately (i.e. not duplexed) to prevent ablation of the signal due to potential competitive amplification of each target of interest. The thermocycler program was identical to the CDC protocol, except the amplification was run for 40 cycles (instead of 45 cycles).
Extracts from each WW sample were analyzed by RT-qPCR as an undilute template and complementary 10−1 diluted template to account for the potential presence of PCR inhibitors. Extracted samples were marked as having potential amplification inhibition if the internal standard BCoV ΔCt values between 10−1 and undilute templates deviated at least 2 cycles from a theoretical 10-fold dilution ΔCt of 3.32. In the Fall, the undilute templates were run in duplicate. Stocks of RNA extracted from inactivated SARS-CoV-2 culture and the BCoV vaccine were used as positive controls for their respective assays. SARS-CoV-2/USA-WA1/2020 isolate used as a positive control was obtained from BEI Resources and grown in Vero cells as previously described,57 to an infectious virus titer of 1.58 × 108 50% tissue culture infectious doses per ml (TCID50 ml−1). Each PCR run contained positive SARS-CoV-2 RNA control templates that were 10-fold serial diluted 3–7 times until extinction into separate reaction wells for quality control. The Ct values for positive control dilution series were fitted to linear calibration curves for the log of each dilution with an average R2 of 0.991 ± 0.014 (1 S.D.). Average amplification efficiency based on the slopes of these curves was 102% ± 15%, indicating consistent amplification reactions over the course of the study. The N1 assay limit of detection (LOD) was determined at the highest discrete stock dilution with at least 95% positive detections in the 50 calibration dilution series run during the study.58 The LOD was the 105 stock dilution (100% detection frequency, average Ct = 33.8), corresponding to an infections virus titer of 1.58 × 103 TCID50 mL−1. The next higher dilution (106) was detected in only 67% of runs (average Ct = 36.5).
WW collection and analysis was optimized to facilitate reporting to university leadership within 48 hours of initial sample collection. Immediately after data interpretation of a given WW collection, positive results were reported to university leadership and used to make decisions regarding potential outbreaks in individual buildings. Sample results were cross-referenced with individual student testing data reported to the university to help determine early warning of an outbreak. Weekly reports were compiled on Fridays to provide a more formal and comprehensive analysis of the surveillance data. A summary of the weekly WW surveillance workflow and reporting timeline is described in Fig. 1.
Each WW sample was classified as either a true/false positive or true/false negative based on its coincidence with a positive clinical sample (Fig. 2). WW samples that were positive and overlapped with a positive clinical detection were classified as true positives (TPs). If there was a positive clinical detection one to two days prior to a WW sample that was negative it was classified as a false negative (FN). WW samples that were negative and did not overlap with positive clinical detection windows were classified as true negatives (TNs). False positives (FPs) were classified if a WW sample was positive without a positive clinical detection one to two days prior to the WW sample. To understand the accuracy and reliability of WW surveillance as a diagnostic test, sensitivity (i.e. the ability for WW to detect a single case in a building) and specificity (i.e. the ability for WW to correctly identify that there are no infected individuals in the building) were calculated. Sensitivity was defined as [TP/(TP + FN)].60 Specificity was defined as [TN/(FP + TN)].
During the Spring 2021 semester, seven residential buildings were occupied by 1468 students. The eleven students who tested positive prior to the start of building WW surveillance were placed in isolation (Fig. 2). A total of 45 positive clinical cases were reported across 16 unique case-dates (Table 2). At the start of the Spring semester (January 29 to February 15), 40 student residents tested positive, making up the largest cluster of infections in the study (Fig. 2A). Contact tracing attributed this multi-residence hall outbreak event to a large off-campus event on Friday January 29. Multiple students began to test positive (both symptomatic and asymptomatic) on Tuesday February 2 after attending the event. A smaller cluster of 4 positives occurred in a 10-day period April 5–14. This coincided with Easter weekend (April 4), a holiday where many students typically travel and congregate. Between these two clusters, only a single additional positive clinical result was reported for the remainder of the Spring semester, confirming the low-incidence environment within which WW surveillance was conducted.
There was an increase in occupancy in Fall 2021 to 2629 residential students across nine buildings. During this period, 23 positive clinical cases were reported across 20 unique case-dates (Table 2). Eight sporadic cases were reported in various buildings throughout the first 12 weeks of semester prior to the weeklong Thanksgiving break (November 20–27). A cluster of eight positive cases was reported in different buildings in a five-day period immediately following the holiday break. The final two weeks of the semester had 7 positive cases, including a series of 4 individual positives from the same building (building C). There were 3 WW positive samples during this period, with a single occurrence of a positive WW detection of two positive cases (Fig. 2B). No WW collection occurred from November 20–27 over the Thanksgiving holiday.
Overall, 17% of measured samples (n = 81) showed internal standard inhibition during amplification (section 2.3). This rate was consistent across different sample locations (11–23%) and was sporadic across sampling dates. The heterogeneity of samples and high degree of potential PCR inhibition were important considerations in the treatment of data. Prior studies have described inconsistent results from applying internal controls to correct for recovery loss of the SARS CoV-2 signal in WW.61,62 Rather than attempt to quantify and normalize gene copy numbers in samples with varying degrees of inhibition, samples were evaluated for the presence/absence of the SARS-CoV-2 signal within the quality control and threshold constraints for the RT-qPCR assay. This simplified approach provided a rapid, conservative, and uniform method of treating such heterogeneous samples collected at the building level.
A total of 26 collected WW samples were positive for SARS-CoV-2 during this study, with 9 out of 10 sampling locations producing at least one positive sample (Table 2). Measured RT-qPCR results for each positive sample are presented in Table S2.† Among all positive samples, SARS-CoV-2 Ct values ranged from 29.8–38.9 with average and median detected values of 35.7 and 35.9 respectively (Table S2†). A similar fraction of positive samples showed inhibition based on BCoV dilution (23%) compared to the total number of samples (17%), which suggests a lack of a selection bias based on PCR inhibition.
In the Fall 2021 semester WW surveillance began on September 5th, one week after the beginning of classes on August 30th. Testing and quarantine of students upon move-in was not conducted. Seven single clinically positive cases and three WW positive samples occurred prior to the Thanksgiving holiday (November 20–27), with a single occurrence of a positive WW detection of two positive cases in building E (Fig. 2B). No WW collection occurred over this holiday period. After this break in the semester, four positive WW detections were found to be associated with three positive clinical tests (Fig. 2B).
The overall positive WW sample detection rate was 5.5%. On a semester basis, the positive detection rate was over three times greater in the Spring (8.9%) than in the following Fall (2.7%). This trend mirrored the overall number of reported positive cases in the residence halls, which dropped from 45 in the Spring to 23 in the Fall. The decreased detection rates occurred despite an increase in student resident density (Table 2) and a relaxation of transmission-reduction protocols within buildings.
Comparison window (from date of clinical positive) | Date range | Sample classification | Performance metrics | ||||||
---|---|---|---|---|---|---|---|---|---|
FN | FP | TN | TP | Sensitivity | Specificity | PPV | NPV | ||
Abbreviations: FN (false negatives), FP (false positives), TN (true negatives), TP (true positives), PPV (positive predictive value), NPV (negative predictive value). Calculations: sensitivity = TP/(TP + FN); specificity = TN/(TN + FP); PPV = TP/(TP + FP); NPV = TN/(TN + FN). | |||||||||
Same day | [0,0] | 7 | 23 | 438 | 3 | 30.0% | 95.0% | 11.5% | 98.4% |
1-Day prior | [−1,0] | 12 | 19 | 433 | 7 | 36.8% | 95.8% | 26.9% | 97.3% |
2-Days prior | [−2,0] | 21 | 16 | 424 | 10 | 32.3% | 96.4% | 38.5% | 95.3% |
1-Day prior, 1-day after | [−1,1] | 18 | 18 | 427 | 8 | 30.8% | 96.0% | 30.8% | 96.0% |
2-Days prior, 1-day after | [−2,1] | 27 | 15 | 418 | 11 | 28.9% | 96.5% | 42.3% | 93.9% |
Breaking down the WW surveillance by semester using the 2-days prior window, the Spring 2021 campaign yielded 60% sensitivity and 94.9% specificity (Table 4). Three of the 6 FNs occurred in buildings where full WW coverage was not achieved (B, D and E), which suggests that greater sensitivity could have been achieved with complete building coverage. In the highly vaccinated context of the Fall 2021 campaign, there was 6.3% sensitivity for WW surveillance and 97.5% specificity (Table 4). Only a single WW detection qualified as a TP during this period and only three of the 15 FNs occurred in buildings without full WW coverage, indicating that building coverage was less of a factor driving poor sensitivity in a highly vaccinated population. Other factors that could be contributing to lower sensitivity in the Fall semester include changes in asymptomatic testing requirements to 1× per week, overall lower cases, greater dilution effects from increased building water use at full occupancy, and different virus strains that may reduce shedding of the virus.63
Semester | # student residents | # positive clinical cases | Sample classification | Performance metrics | ||||||
---|---|---|---|---|---|---|---|---|---|---|
FN | FP | TN | TP | Sensitivity (Se) | Specificity (Sp) | PPV | NPV | |||
Total WW positives | ||||||||||
Spring 2021 | 1468 | 45 | 6 | 10 | 186 | 9 | 60.0% | 94.9% | 47.4% | 96.9% |
Fall 2021 | 2629 | 23 | 15 | 6 | 238 | 1 | 6.3% | 97.5% | 14.3% | 94.1% |
Study total | — | 68 | 21 | 16 | 424 | 10 | 32.3% | 96.4% | 38.5% | 95.3% |
Subtraction of convalescent shedders | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Abbreviations: FN (false negatives), FP (false positives), TN (true negatives), TP (true positives), PPV (positive predictive value), NPV (negative predictive value). Calculations: sensitivity = TP/(TP + FN); specificity = TN/(TN + FP); PPV = TP/(TP + FP); NPV = TN/(TN + FN). + indicates sample classifications that changed due to subtraction of convalescent shedders. | ||||||||||
Spring 2021 | 1468 | 45 | 6 | 5+ | 186 | 9 | 60.0% | 97.4% | 64.3% | 96.9% |
Fall 2021 | 2629 | 23 | 15 | 5+ | 238 | 1 | 6.3% | 97.9% | 16.7% | 94.1% |
Study total | 68 | 21 | 10+ | 424 | 10 | 32.3% | 97.7% | 50.0% | 95.3% |
Although WW surveillance may be most useful as a leading indicator of infection, it has also been observed to be a lagging indicator of infection when convalescent shedding occurs in a building. One clinical study estimated that approximately 40% of individuals with mild to moderate disease continued to shed RNA in stool up to 14 days after initial diagnosis.9 This suggests that students returning to residence halls from 10-day isolation may still shed SARS-CoV-2 virus into WW. WW surveillance performance was subsequently evaluated to determine whether these lag effects could explain FPs observed in WW results. As a follow-up analysis, the effects of convalescent shedding were considered for students who returned to their residence halls from their isolation off-site. A window between the date of return (approximately, but not always 10 days post-clinical positive) and 14 days after a positive clinical test was used to determine potential influence of asymptomatic convalescent shedding on WW positives (Fig. S3†).
Using these criteria, an additional 4 WW samples from the Spring and 1 WW sample from the Fall that were previously classified as FPs could be explained by convalescent shedding (Fig. S3†). This represents a substantial portion of positive WW samples in this study – 31% of all FP samples and 19% of total WW positivity. Subtracting the effects of convalescent shedding (removing FPs), an “adjusted” WW surveillance performance can be estimated in the absence of post-infection shedding (Table 4). This adjustment led to a modest increase in the specificity (from 96.4% to 97.7%) and positive predictive value (from 38.5% to 50%).
The building-level WW surveillance sensitivity and specificity was found to be 60% and 94.9%, respectively in the Spring 2021, when vaccinations were becoming available in the latter half of the semester. In Fall 2021 when the student population was almost fully vaccinated (greater than 95%), sensitivity was reduced to 6.3% and specificity remained at a similar level of 97.5%. Combined for both semesters, the overall sensitivity and specificity were 32.3% and 96.4%. These findings of low sensitivity and high specificity for building-level WW surveillance are in line with prior studies that used frequent asymptomatic clinical surveillance as the gold standard approach.29,64 Of the other COVID-19 university lead-time analyses (Table 1) Rondeau et al.29 was most comparable to this study (using thrice weekly WW sampling and twice weekly asymptomatic testing), though they collected a smaller number of WW samples. Other important conditions that made their findings relevant to this study were the rapid isolation of cases, the same timeframe of Spring 2021, the low incidence of disease with one positive case at a time occurring in a building, and similar use of Ct values instead of concentrations to determine a positive detection. Our study findings aligned closely with no correlation between Ct values and case numbers and similar sensitivity, specificity, PPV values. The low sensitivity of WW surveillance as a leading indicator of the presence of an infected individual suggests that its use at hospitals or airports is less effective than clinical surveillance to ensure that a single case is identified.
When convalescent shedding was considered and potential shedders were eliminated from the analysis, WW detection specificity increased marginally to 97.7% overall, while sensitivity remained unchanged (Table 4). Accounting for convalescent shedding greatly reduced FPs in WW samples and increased PPV from 38.5% to 50.0%. This study combined a high frequency of WW testing (2 times per week) with a high frequency of asymptomatic testing (3 times per week) conducted in concurrent but independent programs to produce building-level diagnostic metrics for WW surveillance. The comparatively lower sensitivity of building-level WW surveillance found in this study implies that there were pre-outbreak cases not detected by WW testing. We found that false negatives (WW−/clinical+) were drivers of reduced sensitivity when there was only one individual from a building testing positive. The largest number of true positives occurred when there were multiple cases diagnosed in a building at the same time, such as in early Spring 2021 when there was a known outbreak event. This implies the lower sensitivity of WW testing when disease incidence is low and is aligned with prior work.29 A second possibility for the lower sensitivity in this study is the comparatively high frequency of asymptomatic clinical testing that identified more individual cases compared to approaches that relied on either clinical testing only after a positive WW sample was detected20 or only symptomatic clinical testing.24 This demonstrates the challenge with relying solely on WW surveillance in congregate living settings to identify a single positive case, prior to an outbreak.
The reduced WW testing sensitivity between the Spring and Fall 2021 semesters was significant and can be attributed to a variety of possible factors. The near-universal vaccination of the student population (>95% coverage) may have substantially reduced the gastrointestinal shedding of virus among positive students in the surveilled population.20 An increase in residential occupancy in the Fall (Table 2) would have also led to an increase in building water usage that could dilute samples and lower RNA concentrations in WW per infected individual, which may fall below limits of detection of the analytical method employed. The lower frequency (once per week for vaccinated and twice per week for unvaccinated) of clinical testing in Fall 2021 may have also reduced the overall sample size of true positives and increased the ratio of false positives to true positives, leading to reduced WW testing sensitivity.
To understand the effectiveness of WW surveillance as an early warning system, convalescent shedding must be accounted for. Clinical studies have shown that post-infection shedding can occur up to months after initial symptoms,9 which suggests that students returning to residence halls from isolation could still shed SARS-CoV-2 virus into WW. Continued shedding post-infection from a resident can be mistaken for a new disease case when a previously positive resident returns to the residence hall setting after isolation. After recovery from respiratory illness and the loss of virus in the respiratory tract, convalescent fecal shedding of SARS-CoV-2 RNA has been shown to persist for an average of seven days.65 This is critical to understand when evaluating the lead-time capability of building-level WW surveillance given that nasal swabs could be negative but fecal material could still be positive due to cryptic virus replication in the intestinal tract. The potential bias introduced by convalescent shedding can be seen in this study after adjusting for its potential effects and the PPV of a WW sample increased from 38.5% to 50%. This effect was particularly relevant in the Spring semester, when returning students in buildings G and H in early March might have been responsible for a cluster of three false positive WW samples. The ability for WW surveillance to capture convalescent shedders is critical to understand individuals chronically shedding SARS-CoV-2. WW surveillance can also be used to monitor ongoing evolution and mutation of the virus. PCR combined with virus genome sequencing can provide important information on how the virus is changing during acute as well as chronic infection. Since most individuals testing positive for SARS-CoV-2 no longer seek medical care, the sequence of the viruses causing these cases never enters the sequence database, causing our databases to be skewed to variants associated with more severe disease. WW sequencing can capture the sequence of the variants causing mild disease in relatively healthy populations thus improving surveillance efforts. Chronic shedding of SARS-CoV-2 can also result in continued mutation of the genome with the potential to change virus replication and disease potential. In fact, WW surveillance can identify not only population changes in virus sequences, but also help to trace and identify individuals who are shedding particularly unique variants.12,66
Based on available data, the circulation of SARS-CoV-2 was relatively low in this study setting. Individuals with clinical positives (asymptomatic and symptomatic) were rapidly isolated (within hours) from buildings undergoing WW surveillance (Fig. 2). The overwhelming majority of samples in this study (94.7%) produced no nucleic acid signal for SARS-CoV-2 which contrasts with many other WW surveillance programs on college campuses during the COVID-19 pandemic. Rather than relying on gene copy number or using correlations of WW concentrations with individual numbers of reported cases, we evaluated the temporal overlap between the occurrence of positive WW and clinical samples to assess the use of WW surveillance as an early warning system.
It is important to acknowledge several limitations to the WW surveillance effort that may have influenced the results of this study. First there was an incomplete mapping of residence hall rooms to sewer cleanouts and buildings B and D could only be confirmed to achieve partial coverage of rooms for WW collection sites. This may have led to missed positive samples (decreased sensitivity), though excluding these buildings from analysis did not substantially change the calculated study sensitivity (data not shown). Potential contributors to unexplained false positives in WW surveillance are non-student individuals such as building staff and contractors, who would be excluded from the clinical testing enumeration (leading to false positives). From a sampling perspective, collecting small sample volumes in discrete intervals (10–20 min) may decrease the likelihood of capturing irregular viral loads flowing through the plumbing. Similarly, filtered sub-samples of highly heterogeneous WW samples with high solid content may not necessarily be fully representative of the larger water sample. Additionally, dilution of viral concentrations in WW resulting from higher water use during higher building occupancy (Fall semester) may have contributed to reduced sensitivity of the WW surveillance protocol.
From this work, we have identified several areas of improvement and future research that may better serve future disease surveillance efforts. For sample collection, the commercially available autosamplers used in this study, used commonly in continuously flowing water bodies (such as WWTPs), were poorly suited for the intermittent and confined spaces of premise plumbing. Improved samplers with more customizable sampling programs that approach continuous flow would be highly beneficial to capture more representative samples. Others have already utilized custom-built continuous samplers to this end.31 Additionally, samplers capable of using smaller, less obtrusive sample tubing, strainers, and flow sensors would be more readily retrofitted into existing buildings and reduce clogging, which frequently occurs at smaller-diameter pipes and building cleanouts compared to other sample points on campus WW surveillance programs.67 In tandem with microbiological analysis, concurrent measurement and comparison with chemical indicators such as human metabolites or pharmaceutical products could reveal additional insights on building populations and provide new avenues for data normalization to compensate for sample dilution and inhibition.
Footnotes |
† Electronic supplementary information (ESI) available. See DOI: https://doi.org/10.1039/d4ew00668b |
‡ Co-first authors. |
This journal is © The Royal Society of Chemistry 2025 |