Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Implementation of rapid and frequent SARS-CoV2 antigen testing and response in congregate homeless shelters

  • Andrés Aranda-Díaz ,

    Contributed equally to this work with: Andrés Aranda-Díaz, Elizabeth Imbert

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    andres.arandadiaz@ucsf.edu

    Affiliations Department of Bioengineering, Stanford University, Stanford, California, United States of America, Division of HIV, ID and Global Medicine, University of California, San Francisco, California, United States of America

  • Elizabeth Imbert ,

    Contributed equally to this work with: Andrés Aranda-Díaz, Elizabeth Imbert

    Roles Conceptualization, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Division of HIV, ID and Global Medicine, University of California, San Francisco, California, United States of America, UCSF Benioff Homelessness and Housing Initiative, San Francisco, California, United States of America

  • Sarah Strieff,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – review & editing

    Affiliation San Francisco Department of Public Health, San Francisco, California, United States of America

  • Dave Graham-Squire,

    Roles Data curation, Writing – review & editing

    Affiliations UCSF Benioff Homelessness and Housing Initiative, San Francisco, California, United States of America, UCSF Center for Vulnerable Populations, University of California, San Francisco, California, United States of America

  • Jennifer L. Evans,

    Roles Data curation, Writing – review & editing

    Affiliations UCSF Benioff Homelessness and Housing Initiative, San Francisco, California, United States of America, UCSF Center for Vulnerable Populations, University of California, San Francisco, California, United States of America

  • Jamie Moore,

    Roles Methodology

    Affiliation San Francisco Department of Public Health, San Francisco, California, United States of America

  • Willi McFarland,

    Roles Supervision, Writing – review & editing

    Affiliations San Francisco Department of Public Health, San Francisco, California, United States of America, Department of Epidemiology and Biostatistics, University of California, San Francisco, California, United States of America

  • Jonathan Fuchs,

    Roles Supervision

    Affiliation San Francisco Department of Public Health, San Francisco, California, United States of America

  • Margaret A. Handley,

    Roles Conceptualization, Methodology, Supervision, Writing – original draft

    Affiliations UCSF Benioff Homelessness and Housing Initiative, San Francisco, California, United States of America, UCSF Center for Vulnerable Populations, University of California, San Francisco, California, United States of America, Department of Epidemiology and Biostatistics, University of California, San Francisco, California, United States of America, UCSF PRISE Center: Partnerships for Research in Implementation Science for Equity, San Francisco, California, United States of America

  • Margot Kushel

    Roles Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliations UCSF Benioff Homelessness and Housing Initiative, San Francisco, California, United States of America, UCSF Center for Vulnerable Populations, University of California, San Francisco, California, United States of America

Abstract

Background

People experiencing homelessness who live in congregate shelters are at high risk of SARS-CoV2 transmission and severe COVID-19. Current screening and response protocols using rRT-PCR in homeless shelters are expensive, require specialized staff and have delays in returning results and implementing responses.

Methods

We piloted a program to offer frequent, rapid antigen-based tests (BinaxNOW) to residents and staff of congregate-living shelters in San Francisco, California, from January 15th to February 19th, 2021. We used the Reach-Effectiveness-Adoption-Implementation-Maintenance (RE-AIM) framework to evaluate the implementation.

Results

Reach: We offered testing at ten of twelve eligible shelters. Shelter residents and staff had variable participation across shelters; approximately half of eligible individuals tested at least once; few tested consistently during the study.

Effectiveness: 2.2% of participants tested positive. We identified three outbreaks, but none exceeded 5 cases. All BinaxNOW-positive participants were isolated or left the shelters.

Adoption: We offered testing to all eligible participants within weeks of the project’s initiation.

Implementation: Adaptations made to increase reach and improve consistency were promptly implemented.

Maintenance: San Francisco Department of Public Health expanded and maintained testing with minimal support after the end of the pilot.

Conclusion

Rapid and frequent antigen testing for SARS-CoV2 in homeless shelters is a viable alternative to rRT-PCR testing that can lead to immediate isolation of infectious individuals. Using the RE-AIM framework, we evaluated and adapted interventions to enable the expansion and maintenance of protocols.

Introduction

People experiencing homelessness are at higher risk of severe COVID-19 due to their older age and comorbidities [15]. Congregate shelters, where the majority of people experiencing homelessness in the United States stay [6], present challenges to controlling airborne diseases, including crowding and transient populations [79].

COVID-19 community prevalence and shelter characteristics (e.g. ventilation, resident density, population turnover, and mask-wearing) determine prevalence in shelters [10]. Frequent symptom screening for COVID-19 is insufficient to prevent outbreaks due to pre- or asymptomatic infectious individuals [10, 11]. Restructuring to allow physical distancing, testing and isolation, can decrease outbreaks [12]. The ability to interrupt transmission chains through early identification of infectious individuals by molecular tests depends on frequency of testing and speed of reporting [13, 14]. Infection transmission models for shelters, found that in addition to standard infection prevention methods, twice-weekly testing may be necessary, and sometimes insufficient, to decrease viral reproduction numbers [1518].

Nucleic acid amplification tests (e.g. real-time Reverse Transcription Polymerase Chain Reaction, rRT-PCR) are sensitive and specific, but they are expensive, require specialized equipment and personnel, and have disclosure delays that may facilitate transmission [19]. Antigen-based tests offer faster turnaround times (15–30 minutes), lower costs, and less specialized training [20]. Testing in moderate prevalence areas using Abbott’s BinaxNOW COVID-19 Ag Card (“BinaxNOW”) antigen test demonstrated high sensitivity and specificity for identifying infections with a transmissible viral load [21]. Along with referrals to isolation and quarantine settings (I&Q) [22], rapid testing and response can interrupt transmission and prevent outbreaks in congregate shelters.

Little is known about the implementation of rapid testing and response to COVID-19 infections in congregate shelters. Implementation frameworks, such as RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance), can aid in planning, adapting and evaluating interventions for implementation and dissemination [23]. We describe the BinaxNOW Shelter Pilot, a voluntary rapid, twice-weekly testing protocol for congregate shelters in San Francisco, California during January and February 2021. We apply the RE-AIM framework (Reach, Effectiveness, Adoption, Implementation and Maintenance) to evaluate the uptake and effectiveness of the BinaxNOW Shelter Pilot and inform recommendations to scale up similar protocols.

Methods

Study setting and design

The UCSF Benioff Homelessness and Housing Initiative (BHHI), the San Francisco Department of Public Health (SFDPH) and Department of Homelessness and Supportive Housing (SFHSH) developed and implemented the BinaxNOW shelter pilot. Initially, we implemented the pilot at four shelters and added six shelters during the study.

All residents and staff in adult, transitional age youth, and family shelters with congregate dormitory settings in San Francisco were eligible. To detect and isolate individuals as close to their infective period as possible, given resource limitations, test sensitivity, and disease progression (time between exposure, infection, and test positivity), we offered participants twice-weekly testing (Monday/Thursday or Tuesday/Friday) during the study period of January 14th to February 19th, 2021.

All participants (or parents or guardians for those under 18) provided verbal informed consent. Consent was documented by non-clinical or clinical staff in a web-based data management platform (PrimaryHealth). We collected data required by state guidelines (contact information, race/ethnicity, gender, and date of birth) in PrimaryHealth. The UCSF Committee on Human Research (UCSF’s Institutional Review Board) stated that the project did not meet criteria for human subjects research (and thereby did not require formal Institutional Review Board review) because this study was an evaluation of a public health intervention in the context of “public health surveillance” for SARS-CoV2, rather than a research study.

BinaxNOW shelter pilot implementation

We based our protocol on previous test-and-respond workflows (Table 1), which involved monthly rRT-PCR for shelter residents and encouragement of shelter staff to seek community testing twice monthly. An outbreak team worked with shelter leadership to refer positive individuals to I&Q and conduct a case investigation and contact tracing.

thumbnail
Table 1. Workflow comparisons pre- and post-implementation of rapid SARS-CoV2 antigen testing at homeless shelters, San Francisco, 2021.

https://doi.org/10.1371/journal.pone.0264929.t001

Staffing and sites preparation.

A detailed description of staffing and supplies is available online [24]. We recruited “shelter champions,” shelter staff members whom we trained and provided with a stipend to advertise testing events, coordinate event setup, and facilitate resident and staff participation. BHHI hired non-clinical staff and laboratory technicians, and recruited community volunteers; SFDPH provided registered nurses (RN) and health workers.

On-site workflow.

Initially, we had four testing stations with 8–10 staff (Fig 1): (1) Check-In: three to four non-clinical staff checked in participants, performed a symptom screen [25], provided information about isolation and quarantine, and labeled testing materials. A RN assessed individuals who reported symptoms consistent with COVID-19 to determine if they required isolation; (2) Swabbing: one to two technicians performed anterior nares swab [26]; (3) Testing: one BinaxNOW-trained staff (Tester) started the reaction [26], and one (Recorder) monitored the reaction time, read the result with the Tester, and recorded results on PrimaryHealth. The RN served as tiebreaker when there was disagreement. (4) Results: A non-clinical staff disclosed negative results to participants [24].

thumbnail
Fig 1. Initial and post-consolidation of rapid SARS-CoV2 antigen testing at homeless shelters, San Francisco, 2021.

Initial BinaxNOW Shelter Pilot workflow: non-clinical staff checked in participants and labeled testing materials (1). Laboratory technicians then swabbed the participants (2) and handed the sample to a testing team (3) who ran the assay. Participants left the testing area and could return to get their results from a non-clinical staff (4). The shelter champion helped recruiting participants and the registered nurse (RN) assessed symptoms and disclosed positive results and conducted case investigation. BinaxNOW Shelter Pilot workflow after consolidation: To streamline the process and reduce staff and supplies needed, Testers registered, checked-in, instructed participants to self-swab and handed assays to the Recorder. The shelter champion helped recruiting participants and the registered nurse (RN) assessed symptoms and disclosed positive results and conducted case investigation.

https://doi.org/10.1371/journal.pone.0264929.g001

We performed rRT-PCR tests for the first 40 participants for validation [27].

Result disclosure and BinaxNOW-positive participant investigation.

The RN, with the shelter champion, located BinaxNOW-positive residents, isolated them, and conducted a case investigation and contact tracing. When staff tested positive, the RN phoned them, gave them isolation guidelines, and elicited if they had close contacts with residents while infectious. We referred close contacts to I&Q.

We provided results within the same shift. PrimaryHealth sent automated emails and text messages to all participants with a link to their results. They sent reports to state and local health departments.

I&Q referral, confirmatory testing and outbreak team integration.

We defined outbreaks as at least three COVID-19 cases within a 14-day period in epidemiologically-linked residents and/or staff (i.e., persons with a close contact to a case or a member of risk cohort) [28].

We isolated symptomatic BinaxNOW-negative and all BinaxNOW-positive participants. The RN or shelter champion completed I&Q referrals. Upon arrival to I&Q, asymptomatic BinaxNOW-positive and symptomatic BinaxNOW-negative individuals received confirmatory tests (rRT-PCR or transcription mediated amplification, TMA). Confirmatory test-negative residents returned to the shelter.

Our team notified the shelter of any positive cases, who paused new admissions upon identification of two BinaxNOW-positive cases or one BinaxNOW-positive and one symptomatic BinaxNOW-negative case in a 14-day period.

Resident participation incentives.

We provided monetary incentives to residents who tested regularly (twice in the first two weeks of testing or >75% of tests over the last four weeks) in all but one shelter.

Iteration: Protocol modifications

Team members met daily on weekdays to discuss protocol modifications.

Modifications to staffing and supplies preparation.

Starting in week three, to improve the implementation of the pilot, we conducted online training sessions for shelter champions (COVID-19 basics and role overview).

Modifications to on-site workflow.

Starting in week five, to increase the number of shelters testing and enable maintenance without external (BHHI) resources, we reduced steps, supplies and staff [24]. We incorporated self-swabbing and reduced teams to five personnel: two Testers who, in addition to their original role, checked-in participants, instructed them on self-swabbing, and supervised self-swabbing; one Recorder; and one RN who, in addition to their original role, disclosed negative results. The shelter staff champion continued in their role. To optimize flow of patients and samples, we arranged the team in one station (Fig 1).

The Testers gave self-swabbing instructions at the time of collection. We provided no other prior training to participants. The participants immediately handed the swabs to the Tester after sampling to start the reaction.

To try to increase reach, we modified schedules.

Modifications to result disclosure and BinaxNOW-positive participant investigation.

In week six, in response to miscommunication about a positive case, we modified the protocol to ensure case identification: (1) the RN reviewed staff responsibilities, and all symptomatic BinaxNOW-negative and BinaxNOW-positive participants at each event; and (2) PrimaryHealth sent a report with symptomatic BinaxNOW-negative and all BinaxNOW-positive participants to the team every day.

Modifications to I&Q referral, confirmatory testing and outbreak team integration.

Starting in week three, because not all asymptomatic BinaxNOW-positive residents received confirmatory testing at the I&Q hotels, the RN completed all I&Q referrals and assessed adherence to confirmatory testing.

Implementation evaluation

Overall approach.

We used the RE-AIM framework to guide implementation planning and evaluation (Table 2). We established reach and effectiveness criteria to mirror shelter realities (reach measures). We evaluated case detection and outbreak control (effectiveness). For adoption, we focused on the number of shelters participating, and their ability to offer testing to eligible participants. For implementation, we assessed the consistency of protocols and adaptations made to increase reach and effectiveness. For maintenance, we assessed whether SFDPH was able to sustain the project without outside resources.

thumbnail
Table 2. RE-AIM framework to evaluate the implementation of rapid SARS-CoV2 antigen testing in homeless shelters, San Francisco, 2021.

https://doi.org/10.1371/journal.pone.0264929.t002

Data collection.

Reach: SFHSH provided de-identified individual resident census data (including demographics, date of birth, and admission and discharge dates), and staff census data. To assess how many residents were on-site during testing events, the testing team conducted a headcount within the facilities during testing events. To estimate staff who were on-site during daytime testing events, SFHSH provided a count of all staff working day shifts.

Effectiveness: We recorded symptoms and test results on PrimaryHealth. We obtained confirmatory test results from the electronic health record.

We also recorded the timeframe of implementation and number of shelters where we implemented BinaxNOW Testing (adoption), the rationale for changes to protocols, and their outcomes (implementation), and the number of shelters where SFDPH offered testing after the study period (maintenance).

Data analysis.

We analyzed data using Matlab [29].

We used census data for the study period corresponding to each shelter. We excluded residents admitted and discharged on the same day. We conducted Mann-Whitney U test to compare age, and chi-squared test to compare gender for the participating and non-participating resident populations. We included shelters with <10% missing gender data in gender comparisons based on the average percent and confidence interval across shelters. We were unable to examine race and ethnicity due to incomplete data.

To determine the period participant residents lived in a shelter, we matched them to the shelter census database using their date of birth. We used the mean number of residents on-site. We assumed participant staff had continuous employment over the study period.

To estimate adherence to twice-weekly testing, we calculated the proportion of tests out of the total number of testing events offered per shelter. We included only shelters with at least six testing events. Because some shelters had high resident turnover, we included only those individuals who remained in the shelter throughout the shelter’s testing period.

All reported ranges refer to the range of values across shelters.

Results

Reach

Identification and characterization of total eligible participants.

We implemented the pilot at ten of 12 eligible shelters during the study period. During the study, 828 unique residents lived in and 435 staff worked at these ten shelters. The mean age among residents and staff was 44 years. Less than one third (28.8%) of residents and nearly half (49.8%) of staff were cis women (Table 3).

thumbnail
Table 3. Characteristics of shelter residents and staff during implementation of rapid SARS-CoV2 antigen testing at homeless shelters, San Francisco, 2021.

https://doi.org/10.1371/journal.pone.0264929.t003

Identification and characterization of on-site sample during testing period.

On average, the daily census included 645 residents. Over half (57.9% n = 636 in 6 shelters) of residents remained in shelters for the duration of the study (Table 3). Less than half of residents (45.2%, range 10.9% to 81.9%) and one third of staff (31.3%, range 5.4% to 68%) were on-site during testing events (Table 4).

thumbnail
Table 4. Participation in shelters included in the pilot implementation of rapid SARS-CoV2 antigen testing, San Francisco, 2021.

https://doi.org/10.1371/journal.pone.0264929.t004

Completion of twice-weekly testing.

Half of eligible residents (47.5%, range 16.5% to 81.4%) and shelter staff (53.3%, range 9.6% to 128%—the latter meaning some staff off their shift tested) participated in testing at least once. On average, one-quarter (24.1%, range 7.3% to 66.7%) of residents and one-fifth (19.6%, range 5.8% to 45.8%) of the staff participated in each event. More than half of the residents (53.2%, range 34.0% to 81.9%) and dayshift staff (62.8%, range 17.6% to 255%) on-site participated per event (Table 4, S1 File). We found no significant demographic differences between participant and non-participant or eligible populations (S1 Appendix).

Residents completed on average 36.8% and staff 34.1% of the tests offered in the shelters where we tested at least three weeks during the study period (n = 196 for residents, n = 198 for staff). Among these participants, most tested only once; only 4.1% of residents and 3.0% of staff tested twice-weekly during the study (i.e., 100% adherence, Fig 2A, S1 File). Participation was stable over time, although two shelters showed a noticeable increase (shelter 2) or decrease (shelter 5) in participation (Fig 2B).

thumbnail
Fig 2. Participation in rapid SARS-CoV2 antigen testing and positive cases over time at homeless shelters, San Francisco, 2021.

A) Histogram of adherence (percentage of tests taken by a participant from tests available to them; n = 394, within 6 shelters with 6 or more testing events). B) Number of participants over testing events per shelter. Missing bars indicate no testing event in that date. Shelters 5–10 were added to the BinaxNOW Testing Pilot after the start of the study period. *: Scheduled testing times were modified after indicated event. C) 3 outbreaks and 1 isolated BinaxNOW-positive case were identified. All outbreaks were resolved. No cases were identified in the other 6 shelters during the study period.

https://doi.org/10.1371/journal.pone.0264929.g002

Effectiveness

Identification of positives and effective isolation.

We performed concomitant rRT-PCR on the first 40 participants, all of whom were asymptomatic and BinaxNOW negative. Two (5%) residents tested positive on rRT-PCR. Follow-up tests three days later in I&Q found that the first resident tested negative on BinaxNOW and rRT-PCR, and the second participant, who subsequently developed symptoms, tested positive on both tests.

BinaxNOW prevalence was 2.2%: ten residents (2.5%), and four staff (1.8%) in four different shelters tested positive (Fig 2C). Of the 14 BinaxNOW-positive participants, only one resident and two staff were symptomatic. We referred eight of ten residents to I&Q on the same date of the event. Of the two not referred, one resident received isolation guidance and left the shelter. The second resident was not isolated until five days after their positive test due to miscommunication. We identified no resident close contacts during case investigations. The float RN contacted all BinaxNOW-positive staff.

One symptomatic BinaxNOW-negative resident was referred to I&Q. The confirmatory test was negative, and they returned to the shelter.

No residents received a COVID-19 diagnosis outside of BinaxNOW testing during the study; three staff members did.

Identification of incongruent confirmatory tests.

Of the eight asymptomatic BinaxNOW-positive residents referred to I&Q, three were confirmed positive; two did not receive a confirmatory test; and three tested negative on confirmatory testing. Two of the three BinaxNOW-positive/confirmatory-negative residents were BinaxNOW-positive in subsequent testing events and were referred to I&Q again, where they tested negative by confirmatory tests.

Identification of cases and outbreaks.

We identified cases in four of the ten shelters. Three shelters met criteria for outbreaks (i.e., ≥ three cases) but no outbreak exceeded five cases (Fig 2C). The three shelters with outbreaks were large, had transient resident populations, or had high participation (Table 4). One shelter had one isolated positive case.

Adoption

Shelter-level offering of BinaxNOW shelter pilot.

We implemented testing in ten shelters within weeks of initiating planning. We delayed staff testing for one week for staff to complete release forms.

Implementation

Adaptation and fidelity of implementation.

The testing team adopted the new workflow (Fig 1) in all shelters within a week of trying it in one shelter. These changes led to a significant decrease in staffing and supply needs.

We did not see an increase in participation after changes in scheduled testing times due to shelter champion input (Fig 2B).

We replicated the same workflow and protocol modifications in all shelters with few modifications (e.g., incentive structure).

We conducted 1,142 tests before self-swabbing implementation, of which 8 were positive and 4 were false positive (0.70% true positivity). We conducted 562 tests by self-swabbing, of which 4 were positive and 1 was a false positive (0.71% true positivity).

The testing team and shelter champions adopted changes aiming to address deviations to the protocols (e.g., missing confirmatory testing at I&Q or delaying positive case disclosure). We completed all resident confirmatory tests after week three and contacted all BinaxNOW-positive during the event after week six.

Maintenance

Transference of BinaxNOW testing to SFDPH.

SFDPH was able to sustain testing in all ten shelters and expanded to all eligible shelters with limited support from BHHI (two non-clinical staff and PrimaryHealth contract) after the end of the study period.

Discussion

In a pilot twice-weekly BinaxNOW antigen testing in congregate homeless shelters in San Francisco, we were able to implement testing, detect SARS-CoV-2 infections, isolate individuals, and identify outbreaks.

The BinaxNOW testing pilot reached approximately one quarter of eligible residents and staff, and one-half of those on-site. Limited reach could have resulted from residents leaving the shelter (residents had to check in every 48 hours to retain their beds). Participation levels varied largely across shelters, and in some shelters over time. This may have been due to shelter culture, the involvement level of shelter champions, or unmeasured characteristics of the residents. In some shelters, testing drew non-shift staff for testing.

Although approximately half of residents and staff tested at least once, there was a low adherence to twice-weekly testing. This may be due to our inability to convey the rationale behind twice weekly testing, discomfort with testing, a recognition of the implications of low community prevalence, or competing priorities. Other incentive structures (e.g., incentives at each event or non-monetary incentives instead of delayed financial rewards) may be more motivating. Twice-weekly cadence may be unrealistic for some shelters. Models that indicate preventive effects depend on twice weekly testing may overestimate the true effectiveness of testing programs.

The effective reach of the BinaxNOW shelter pilot was higher than with prior testing regimens (five shelters once a month with an average uptake of 35% of residents (and no staff) at each event; S. Strieff, personal communication, March 22nd, 2021). Due to rapid turnaround, we reduced delays in isolation of infectious individuals compared to previous workflows (Table 1). These responses may have contributed to preventing large outbreaks, despite a relatively narrow reach of testing.

Despite mid to low community prevalence (one-week average 30.9 and 7.7 new cases per day per 100,000 during the first and last week of the study, respectively) [30], we detected three outbreaks and one isolated case. The largest had five cases, fewer than prior outbreaks [11, 16, 31, 32]. This may have been a result of our intervention or other changes instituted since early in the pandemic (reduced capacity and improved adherence to mask-wearing) [33]. We detected most cases in asymptomatic participants, highlighting the limitations of symptom screening for isolation of infectious individuals [16]. While BinaxNOW is less sensitive than nucleic acid amplification tests, it appears effective at detecting infectious individuals [27]. Detecting asymptomatic individuals is key to interrupting transmission chains as asymptomatic individuals may account for more than half of all transmission [34].

We detected two of 40 individuals who were BinaxNOW-negative but rRT-PCR-positive. However, one of these was consistent with a prior infection [35], leading to unnecessary isolation, a potential problem with highly sensitive RT-PCR testing. The other individual’s test patterns align with early infection, prior to high infectivity. High adherence to twice-weekly testing would be needed to detect these early cases.

We found a relatively high false positive rate, consistent with concerns of using BinaxNOW in low community prevalence and among asymptomatic persons [36]. Three of eight asymptomatic individuals were BinaxNOW-positive/confirmatory-negative, suggesting false BinaxNOW positives. This is costly in terms of transportation and I&Q requirements and may have undermined trust in testing and the healthcare system, raising questions about BinaxNOW testing during periods of low community prevalence. We recommend continuous dialogue and education of participants on BinaxNOW testing strengths and limitations.

As a result of the strong collaboration between academic, public health and homeless service providers, we were able to implement and adapt the pilot, allowing us to minimize errors, increase adoption and reduce resources, which contributed to maintenance. Self-swabbing had no noticeable effect on positivity rates or the ability to detect outbreaks. The SFDPH offered twice-weekly testing in all eligible shelters with little external support after the study, suggesting maintenance of this intervention. We found the web-based test reporting system (PrimaryHealth) to be instrumental to conduct mandatory reporting to local and state officials, and track data. Despite our efforts to streamline staff and resources, BinaxNOW screening testing still requires significant staff and resources. Further implementation studies should evaluate modifications to reduce workflow and staff and consider further task-shifting to non-clinical partners.

The study has several limitations. We focused on implementation of BinaxNOW testing rather than comparing different strategies. Thus, the contribution of twice-weekly testing to preventing and resolving outbreaks is unclear. While infection transmission models suggest that twice-weekly testing is necessary [1618], we tested a lower proportion of eligible participants than recommended by models [18]. However, this may reflect the reality of testing regimens at homeless shelters, where residents do not tend to stay during the days. Those who leave during the day could be at higher risk of contracting SARS-COV-2. We did not study the causes (e.g., low interest, previous COVID-19 infections, testing fatigue) and consequences (e.g., transmission) of low participation. We estimated shelter residents present by headcounts for three weeks; these may not be accurate. We had limited demographic data, which limited our ability to detect differences. In addition, BinaxNOW sensitivity is lower than nucleic acid amplification methods [21], implying that we could have missed infections within the participant population. Furthermore, we conducted our study for six weeks, in one jurisdiction which had implemented aggressive COVID prevention protocols in shelters (including reduced capacity and universal masking) during a period of low to moderate COVID-19 community incidence that preceded vaccine rollouts. Other settings and contexts could have different results. However, the lack of large-scale outbreaks is reassuring.

As the COVID-19 pandemic evolves, the trade-offs of frequent testing in congregate shelters will change. Effectiveness (and cost-effectiveness) of rapid testing for isolation and outbreak prevention should thus be evaluated in the specific setting context. Fluctuations in community transmission affect false positive and negative rates, and determine the probability of infection for individuals. Vaccination campaigns and other interventions may require a change in resource allocation. Vaccinations, as well as previous exposure, can affect the susceptibility of individuals to severe illness and change the population at risk. The rise of new variants has the potential of changing the epidemiology of the disease, as well as the sensitivity of diagnostic tests. While we expect rapid test and response programs to be less cost-effective with high vaccination rates and low community transmission, all these factors should be considered when implementing measures to prevent outbreaks in congregate settings.

Our pilot allowed for detection and isolation of COVID-19 cases among staff and residents. This intervention could be applied to other congregate settings where there is a high turnover of residents, a higher risk of transmission, and challenges to physical distancing [37]. Lessons learned from our rapid test and respond model, and application of an implementation framework matching the cascade of care could be applied to how we approach detection and response for other infectious diseases in this population with additional considerations of how to assign staff and resources to needs. The partnership between an academic group, and representation from city departments that manage public health and the shelters, with additional training and support for a shelter champion could be applied to vaccination or other public health efforts. Low-barrier frequent testing with rapid turnaround is an important public health intervention to improve accessibility and availability of testing and rapid identification and isolation of COVID-19 positive cases in shelters.

Supporting information

S1 Appendix. Demographic description of participant and eligible populations.

https://doi.org/10.1371/journal.pone.0264929.s001

(DOCX)

S1 File. Census and participant number.

Individual shelter participation per event and total census population. This data is shown in Fig 2B. Percentage of tests taken. Individual datapoints shown in Fig 2A.

https://doi.org/10.1371/journal.pone.0264929.s002

(XLSX)

Acknowledgments

Sandra Nicholson, Lunden Stiggers, Rocio Novoa, Cesar Cardenas, Gabriela Alvarez, Jorge Contreras, Celeste Enriquez, Tamar Schnepp, Lena Simbe and Princess Luna provided on the ground input for the implementation of this project. Jennifer Coffey, Louis Bracco, Lisa Rachowitz, Scott Walton, Howard Chen, Elisabet Medina, Ronald Thai, Ashley Scarborough, facilitated data availability, coordinated work with multiple stakeholders and gave feedback throughout. Carina Marquez, Genay Pilarowski and Jackie Martinez provided technical advice and support. This project would not have been possible without the help of shelter leadership, especially the shelter champions, and community volunteers.

References

  1. 1. Aldridge RW, Story A, Hwang SW, Nordentoft M, Luchenski SA, Hartwell G, et al. Morbidity and mortality in homeless individuals, prisoners, sex workers, and individuals with substance use disorders in high-income countries: a systematic review and meta-analysis. Lancet. 2018;391(10117):241–50. Epub 2017/11/16. pmid:29137869.
  2. 2. Tibbetts KK, Ottoson RA, Tsukayama DT. Public Health Response to Tuberculosis Outbreak among Persons Experiencing Homelessness, Minneapolis, Minnesota, USA, 2017–2018. Emerg Infect Dis. 2020;26(3):420–6. Epub 2020/02/25. pmid:32091365.
  3. 3. Baggett TP, Liauw SS, Hwang SW. Cardiovascular Disease and Homelessness. J Am Coll Cardiol. 2018;71(22):2585–97. Epub 2018/06/02. pmid:29852981.
  4. 4. Peak CM, Stous SS, Healy JM, Hofmeister MG, Lin Y, Ramachandran S, et al. Homelessness and Hepatitis A-San Diego County, 2016–2018. Clin Infect Dis. 2020;71(1):14–21. Epub 2019/08/15. pmid:31412358.
  5. 5. Hahn JA, Kushel MB, Bangsberg DR, Riley E, Moss AR. BRIEF REPORT: the aging of the homeless population: fourteen-year trends in San Francisco. J Gen Intern Med. 2006;21(7):775–8. Epub 2006/07/01. pmid:16808781.
  6. 6. Henry M, Watt R, Mahathey A, Ouellette J, Sitler A. The 2019 Annual Homeless Assessment (AHAR) Report. Washington, DC: The US Department of Housing and Urban Development. 2020.
  7. 7. Leung CS, Ho MM, Kiss A, Gundlapalli AV, Hwang SW. Homelessness and the response to emerging infectious disease outbreaks: lessons from SARS. J Urban Health. 2008;85(3):402–10. Epub 2008/03/19. pmid:18347991.
  8. 8. Tsai J, Wilson M. COVID-19: a potential public health problem for homeless populations. Lancet Public Health. 2020;5(4):e186–e7. Epub 2020/03/15. pmid:32171054.
  9. 9. Perri M, Dosani N, Hwang SW. COVID-19 and people experiencing homelessness: challenges and mitigation strategies. CMAJ. 2020;192(26):E716–E9. Epub 2020/07/01. pmid:32601252 from Inner City Health Associates for providing and directing medical care for people experiencing homelessness in Toronto. No other competing interests were declared.
  10. 10. Karb R, Samuels E, Vanjani R, Trimbur C, Napoli A. Homeless Shelter Characteristics and Prevalence of SARS-CoV-2. West J Emerg Med. 2020;21(5):1048–53. Epub 2020/09/25. pmid:32970553.
  11. 11. Imbert E, Kinley PM, Scarborough A, Cawley C, Sankaran M, Cox SN, et al. Coronavirus Disease 2019 (COVID-19) Outbreak in a San Francisco Homeless Shelter. Clin Infect Dis. 2020. Epub 2020/08/04. pmid:32744615.
  12. 12. Bodkin C, Mokashi V, Beal K, Wiwcharuk J, Lennox R, Guenter D, et al. Pandemic Planning in Homeless Shelters: A pilot study of a COVID-19 testing and support program to mitigate the risk of COVID-19 outbreaks in congregate settings. Clin Infect Dis. 2020. Epub 2020/06/09. pmid:32511704.
  13. 13. Larremore DB, Wilder B, Lester E, Shehata S, Burke JM, Hay JA, et al. Test sensitivity is secondary to frequency and turnaround time for COVID-19 screening. Sci Adv. 2021;7(1). Epub 2020/11/22. pmid:33219112.
  14. 14. Paltiel AD, Zheng A, Walensky RP. Assessment of SARS-CoV-2 Screening Strategies to Permit the Safe Reopening of College Campuses in the United States. JAMA Netw Open. 2020;3(7):e2016818. Epub 2020/08/01. pmid:32735339.
  15. 15. Chapman LAC, Kushel M, Cox SN, Scarborough A, Cawley C, Nguyen T, et al. Comparison of infection control strategies to reduce COVID-19 outbreaks in homeless shelters in the United States: a simulation study. medRxiv. 2020:2020.09.28.20203166.
  16. 16. Baggett TP, Scott JA, Le MH, Shebl FM, Panella C, Losina E, et al. Management Strategies for People Experiencing Sheltered Homelessness during the COVID-19 Pandemic: Clinical Outcomes and Costs. medRxiv. 2020. Epub 2020/08/21.
  17. 17. Chin ET, Huynh BQ, Chapman LAC, Murrill M, Basu S, Lo NC. Frequency of routine testing for SARS-CoV-2 to reduce transmission among workers. medRxiv. 2020. Epub 2020/06/09.
  18. 18. Paul P, Mosites E, Laws RL, Scobie H, Slayton RB, Clarke KEN. Modeling the frequency and number of persons to test to detect and control COVID-19 outbreaks in congregate settings. bioRxiv. 2020:2020.11.20.391011.
  19. 19. Esbin MN, Whitney ON, Chong S, Maurer A, Darzacq X, Tjian R. Overcoming the bottleneck to widespread testing: a rapid review of nucleic acid testing approaches for COVID-19 detection. RNA. 2020;26(7):771–83. Epub 2020/05/03. pmid:32358057.
  20. 20. Centers for Disease Control and Prevention. Interim Guidance for Antigen Testing for SARS-CoV-2 2020 [cited 2021 March 20th]. https://www.cdc.gov/coronavirus/2019-ncov/lab/resources/antigen-tests-guidelines.html.
  21. 21. Pilarowski G, Lebel P, Sunshine S, Liu J, Crawford E, Marquez C, et al. Performance characteristics of a rapid SARS-CoV-2 antigen detection assay at a public plaza testing site in San Francisco. medRxiv. 2020. Epub 2020/11/12. pmid:33173911.
  22. 22. Fuchs JD, Carter HC, Evans J, Graham-Squire D, Imbert E, Bloome J, et al. Assessment of a Hotel-Based COVID-19 Isolation and Quarantine Strategy for Persons Experiencing Homelessness. JAMA Netw Open. 2021;4(3):e210490. Epub 2021/03/03. pmid:33651111.
  23. 23. Glasgow RE, Estabrooks PE. Pragmatic Applications of RE-AIM for Health Care Initiatives in Community and Clinical Settings. Prev Chronic Dis. 2018;15:E02. Epub 2018/01/05. pmid:29300695.
  24. 24. Benioff Homelessness and Housing Initiative NHCftHC. Antigen Testing in Congregate Shelters: Process Outline and Implementation Playbook2021.
  25. 25. Centers for Disease Control and Prevention. CDC Facilities COVID-19 Screening 2021 [cited 2021 March 20th]. https://www.cdc.gov/screening/index.html.
  26. 26. Diagnostics A. Abbott BinaxNOW COVID-19 Ag package insert, version 2.2 2020 [cited 2021 March 20th]. https://www.fda.gov/media/141570/download.
  27. 27. Pilarowski G, Marquez C, Rubio L, Peng J, Martinez J, Black D, et al. Field performance and public health response using the BinaxNOW TM Rapid SARS-CoV-2 antigen detection assay during community-based testing. Clin Infect Dis. 2020. Epub 2020/12/29. pmid:33367619.
  28. 28. Health CDoP. Non-Healthcare Congregate Setting COVID-19 Outbreak Definitions 2020 [cited 2021 April 12th]. https://www.cdph.ca.gov/Programs/CID/DCDC/Pages/COVID-19/OutbreakDefinitionandReportingGuidance.aspx.
  29. 29. The MathWorks I. Matlab. R2020b ed.
  30. 30. Division SFDoPH-PH. COVID-19 Cases: Summarized by Date, Transmission and Case Disposition. 2021.
  31. 31. Tobolowsky FA, Gonzales E, Self JL, Rao CY, Keating R, Marx GE, et al. COVID-19 Outbreak Among Three Affiliated Homeless Service Sites—King County, Washington, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(17):523–6. Epub 2020/05/01. pmid:32352954 Journal Editors form for disclosure of potential conflicts of interest. Helen Chu reports personal consultant fees from Merck and GlaxoSmithKline and a research grant from Sanofi Pasteur. No other potential conflicts of interest were disclosed.
  32. 32. Emergency Operations Center, County of Santa Clara. County of Santa Clara Reports Significant Increase in COVID-19 cases in Congregate Settings, Including Homeless Shelters and Long-Term Care Facilities 2021 [cited 2021 March 30th]. https://www.sccgov.org/sites/covid19/Pages/press-release-12-3-2020-significant-increase-COVID19-in-congregate-settings.aspx.
  33. 33. San Francisco Department of Homelessness and Supportive Housing. San Francisco’s COVID-19 Response 2021 [cited 2021 April 5th]. https://hsh.sfgov.org/covid-19/.
  34. 34. Johansson MA, Quandelacy TM, Kada S, Prasad PV, Steele M, Brooks JT, et al. SARS-CoV-2 Transmission From People Without COVID-19 Symptoms. JAMA Netw Open. 2021;4(1):e2035057. Epub 2021/01/08. pmid:33410879.
  35. 35. Centers for Disease Control and Prevention. Interim Guidance for SARS-CoV-2 Testing in Homeless Shelters and Encampments 2021 [cited 2021 March 26th]. https://www.cdc.gov/coronavirus/2019-ncov/community/homeless-shelters/testing.html.
  36. 36. Peeling RW, Olliaro PL, Boeras DI, Fongwen N. Scaling up COVID-19 rapid antigen tests: promises and challenges. Lancet Infect Dis. 2021. Epub 2021/02/27. pmid:33636148.
  37. 37. Centers for Disease Control and Prevention. Interim Public Health Recommendations for Fully Vaccinated People 2021 [cited 2021 March 26th]. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/fully-vaccinated-guidance.html.