- Open Access
Barriers to recruitment, retention and intervention delivery in a randomized trial among patients with firearm injuries
Injury Epidemiology volume 8, Article number: 37 (2021)
We discuss barriers to recruitment, retention, and intervention delivery in a randomized controlled trial (RCT) of patients presenting with firearm injuries to a Level 1 trauma center. The intervention was adapted from the Critical Time Intervention and included a six-month period of support in the community after hospital discharge to address recovery goals. This study was one of the first RCTs of a hospital- and community-based intervention provided solely among patients with firearm injuries.
Barriers to recruitment included limited staffing, coupled with wide variability in length of stay and admission times, which made it difficult to predict the best time to recruit. At the same time, more acutely affected patients needed more time to stabilize in order to determine whether eligibility criteria were met. Barriers to retention included insufficient patient resources for stable housing, communication and transportation, as well as limited time for patients to meet with study staff to respond to follow-up surveys. These barriers similarly affected intervention delivery as patients who were recruited, but had fewer resources to help with recovery, had lower intervention engagement. These barriers fall within the broader context of system avoidance (e.g., avoiding institutions that keep formal records). Since the patient sample was racially diverse with the majority of patients having prior criminal justice system involvement, this may have precluded active participation from some patients, especially those from communities that have been subject to long and sustained history of trauma and racism. We discuss approaches to overcoming these barriers and the importance of such efforts to further implement and evaluate hospital-based violence intervention programs in the future.
Developing strategies to overcome barriers to data collection and ongoing participant contact are essential to gathering robust information to understand how well violence prevention programs work and providing the best care possible for people recovering from injuries.
The Helping Individuals with Firearm Injuries (HiFi) study was launched to better understand the effectiveness of hospital- and community-based programs in reducing violence and subsequent injuries during and after recovery from gunshot wounds (GSWs) (Rowhani-Rahbar et al. 2016; Lyons et al., 2021). The intervention was based on the Critical Time Intervention and included a phased intensity, with hospital and community-based interactions with the Support Specialist (Herman and Conover 2011; Tomita and Herman 2012). The study was conducted among patients presenting to Harborview Medical Center, a Level 1 trauma center in Seattle, Washington. The study is described in detail in Lyons et al. (2020), Lyons et al. (2021). The intervention goal was to support overall health and well-being, while the primary outcome was preventing arrest over two-years following hospital discharge, with a secondary outcome of preventing injury recidivism.
Intervention participants were offered six-months of support, beginning with a motivational interviewing-based goal-setting discussion, during which they met with the Support Specialist to address a broad range of recovery goals and connect to resources in the community after discharge. They were compared to people who were offered a list of referral services. Both groups had access to hospital-based social workers. The hospital did not offer a separate Hospital-Based Violence Intervention program (HVIP). Self-reported interview data were linked with Washington State administrative records documenting arrests and hospitalizations.
Several studies examined strategies for improving recruitment and retention with patients who sustain trauma. (McFarlane 2007; Clough et al. 2011; Monopoli et al. 2018). Other studies examined enrollment of people from minority racial and ethnic populations, who constituted 46% of the study sample in HiFi. Those studies point to understanding cultural context, engaging stakeholders, and being intentional in recruitment (Daunt 2003; Dancy et al. 2004; Durant et al. 2007; Heller et al. 2014). Barriers also exist more broadly in conducting RCTs, given their complexity (De Salis et al. 2008; Howard et al. 2009; Sibai et al. 2012; Thoma et al. 2010). Though considerable effort went into addressing these concerns during the study, challenges persisted.
High rates of recruitment and retention are possible in firearm injury studies, though challenges in our study were likely more systemic (Carter et al. 2015; Cunningham et al. 2015). Most participants in our sample (72.8%) had a prior arrest, pointing to a possible climate of distrust for institutions especially considering the long and sustained history of trauma and racism (Goffman 2009). At the same time, concerns regarding judgment, stigma, and loss of privacy may have dissuaded participants from help-seeking within the healthcare system (Jacoby et al. 2020). As such, participants may have engaged in “system avoidance,” avoiding institutions that keep formal records (Brayne 2014). One form of system avoidance is providing incorrect identifying and contact information to the healthcare and research staff. In our commentary we discuss the barriers we encountered during the trial and our attempts to resolve them. A summary of these barriers and our approaches to overcome them are provided in Table 1.
Patients with GSWs arrived at all hours each day. Knowing when a participant was arriving did not ensure timely access to approach for enrollment. For the first 2.5 years of the study, funding only allowed for two part-time research assistants and one Support Specialist. Near the end of the study, four temporary research assistants were hired. This allowed for short-term, around the clock coverage. Initial participants may have been missed due to lack of 24/7 staff coverage. In some cases, patients were discharged while awaiting confirmation of eligibility.
Research staff made use of online records and flexible schedules to track patients prior to discharge. During enrollment, research staff consulted medical providers about possible imminent discharge in order to time recruitment. Research staff maintained good rapport with family members who may influence participation. Study brochures were provided. Patients discharged before approach were later contacted for enrollment, either using contact information from medical records, or by attempting to meet patients at scheduled outpatient appointments.
The study only required one form of direct or collateral contact information. Housing instability, including homelessness, transiency, and eviction often coincided with more challenges in communication, including unstable access to internet for emails or to cellular devices. Frequent communication attempts were time-consuming, with staff regularly maximizing the allowable number of contact attempts without successful contacts. Even participants with greater stability were challenging to retain due to work schedules. Inevitably, some participants were unreachable after their baseline visit.
Where possible, intervention visits were coupled with follow-up medical appointments to maximize subject time and help boost retention. Research staff were often able to visit participants in the field, but the tradeoff was potentially missing new admissions. For follow-up visits, data collection was done either in-person, by phone or online. We utilized text messages, email, and social media for communications, and contacted participants outside of normal work hours.
Intervention delivery barriers
As a patient-centered intervention, there were no limits to the areas of concern that participants could identify for their recovery. Community-based professionals across different disciplines helped identify available community resources, yet some concerns were consistently hard to address (e.g., temporary housing or shelters). While many intervention participants requested help submitting claims for crime victim’s compensation, claims were sometimes delayed or denied due to perceived lack of cooperation with law enforcement, prior criminal history, or delays in police report filings. For participants who were unable to remain employed because of their injuries, these delays could be significant. The Support Specialist attempted to maintain rapport in all areas, even if an area of concern could not be fully addressed.
Research staff notified the Support Specialist in advance of initial approach. The Support Specialist made patient contact as quickly as possible, ideally in-person and during the index hospitalization to build a strong helping relationship and enhance retention. If an in-person option was not possible, phone-based introductory calls were conducted successfully. Video conferencing was also an available option. The Support Specialist focused on the issues which could be addressed in a timely manner. This would sometimes lead to participants discovering options to address longer-term problems (e.g., short-term housing).
Violence is a pervasive public health problem and leading cause of morbidity and mortality in the U.S. (Sumner et al. 2015). A violent injury treated in the emergency department often represents the only access point to the healthcare system for those most at risk for violent re-injury (Rowhani-Rahbar et al. 2015; Cunningham et al. 2012; Garth et al. 2020). Up to 50% of patients injured by violence may suffer violent re-injury within 5 years following hospital discharge (Corbin et al. 2011). At the same time, the threat of violent re-injury cannot be discussed independently from factors such as systemic and institutional racism, affecting engagement and injury outcomes (Jacoby et al. 2018). By understanding the depths of the barriers that exist, we can better gauge the efforts needed to overcome them. More studies are needed to provide evidence of effectiveness for funding of HVIPs and ensure that healthcare services sufficiently meet patient needs, making trauma-informed approaches an integral part of trauma centers (Dicker 2016; Juillard et al. 2016). Follow-up retention is critical to both the intervention delivery and assessment of study outcomes, and requires constant attention to successfully implement.
Availability of data and materials
Data are not available for distribution.
Helping Individuals with Firearm Injuries
Brayne S. Surveillance and System Avoidance: Criminal Justice Contact and Institutional Attachment. Am Sociol Rev. 2014;79(3):367–91. https://0-doi-org.brum.beds.ac.uk/10.1177/0003122414530398.
Carter PM, Walton MA, Roehler DR, Goldstick J, Zimmerman MA, Blow FC, et al. Firearm violence among high-risk emergency department youth after an assault injury. Pediatrics. 2015;135(5):805–15. https://0-doi-org.brum.beds.ac.uk/10.1542/peds.2014-3572.
Clough A, Wagman J, Rollins C, Barnes J, Connor-Smith J, Holditch-Niolon P, et al. The share project: maximizing participant retention in a longitudinal study with victims of intimate partner violence. Field Methods. 2011;23(1):86–101. https://0-doi-org.brum.beds.ac.uk/10.1177/1525822X10384446.
Corbin TJ, Rich JA, Bloom SL, Delgado D, Rich LJ, Wilson AS. Developing a trauma-informed, emergency department-based intervention for victims of urban violence. J Trauma Dissociation. 2011;12(5):510–25. https://0-doi-org.brum.beds.ac.uk/10.1080/15299732.2011.593260.
Cunningham RM, Carter PM, Ranney M, Zimmerman MA, Blow FC, Booth BM, et al. Violent reinjury and mortality among youth seeking emergency department care for assault-related injury: A 2-year prospective cohort study. JAMA Pediatr. 2015;169(1):63–70. https://0-doi-org.brum.beds.ac.uk/10.1001/jamapediatrics.2014.1900.
Cunningham RM, Chermack ST, Zimmerman MA, Shope JT, Bingham CR, Blow FC, et al. Brief motivational interviewing intervention for peer violence and alcohol use in teens: one-year follow-up. Pediatrics. 2012;129(6):1083–90. https://0-doi-org.brum.beds.ac.uk/10.1542/peds.2011-3419.
Dancy BL, Wilbur J, Talashek M, Bonner G, Barnes-Boyd C. Community-based research: barriers to recruitment of African Americans. Nurs Outlook. 2004;52(5):234–40. https://0-doi-org.brum.beds.ac.uk/10.1016/j.outlook.2004.04.012.
Daunt DJ. Ethnicity and recruitment rates in clinical research studies. Appl Nurs Res. 2003;16(3):189–95. https://0-doi-org.brum.beds.ac.uk/10.1016/S0897-1897(03)00042-9.
De Salis I, Tomlin Z, Toerien M, Donovan J. Qualitative research to improve RCT recruitment : issues arising in establishing research collaborations. Contemp Clin Trials. 2008;29(5):663–70. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cct.2008.03.003.
Dicker RA. Hospital-based violence intervention: an emerging practice based on public health principles. Trauma Surg Acute Care Open. 2016;1(1). https://0-doi-org.brum.beds.ac.uk/10.1136/tsaco-2016-000050.
Durant RW, Davis RB, Marie D, et al. Participation in research studies : factors associated with failing to meet minority recruitment goals. Ann Epidemiol. 2007;1(8):634–42. https://0-doi-org.brum.beds.ac.uk/10.1016/j.annepidem.2007.02.003.
Garth N, Annette M, David A, Walker GN. A case for risk stratification in survivors of firearm and interpersonal violence in the urban environment. West J Emerg Med. 2020;21(6):132–40. https://0-doi-org.brum.beds.ac.uk/10.5811/westjem.2020.8.45041 Published online.
Goffman A. On the run: wanted men in a Philadelphia ghetto. Am Sociol Rev. 2009;74(3):339–57. https://0-doi-org.brum.beds.ac.uk/10.1177/000312240907400301.
Heller C, Balls-Berry JE, Dumbauld J, et al. Strategies addressing barriers to clinical trial enrollment of underrepresented populations : a systematic review. Contemp Clin Trials. 2014;39(2):169–82. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cct.2014.08.004.
Herman DB, Conover S. Gorroochurn, et al. randomized trial of critical time intervention to prevent homelessness after hospital discharge. Psychiatr Serv. 2011;62(7):3–9. https://0-doi-org.brum.beds.ac.uk/10.1176/ps.62.7.pss6207_0713.
Howard L, de Salis I, Tomlin Z, Thornicroft G, Donovan J. Why is recruitment to trials difficult? An investigation into recruitment difficulties in an RCT of supported employment in patients with severe mental illness. Contemp Clin Trials. 2009;30(1):40–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cct.2008.07.007.
Jacoby SF, Rich JA, Webster JL, Richmond TS. ‘Sharing things with people that I don’t even know’: help-seeking for psychological symptoms in injured black men in Philadelphia. Ethnicity Health. 2020;25(6):777–95. https://0-doi-org.brum.beds.ac.uk/10.1080/13557858.2018.1455811.
Jacoby SF, Richmond TS, Holena DN, Kaufman EJ. A safe haven for the injured? Urban trauma care at the intersection of healthcare, law enforcement, and race. Soc Sci Med. 2018;199:115–22. https://0-doi-org.brum.beds.ac.uk/10.1016/j.socscimed.2017.05.037.
Juillard C, Cooperman L, Allen I, Pirracchio R, Henderson T, Marquez R, et al. A decade of hospital-based violence intervention: benefits and shortcomings. J Trauma Acute Care Surg. 2016;81(6):1156–61. https://0-doi-org.brum.beds.ac.uk/10.1097/TA.0000000000001261.
Lyons VH, Benson LR, Griffin E, Floyd AS, Kiche SW, Haggerty KP, et al. Fidelity assessment of a social work–led intervention among patients with firearm injuries. Res Soc Work Pract. 2020;30(6):678–87. https://0-doi-org.brum.beds.ac.uk/10.1177/1049731520912002.
Lyons VH, Floyd AS, Griffin E, Wang J, Hajat A, Carone M, et al. Helping individuals with firearm injuries a cluster randomized trial. J Trauma Acute Care Surg. 2021;90(4):722–30. https://0-doi-org.brum.beds.ac.uk/10.1097/TA.0000000000003056.
Mcfarlane J. Strategies for successful recruitment and retention of abused women for longitudinal studies. Issues Ment Health Nurs. 2007;28(8):883–97. https://0-doi-org.brum.beds.ac.uk/10.1080/01612840701493527.
Monopoli WJ, Myers RK, Paskewich BS, Bevans KB, Fein JA. Generating a core set of outcomes for hospital-based violence intervention programs. J Interpers Violence. 2018. https://0-doi-org.brum.beds.ac.uk/10.1177/0886260518792988 Published online.
Rowhani-Rahbar A, Fan MD, Simonetti JA, Lyons VH, Wang J, Zatzick D, et al. Violence perpetration among patients hospitalized for unintentional and assault-related firearm injury: A case-control study and a cohort study. Ann Intern Med. 2016;165(12):841–7. https://0-doi-org.brum.beds.ac.uk/10.7326/M16-1596.
Rowhani-Rahbar A, Zatzick D, Wang J, Mills BM, Simonetti JA, Fan MD, et al. Firearm-related hospitalization and risk for subsequent violent injury, death, or crime perpetration: A cohort study. Ann Intern Med. 2015;162(7):492–500. https://0-doi-org.brum.beds.ac.uk/10.7326/M14-2362.
Sibai T, Carlisle H, Tornetta P. The darker side of randomized trials: recruitment challenges. J Bone Joint Surg. 2012;1(94):49–55. https://0-doi-org.brum.beds.ac.uk/10.2106/JBJS.L.00240.
Sumner SA, Mercy JA, Dahlberg LL, Hillis SD, Klevens J, Houry D. Violence in the United States: status, challenges, and opportunities. JAMA. 2015;314(5):478–88. https://0-doi-org.brum.beds.ac.uk/10.1001/jama.2015.8371.
Thoma A, Farrokhyar F, McKnight L, Bhandari M. Practical tips for surgical research: how to optimize patient recruitment. Can J Surg. 2010;53(3):205–10.
Tomita A, Herman DB. The impact of critical time intervention in reducing psychiatric rehospitalization after hospital discharge. Psychiatr Serv. 2012;63(9):935–7. https://0-doi-org.brum.beds.ac.uk/10.1176/appi.ps.201100468.
The authors wish to thank our colleagues at Harborview Medical Center, and the Harborview Injury Prevention & Research Center for generous resources that enabled us to conduct the study. We are especially grateful for the tremendous efforts made by Erin Ballsmith, Lina Benson, Emma Bent, David Cheever, Cara Currier, Tamara Dominguez, Elizabeth Griffin, Navya Gunaje, Ashley Hink, Manal Jmaileh, Alvaro Martinez, Erin McCormick, Serena Skidmore, and Alice Yan.
Funding for this study was provided by City of Seattle and Arnold Ventures. The content is solely the responsibility of the authors and does not represent the official views of the funders.
Ethics approval and consent to participate
This study was approved by the University of Washington Human Subjects Division (Institutional Review Board) STUDY00000852 and Washington State IRB #D-100616-H.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Floyd, A.S., Lyons, V.H., Whiteside, L.K. et al. Barriers to recruitment, retention and intervention delivery in a randomized trial among patients with firearm injuries. Inj. Epidemiol. 8, 37 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s40621-021-00331-z
- System avoidance