Implementation Evaluation Proposal: City of Joplin Homelessness Prevention and Rapid Rehousing Program (HPRP) Sample

Introduction

After the 2007-8 financial emergency, homelessness became a critical social issue in the United States. The economic downturn triggered job losses and housing instability in the country. The City of Joplin, Missouri, was not immune to this crisis, and the demographics and socioeconomic landscape further aggravated the gravity of this issue. The 50,000-population city has 21,000 households, with only 57 percent homeowners (US Census Bureau, 2022). Moreover, 17.6 percent of the people live in poverty, which has compounded the problem in the City of Joplin (US Census Bureau, 2022). The US HUD developed the Homelessness Prevention and Rapid Rehousing Program (HPRP) to resolve this issue. This proposal aims to evaluate the HPRP implementation effectiveness in the City of Joplin.

The HPRP addresses the pervasive issue of homelessness in the region. The program involves several key stakeholders and parties in Joplin, including the local government, nonprofit organizations, community-based groups, and HPRP staff, including case managers, housing specialists, counselors, and administrative personnel. The implementation policy involves steps designed to ensure the program delivers the intended objectives. Firstly, the City of Joplin’s staff and partner organizations receive training on HPRP’s guidelines, which covers eligibility criteria, program requirements, and documentation standards. Next, after applications from individuals at risk of homelessness, HPRP staff conduct assessments to determine eligibility and the level of assistance needed. Case managers then develop housing stability plans, identify appropriate options, and connect participants to HPRP support services. HPRP staff then disburse financial assistance to eligible participants, including rent, security deposits, utility payments, and moving costs. Also, City staff collect data on participant progress and report it to the HUD. Therefore, compliance with HPRP’s policy is essential for proper implementation.

This project evaluates whether Joplin’s staff and partner organizations implement HPRP effectively for several reasons. Firstly, adherence to program procedures is paramount for successfully implementing any initiative. According to Bailey et al. (2018), consistent implementation of policies helps maintain integrity, safeguards against misuse of resources, and ensures equitable service delivery to all eligible beneficiaries. Secondly, effective communication is a fundamental pillar for the success of any program. Othman et al. (2020) contend that transparent communication channels help build trust, reduce ambiguity, enable quick problem-solving, and foster a shared vision among team members. Thirdly, the allocation of resources is a pivotal determinant of project success. Inadequate resources, such as funding, personnel, training, and materials, can hinder service delivery, limit outreach efforts, and compromise program outcomes (Buniya et al., 2021). Finally, a community-specific approach is fundamental to tailoring programs, such as HPRP, to the unique needs of the local population (Janda et al., 2021). As such, this project seeks to answer three major evaluation questions:

1. How well are HPRP policies being followed by City staff and partner organizations? 
2. Does the City staff and partner organizations have adequate resources for HPRP implementation?
3. Are there any unique challenges to HPRP implementation specific to the Joplin community?

The results of this implementation evaluation project are integral for various stakeholders. Firstly, policymakers will gain insights into its impact on homelessness in the City of Joplin, enabling them to make informed decisions about the allocation of public resources (Pruit et al., 2018). Service providers can also establish what aspects of their services are most effective in aiding homeless families. This knowledge allows them to adapt and improve their practices to better meet the unique needs of their clients (Rog et al., 2021). Finally, the project will give community members confidence that their struggles are being addressed comprehensively. Furthermore, it allows for community input and feedback, ensuring that the program remains responsive to their specific needs (Pruit et al., 2018). Thus, the results will have multifaceted significance to society. 

Program’s Theory of Change

This structured framework outlines the expected causal relationships between the program’s inputs, activities, outputs, outcomes, and ultimate impact on HPRP (see Figure 1). In the outputs, this housing initiative relies on allocating funding and resources by the HUD and City of Joplin government, which serve as the program’s financial backbone (Bryne et al., 2023). Additionally, HPRP draws strength from its human capital, consisting of staff from the City of Joplin and partner organizations with the skills and expertise required to effectively address housing instability. Collaborations with local government agencies and nonprofit organizations further enrich HPRP initiative by leveraging existing networks and resources (Humphries & Canham, 2021). Lastly, housing market analysis provide critical insights into the local housing landscape, enabling HPRP to make data-driven decisions and target interventions effectively (Bryne et al., 2023). These inputs collectively lay the foundation for the program’s theory of change, ensuring that it operates with the necessary tools and support to achieve its goals.

Figure 1: HPRP’s Theory of Change

The activities core to the HPRP’s theory of change are instrumental in achieving its objectives. First, outreach and identification efforts are critical for locating individuals and families at risk of homelessness within the community, a process underscored by literature as essential (Bryne et al., 2023). Once identified, the program engages in the provision of vital financial assistance, encompassing rent payments, utility support, and security deposits, directly addressing the immediate housing crises individuals face (Chamberlain & Johnson, 2018). Simultaneously, HPRP offers comprehensive case management and counseling services, aligning with best practices to tackle the root causes of housing instability (Bryne et al., 2023). Furthermore, it involves close coordination with landlords to secure stable housing options for program participants, fostering collaboration between tenants and property owners. As such, HPRP actively follows its theory of change to promote long-term housing security for families in Joplin.

The outputs of the HPRP constitute measurable and tangible results directly stemming from its activities. These outputs include the number of families served by HPRP, reflecting the reach and scope of the program’s assistance efforts. Additionally, the amount of financial assistance provided signifies the immediate relief offered to prevent homelessness, encompassing rent payments, utility support, and security deposits (Bryne et al., 2023). The number of housing units secured demonstrates the program’s effectiveness in stabilizing housing situations and offering stable living arrangements. Moreover, the utilization of support services reflects the engagement of program participants with critical resources, such as counseling and case management (Parsell et al., 2022). These outputs serve as essential markers of HPRP’s performance, indicating its ability to address housing instability and homelessness in the community (Bryne et al., 2023). As HPRP generates these outputs, it contributes significantly to housing stability for families in Joplin.

The outcomes of the HPRP extend beyond immediate outputs, encompassing long-term changes in the City of Joplin community. These outcomes include increased housing stability for program participants, a crucial marker of success as it directly addresses homelessness prevention (Bryne et al., 2023). Improved financial stability, including employment and income growth, is another key outcome, reflecting the program’s potential to enhance economic well-being (Parsell et al., 2022). Reduced shelter utilization also signifies a tangible reduction in the burden of homelessness within Joplin community (Bryne et al., 2023). Furthermore, HPRP aims to foster enhanced self-sufficiency among program participants, leading to improved overall quality of life. These outcomes collectively reflect the HPRP’s commitment to creating meaningful change, not only for families served but also for the broader community.

The ultimate impact of the HPRP is a reduction in homelessness rates within the City of Joplin. This aligns with the program’s theory of change, as the decrease in homelessness rates signifies progress towards self-sufficiency (Reinholz & Andrews, 2020). Moreover, HPRP’s activities and outcomes translate into cost savings for the community by reducing emergency shelter and crisis response expenses, a critical consideration for local governments and taxpayers (Bryne et al., 2023). Beyond economic implications, the HPRP’s impact is reflected in the long-term housing stability experienced by program participants (Humphries & Canham, 2021). Therefore, HPRP’s theory of change aims to create a lasting and positive impact, not only by addressing homelessness but by fostering a more stable and prosperous future for the City of Joplin. 

Research Design

This implementation evaluation for HPRP will incorporate a mixed-methods approach. This strategy combines both quantitative and qualitative data collection methods within a single survey instrument. According to Stern et al. (2021), it allows researchers to gather a more holistic understanding of a research question by collecting both numerical data and narrative information. This research design aligns with the nature of this project, which aims to assess the effectiveness of the program’s implementation processes and address specific evaluation questions (Palinkas et al., 2019). The survey will be distributed to stakeholders involved in program implementation and will include 15 closed-ended questions to quantify adherence to HPRP policies, communication strategies, and assess the availability of necessary resources. Additionally, open-ended questions will be included to gather qualitative insights, allowing respondents to provide detailed explanations, examples, and suggestions related to any unique challenges related to the program implementation. As such, this framework aims to contribute to the success of the HPRP in addressing homelessness in Joplin.

The approach will seek to test three major hypotheses:

H1: Adhering strictly to program policies and procedures is more likely to enhance the effectiveness of HPRP implementation in reducing homelessness in Joplin.

H2: Effective communication among HPRP stakeholders is more likely to contribute to improved program outcomes

H3: Adequate allocation of resources, including funding, training, and personnel, will significantly correlate with the success of HPRP implementation in Joplin.

Sample, Measures, and Data Collection

The population of study participants for this implementation include individuals from various groups involved in the City of Joplin HPRP. This population encompasses City of Joplin staff members responsible for program coordination, data collection, policy adherence, and training, as well as personnel from partner organizations collaborating with the City. According to the US Department of Housing and Urban Development (n.d.), an estimated 100 personnel will be involved in the program within Joplin, which constitutes the population of this project. Additionally, HPRP officials, such as case managers, housing specialists, counselors, and administrative personnel, are part of the study population (Byrne et al., 2023). These participants represent a diverse range of roles within HPRP implementation, ensuring a comprehensive assessment of the program’s effectiveness. Their perspectives are crucial in understanding policy compliance, resource allocation, communication, and community-specific challenges related to HPRP in Joplin.

This project will incorporate a purposive sampling approach. According to Campbell et al. (2020), it involves is a non-probability technique where researchers deliberately select specific cases to be included based on predefined criteria and their judgment about which participants are most relevant to the research objectives (See criteria in Figure 2). The focus on a purposive sample of 15 participants is justified by the need to obtain in-depth, context-specific information about HPRP implementation in the City of Joplin (Campbell et al., 2020). These participants hold critical positions within the program’s implementation framework and their experiences will be key vital for assessing its effectiveness. Furthermore, the study can concentrate in the aspects of policy adherence, resource availability, and community-specific challenges by focusing on this select group. Thus, the sample size will allow for rich data collection and analysis while ensuring feasibility in terms of time and resources.

Figure 2: Inclusion and exclusion criteria for participant selection

Data for this project will be collected through Qualtrics, an online survey platform. According to Miller et al. (2020), the technique offers efficient data collection, easy management of responses, and is capable to export data for subsequent analysis. Recruiting participants will be achieved through a strategic and multi-faceted approach. Firstly, the researcher will establish collaboration with City of Joplin’s HR department, partner organizations, and HPRP management to gain their support in identifying potential participants and providing contact information. Further, the project will utilize multiple communication channels to reach out to potential participants, including text message, emails, and information on the organization’s intranet. Notably, the researcher will not only ensure that participants complete the survey online at their convenience, but also offer alternatives like paper surveys for those who may face technological barriers. Finally, the project will seek endorsement from organizational leaders, department heads, or supervisors within the City of Joplin and partner organizations. This data collection approach will ensure ample data collection for analysis.

In this evaluation, the project will employ several key variables to assess the implementation of Joplin’s HPRP. These measures, will be derived from survey questions, include housing stability, policy adherence, challenges in policy adherence, policy communication, and resource availability. Housing stability will be measured on a scale from 1 to 5, gauging the immediate impact of HPRP assistance. Policy adherence will assess the extent to which HPRP policies are consistently followed, with responses ranging from “Strongly Agree” to “Strongly Disagree”, while communication strategy will be rated on a scale of 1 to 5. Resource availability will capture respondents’ perceptions of support provided to program staff, ranging from “Inadequate” to “Very adequate.” Finally, Joplin-specific challenges in policy adherence will collect qualitative data on specific implementation barriers. These measures will provide a comprehensive understanding of program strengths and areas for improvement.

Limitations

This project will have unique drawbacks. Firstly, the use of a relatively small purposive sample of 15 participants may limit the generalizability of the findings. While this sample allows for in-depth insights, it may not fully represent the diversity of perspectives within the City of Joplin’s staff, partner organizations, and HPRP officials (Ster et al., 2021). As such, the findings may not be applicable to all individuals involved in program implementation and other geographical contexts. Secondly, the data collected relies on self-reporting by participants, which introduces the potential for self-report bias where respondents provide responses they believe are socially desirable (Dang et al., 2020). However, the researcher will mitigate this limitation by encouraging honest responses, although some degree of bias may still exist. Finally, while survey responses are valuable for capturing participant perspectives, they may not provide a complete picture of HPRP implementation. Additional data sources, such as program records and observations, could enhance the depth of the evaluation. However, such data sources may be subject to practical constraints and resource limitations.

References

Bailey, K., Paquet, S. R., Ray, B. R., Grommon, E., Lowder, E. M., & Sightes, E. (2018). Barriers and facilitators to implementing an urban co-responding police-mental health team. Health & Justice, 6(1), 1-12.

Buniya, M. K., Othman, I., Sunindijo, R. Y., Kineber, A. F., Mussi, E., & Ahmad, H. (2021). Barriers to safety program implementation in the construction industry. Ain Shams Engineering Journal, 12(1), 65-72. https://doi.org/10.1016/j.asej.2020.08.002

Byrne, T., Huang, M., Nelson, R. E., & Tsai, J. (2023). Rapid rehousing for persons experiencing homelessness: A systematic review of the evidence. Housing Studies, 38(4), 615-641. https://doi.org/10.1080/02673037.2021.1900547 

Campbell, S., Greenwood, M., Prior, S., Shearer, T., Walkem, K., Young, S., … & Walker, K. (2020). Purposive sampling: complex or simple? Research case examples. Journal of Research in Nursing, 25(8), 652-661. https://doi.org/10.1177/1744987120927206 

Chamberlain, C., & Johnson, G. (2018). From long-term homelessness to stable housing: investigating ‘liminality’. Housing Studies, 33(8), 1246-1263. https://doi.org/10.1080/02673037.2018.1424806 

Dang, J., King, K. M., & Inzlicht, M. (2020). Why are self-report and behavioral measures weakly correlated? Trends in Cognitive Sciences, 24(4), 267-269. https://doi.org/10.1016/j.tics.2020.01.007 

Humphries, J., & Canham, S. L. (2021). Conceptualizing the shelter and housing needs and solutions of homeless older adults. Housing Studies, 36(2), 157-179. https://doi.org/10.1080/02673037.2019.1687854 

Janda, K. M., Hood, R., Price, A., Night, S., Marty, W. E., Rohlich, A., & van den Berg, A. E. (2021). Examining food insecurity and areas with unmet food needs during COVID-19: A geospatial, community-specific approach. Journal of Agriculture, Food Systems, And Community Development, 10(3), 55-62. https://doi.org/10.5304/jafscd.2021.103.017

Miller, C. A., Guidry, J. P., Dahman, B., & Thomson, M. D. (2020). A tale of two diverse qualtrics samples: information for online survey researchers. Cancer Epidemiology, Biomarkers & Prevention, 29(4), 731-735. https://doi.org/10.1158/1055-9965.EPI-19-0846 

Othman, I., Kamil, M., Sunindijo, R. Y., Alnsour, M., & Kineber, A. F. (2020, April). Critical success factors influencing construction safety program implementation in developing countries. Journal Of Physics Conference Series, 1529(4), 1-8. https://doi.org/10.1088/1742-6596/1529/4/042079

Palinkas, L. A., Mendon, S. J., & Hamilton, A. B. (2019). Innovations in mixed methods evaluations. Annual Review of Public Health, 40, 423-442. https://doi.org/10.1146/annurev-publhealth-040218-044215

Parsell, C., Clarke, A., & Kuskoff, E. (2022). Understanding responses to homelessness during COVID-19: an examination of Australia. Housing Studies, 38(1), 8-21. https://doi.org/10.1080/02673037.2020.1829564 

Pruitt, A. S., Barile, J. P., Ogawa, T. Y., Peralta, N., Bugg, R., Lau, J., & Mori, V. (2018). Housing first and photovoice: Transforming lives, communities, and systems. American Journal of Community Psychology, 61(1-2), 104-117. https://doi.org/10.1002/ajcp.12226

Reinholz, D. L., & Andrews, T. C. (2020). Change theory and theory of change: what’s the difference anyway? International Journal of STEM Education, 7(1), 1-12. https://doi.org/10.1186/s40594-020-0202-3 

Rog, D. J., Henderson, K. A., Wagner, C. A., & Abbruzzi, E. L. (2021). Housing matters, services might: Findings from the high needs families program evaluation. The ANNALS of the American Academy of Political and Social Science, 693(1), 209-229. https://doi.org/10.1177/0002716221997037 

Stern, C., Lizarondo, L., Carrier, J., Godfrey, C., Rieger, K., Salmond, S., … & Loveday, H. (2021). Methodological guidance for the conduct of mixed methods systematic reviews. JBI Evidence Implementation, 19(2), 120-129. https://doi.org/10.1097/XEB.0000000000000282 

US Census Bureau (2022). Quick facts. https://www.census.gov/quickfacts/fact/table/joplincitymissouri/PST045222

US Department of Housing and Urban Development (n.d.) HPRP program administration, design, and implementation resources.