Authors: Jay A. Mancini, Professor and Extension Specialist, Department of Family and Child Development, Virginia Tech; Lydia I. Marek, Research Scientist, Department of Family and Child Development, Virginia Tech.
Publication Number 350-800, September 1998
Return to Table of Contents
The central questions addressed in this brief report are: What is the current status of Youth at Risk projects originally funded by this USDA initiative? What are the dominant ways that projects have continued? What are the past and present roles of Cooperative Extension in supporting community-based projects?
Return to Table of Contents
Current Role of Cooperative Extension (CES Role as Leaders or Advisors, Support Provided by Local and State CES to Projects, and What Projects Need From State and Federal Extension);
Project Continuity Mechanisms (Community Support, CES Support, User Fees, Grants or Foundation Funding, Modification in Program Depth and/or Breadth); and
Critical Issues in Project Success and Longevity (Funding, Turnover, Staffing, Conflict, Sustainability, Politics, Economy, Receptivity, User Fees).
In addition, an emerging framework for sustaining community-based programs is included. Implications for program sustainability focus upon Vision and Leadership; Collaborations and Partnerships; Community Awareness, Involvement and Needs; Demonstrated Program Impact; Funding; and Staffing. Appendix A provides information on the level of program activity, Cooperative Extension (CES) involvement, and funding patterns for each Youth at Risk project (Status of Youth at Risk Projects) and Appendix B provides a list of related readings.
Return to Table of Contents
Active - Projects whose delivery modes and program content remain the same/similar or have expanded.
Modified Programming - Projects that modified by reducing the amount and type of programming.
Modified sites/participants - Projects that are offering the same type of programming to fewer sites and/or to fewer participants.
Modified Programming and Sites/Participants - Projects that modified the amount and type of programming and reduced the number of and/or are reaching fewer participants.
Inactive - Projects that closed as YAR/USDA funding ended.
Level of Project Activity
Across the 67 projects, 39% are currently active, 9% have modified their programming, 13% have modified their sites/participants, 27% have modified their programming and sites/participants, and 13% are inactive (Table 1). Therefore, 87% of projects funded under the Youth at Risk Initiative are still functioning, one year post USDA funding, although the actual level of that functioning varies substantially. More than one-third are functioning at levels that are the same as or exceed the programming while they were receiving YAR/USDA funding.
Table 1. Level Of Program/Coalition Activity
| Science/Lit n=15 | SACC n=23 | Coalition n=29 | Overall n=67 | |
|---|---|---|---|---|
| Active | 27% | 57% | 28% | 39% |
| Modified | 48% | |||
| 7% 13% 27% | 9% 13% 17% | 14% 10% 34% | 9% 13% 27% |
| Inactive | 27% | 4% | 14% | 13% |
Project Evaluation
For the most part evaluation was not a high priority in these projects, even though it was an expectation of the funder. While the desirability to document change as a result of program interventions was recognized, few projects had the capacity to effectively conduct that kind of research. Although expectations from CSREES/USDA were that land-grant University Extension personnel would provide the evaluation capacity, linkages between community projects and universities were uneven. The gap between evaluation needs and evaluation resources was also evident when instruments were considered to be culturally inappropriate for their intended audience. Generally, when it came to allocating time and effort to evaluation versus program and service delivery, the latter received the emphasis.
Because evaluating programs is pivotal to demonstrating merit and documenting program progress we assessed the status of evaluation among sustained projects. Evaluation was indexed in two ways. The first focuses on the current level of effort for sustained projects, and the second focuses on current Cooperative Extension involvement in evaluation research.
Level of Effort
Of the 58 sustained projects, 71% were engaged in some form of evaluation. Of these projects, 90% were assessing youth, parent, and/or staff satisfaction with programs through informal methods or through interviews and surveys. Twenty-four (24%) percent of those conducting satisfaction assessments were also assessing knowledge gained or personal indicators such as well-being, self-esteem, and competence. There also were nine projects (16%) that were conducting evaluation which was required as part of their new funding.
Cooperative Extension Involvement
For one-third (33%) of the sustained projects, Extension was providing leadership in evaluation. In more than half of the cases (59%) CES was not involved in evaluation activities, and in very few cases (less than 6%) Extension acted as a resource for evaluation questions, or it was anticipated that Extension would be involved in future project evaluations.
To summarize, it is evident from these data that rigorous evaluation is not common. What is common is soliciting customer satisfaction after some program or service is delivered; typically less focus is placed on outcomes other than feelings of satisfaction with a program or service.
Role of Collaborators
Collaboration has been an important component of these projects. Currently, leadership is shared by collaborators in 36% of sustained projects and in 41% the leadership is provided by a single organization. For 17% of sustained projects collaborators are in an advisory/resource role; and in 5% of the projects there is minimal or no collaboration.
Return to Table of Contents
CES Role as Leaders and/or Advisors For the most part, general technical assistance support from local Extension is substantial. However, state support varies dramatically. In some instances the support is and was unwavering while in other cases it was given grudgingly. Cooperative Extension (CES) has continued to stay involved in a large majority of sustained YAR projects through providing leadership (24%), sharing leadership responsibilities with community collaborators (21%), or serving in an advisory or resource capacity (40%). Cooperative Extension is minimally or not at all involved in 16% of the sustained projects.
Support Provided by Local and State CES to Projects
Table 2 shows what sustained projects are currently receiving from CES. The principal form of support involves training, followed by technical assistance as it involves proposal development and evaluation, site coordination, and provision of curricula.
Table 2. CES Support to Sustained Projects
From State CES:
From Federal CES level:
Return to
Table of Contents
TYPE OF SUPPORT PROJECTS RECEIVING Trainings/workshops 48%
Technical (grant writing/evaluation) assistance 34% Program direction/site coordination 33% Curricula/materials 31% Participates in coalition in any capacity 24% Serves in advisory role/liaison 22% Funding 14% Fiscal management 12% Personnel/volunteer supervisor 12%
When personnel from Youth at Risk Projects were asked what they needed from both State and Federal CES, several themes emerged.
Community & CES Support
Community Support: Leadership, funding, or other resources were provided by agencies, businesses, schools, and/or community coalitions or collaborations to 79% of sustained projects.
Project continuation through collaborator involvement included both state and federal agencies, as well as a number of community agencies, businesses and corporations. Ownership of projects was transferred by being folded into or attaching the project to programs run by the schools, or community agencies, (such as Boys and Girls Clubs and YMCA/YWCA, recreation departments, housing authorities, local businesses, parent groups), or by attaching to a coalition of state government organizations. In a number of cases local schools assumed ownership of projects. Active projects had more community support when compared to modified projects.
CES Support: 38% of sustained projects were provided support by Extension in the form of leadership, personnel, funding, and other non-monetary resources.
Eight YAR projects (14% of sustained projects) were integrated into regular CES programming. Of these 8 projects, all were currently operating at a Modified level with 6 having both a reduction in program and in participants served. In a majority of projects, activities often were not well-integrated with ongoing Extension programs. In a number of instances project activities were seen as quite separate from mainstream 4-H activities. And while agent overload may have been one reason for this separation, another had to do with the sentiment that 4-H programming was not for at risk families. There was both skepticism over whether Extension could deal with at risk programming, and the perception that project-related activities were receiving less support than the mainstream programs. There were those who felt that being separate from regular programming made it more difficult to secure ongoing support, either from Extension or from the community in general.
Funding Streams
The most obvious continuity mechanism is securing additional funding, which occurred via grant-writing activities, the charging of user fees to participants, and/or receiving funding from collaborators. Those projects whose staff began efforts into securing funding early in their projects put a substantial amount of effort into training in and conducting grant-writing as well as approaching other organizations to collaborate in writing proposals.
User Fees: 40% of sustained projects maintain themselves either entirely or largely on participant user fees.
Distinctive to School-Age Child Care projects is the charging of fees for care, which of course is standard for child care no matter where it is found. User fees are the life-blood of these projects. In some cases projects were awarded tax-exempt status (501c3).
Grants or Foundation Funding: 31% of sustained projects were mainly funded through large state or federal grants or through foundation funding.
There was a difference between active and modified projects in that active projects received more grants. Additional funding sources and cost-sharing that sustained project activities included federal child care block grants, state child care councils, state-level housing authority, state human resources departments, and state parks and recreation agencies. Fiscal responsibility for particular program components was sometimes assumed by various organizations, particularly those of coalition projects. Sometimes when grants were received, programs adapted to meet those funder's requirements.
Modifications
Modification In Program Depth and/or Breadth: 57% of sustained projects were modified in size in order to scale back expenses and personnel needs to maintain programming on decreased funding.
Changes occurred in program content and the number of participants that could be accommodated. In order to remain open some projects modified particular project components, such as the length or depth of summer programs, or taught fewer classes in a program area. The number of individual sites that comprised a project were consolidated, therefore reducing the number of families that were served. Program breadth was sacrificed in a number of instances so that some part of the project could be retained.
Mechanisms Summary
All things considered, the mechanisms used across Youth at Risk projects had a great deal in common. While they may have differed in degree, most projects were similar in that they relied on collaborators to institutionalize projects, down-sized programs, integrated projects into CES programming, and made efforts at securing additional grants. There were important differences as well, in that charging fees, becoming institutionalized by the school, and establishing advisory boards were more typical of the School-Age Child Care projects. Becoming integrated into Cooperative Extension was most typical of Science and Technology Literacy and Coalition projects and shifting responsibility through leadership changes was more typical of Coalition projects.
Return to Table of Contents
Return to Table of Contents
Thus far the data provide a beginning understanding of the foundation for program sustainability. These Youth at Risk projects will continue to be studied to further understand the processes that underlie programs sustaining themselves. In addition, community-based programs which were funded through CYFAR (State Strengthening) will also be studied to aid in the expansion of the sustainability framework. The current sustainability framework revolves around Vision and Leadership; Collaborations and Partnerships; Community Awareness, Involvement, and Needs; Demonstrated Program Impact; Funding; and Staffing. This report concludes with these factors as implications for program sustainability.
Return to Table of Contents
Collaborations and Partnerships
Community Awareness, Involvement, and Needs
Return to Table of Contents
| STATE | PROGRAM ACTIVITY | CES | FUNDING |
| Alabama | Inactive | ||
| Alaska | Active | Provides Leadership | CES and fundraising/ small grants/or in-kind donations |
| Arizona | Modified programming | Provides Leadership | Fundraising/ small grants/or in-kind donations |
| Arkansas | Inactive | ||
| California | Active | Provides Advising/Resources | School, large grant(s), user fees |
| Connecticut 1 (Hartford SACC) | Modified sites/participants | Provides Advising/Resources | Community agency(ies), user fees, and school and fundraising/small grants/or in-kind donations |
| Connecticut 2 (New Haven Spaces) | Modified sites/participants Modified programming | Provides Advising/Resources | Community agency(ies), school and fundraising/small grants/ or in-kind donations |
| Connecticut 3 (Bridgeport RISE) | Modified sites/participants Modified programming | Provides Advising/Resources | Fundraising/small grants/or in-kind donations |
| Delaware 1 (WCASA) | Modified programming | Minimal/No Involvement | Community agency(ies), and fundraising/small grants/or in-kind donations |
| Delaware 2 (Seaford) | Modified sites/participants Modified programming | Shares Leadership | CES allocates personnel, Community agency(ies), and Fundraising/small grants/or in-kind donations |
| Florida | Inactive | ||
| Georgia | Modified sites/participants Modified programming | Shares Leadership | Large grant(s), User fees, and small grants/or in-kind donations |
| Guam | Modified sites/participants Modified programming | Provides Leadership | CES allocates personnel |
| Hawaii | Active | Provides Leadership | CES allocates personnel User fees, and small grants/or in-kind donations |
| Idaho 1 (After School Adventures) | Modified programming | Provides Advising/Resources | Community agency(ies), User fees, and Fundraising/small grants/or in-kind donations |
| Idaho 2 (Just for Kicks) | Active | Provides Advising/Resources | User fees |
| Illinois 1 (Computer Assisted Learning) | Active | Provides Advising/Resources | Community agency(ies), User fees, and Fundraising/ small grants/or in-kind donations |
| Illinois 2 (SACC for Alredo, Sherrard, Westmer) | Active | Provides Leadership | CES allocates personnel, User fees |
| Indiana | Modified sites/participants Modified programming | Provides Leadership | CES allocates personnel, Community agency(ies), and Fundraising/small grants/or in-kind donations |
| Iowa 1 (Community Coalition) | Inactive | ||
| Iowa 2 (Model City) | Modified programming | Provides Leadership | CES allocates personnel, School and Fundraising/small grants/or in-kind donations |
| Kansas 1 (Caring & Collaborating) | Modified programming | Shares Leadership | CES allocates personnel, School and Community agency(ies), Fundraising/small grants/or in-kind donations |
| Kansas 2 (READ) | Inactive | ||
| Kentucky | Inactive | ||
| Louisiana | Active | Shares Leadership | Large grant(s) and Fundraising/small grants/or in-kind donations |
| Maine | Active | Provides Advising/Resources | Community agency(ies), User fees, and Fundraising/small grants/or in-kind donations |
| Maryland | Modified sites/participants Modified programming | Provides Leadership | CES allocates personnel, User fees, and Fundraising/small grants/or in-kind donations |
| Massachusetts | Modified sites/participants Modified programming | Provides Advising/Resources | CES allocates personnel, and Fundraising/small grants/or in-kind donations |
| Michigan | Modified sites/participants | Provides Leadership | CES allocates personnel, School and Fundraising/small grants/or in-kind donations |
| Minnesota 1 (FINE) | Modified programming | Minimal/No Involvement | Fundraising/small grants/or in-kind donations |
| Minnesota 2 (YIE) | Inactive | ||
| Mississippi | Active | Provides Advising/Resources | Large grant(s) |
| Missouri 1 (St. Joseph) | Active | Provides Advising/Resources | Large grant(s) and Fundraising/small grants/or in-kind donations |
| Missouri 2 (Walbridge 4H Adventure Club) | Active | Minimal/No Involvement | Large grant(s) and Fundraising/small grants/or in-kind donations |
| Montana | Modified sites/participants Modified programming | Provides Advising/Resources | Fundraising/small grants/or in-kind donations |
| Nevada | Modified sites/ participants | Shares Leadership | CES allocates personnel and Large grant(s) |
| New Hampshire | Active | Provides Advising/Resources | Large grant(s) and Fundraising/small grants/or in-kind donations |
| New Jersey 1 (Bergen-LaFayette) | Inactive | ||
| New Jersey 2 (Camden City Gardening) | Active | Provides Advising/ Resources | Fundraising/small grants/or in-kind donations |
| New Jersey 3 (Soweto Academy) | Active | Provides Advising/ Resources | CES allocates personnel and Community agency(ies) |
| New Mexico 1 (Quay Co.) | Modified sites/participants | Shares Leadership | CES allocates personnel, School, Large grant(s) User fees, and Fundraising/small grants/or in-kind donations |
| New York 1 (Make a Difference) | Modified sites/participants | Provides Leadership | CES allocates personnel and Community agency(ies) |
| New York 2 (Rural Family Coop) | Modified sites/participants | Provides Advising/ Resources | Community agency(ies), Modified programming User fees, and Fundraising/small grants/or in-kind donations |
| New York 3 (Schools Out) | Modified sites/participants Modified programming | Provides Advising/ Resources | Community agency(ies), School, User fees, and Fundraising/small grants/or in-kind donations |
| North Carolina | Active | Shares Leadership | CES allocates personnel and Community agency(ies) |
| North Dakota | Active | Provides Advising/ Resources | Large grant(s), User fees, and Fundraising/small grants/or in-kind donations |
| Ohio 1 (Cleveland Peer Volunteer) | Modified sites/participants Modified programming | Provides Leadership | CES allocates personnel, and Fundraising/small grants/or in-kind donations |
| Ohio 2 (Knox Co. 4H) | Active | Provides Leadership | CES allocates personnel, School, and User fees |
| Ohio 3 (Athens Co.) | Active | Shares Leadership | CES allocates personnel, School, Large grant(s), User fees, and Fundraising/small grants/or in-kind donations |
| Oklahoma 1 (COA for ASC) | Modified sites/participants Modified programming | Minimal/No Involvement | Community agency(ies) and School |
| Oklahoma 2 (Adol. Mothers) | Modified sites/participants | Shares Leadership | Large grant(s) |
| Oregon 1 (Kid Konnect) | Inactive | ||
| Oregon 2 (Mill City/ Gates) | Modified sites/participants Modified programming | Provides Advising/ Resources | School and Fundraising/ small grants/or in-kind donations |
| Pennsylvania | Modified sites/participants | Shares Leadership | CES allocates personnel and Community agency(ies) |
| South Dakota | Modified sites/participants | Shares Leadership | User fees, and Fundraising/small grants/or in-kind donations |
| Texas 1 (OLE) | Modified sites/participants | Minimal/ No Involvement | Community agency(ies) |
| Texas 2 (Making the Grade) | Active | Minimal/ No Involvement | Large grant(s) and Fundraising/small grants/or in-kind donations |
| Utah | Active | Provides Advising/ Resources | CES allocates personnel, School, Large grant(s) and Fundraising/small grants/or in-kind donations |
| Virginia 1 (Giles Sci/Tech) | Active | Minimal/ No Involvement | Community agency(ies), Large grant(s), and Fundraising/small grants/or in-kind donations |
| Virginia 2 (Strong Families) | Modified programming | Minimal/ No Involvement | School |
| Washington 1 (ONTU) | Modified sites/participants | Provides Leadership | CES allocates personnel, Community agency(ies), User fees, and Fundraising/small grants/or in-kind donations |
| Washington 2 (Spokane Family Focus) | Active | Provides Leadership | CES allocates personnel, Community agency(ies), School, Large grant(s), and Fundraising/small grants/or in-kind donations |
| West Virginia | Active | Shares Leadership | CES allocates personnel, Community agency(ies) |
| Wisconsin 1 | Active | Provides Advising/ Resources | Large grant(s), and Fundraising/small grants/or or in-kind donations |
| Wyoming 1 | Modified sites/ participants | Minimal/ No Involvement | User fees and Fundraising/small grants/or in-kind donations |
| Wyoming 2 (Wind River) | Modified programming | Provides Advising/ Resources | Community agency(ies) and Fundraising/small grants/or in-kind donation |
Return to Table of Contents
Green, B.L., Mulvey, L., Fisher, H.A. & Woratschek, F. (1996). Integrating program and evaluation values: A family support approach to program evaluation. Evaluation Practice, 17 (3), pp. 261-272.
Hollister, R.B. & Hill, J. (1995). Problems in the evaluation of community-wide initiatives. In Connel, J.P., Kubisch, A.C., Schorr, L.B., & Weiss, C.H. (Eds.). New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts. Washingron, DC: The Aspen Institute.
Kretzmann, J.P. & McKnight, J.L. (1993). Building Communities from the Inside Out. Chicago: ACTA Publications.
Schorr, L.B. (1997). Common Purpose: Strengthening Families and Neighborhoods to Rebuild America. NY: Anchor Books-Doubleday.
Return to Table of Contents
The CYFAR Initiative funds 5 National Children, Youth and Family Networks and CYFERNetÇcollaborations of universities which provide access to research articles, curriculum sources, program materials and training in child care, family resiliency, science and technology, health and collaboration. By funding computers and Internet Connectivity in community-based programs, the CYFAR Initiative promotes the use of technology to improve programs, provide efficient access to educational resources, and provide essential technological skills for youth and adults in at risk environments.
The long-term goals of the CYFAR Initiative are to sustain programming for at risk children and families, and to institutionalize collaboration and application of technology across the Cooperative Extension System.
This report is one product of the CYFAR Evaluation Collaboration, a team of University evaluation researchers assessing impact of CYFAR Initiative programs and providing evaluation assistance to Extension professionals. For information about the CYFAR Initiative, contact Sharon K.B. Wright, Cooperative State Research, Education, and Extension Service, U.S. Department of Agriculture.
Phone: 202-720-5075 or
E-mail: swright@reeusda.gov
or visit the CYFAR Initiative page at: http://www.reeusda.gov/4h/cyfar/cyfar.htm
Return to Table of Contents
Lydia I. Marek is a Research Scientist in the Department of Family and Child Development at Virginia Tech. Dr. Marek has been engaged in evaluation research since the early 1990s. Her research has been funded by the U.S. Department of the Army and USDA-CSREES. Dr. Marek is a Certified Family Life Educator (National Countil on Family Relations) and a licensed Marriage and Family Therapist. Her research has been published in the Journal of Amily Psychotherapy, Family Therapy, and in the book, Looking Back, Looking Forward: Life Course Unfolding of Parenthood. lmarek@vt.edu or (540) 231-6306.
View this document in PDF format.
Visit Virginia Cooperative Extension