Psychiatr Serv 53:967-969, August 2002
© 2002 American Psychiatric Association
Lessons From the Evaluation of the ACCESS Program
Howard H. Goldman, M.D., Ph.D.,
Joseph P. Morrissey, Ph.D.,
Robert A. Rosenheck, M.D.,
Joseph Cocozza, Ph.D.,
Margaret Blasinsky, M.A.,
Frances Randolph, Dr.P.H. and
the ACCESS National Evaluation Team
|
Abstract
|
The authors summarize the main findings of the ACCESS (Access to Community Care and Effective Services) program and offer lessons for policy makers. Data from studies at the site level and the client level, which were presented in the two previous articles in this issue of Psychiatric Services, are summarized and synthesized with the authors' collective experience with the ACCESS program. The results of the evaluation suggest that although service systems integration can be improved, targeted efforts to implement strategies for integration do not produce better client outcomes. Efforts to integrate service systems can be supported by their effects on some organizational relationships within the mental health service system but not by their widespread effects across human services or their direct effects on clients.
|
Introduction
|
This article summarizes the main findings of the ACCESS (Access to Community Care and Effective Services and Supports) program, which evaluated the effectiveness of systems integration strategies in addressing the problem of homelessness among persons with severe mental illness, and presents lessons for policy makers. This is the last in a set of four articles in this issue of Psychiatric Services. In combination, these articles provide an overview of the evaluation of the ACCESS program.
The ACCESS program provided funds and technical support to nine randomly selected sites in nine states to implement strategies for promoting integration of service systems. These experimental sites, along with nine comparison sites in the same states, also received funds to support assertive community treatment to assist 100 clients per site per year in four annual cohorts (1). Data on the implementation of system change strategies were collected through annual visits to the sites (2). Data on changes in systems integration were obtained from interviews with key representatives of relevant organizations in each community (3). Client outcome data were obtained at baseline and three and 12 months later from 7,055 clients across the four cohorts at all sites (4).
|
Summary of findings
|
Table 1 lists the six hypotheses that were central to the evaluation of the ACCESS program and indicates whether or not each hypothesis was supported by the evaluation. Details are presented in other articles (3,4).
The evaluation that was described only briefly in the first of the four articles (2) but that has been described in more detail elsewhere (5) assessed the feasibility of implementing the various strategies of the ACCESS demonstration. The study showed that systems integration strategies could be implemented as intended only if significant additional technical assistance was provided. The evaluation also showed that when technical assistance and substantial resources were provided by the federal government, all the sites were able to implement outreach and intensive case management programs that were moderately faithful to the assertive community treatment model. Interestingly, most sites retained these services for one year after the federal resources were withdrawn (6).
Other nonexperimental data showed that on average, clients at all sites and in all cohorts showed improvement, as would be expected for clients of assertive community treatment programs (7). In addition, analyses of preliminary data from the ACCESS program demonstrated that street outreach is an effective way of contacting individuals who are more severely ill and those who are less motivated (8). Furthermore, termination of assertive community treatment after only one year was not associated with any subsequent deterioration in clinical outcomes after about six months (9).
In addition, clients at sites that had greater improvements in systems integration were more likely to achieve stable housing (4). This finding was consistent with the results of a previous cross-sectional examination, which showed that clients at sites with higher levels of systems integration were more likely to be independently housed 12 months after enrollment in assertive community treatment (10).
In policy terms, although the theory that links systems integration and individual outcomes was supported for independent housing, across-the-board efforts to implement systems integration strategies cannot be recommended as a means of achieving desired client-level outcomes. Although implementing systems integration strategies might be advocated to achieve other objectives, such as a more efficient system, it cannot be recommended as a way of promoting individual-level outcomes.
|
Conclusions
|
The ACCESS evaluation demonstrated that it is possible to enhance project-centered integration. The evaluation also showed that specific strategies for enhancing project-centered integration exist and can be helpful in increasing integration in a community, and that enhanced integration can help homeless persons with severe mental illness escape from homelessness.
The evaluation did not show that these strategies promote better client outcomes above and beyond what can be achieved with good clinical services, such as assertive community treatment. Nevertheless, the findings offer some hope of progress in dealing with the seemingly intractable problem of homelessness among persons with severe mental illness.
Much was learned from this elaborate and well-implemented demonstration program and its evaluation. The most important lessons are summarized below:
• Systems integration can be improved.
• Important, practical strategies for systems integration can be identified and implemented.
• Implementation of systems integration strategies takes time and requires both technical assistance and resources.
• Implementation of systems integration strategies will not necessarily improve integration on a systemwide level but is likely to improve integration between a designated mental health agency and other agencies in the same community.
With considerable resources and effort, policy makers might use specific strategies to achieve integration. These strategies are more likely to be successful within the mental health system than across human services agencies broadly.
In addition:
• Systems that are better integrated have significantly better housing outcomes. (Although this cross-sectional finding is encouraging, the ACCESS demonstration did not provide evidence to suggest specific strategies that would produce this result. Some communities are just better integrated for a variety of reasons.)
• Investment in systems integration cannot be expected to produce desired clinical outcomes.
• Mental health authorities should be encouraged to provide substantial resources to develop housing, outreach, and assertive community treatment teams.
In summary, the systems-integration solution to the problem of homelessness and mental illness that the authors of Outcasts on Main Street(11) had hoped for was only partly realized in the ACCESS program. Extensive and targeted efforts to promote systems integration do not produce desired social and clinical outcomes at the individual client level. However, the ACCESS program has provided sound empirical answers to questions that were first raised more than 30 years ago (11,12,13,14). It has taught us many lessons and has kept the problem of homelessness in the consciousness of a nation that would otherwise be in danger of forgetting about it.
Furthermore, the ACCESS program has demonstrated the feasibility of implementing a range of direct services capable of reaching out and engaging thousands of homeless people who have severe mental illnesses and who often are living on city streets. These individualized services improve both the physical health and the mental health of these people and can help in moving them into independent housing. What remains is to provide the resources for outreach and intensive clinical care as well as housing and rental subsidies to sustain the lessons of the ACCESS program.
|
Acknowledgments
|
This study was funded under interagency agreement AM-9512200A between the Department of Health and Human Services, the Substance Abuse and Mental Health Services Administration, the Center for Mental Health Services, and the Department of Veterans Affairs Northeast Program Evaluation Center as well as through a contract between the Center for Mental Health Services and ROW Sciences, Inc. (now part of Northrop Grumman Corp.) and subcontracts between ROW Sciences, Inc., and the Cecil A. Sheps Center for Health Services Research at the University of North Carolina at Chapel Hill, the University of Maryland, and Policy Research Associates, Delmar, New York. The ACCESS National Evaluation Team includes Lisa Creatura, M.P.A., Mary Lou Dogoloff, Matthew Johnsen, Ph.D., Monique Mercer, M.P.A., Laura Samberg, M.A., Joseph Sonnefeld, M.A., and Ann Worthen, B.A.
|
Footnotes
|
Dr. Goldman is affiliated with the department of psychiatry and the Center for Mental Health Services Research at the University of Maryland School of Medicine, 685 Baltimore Street, MSTF Building, Room 300, Baltimore, Maryland 21201 (e-mail, hh.goldman{at}verizon.net). Dr. Morrissey is with the Cecil A. Sheps Center for Health Services Research at the University of North Carolina in Chapel Hill. Dr. Rosenheck is with the Northeast Program Evaluation Center of the Department of Veterans Affairs inWest Haven, Connecticut, and the department of psychiatry of Yale Medical School in New Haven. Dr. Cocozza is with Policy Research Associates, Inc., in Delmar, New York. Ms. Blasinsky is with Northrop Grumman Information Technology-Health Solutions in Rockville, Maryland. Dr. Randolph is with the homeless programs branch of the Center for Mental Health Services in Rockville. This paper is one of four in this issue in which the main results of the ACCESS program are presented and discussed.
|
References
|
- Randolph F, Blasinsky M, Leginski W, et al: Creating integrated service systems for homeless persons with mental illness: the ACCESS Program: Access to Community Care and Effective Services and Supports. Psychiatric Services 48:369-373, 1997[Abstract/Free Full Text]
- Cocozza J, Steadman H, Dennis D, et al: Successful systems integration strategies: the ACCESS program for persons who are homeless and mentally ill. Administration and Policy in Mental Health 27:395-407, 2000[CrossRef][Medline]
- Morrissey J, Calloway M, Thakur N, et al: Integration of service systems for homeless persons with serious mental illness through the ACCESS program. Psychiatric Services 53:949-957, 2002[Abstract/Free Full Text]
- Rosenheck R, Morrissey J, Lam J, et al: Effects of service systems integration of homeless persons with severe mental illness in the ACCESS program. Psychiatric Services 53:958-966, 2002[Abstract/Free Full Text]
- ACCESS Evaluation. Rockville, Maryland, Center for Mental Health Services, 2001
- Steadman HJ, Cocozza JJ, Dennis DL, et al: Successful program maintenance when federal demonstration dollars stop. Administration and Policy in Mental Health, in press
- Morse G: A review of case management for people who are homeless: implications for practice, policy, and research, in Practical Lessons: The 1998 National Symposium on Homelessness Research. Edited by Forsburg LB, Dennis DL. Washington, DC, US Department of Housing and Urban Development and US Department of Health and Human Services, 1999
- Lam J, Rosenheck RA: Street outreach for homeless persons with serious mental illness: is it effective? Medical Care 37:894-907, 1999
- Rosenheck R, Dennis D: Time-limited assertive community treatment (ACT) for homeless persons with severe mental illness. Archives of General Psychiatry 58:1073-1080, 2001[Abstract/Free Full Text]
- Rosenheck R, Morrissey J, Lam J, et al: Service system integration, access to services, and housing outcomes in a program for homeless persons with severe mental illness. American Journal of Public Health 88:1610-1615, 1998[Abstract/Free Full Text]
- Outcasts on Main Street: Report of the Federal Task Force on Homelessness and Severe Mental Illness. Washington, DC, Interagency Council on the Homeless, 1992
- Kagan SL: Integrating Services for Children and Families: Understanding the Past to Shape the Future. New Haven, Conn, Yale University Press, 1993
- Agranoff R: Human services integration: past and present challenges in public administration. Public Administration Review 51:533-542, 1991[CrossRef]
- Morrissey JP: Integrating service delivery systems for persons with a severe mental illness, in A Handbook for the Study of Mental Health: Social Contexts, Theories, and Systems. Edited by Horwitz A, Scheid T. New York, Cambridge University Press, 1999
This article has been cited by other articles:
|
|
|
|
 
A. I Wierdsma, H. D Poodt, and C. L Mulder
Effects of community-care networks on psychiatric emergency contacts, hospitalisation and involuntary admission
J Epidemiol Community Health,
July 1, 2007;
61(7):
613 - 618.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
P. B. Gold, S. M. Glynn, and K. T. Mueser
Challenges to Implementing and Sustaining Comprehensive Mental Health Service Programs
Eval Health Prof,
June 1, 2006;
29(2):
195 - 218.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. A. Rosenheck
Back to the Future: Funding, Integrating, and Improving Mental Health Services
Psychiatr Serv,
October 1, 2004;
55(10):
1141 - 1142.
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. P. Morrissey, M. O. Calloway, N. Thakur, J. Cocozza, H. J. Steadman, D. Dennis, and the ACCESS National Evaluation Team
Integration of Service Systems for Homeless Persons With Serious Mental Illness Through the ACCESS Program
Psychiatr Serv,
August 1, 2002;
53(8):
949 - 957.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
R. A. Rosenheck, J. Lam, J. P. Morrissey, M. O. Calloway, M. Stolar, F. Randolph, and the ACCESS National Evaluation Team
Service Systems Integration and Outcomes for Mentally Ill Homeless Persons in the ACCESS Program
Psychiatr Serv,
August 1, 2002;
53(8):
958 - 966.
[Abstract]
[Full Text]
[PDF]
|
|
|
Get information about faster international access.
Privacy Policy
Copyright © 2002
American Psychiatric Association.
All rights reserved.
Home
| Search
| Current Issue
| Past Issues
| Subscribe
| All APPI Journals
| Help
| Contact Us
|
TOP
Abstract
Introduction
