Email this article Community Impact Evaluation. Telling a stronger story
Abstract
This paper presents the Community Impact model, which provides a systematic evaluation of a programme or intervention and, consistent with Community Psychology methodologies, proposes new perspectives in selecting strategic tools to support systems, organisations and communities in order to activate a positive process of change. This contribution provides a state of the art in impact evaluation by means of a review of studies on empowerment evaluation, systemic approach, human rights impact evaluation and collective impact, and illustrates the success factors for achieving suitable policies and for promoting stakeholders' involvement in all stages of an intervention. Based on existing literature, a first prototype of the model was drawn up and tested in three case studies in European countries. Subsequently, the Community Impact (CI) evaluation model was defined. This paper presents its theoretical and operational aspects, which comprise six steps that are strictly connected to one another and pertain to: forming accountable groups and leadership, transferring knowledge, transforming “bad data” into useful data, providing added value to interventions, and increasing local partnerships in order to create a more effective narrative regarding the implemented process and its outcomes.
References
Albanesi, C. (2012). La rete sociale e il lavoro di rete. In B. Zani (a cura di), Psicologia di comunità. Prospettive, idee, metodi (pp. 181-310). Roma: Carocci.
Andreassen, B.A., Sano, H.O., & McInerney-Lankford, S. (Eds.). (2017). Research Methods in Human Rights: A Handbook. Cheltenham, UK: Edward Elgar Publishing.
Brandon, P.R., & Fukunaga, L.L. (2014). The state of the empirical research literature on stakeholder involvement in program evaluation. American Journal of Evaluation, 35(1), 26-44. doi.org/10.1177/1098214013503699
Chiodini, M., Volpi, C., & Meringolo, P. (2018). Community Impact. Come produrre una narrativa migliore. Presentation at the Italian Community Psychology Association national conference “Comunità Imperfette. Dalle dinamiche disgregative al decision making comunitario” [Imperfect communities: From disintegration to community decision-making], Palermo, June 7-9.
Cox, A., Swift, S., & Rhisiart, M. (2015). Success factors for achieving policy impact in foresight studies. European Risk Observatory, European Agency for Safety and Health at Work.
Ebener P.A., Hunter S.B., Adams R.M., Eisenman D., Acosta J.D., & Chinman M. (2017). Getting to Outcomes. Guide for community emergency preparedness. RAND Corporation, Santa Monica, Calif.
Estrella, M. (2000). Learning from Change: Issues and Experiences in Participatory Monitoring and Evaluation. International Development Research Centre, Ottawa
EUROPE ENGAGE (2014). Developing a culture of civic engagement through Service-Learning within higher education in Europe. 2014-1-ES01-KA203-004798. Retrieved from https://europeengage.org and https://europeengage.org/2-1-quality-standards-indicators-of-service-learning/
Fetterman, D.M. (2001). Foundations of empowerment evaluation. Thousand Oaks, CA: Sage.
Fetterman, D., & Wandersman, A. (2007). Empowerment evaluation: Yesterday, today, and tomorrow. American Journal of Evaluation, 28(2), 179-198. doi.org/10.1177/1098214007301350
Flaspohler, P., Lesesne, C.A., Puddy, R.W., Smith, E., & Wandersman, A. (2012). Advances in bridging research and practice: introduction to the second special issue on the interactive system framework for dissemination and implementation. American journal of community psychology, 50(3-4), 271-281. https://doi.org/10.1007/s10464-012-9545-3
Gallahue, P., Saucier, R., & Barrett, D. (2012). Partners in Crime: International Funding for Drug Control and Gross Violations of Human Rights. Harm Reduction International.
Garbarino, S., & Holland, J. (2009). Quantitative and Qualitative Methods in Impact Evaluation and Measuring Results. Birmingham: Governance and Social Development Resource Center.
Götzmann, N., Bansal, T., Wrzoncki, E., Poulsen-Hansen, C., Tedaldi, J., & Høvsgaard, R. (2006). Human rights impact assessment guidance and toolbox. Copenhagen: The Danish Institute for Human Rights Denmark’s National Human Rights Institution.
Guba, E. & Y. Lincoln (1989). Fourth Generation Evaluation. Newbury Park, CA: Sage.
Guijt, I. (2014). Participatory Approaches, Methodological Briefs: Impact Evaluation 5, UNICEF Office of Research, Florence. Retrieved from: http://devinfolive.info/impact_evaluation/img/downloads/Participatory_Approaches_ENG.pdf
Hanleybrown, F., Kania, J., & Kramer, M. (2012). Channeling change: Making collective impact work. Retrieved from: https://www.keywestchamber.org/uploads/4/6/5/2/46520599/channeling_change_pdf-ssi-article-2012.pdf
Helms, M.M., & Nixon, J. (2010). Exploring SWOT analysis – where are we now?: A review of academic research from the last decade. Journal of Strategy and Management, 3(3), 215-251. https://doi.org/doi/abs/10.1108/17554251011064837
Hentschel, J. (1999). Contextuality and data collection methods: A Framework and application to health service utilisation. The Journal of Development Studies 35, 64-94. doi.org/10.1080/00220389908422581
Himmelman, A.T. (2002). Collaboration for a change: Definitions. Decision-Making Models, Roles, and Collaboration Process Guide. Minneapolis: Hubert Humphrey Institute of Public Affairs, University of Minnesota.
Holland, J., Brook, S., Dudwick, N., Bertelsen, M., &Yaron, G. (2007). Monitoring empowerment in policy and programme interventions: Combining Qualitative and Quantitative Approaches’. Q-Squared Working Paper, No. 45, University of Toronto.
Kagan, C., Burton, M., Duckett, P., Lawthom, R., & Siddiquee, A. (2011). Critical community psychology. West Sussex, UK: Wiley.
Khandker, S., Koolwal, G.B., & Samad, H. (2009). Handbook on impact evaluation: quantitative methods and practices. The World Bank.
Labonté, R., & Laverack, G. (2008). Health promotion in action: from local to global empowerment. London: Palgrave Macmillan.
Laverack, G. (2004). Health promotion practice: power and empowerment. London: Sage Publications.
Lewin, K. (1946). Action research and minority problems. Journal of social issues, 2(4), 34-46
Luke, D.A. (2005). Getting the big picture in community science: Methods that capture context. American journal of community psychology, 35(3-4), 185. https://doi.org/10.1007/s10464-005-3397-z
Meringolo, P., Chiodini, M., & Nardone, G. (2016). Che le lacrime diventino perle. Milano: Ponte alle Grazie.
Montero, M. (2009). Community action and research as citizenship construction. American journal of community psychology, 43(1-2), 149-161. https://doi.org/10.1007/s10464-008-9224-6
Moreno, J.L. (1946). Sociogram and sociomatrix. Sociometry, 9, 348-349
Napan, K., Green, J.K., Thomas, J.A., Stent, W.J., Jülich, S.J., Lee, D., & Patterson, L. (2018). Collaborative Transformations: Cooperative Inquiry as a Catalyst for Change. Journal of Transformative Education, 16(3), 246-267. https://doi.org/10.1177/1541344617736636
Norris, F., Stevens, S., Pfefferbaum, B., Wyche, K., & Pfefferbaum, R. (2008). Community resilience as a metaphor, theory, set of capacities, and strategy for disaster readiness. American Journal of Community Psychology, 41, 127-150. https://doi.org/10.1007/s10464-007-9156-6
Norris, F.H., Tarcy, M., & Galea, S. (2009). Looking for resilience: understanding the longitudinal trajectories of responses to stress. Social Science and Medicine, 68, 2190-2198. https://doi.org/10.1016/j.socscimed.2009.03.043
Olson, B.D., Cooper, D.G., Viola, J.J., & Clark, B. (2016). Community narratives. In L.A. Jason & D.S. Glewick (Eds.), Handbook of methodological approaches to community-based research: Qualitative, quantitative, and mixed methods (pp. 43-51). New York: Oxford University Press.
Pfefferbaum, R.L., Pfefferbaum, B., Van Horn, R.L., Klomp, R.W., Norris, F.H., & Reissman, D.B. (2013). The communities advancing resilience toolkit (CART): An intervention to build community resilience to disasters. Journal of public health management and practice, 19(3), 250-258. https://doi.org/10.1097/PHH.0b013e318268aed8
Pietrzak R.H., & Southwick S.M. (2011). Psychological resilience in OEF-OIF Veterans: application of a novel classification approach and examination of demographic and psychosocial correlates. Journal of affective disorders,133(3), 560-568. https://doi.org/10.1016/j.jad.2011.04.028
PROVA (2016-2018). Prevention of violent Radicalisation and Of Violent Actions in intergroup relations. 580365-EPP-1-2016-1-IT-EPPKA3-IPI-SOC-IN. Retrieved from https://provaproject.org
Rappaport, J. (2000). Community Narratives: Tales of Terror and Joy. American Journal of Community Psychology, 28(1), 1-24. https://doi.org/10.1023/A:1005161528817
Sarason, S.B. (2000). Barometers of community change. In J. Rappaport & E. Seidman (Eds.), Handbook of community psychology (pp. 919-929). Boston, MA: Springer.
Stark, W. (2017). The University of the Future: Engaged – Creative – Responsible. Community Service Learning for Active Citizenship. In Reflections and Challenges Community Psychology in the European Context. Newcastle 18th-20th October. (Proceedings in press).
Wandersman, A., Imm, P., Chinman, M., & Kaftarian, S. (2000). Getting To Outcomes: A results-based approach to accountability. Evaluation and Program Planning, 23, 389-395. doi.org/10.1016/S0149-7189(00)00028-8
Wandersman, A., Snell-Johns, J., Lentz, B., Fetterman, D., Keener, D.C., Livet, M., & Flaspohler, P. (2005). The principles of empowerment evaluation. In D.M. Fetterman & A. Wandersman (Eds.), Empowerment evaluation principles in practice (pp. 27-41). New York: Guilford.
Watzlawick, P., Weakland, J., & Fish, R. (1974). Change: Principles of problem resolution and problem formation. New York: Norton.
Werner, E., & Smith, R. (1982). Vulnerable but invincible: A longitudinal study of resilient children and youth. New York: McGraw-Hill.
White, H. (2010). A contribution to current debates in impact evaluation. Evaluation, 16(2), 153-164. https://doi.org/10.1177%2F1356389010361562
Wolff, T. (2016). Ten places where collective impact gets it wrong. Global Journal of Community Psychology Practice, Guest editorial, 7(1), 1-13. Retrieved from http://www.gjcpp.org/
Zukoski, A., & Luluquisen, M. (2002). Participatory Evaluation: What is it? Why do it? What are the challenges? Policy & Practice, 5. Retrieved from http://depts.washington.edu/ccph/pdf_files/Evaluation.pdf
Full Text: PDF
Refbacks
- There are currently no refbacks.
