An Exploratory Study on Public Sector Program Evaluation Practices and Culture in Barbados, Belize, Guyana and Saint Vincent and the Grenadines: Where Are We? Where Do We Need To Go?
Main Article Content
Abstract
Background: Little is known about the status of program evaluation culture and practice in the English Speaking Commonwealth Caribbean (ESCC). This study examined the extent of evaluation culture and practice in four small Caribbean nations: Barbados, Belize, Guyana, and Saint Vincent and the Grenadines.
Purpose: The objective of this study was to learn about public sector program evaluation practices and culture in these four countries.
Setting: Public sector agencies in the four countries.
Intervention: NA
Research Design: Cross-sectional survey
Data Collection and Analysis: A total of eighty-eight public sector officials participated in a cross-sectional survey study.
Findings: The research highlighted that while program evaluation is being practiced in the public sector in all four countries, the extent of practice varied among the countries. One noticeable factor that affected program evaluation practices was the financial costs associated with program evaluations. This problem was particularly evident in Guyana where program evaluations were conducted primarily to satisfy funding requirements. However, despite the variation in practices, all four countries recognized that program evaluation is a valuable and important activity. Solutions proposed by the study participants to build a more vibrant public-sector program evaluation culture included making program evaluation culture a part of organizational culture, building organizational monitoring and evaluation (M&E) capacity, and making program evaluation a regular mandatory public sector activity.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Alkin, M., & Christie, C. (2004). An evaluation theory tree. In Evaluation roots: Tracing theorists' views and influences. https://doi.org/10.1016/j.stueduc.2008.07.001 https://doi.org/10.1016/j.stueduc.2008.07.001 DOI: https://doi.org/10.1016/j.stueduc.2008.07.001
Bamberger, M. (2000). The evaluation of international development programs: A view from the front. American Journal of Evaluation, 21(1), 95-102. https://doi.org/10.1177/109821400002100108 DOI: https://doi.org/10.1016/S1098-2140(00)00050-3
Bamberger, M. (2001). Book review: Evaluation in developing countries: Experience with agricultural research and development, the annotated bibliography of international program evaluation. American Journal of Evaluation, 22(1), 117-122. https://doi.org/10.1177/109821400102200115 DOI: https://doi.org/10.1177/109821400102200115
Bamberger, M., Rugh, J., & Mabry, L. (2006). RealWorld evaluation: Working under budget, time, data, and political constraints (1st ed.). Sage.
Blomquist, J. (2003). Impact evaluation of social programs: A policy perspective. http://siteresources.worldbank.org/safetynetsandtransfers/Resources/Eval-uation_Blomquist.pdf DOI: https://doi.org/10.1596/11827
Brereton, B. M., & Clarke, C. G. (2017). West Indies. In Encyclopedia Britannica. https://www.britannica.com/place/West-Indies-island-group-Atlantic-Ocean
Canadian Evaluation Society. (2018). Our history. https://evaluationcanada.ca/our-history
Caribbean Evaluators International. (2018). Our mission. https://caribbeanevaluatorsinternational.org/our-mission/
Central Intelligence Agency (US). (2018a). Guyana. https://www.cia.gov/library/publications/the-world-factbook/geos/gy.html
Central Intelligence Agency (US). (2018b). Jamaica. https://www.cia.gov/library/publications/the-world-factbook/geos/jm.html
Central Intelligence Agency (US). (2018c). Saint Kitts and Nevis. https://www.cia.gov/library/publications/the-world-factbook/geos/sc.html
Central Intelligence Agency (US). (2018d). Saint Vincent and the Grenadines. https://www.cia.gov/library/publications/the-world-factbook/geos/vc.html
Corbett, J., & Veenendaal, W. (2016). Westminster in small states: Comparing the Caribbean and Pacific experience. Contemporary Politics, 22(4), 432-449. https://doi.org/10.1080/13569775.2016.1175096 DOI: https://doi.org/10.1080/13569775.2016.1175096
Donaldson, S. I., Gooler, L. E., & Scriven, M. (2002). Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. American Journal of Evaluation, 23(3), 261-273. https://doi.org/10.1177/109821400202300303 DOI: https://doi.org/10.1177/109821400202300303
EvalPartners. (2012). The international partnership initiative to promote evaluation capacity development. https://www.evalpartners.org/sites/default/files/documents/%09mapping/VOPE_Mapping_2012_12_31.pdf
Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines (4th ed.). Pearson Educational.
Gugiu, P. C., & Persaud, N. (2005, October 26). Marketing evaluation to small developing countries [Paper presentation]. Joint annual conference of the Canadian Evaluation Society and American Evaluation Association, Toronto, Canada.
Horton, D., & Mackay, R. (2003). Using evaluation to enhance institutional learning and change: Recent experiences with agricultural research and development. Agricultural Systems, 78(2), 127-142. https://doi.org/10.1016/S0308-521X(03)00123-9 DOI: https://doi.org/10.1016/S0308-521X(03)00123-9
Inter-American Development Bank. (2012). The Caribbean and the IDB. http://www.iadb.org/en/news/webstories/2012-02-11/the-caribbean-and-the-idb,9840.html
Inter-American Development Bank. (2017). Lessons from four decades of infrastructure project-related conflicts in Latin America and the Caribbean.
International Development Evaluation Association. (2013). 2013 Global Assembly. https://ideas-global.org/category/2013-conference/
Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards: How to assess evaluations of educational programs (2nd ed.). Sage Publications.
Khan, J. (2003). Project monitoring and evaluation: Muddling, managing, making. In F. Alleyne, J. Khan, & W. Soverall (Eds.), Managing and evaluating projects (pp. 158-184). Arawak Publications.
Kim, P. S. (2002). Cultural change in government: Promoting a high-performance culture: A review of ten years of modernisation: The HRM perspective. Human Resources Management (HRM) Working Party Meeting, OECD.
Kosheleva, N., & Segone, N. (2013). EvalPartners and the role of voluntary organizations for professional evaluation (VOPEs) in the development of national evaluation capacity. In J. Rugh & M. Seagone (Eds.), Voluntary organizations for professional evaluation (VOPEs): Learning from Africa, Americas, Asia, Australasia, Europe and Middle East (pp. 8-12). UNICEF, EvalPartners, International Organisation for Cooperation in Evaluation. https://www.mymande.org/sites/default/files/UNICEF_NY_ECS_Book2_web.pdf
Mark, M. M. (2005). American Journal of Evaluation. In S. Mathison (Ed.), Encyclopedia of Evaluation (p. 17). Sage.
Mathison, S. (2005). American Evaluation Association. In S. Mathison (Ed.), Encyclopedia of evaluation (p. 17). Sage. https://doi.org/10.4135/9781412950558.n24 DOI: https://doi.org/10.4135/9781412950558
Mayne, J. (2008). Building an evaluative culture for effective evaluation and results management (ILAC Working Paper No. 8). http://www.focusintl.com/RBM107-ILAC_WorkingPaper_No8_EvaluativeCulture_Mayne.pdf
Mayne, J. (2009). Building an evaluative culture: The key to effective evaluation and results management. Canadian Journal of Program Evaluation, 24(2), 1-30. https://evaluationcanada.ca/canadian-journal-program-evaluation/volume-24-2009/fall https://doi.org/10.3138/cjpe.24.001 DOI: https://doi.org/10.3138/cjpe.24.001
Meditz, S. W., & Hanratty, D. M. (1987). Islands of the Commonwealth Caribbean: A regional study. Federal Research Division, Library of Congress.
Morrell, J. (2005). Evaluation and program planning. In S. Mathison (Ed.), Encyclopedia of evaluation (p. 140). Sage.
Rondinelli, D. A. (1976). Why development projects fail: Problems of management in developing countries. Project Management Quarterly, 7(1), 10-15.
Royse, D., Thyer, B. A., & Padgett, D. K. (2001). Program evaluation: An introduction (3rd ed.). ThomsonLearning Inc.
Rugh, J. (2013). The growth and evolving capacities of VOPEs. In J. Rugh & M. Seagone (Eds.), Voluntary organizations for professional evaluation (VOPEs): Learning from Africa, Americas, Asia, Australasia, Europe and Middle East (pp. 13-40). EvalPartners, UNICEF, IOCE.
Sanderson, I. (2002). Evaluation, policy learning and evidence-based policy making. Public Administration, 80(1), 1-22. https://doi.org/10.1111/1467-9299.00292 DOI: https://doi.org/10.1111/1467-9299.00292
Scriven, M. (1991). Evaluation thesaurus (4th ed.). SAGE.
Scriven, M. (1996). The theory behind practical evaluation. Evaluation, 2(4), 393-404. https://doi.org/10.1177/135638909600200403 DOI: https://doi.org/10.1177/135638909600200403
Shadish, W. R., & Luellen, J. K. (2005). History of evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 183-186). Sage.
Shepherd, R. (2016, April 13). Deliverology and innovation in evaluation: Canada as a case study [Paper presentation]. Collaborative conference between the University of the West Indies, The Caribbean Development Bank, and Carleton University, Bridgetown, Barbados.
Stufflebeam, D. L. (2005). The Personnel Evaluation Standards. In S. Mathison (Ed.), Encyclopedia of evaluation (p. 313). Sage.
United Nations. (2018). World economic situation and prospects 2018. https://www.un.org/development/desa/dpad/wp-content/uploads/sites/45/publication/WESP2018_Full_Web-1.pdf
Weiss, C. H. (1993). Where politics and evaluation research meet. Evaluation Practice, 14(1), 93-106. https://doi.org/10.1177/109821409301400119 DOI: https://doi.org/10.1177/109821409301400119