Tracing the Transnational Influence of Jennifer Greene’s Ideas: Research on Evaluation Theory Across Countries
DOI:
https://doi.org/10.56645/jmde.v19i45.845Keywords:
research on evaluation, transnational influence, evaluation theory, mixed-methods citation analysis, valuesAbstract
The study examines the transnational influence of American evaluation theorist Jennifer Greene’s ideas. Using mixed methods citation analysis, we investigate how Greene’s work in program evaluation theory on equity, democracy, and values engagement has impacted the field across countries. Rather than investigating theorist influence in a strictly quantitative way, we sought a contextualized, richer understanding of the contexts in which Greene’s ideas were being used to observe the imprint of her work on evaluators theorizing and practicing outside of the United States. To achieve this depth of knowledge required both quantitative and qualitative strategies as well as attention to geographical and cultural locations and translations. This study details a distinct methodological strategy for conducting research on evaluation theory.
Downloads
References
Alkin, M. C. (2013). Evaluation roots: A wider perspective of theorists’ views and influences. Sage.
Arvidson, M., & Kara, H. (2013, October). Putting evaluations to use: From measuring to endorsing social value (Report no. 110). Third Sector Research Centre.
Blewden, M. B. (2014). Why do evaluators intentionally seek process use? Exploring meaning and reason as explanation [Doctoral dissertation, Massey University]. Massey University Archive.
Cavino, H. M. (2013). Across the colonial divide: Conversations about evaluation in Indigenous contexts. American Journal of Evaluation, 34(3), 339–355. DOI: https://doi.org/10.1177/1098214013489338
Chilisa, B., Major, E. T., Gaotlhobogwe, M., & Mokgolodi, H. (2016). Decolonizing and indigenizing evaluation practice in Africa: toward African relational evaluation approaches. Canadian Journal of Program Evaluation, 30(3), 313–328. DOI: https://doi.org/10.3138/cjpe.30.3.05
Chilisa, B., & Mertens, D. (2021). Indigenous made in Africa evaluation frameworks: Addressing epistemic violence and contributing to social transformation. American Journal of Evaluation, 42(2), 241–253. DOI: https://doi.org/10.1177/1098214020948601
Christie, C. A. (2003). What guides evaluation? A study of how evaluation practice maps onto evaluation theory. New Directions for Evaluation, 97, 7–35. DOI: https://doi.org/10.1002/ev.72
Cram, F., Pipi, K., & Paipa, K. (2018). Kaupapa Māori evaluation in Aotearoa New Zealand. New Directions for Evaluation, 159, 63– 77. DOI: https://doi.org/10.1002/ev.20331
Datta, L. E. (1999). The ethics of evaluation neutrality and advocacy. New Directions for Evaluation, 82, 77–88. DOI: https://doi.org/10.1002/ev.1139
Emerson, R. O. (2020). Evaluation use and evaluator competencies in low-income countries: A three article dissertation (Publication No. 27671557) [Doctoral Dissertation, University of Massachusetts Lowell]. ProQuest.
Goodnight, M. R. (2017). Learning to “measure what affects their lives”: Ethnography of a citizen-engaged evaluation of primary education in India (Publication No. 10599943) [Doctoral dissertation, University of California Los Angeles]. ProQuest.
Goodnight, M. R., & Avent, C. M. (2023). In pursuit of democratic values: Transnational influences on Jennifer Greene. In J. N. Hall, A. Boyce, & R. Hopson (Eds.), Disrupting program evaluation and mixed methods research for a more just society: The contributions of Jennifer C. Greene (pp. 165–180). Information Age Publishing.
Goodnight, M. R., Avent, C. M. & Kumaran, R. (2022). Employing mixed methods citation analysis to investigate transnational influence in evaluation theory [Manuscript submitted for publication]. University of Illinois at Urbana-Champaign, Department of Educational Psychology, Champaign, Illinois.
Greene J. C. (1997) Evaluation as advocacy. American Journal of Evaluation, 18(1), 25–35. DOI: https://doi.org/10.1016/S0886-1633(97)90005-2
Greene, J. C. (2007). Mixed methods in social inquiry. John Wiley & Sons, Inc.
Greene, J. C. (2012). Values-engaged evaluation. In M. Segone (Ed.), Evaluation for equitable development results (pp. 192–206). UNICEF.
Greene, J. C. (2013). Making the world a better place through evaluation. Evaluation roots: A wider perspective of theorists’ views and influences (2nd ed., pp. 208–217). Sage.
Greene, J. C. (2015a). Culture and evaluation: From a transcultural Belvedere. In S. Hood, R. Hopson, & H. Frierson (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice (pp. 91–107). Information Age Publishing.
Greene, J. C. (2015b). The emergence of mixing methods in the field of evaluation. Qualitative Health Research, 25(6), 746–750. DOI: https://doi.org/10.1177/1049732315576499
Greene, J. C. (2016). Advancing equity: Cultivating an evaluation habit. In S. Donaldson & R. Picciotto (Eds.), Evaluation for an equitable society (pp. 49–66). Information Age Publishing.
Greene, J. C., DeStefano, L., Burgon, H., & Hall, J. (2006). An educative, values-engaged approach to evaluating STEM educational programs. New Directions for Evaluation, 109, 53–71. https://doi.org/10.1002/ev.178 DOI: https://doi.org/10.1002/ev.178
Greene, J. C., Millett, R. A., & Hopson, R. K. (2004). Evaluation as a democratizing practice. In M. T. Braverman, N. Constantine, & J. K. Slater (Eds.), Foundations and evaluation: Contexts and practices for effective philanthropy (pp. 96–118). Jossey-Bass.
Greenseid, L. O., & Lawrenz, F. (2011). Using citation analysis methods to assess the influence
of science, technology, engineering, and mathematics education evaluations. American Journal of Evaluation, 32(3), 392–407. DOI: https://doi.org/10.1177/1098214011399750
Hall, J. N., Boyce A., & Hopson, R. (2023). Disrupting program evaluation and mixed methods research for a more just society: The Contributions of Jennifer C. Greene. Information Age Publishing.
Heberger, A. E., Christie, C. A., & Alkin, M. C. (2010). A bibliometric analysis of the academic influences of and on evaluation theorists’ published works. American Journal of Evaluation, 31(1), 24–44. DOI: https://doi.org/10.1177/1098214009354120
Hood, S. (1998). Responsive evaluation Amistad style: Perspectives of one African American evaluator. In R. Davis (Ed.), Proceedings of the Stake Symposium on Educational Evaluation (pp. 101–112). University of Illinois.
Hood, S. (2001), Nobody knows my name: In praise of African American evaluators who were responsive. New Directions for Evaluation, 92, 31–44. DOI: https://doi.org/10.1002/ev.33
Hood, S., Hopson, R. K., & Kirkhart, K. E. (2015). Culturally responsive evaluation: Theory, practice, and future implications. In K. Newcomer, H. Hatry, & J. Wholey (Eds.), Handbook of practical program evaluation (4th ed., pp. 281–317). Wiley. DOI: https://doi.org/10.1002/9781119171386.ch12
Izurieta, A., Sithole, B., Stacey, N., Hunter-Xenie, H., Campbell, B., Donohoe, P., Brown, J., & Wilson, L. (2011). Developing indicators for monitoring and evaluating joint management effectiveness in protected areas in the Northern Territory, Australia. Ecology and Society, 16(3). DOI: https://doi.org/10.5751/ES-04274-160309
Kim, H., & Cervero, R. M. (2007). How power relations structure the evaluation process for HRD programmes. Human Resource Development International, 10(1), 5–20. DOI: https://doi.org/10.1080/13678860601170245
King, J. (2003). The Challenge of studying evaluation theory. New Directions for Evaluation, 97, 57–67. DOI: https://doi.org/10.1002/ev.76
Kwok, W. L. (2013). Evaluating preventing violence against women initiatives: A participatory and learning-oriented approach for primary prevention in Victoria. Victorian Health Promotion Foundation, Melbourne, Australia.
LaFrance, J. (2004). Culturally competent evaluation in Indian Country. New Directions for Evaluation, 102, 39–50. DOI: https://doi.org/10.1002/ev.114
LaFrance, J. & Nichols, R. (2010). Reframing evaluation: Defining an indigenous evaluation framework. The Canadian Journal of Program Evaluation, 23(2), 13–31. DOI: https://doi.org/10.3138/cjpe.23.003
Lemire, S., Whynot, J., & Montague, S. (2019). How we model matters: A manifesto for the next generation of program theorizing. Canadian Journal of Program Evaluation, 33(3), 414–433. DOI: https://doi.org/10.3138/cjpe.53070
Mathie, A., & Greene, J. C. (1997). Stakeholder participation in evaluation: How important is diversity? Evaluation and Program Planning, 20(3), 279–285. DOI: https://doi.org/10.1016/S0149-7189(97)00006-2
Meho, L. I., & Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS
faculty: Web of Science versus Scopus and Google Scholar. Journal of the American Society for Information Science and Technology, 58(13), 2105–2125.
Mertens, D. M., & Wilson, A. T. (2019). Program evaluation theory and practice: A comprehensive guide (2nd ed.). Guilford Press.
Moed, H. F. (2005). Citation analysis in research evaluation (Vol. 9). Springer Science & Business Media.
Nehaus, C. & Daniel, H. (2008). Data sources for performing citation analysis: An overview. Journal of Documentation, 64(2), 193–210. DOI: https://doi.org/10.1108/00220410810858010
Noruzi, A. (2005). Google Scholar: The new generation of citation indexes. LIBRI, 55(4), 170–180. DOI: https://doi.org/10.1515/LIBR.2005.170
Quiedeville, S. (2017). Ex-post assessment of impacts of research on innovations for organic farming: Issues, methods, tools and instruments [Doctoral dissertation, Université De Montpellier. https://www.cairn.info/revue-journal-of-innovation-economics-2017-1-page-145.htm&wt.src=pdf.]
Pino, M. (2014) Los valores que sustentan el SIMCE: Pensando en un sistema de evaluación más allá de una medición estandarizada [The values that support SIMCE: Thinking about an evaluation system beyond a standardized measurement]. Politica Educativa, Chile.
Roseland, D., Greenseid, L. O., Volkov, B. B., & Lawrenz, F. (2011). Documenting the impact of multisite evaluations on the science, technology, engineering, and mathematics field. New Directions for Evaluation, 129, 39–48. DOI: https://doi.org/10.1002/ev.353
Shadish, W. R. (1998). Evaluation theory is who we are. American Journal of Evaluation, 19(1), 1–19. DOI: https://doi.org/10.1016/S1098-2140(99)80177-5
Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation. SAGE.
Smith, N. L., & Brandon, P. R. (2008). Fundamental issues in evaluation (1st ed.). Routledge.
Streatfield, D., & Markless, S. (2011) Impact evaluation, advocacy and ethical research: Some issues for national strategy development? Library Review, 60(4), 312–327. DOI: https://doi.org/10.1108/00242531111127866
Thomas, V. G., & Campbell, P. B. (2021). Evaluation in today’s world: Respecting diversity, improving quality, and promoting usability. Sage.
Vallin, L. M., Philippoff, J., Pierce, S., & Brandon, P. R. (2015). Research-on-evaluation articles published in the American Journal of Evaluation, 1998–2014. New Directions for Evaluation, 148, 7–15. DOI: https://doi.org/10.1002/ev.20153
Walters, W. H. (2016). Information sources and indicators for the assessment of journal reputation and impact. The Reference Librarian, 57(1), 13–22. DOI: https://doi.org/10.1080/02763877.2015.1088426
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Melissa Rae Goodnight, Cherie M. Avent, Ramya Kumaran
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
