The Relationship Between Employee Motivation and Evaluation Capacity in a Community-Based Education Organization
DOI:
https://doi.org/10.56645/jmde.v19i45.719Keywords:
evaluation, evaluation capacity building, evaluative thinking, work motivation, community-based organizationAbstract
- Background: Evaluation capacity building (ECB) has gained popularity among organizations due to the increased importance of accountability and organizational effectiveness. While the ECB literature has occasionally addressed the notion of motivation, it has usually been in terms of motivation to do or use evaluation (Clinton, 2014; Taylor-Ritzler et al., 2013); this study sought to ascertain whether general overall employee motivation in an organization is itself related to evaluation capacity. By better understanding this relationship, those who are involved in administering, implementing, evaluating, or researching ECB can be better equipped to understand one of the ‘mediating conditions’ or ‘antecedent conditions’ (Cousins et al., 2014) affecting an organization’s ability to do and use evaluation, and, in turn, can more efficiently and effectively craft their ECB work.
- Purpose: The purpose of this study was to explore the relationship between: (a) employee motivation and individual evaluation capacity; (b) employee motivation and evaluative thinking, and (c) evaluation capacity and evaluative thinking.
- Setting: The study focused on the Cooperative Extension System, a non-formal community-based education organization linked to public land-grant universities throughout the United States. Specifically, this study drew participants from two state Extension systems, Virginia and Maryland.
- Intervention: Not applicable.
- Research Design: This quantitative study used a descriptive correlational design (Creswell, 2003) to uncover the relationship between the variables: motivation and evaluation capacity, motivation and evaluative thinking, and evaluation capacity and evaluative thinking.
- Data Collection and Analysis: To investigate the relationship between the factors of interest (motivation, evaluation capacity, and evaluative thinking), three instruments were used: the Multidimensional Work Motivation Scale (MWMS), the Evaluation Capacity Assessment Instrument (ECAI), and the Evaluative Thinking Inventory (ETI). STATA MP 13.1 quantitative software was used to analyze the collected data.
- Findings: Employees with lower overall motivation in doing their work have lower evaluation capacity, and employees with higher motivation which is triggered by no external means but driven by internal factors have higher evaluation capacity.
Downloads
References
Adams, J. S. (1965). Inequity in social exchange. In Advances in experimental social psychology (Vol. 2, pp. 267–299). Academic Press. https://doi.org/10.1016/S0065-2601(08)60108-2
Aliyyah, N., Prasetyo, I., Rusdiyanto, R., Endarti, E. W., Mardianah, F., Winarko, R., Chamariyah, Mulyani, S., Grahani, F. O., Rochman, A. S., Kalbuana, N., Hidayat, W., & Tjaraka, H. (2021). What affects employee performance through work motivation? Journal of Management Information and Decision Sciences, 24(1).
Anderson, J. C., Woods-Wells, T. M., Amal, T. M., Bass, R. T., & Simpson, C. Y. (2018). Examining the relationships among motivational factors and the academic achievement of students enrolled in a comprehensive agricultural education program. Journal of Career and Technical Education, 33(1), 27–48. https://doi.org/10.21061/jcte.v33i1.a2
Archibald, T., Neubauer, L. C., & Brookfield, S. D. (2018). The critically reflective evaluator: Adult education’s contributions to evaluation for social justice. New Directions for Evaluation, 158, 109–123. https://doi.org/10.1002/ev.20319
Archibald, T., Sharrock, G., Buckley, J., & Young, S. (2018). Every practitioner a “knowledge worker”: Promoting evaluative thinking to enhance learning and adaptive management in international development. New Directions for Evaluation, 158, 73–91. https://doi.org/10.1002/ev.20323
Baker, A., & Bruner, B. (2006). Evaluation capacity and evaluative thinking in organizations. Bruner Foundation Inc.
Bedeian, T. (1993). Motivation and Leadership in Workplace. (3rd ed.). London:McGrawHill.
Buckley, J. & Archibald, T. (2011). The Evaluative Thinking Inventory. Cornell University. Retrieved from: https://static1.squarespace.com/static/5dd452abb1ab661ae7d79446/t/619e6890b6b72a66c5f6cbff/1637771408742/Cornell+ETInventory.pdf
Buckley, J., Archibald, T., Hargraves, M., & Trochim, W. M. (2015). Defining and teaching evaluative thinking: Insights from research on critical thinking. American Journal of Evaluation, 36(3), 375–388. https://doi.org/10.1177/1098214015581706
Clinton, J. (2014). The true impact of evaluation: Motivation for ECB. American Journal of Evaluation, 35(1), 120–127. https://doi.org/10.1177/1098214013499602
Compton, D. W., Glover-Kudon, R., Smith, I. E., & Eden Avery, M. (2002). Ongoing capacity building in the American Cancer Society (ACS) 1995–2001. New Directions for Evaluation, 93, 47–62. https://doi.org/10.1002/ev.41
Cousins, J. B., Goh, S. C., & Elliot, C. J. (2007, June). Organizational capacity to do and use evaluation: Preliminary results of a pan-Canadian survey of evaluators [Paper presentation]. Annual meeting of the Canadian Evaluation Society, Winnipeg, Manitoba, Canada.
Cousins, J. B., Goh, S. C., Elliott, C. J., & Bourgeois, I. (2014). Framing the capacity to do and use evaluation. New Directions for Evaluation, 141, 7–23. https://doi.org/10.1002/ev.20076
Creswell, J. W. (2003). Research design: Qualitative, quantitative, and mixed methods approaches. Sage.
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Pearson.
Deci, E. L., Connell, J. P., & Ryan, R. M. (1989). Self-determination in a work organization. Journal of Applied Psychology, 74(4), 580. https://doi.org/10.1037/0021-9010.74.4.580
Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human
behavior. Plenum.
Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227–268. https://doi.org/10.1207/S15327965PLI1104_01
Dickson, W. J. (1973). Hawthorne experiments. In C. Heyel, Ed., The Encyclopedia of management. Van Nostrand Reinhold.
Duffy, J. L., & Wandersman, A. (2007, November). A review of research on evaluation capacity building strategies [Paper presentation]. Annual conference of the American Evaluation Association, Baltimore, Maryland, United States.
Gagné, M., & Deci, E. L. (2005). Self‐determination theory and work motivation. Journal of Organizational Behavior, 26(4), 331–362. https://doi.org/10.1002/job.322
Gagné, M., Forest, J., Vansteenkiste, M., Crevier-Braud, L., Van den Broeck, A., Aspeli, A. K., Bellerose, J., Benabou, C., Chemolli, E., Güntert, S. T., Halvari, H., Indiyastuti, D. L., Johnson, P. A., Molstad, M. H., Naudin, M., Ndao, A., Olafsen, A. H., Roussel, P., Wang, Z., & Westbye, C. (2015). The Multidimensional Work Motivation Scale: Validation evidence in seven languages and nine countries. European Journal of Work and Organizational Psychology, 24(2), 178–196. https://doi.org/10.1080/1359432X.2013.877892
Gliem, J. A., & Gliem, R. R. (2003). Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales [Paper presentation]. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education, Columbus, Ohio, United States.
Johari, S., & Jha, K. N. (2020). Impact of work motivation on construction labor productivity. Journal of Management in Engineering, 36(5), 04020052. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000824
Kuhl, J., Quirin, M., & Koole, S. L. (2021). The functional architecture of human motivation: Personality systems interactions theory. In Advances in motivation science (Vol. 8, pp. 1–62). Elsevier. https://doi.org/10.1016/bs.adms.2020.06.001
Labin, S. N., Duffy, J. L., Meyers, D. C., Wandersman, A., & Lesesne, C. A. (2012). A research synthesis of the evaluation capacity building literature. American Journal of Evaluation, 33(3), 307–338. https://doi.org/10.1177/1098214011434608
Lindner, J. R. (1998). Understanding employee motivation. Journal of Extension, 36(3), 1–8.
Maslow, A. H. (1943). A theory of human motivation. Psychological Review, 50(4), 370. https://doi.org/10.1037/h0054346
McIntosh, J. S., Buckley, J., & Archibald, T. (2020). Refining and measuring the construct of evaluative thinking: An exploratory factor analysis of the evaluative thinking inventory. Journal of MultiDisciplinary Evaluation, 16(34), 104–117. https://doi.org/10.56645/jmde.v16i34.591
Milstein, B., Chapel, T. J., Wetterhall, S. F., & Cotton, D. A. (2002). Building capacity for program evaluation at the Centers for Disease Control and Prevention. New Directions for Evaluation, 93, 27–46. https://doi.org/10.1002/ev.40
Patton, M. Q. (2018). A historical perspective on the evolution of evaluative thinking. New Directions for Evaluation, 158, 11–28. https://doi.org/10.1002/ev.20325
Preskill, H. (2014). Now for the hard stuff: Next steps in ECB research and practice. American Journal of Evaluation, 35(1), 116–119. https://doi.org/10.1177/1098214013499439
Preskill, H., & Boyle, S. (2008a). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4), 443–459. https://doi.org/10.1177/1098214008324182
Preskill, H., & Boyle, S. (2008b). Insights into evaluation capacity building: Motivations, strategies, outcomes, and lessons learned. The Canadian Journal of Program Evaluation, 23(3), 147. https://doi.org/10.3138/cjpe.0023.008
Riyanto, S., Endri, E., & Herlisha, N. (2021). Effect of work motivation and job satisfaction on employee performance: Mediating role of employee engagement. Problems and Perspectives in Management, 19(3), 162–174. http://dx.doi.org/10.21511/ppm.19(3).2021.14
Robbins, S. P. (1993). Organizational behavior: Concept, controversies, and applications: Instructor's manual with transparency masters. Prentice Hall.Ryan, R. M., & Deci, E. L. (2020). Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions. Contemporary Educational Psychology, 61, 101860. https://doi.org/10.1016/j.cedpsych.2020.101860
Schunk, D. H., & DiBenedetto, M. K. (2020). Motivation and social cognitive theory. Contemporary Educational Psychology, 60, 101832. https://doi.org/10.1016/j.cedpsych.2019.101832
Schwandt, T. A. (2018). Evaluative thinking as a collaborative social practice: The case of boundary judgment making. New Directions for Evaluation, 158, 125–137. https://doi.org/10.1002/ev.20318
Sobeck, J., & Agius, E. (2007). Organizational capacity building: Addressing a research and practice gap. Evaluation and Program Planning, 30(3), 237–246. https://doi.org/10.1016/j.evalprogplan.2007.04.003
Suarez-Balcazar, Y., & Taylor-Ritzler, T. (2014). Moving from science to practice in evaluation capacity building. American Journal of Evaluation, 35(1), 95–99. https://doi.org/10.1177/1098214013499440
Taut, S. (2007). Studying self-evaluation capacity building in a large international development organization. American Journal of Evaluation, 28(1), 45–59. https://doi.org/10.1177/1098214006296430
Taylor‐Powell, E., & Boyd, H. H. (2008). Evaluation capacity building in complex organizations. New Directions for Evaluation, 120, 55–69. https://doi.org/10.1002/ev.276
Taylor-Ritzler, T., Suarez-Balcazar, Y., Garcia-Iriarte, E., Henry, D. B., & Balcazar, F. E. (2013). Understanding and measuring evaluation capacity: A model and instrument validation study. American Journal of Evaluation, 34(2), 190–206. https://doi.org/10.1177/1098214012471421
Tietjen, M. A., & Myers, R. M. (1998). Motivation and job satisfaction. Management decision, 36(4), 226–231. https://doi.org/10.1108/00251749810211027
Van den Broeck, A., Howard, J. L., Van Vaerenbergh, Y., Leroy, H., & Gagné, M. (2021). Beyond intrinsic and extrinsic motivation: A meta-analysis on self-determination theory’s multidimensional conceptualization of work motivation. Organizational Psychology Review, 11(3), 240–273. https://doi.org/10.1177/20413866211006173
Vo, A. T., & Archibald, T. (2018). New directions for evaluative thinking. New directions for evaluation, 2018(158), 139-147. https://doi.org/10.1002/ev.20317
Vo, A. T., Schreiber, J. S., & Martin, A. (2018). Toward a conceptual understanding of evaluative thinking. New Directions for Evaluation, 158, 29–47. https://doi.org/10.1002/ev.20324
Vroom, V. H. (1964). Work and motivation (Vol. 54). Wiley.
Wandersman, A. (2014). Moving forward with the science and practice of evaluation capacity building (ECB): The why, how, what, and outcomes of ECB. American Journal of Evaluation, 35(1), 87–89. https://doi.org/10.1177/1098214013503895
Wang, S. L. (2014). Cooperative extension system: Trends and economic impacts on U.S. agriculture. Choices, 29(316-2016-7709), 1–8. https://doi.org/10.22004/ag.econ.171040
Downloads
Published
Versions
- 20-Sep-23 (2)
- 15-Sep-23 (1)
How to Cite
Issue
Section
License
Copyright (c) 2023 Anuradha Sen, Thomas Archibald, PhD, James C. Anderson, PhD, Tiffany Drape, PhD
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
