The Relationship Between Employee Motivation and Evaluation Capacity in a Community-Based Education Organization

Authors

  • Anuradha Sen Virginia Tech
  • Thomas Archibald Virginia Tech
  • James C. Anderson University of Georgia
  • Tiffany Drape Virginia Tech

DOI:

https://doi.org/10.56645/jmde.v19i45.719

Keywords:

evaluation, evaluation capacity building, evaluative thinking, work motivation, community-based organization

Abstract

  • Background: Evaluation capacity building (ECB) has gained popularity among organizations due to the increased importance of accountability and organizational effectiveness. While the ECB literature has occasionally addressed the notion of motivation, it has usually been in terms of motivation to do or use evaluation (Clinton, 2014; Taylor-Ritzler et al., 2013); this study sought to ascertain whether general overall employee motivation in an organization is itself related to evaluation capacity. By better understanding this relationship, those who are involved in administering, implementing, evaluating, or researching ECB can be better equipped to understand one of the ‘mediating conditions’ or ‘antecedent conditions’ (Cousins et al., 2014) affecting an organization’s ability to do and use evaluation, and, in turn, can more efficiently and effectively craft their ECB work.
  • Purpose: The purpose of this study was to explore the relationship between: (a) employee motivation and individual evaluation capacity; (b) employee motivation and evaluative thinking, and (c) evaluation capacity and evaluative thinking.
  • Setting: The study focused on the Cooperative Extension System, a non-formal community-based education organization linked to public land-grant universities throughout the United States. Specifically, this study drew participants from two state Extension systems, Virginia and Maryland.
  • Intervention: Not applicable.
  • Research Design: This quantitative study used a descriptive correlational design (Creswell, 2003) to uncover the relationship between the variables: motivation and evaluation capacity, motivation and evaluative thinking, and evaluation capacity and evaluative thinking.
  • Data Collection and Analysis: To investigate the relationship between the factors of interest (motivation, evaluation capacity, and evaluative thinking), three instruments were used: the Multidimensional Work Motivation Scale (MWMS), the Evaluation Capacity Assessment Instrument (ECAI), and the Evaluative Thinking Inventory (ETI). STATA MP 13.1 quantitative software was used to analyze the collected data.
  • Findings: Employees with lower overall motivation in doing their work have lower evaluation capacity, and employees with higher motivation which is triggered by no external means but driven by internal factors have higher evaluation capacity.

Downloads

Download data is not yet available.

References

Adams, J. S. (1965). Inequity in social exchange. In Advances in experimental social psychology (Vol. 2, pp. 267–299). Academic Press. https://doi.org/10.1016/S0065-2601(08)60108-2 DOI: https://doi.org/10.1016/S0065-2601(08)60108-2

Aliyyah, N., Prasetyo, I., Rusdiyanto, R., Endarti, E. W., Mardianah, F., Winarko, R., Chamariyah, Mulyani, S., Grahani, F. O., Rochman, A. S., Kalbuana, N., Hidayat, W., & Tjaraka, H. (2021). What affects employee performance through work motivation? Journal of Management Information and Decision Sciences, 24(1).

Anderson, J. C., Woods-Wells, T. M., Amal, T. M., Bass, R. T., & Simpson, C. Y. (2018). Examining the relationships among motivational factors and the academic achievement of students enrolled in a comprehensive agricultural education program. Journal of Career and Technical Education, 33(1), 27–48. https://doi.org/10.21061/jcte.v33i1.a2 DOI: https://doi.org/10.21061/jcte.v33i1.a2

Archibald, T., Neubauer, L. C., & Brookfield, S. D. (2018). The critically reflective evaluator: Adult education’s contributions to evaluation for social justice. New Directions for Evaluation, 158, 109–123. https://doi.org/10.1002/ev.20319 DOI: https://doi.org/10.1002/ev.20319

Archibald, T., Sharrock, G., Buckley, J., & Young, S. (2018). Every practitioner a “knowledge worker”: Promoting evaluative thinking to enhance learning and adaptive management in international development. New Directions for Evaluation, 158, 73–91. https://doi.org/10.1002/ev.20323 DOI: https://doi.org/10.1002/ev.20323

Baker, A., & Bruner, B. (2006). Evaluation capacity and evaluative thinking in organizations. Bruner Foundation Inc.

Bedeian, T. (1993). Motivation and Leadership in Workplace. (3rd ed.). London:McGrawHill.

Buckley, J. & Archibald, T. (2011). The Evaluative Thinking Inventory. Cornell University. Retrieved from: https://static1.squarespace.com/static/5dd452abb1ab661ae7d79446/t/619e6890b6b72a66c5f6cbff/1637771408742/Cornell+ETInventory.pdf

Buckley, J., Archibald, T., Hargraves, M., & Trochim, W. M. (2015). Defining and teaching evaluative thinking: Insights from research on critical thinking. American Journal of Evaluation, 36(3), 375–388. https://doi.org/10.1177/1098214015581706 DOI: https://doi.org/10.1177/1098214015581706

Clinton, J. (2014). The true impact of evaluation: Motivation for ECB. American Journal of Evaluation, 35(1), 120–127. https://doi.org/10.1177/1098214013499602 DOI: https://doi.org/10.1177/1098214013499602

Compton, D. W., Glover-Kudon, R., Smith, I. E., & Eden Avery, M. (2002). Ongoing capacity building in the American Cancer Society (ACS) 1995–2001. New Directions for Evaluation, 93, 47–62. https://doi.org/10.1002/ev.41 DOI: https://doi.org/10.1002/ev.41

Cousins, J. B., Goh, S. C., & Elliot, C. J. (2007, June). Organizational capacity to do and use evaluation: Preliminary results of a pan-Canadian survey of evaluators [Paper presentation]. Annual meeting of the Canadian Evaluation Society, Winnipeg, Manitoba, Canada.

Cousins, J. B., Goh, S. C., Elliott, C. J., & Bourgeois, I. (2014). Framing the capacity to do and use evaluation. New Directions for Evaluation, 141, 7–23. https://doi.org/10.1002/ev.20076 DOI: https://doi.org/10.1002/ev.20076

Creswell, J. W. (2003). Research design: Qualitative, quantitative, and mixed methods approaches. Sage.

Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Pearson.

Deci, E. L., Connell, J. P., & Ryan, R. M. (1989). Self-determination in a work organization. Journal of Applied Psychology, 74(4), 580. https://doi.org/10.1037/0021-9010.74.4.580 DOI: https://doi.org/10.1037//0021-9010.74.4.580

Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human DOI: https://doi.org/10.1007/978-1-4899-2271-7

behavior. Plenum.

Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227–268. https://doi.org/10.1207/S15327965PLI1104_01 DOI: https://doi.org/10.1207/S15327965PLI1104_01

Dickson, W. J. (1973). Hawthorne experiments. In C. Heyel, Ed., The Encyclopedia of management. Van Nostrand Reinhold.

Duffy, J. L., & Wandersman, A. (2007, November). A review of research on evaluation capacity building strategies [Paper presentation]. Annual conference of the American Evaluation Association, Baltimore, Maryland, United States.

Gagné, M., & Deci, E. L. (2005). Self‐determination theory and work motivation. Journal of Organizational Behavior, 26(4), 331–362. https://doi.org/10.1002/job.322 DOI: https://doi.org/10.1002/job.322

Gagné, M., Forest, J., Vansteenkiste, M., Crevier-Braud, L., Van den Broeck, A., Aspeli, A. K., Bellerose, J., Benabou, C., Chemolli, E., Güntert, S. T., Halvari, H., Indiyastuti, D. L., Johnson, P. A., Molstad, M. H., Naudin, M., Ndao, A., Olafsen, A. H., Roussel, P., Wang, Z., & Westbye, C. (2015). The Multidimensional Work Motivation Scale: Validation evidence in seven languages and nine countries. European Journal of Work and Organizational Psychology, 24(2), 178–196. https://doi.org/10.1080/1359432X.2013.877892 DOI: https://doi.org/10.1080/1359432X.2013.877892

Gliem, J. A., & Gliem, R. R. (2003). Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales [Paper presentation]. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education, Columbus, Ohio, United States.

Johari, S., & Jha, K. N. (2020). Impact of work motivation on construction labor productivity. Journal of Management in Engineering, 36(5), 04020052. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000824 DOI: https://doi.org/10.1061/(ASCE)ME.1943-5479.0000824

Kuhl, J., Quirin, M., & Koole, S. L. (2021). The functional architecture of human motivation: Personality systems interactions theory. In Advances in motivation science (Vol. 8, pp. 1–62). Elsevier. https://doi.org/10.1016/bs.adms.2020.06.001 DOI: https://doi.org/10.1016/bs.adms.2020.06.001

Labin, S. N., Duffy, J. L., Meyers, D. C., Wandersman, A., & Lesesne, C. A. (2012). A research synthesis of the evaluation capacity building literature. American Journal of Evaluation, 33(3), 307–338. https://doi.org/10.1177/1098214011434608 DOI: https://doi.org/10.1177/1098214011434608

Lindner, J. R. (1998). Understanding employee motivation. Journal of Extension, 36(3), 1–8.

Maslow, A. H. (1943). A theory of human motivation. Psychological Review, 50(4), 370. https://doi.org/10.1037/h0054346 DOI: https://doi.org/10.1037/h0054346

McIntosh, J. S., Buckley, J., & Archibald, T. (2020). Refining and measuring the construct of evaluative thinking: An exploratory factor analysis of the evaluative thinking inventory. Journal of MultiDisciplinary Evaluation, 16(34), 104–117. https://doi.org/10.56645/jmde.v16i34.591 DOI: https://doi.org/10.56645/jmde.v16i34.591

Milstein, B., Chapel, T. J., Wetterhall, S. F., & Cotton, D. A. (2002). Building capacity for program evaluation at the Centers for Disease Control and Prevention. New Directions for Evaluation, 93, 27–46. https://doi.org/10.1002/ev.40 DOI: https://doi.org/10.1002/ev.40

Patton, M. Q. (2018). A historical perspective on the evolution of evaluative thinking. New Directions for Evaluation, 158, 11–28. https://doi.org/10.1002/ev.20325 DOI: https://doi.org/10.1002/ev.20325

Preskill, H. (2014). Now for the hard stuff: Next steps in ECB research and practice. American Journal of Evaluation, 35(1), 116–119. https://doi.org/10.1177/1098214013499439 DOI: https://doi.org/10.1177/1098214013499439

Preskill, H., & Boyle, S. (2008a). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4), 443–459. https://doi.org/10.1177/1098214008324182 DOI: https://doi.org/10.1177/1098214008324182

Preskill, H., & Boyle, S. (2008b). Insights into evaluation capacity building: Motivations, strategies, outcomes, and lessons learned. The Canadian Journal of Program Evaluation, 23(3), 147. https://doi.org/10.3138/cjpe.0023.008 DOI: https://doi.org/10.3138/cjpe.0023.008

Riyanto, S., Endri, E., & Herlisha, N. (2021). Effect of work motivation and job satisfaction on employee performance: Mediating role of employee engagement. Problems and Perspectives in Management, 19(3), 162–174. http://dx.doi.org/10.21511/ppm.19(3).2021.14 DOI: https://doi.org/10.21511/ppm.19(3).2021.14

Robbins, S. P. (1993). Organizational behavior: Concept, controversies, and applications: Instructor's manual with transparency masters. Prentice Hall.Ryan, R. M., & Deci, E. L. (2020). Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions. Contemporary Educational Psychology, 61, 101860. https://doi.org/10.1016/j.cedpsych.2020.101860 DOI: https://doi.org/10.1016/j.cedpsych.2020.101860

Schunk, D. H., & DiBenedetto, M. K. (2020). Motivation and social cognitive theory. Contemporary Educational Psychology, 60, 101832. https://doi.org/10.1016/j.cedpsych.2019.101832 DOI: https://doi.org/10.1016/j.cedpsych.2019.101832

Schwandt, T. A. (2018). Evaluative thinking as a collaborative social practice: The case of boundary judgment making. New Directions for Evaluation, 158, 125–137. https://doi.org/10.1002/ev.20318 DOI: https://doi.org/10.1002/ev.20318

Sobeck, J., & Agius, E. (2007). Organizational capacity building: Addressing a research and practice gap. Evaluation and Program Planning, 30(3), 237–246. https://doi.org/10.1016/j.evalprogplan.2007.04.003 DOI: https://doi.org/10.1016/j.evalprogplan.2007.04.003

Suarez-Balcazar, Y., & Taylor-Ritzler, T. (2014). Moving from science to practice in evaluation capacity building. American Journal of Evaluation, 35(1), 95–99. https://doi.org/10.1177/1098214013499440 DOI: https://doi.org/10.1177/1098214013499440

Taut, S. (2007). Studying self-evaluation capacity building in a large international development organization. American Journal of Evaluation, 28(1), 45–59. https://doi.org/10.1177/1098214006296430 DOI: https://doi.org/10.1177/1098214006296430

Taylor‐Powell, E., & Boyd, H. H. (2008). Evaluation capacity building in complex organizations. New Directions for Evaluation, 120, 55–69. https://doi.org/10.1002/ev.276 DOI: https://doi.org/10.1002/ev.276

Taylor-Ritzler, T., Suarez-Balcazar, Y., Garcia-Iriarte, E., Henry, D. B., & Balcazar, F. E. (2013). Understanding and measuring evaluation capacity: A model and instrument validation study. American Journal of Evaluation, 34(2), 190–206. https://doi.org/10.1177/1098214012471421 DOI: https://doi.org/10.1177/1098214012471421

Tietjen, M. A., & Myers, R. M. (1998). Motivation and job satisfaction. Management decision, 36(4), 226–231. https://doi.org/10.1108/00251749810211027 DOI: https://doi.org/10.1108/00251749810211027

Van den Broeck, A., Howard, J. L., Van Vaerenbergh, Y., Leroy, H., & Gagné, M. (2021). Beyond intrinsic and extrinsic motivation: A meta-analysis on self-determination theory’s multidimensional conceptualization of work motivation. Organizational Psychology Review, 11(3), 240–273. https://doi.org/10.1177/20413866211006173 DOI: https://doi.org/10.1177/20413866211006173

Vo, A. T., & Archibald, T. (2018). New directions for evaluative thinking. New directions for evaluation, 2018(158), 139-147. https://doi.org/10.1002/ev.20317 DOI: https://doi.org/10.1002/ev.20317

Vo, A. T., Schreiber, J. S., & Martin, A. (2018). Toward a conceptual understanding of evaluative thinking. New Directions for Evaluation, 158, 29–47. https://doi.org/10.1002/ev.20324 DOI: https://doi.org/10.1002/ev.20324

Vroom, V. H. (1964). Work and motivation (Vol. 54). Wiley.

Wandersman, A. (2014). Moving forward with the science and practice of evaluation capacity building (ECB): The why, how, what, and outcomes of ECB. American Journal of Evaluation, 35(1), 87–89. https://doi.org/10.1177/1098214013503895 DOI: https://doi.org/10.1177/1098214013503895

Wang, S. L. (2014). Cooperative extension system: Trends and economic impacts on U.S. agriculture. Choices, 29(316-2016-7709), 1–8. https://doi.org/10.22004/ag.econ.171040

cover page

Downloads

Published

15-Sep-23 — Updated on 20-Sep-23

Versions

How to Cite

Sen, A., Archibald, T., Anderson, J. C., & Drape, T. (2023). The Relationship Between Employee Motivation and Evaluation Capacity in a Community-Based Education Organization. Journal of MultiDisciplinary Evaluation, 19(45), 3–18. https://doi.org/10.56645/jmde.v19i45.719 (Original work published September 15, 2023)

Issue

Vol. 19 No. 45 (2023)

Section

Research Articles

License

Copyright (c) 2023 Anuradha Sen, Thomas Archibald, PhD, James C. Anderson, PhD, Tiffany Drape, PhD

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright and Permissions

Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org