How do Evaluators Communicate Cultural Competence? Indications of Cultural Competence through an Examination of the American Evaluation Association’s Career Center
Main Article Content
Abstract
Background: Cultural competency is an important but under-adopted skill among professional evaluators. Yet in the transactions around job seeking and hiring in evaluation, cultural competency is a practical and common concept. How cultural competency gets communicated in those transactions may provide insights for the field.
Purpose: The purpose of this article is to identify ways job seekers and employers discuss cultural competency in order to move toward a more widely accepted way of operationalizing the concept.
Setting: The American Evaluation Association’s (AEA) Career Center Webpage.
Intervention: Not applicable.
Research Design: A nonexperimental design was used in the study.
Data Collection and Analysis: Document review was the main form of data collection, where resumes and job postings on AEA’s webpage were systematically collected. They were then rated by the two study authors on cultural competency and interrater reliabilities were calculated. Content analysis was also used to identify themes in ways through which cultural competency is expressed or communicated in the documents.
Findings: Indicators of cultural competency are identified, in the context of employment seeking. The study also highlights the conditions which may have contributed to low interrater reliabilities and a larger need to develop a practical, operationalized definition of cultural competency, despite inherent flaws.
Downloads
Article Details

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
American Evaluation Association Diversity Committee. (2004). A Cultural Reading of the Program Evaluation Standards (2nd edition). Retrieved from http://www.eval.org/aea05.cr.BoardApproved2.pdf
American Evaluation Association Ethics Committee. (2004). Guiding Principles for Evaluators. Retrieved from http://www.eval.org/publications/GuidingPrinciplesPrintable.asp
Baumann, S. (2009). Beyond cultural competence: Nursing practice with political refugees. Nursing Science Quarterly, 22(1), 83-84. https://doi.org/10.1177/0894318408329153 DOI: https://doi.org/10.1177/0894318408329153
Dewey, J. D., Montrosse, B. E., Schröter, D. C., Sullins, C. D., & Mattox, J. R. II. (2008). Evaluator competencies: What's taught versus what's sought. American Journal of Evaluation, 29(3), 268-287. https://doi.org/10.1177/1098214008321152 DOI: https://doi.org/10.1177/1098214008321152
Evergreen, S. D. H., & Cullen, A. (2008). Moving to genuine: Credible cultural competence and stakeholder believability. Multipaper session presented to American Evaluation Association Conference in Denver, CO, November.
Evergreen, S. & Cullen, A. (2010.) Moving to genuine: Credible cultural competence and stakeholder believability. Journal of Multidisciplinary Evaluation, 6(13), 130-139. https://doi.org/10.56645/jmde.v6i13.263 DOI: https://doi.org/10.56645/jmde.v6i13.263
Hopson, R. K. (2008). Reclaiming knowledge at the margins: Culturally responsive evaluation in the current evaluation moment. In K. E. Ryan & J. B. Cousins (Eds.) International Handbook on Educational Evaluation. (pp. 431-448). Newbury, CA: Sage. https://doi.org/10.4135/9781452226606.n24 DOI: https://doi.org/10.4135/9781452226606.n24
King, J. A., Stevahn, L., Ghere, G., & Minnema, J. (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22(2), 229-247. https://doi.org/10.1177/109821400102200206 DOI: https://doi.org/10.1177/109821400102200206
Kulsamrit, W. (2004). Evaluator cultural competence in international development evaluation practices. Ph.D. dissertation, University of Illinois at Urbana-Champaign, United States -- Illinois. Retrieved October 18, 2009, from Dissertations & Theses: Full Text. (Publication No. AAT 3130962).
Pon, G. (2009). Cultural competency as the new racism: An anthology of forgetting. Journal of Progressive Human Services, 20, 59-71. https://doi.org/10.1080/10428230902871173 DOI: https://doi.org/10.1080/10428230902871173
Sakamoto, I. (2007.) An anti-oppressive approach to cultural competence. Canadian Social Work Review, 24(1), 105-114.
Shorkey, C., Windsor, L. C., & Spence, R. (2009). Assessing culturally competent chemical dependence treatment services for Mexican Americans. The Journal of Behavioral Health Services & Research, 36(1), 61-7. https://doi.org/10.1007/s11414-008-9110-x DOI: https://doi.org/10.1007/s11414-008-9110-x
Sue, S., Zane, N., Hall, G., & Berger, K. (2009). The case for cultural competency in psychotherapeutic interventions. Annual Review of Psychology, 60, 525-548. https://doi.org/10.1146/annurev.psych.60.110707.163651 DOI: https://doi.org/10.1146/annurev.psych.60.110707.163651