Conference Evaluation Focusing on Learning and Transfer
Main Article Content
Abstract
Background: The article presents the results of using a model for evaluation of conferences; a model focusing on learning and transfer. Many conferences are evaluated using participant-satisfaction surveys, but satisfaction is a diffuse concept and is linked to many factors other than learning.
Purpose: The purpose of the present study was to examined how participants of four national conferences of adult learning assessed the relevance of the content of a number of workshops, how much they had learned from the workshops and whether they had used what they had learned. And to test a tool to measure this.
Setting: The subject matters of the study is four evaluations based on surveys of national conferences in Denmark in 2010, 2011, 2012 and 2013. The overall purpose of the conferences was to communicate and discuss new knowledge within the area of general adult education and vocational education and training, and to help ensure that this knowledge is subsequently used in the participants' daily practices at work.
Intervention: Testing a tool to measure learning and transfer, which is not too resource-intensive to use for managers of workshops as well as conferences to strengthen the potential for learning and transfer by participants.
Research Design: Using the same survey-based evaluation-tool in four different conferences in order to compare the results and try to find general knowledge.
Data Collection and Analysis: Collecting and analysing data on the basis of survey-data of the participant’s self-reported perception of relevance, learning and use (transfer) of the content of the workshops.
Findings: The study shows that the percentage of conference participants who experience relevance, learning and transfer from the conferences only varies marginally from year to year, while this percentage varies particularly between the individual workshops. Another finding is that participants’ assessment of relevance is more associated than satisfaction with learning and transfer.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Absalom, M., and Morgan, A. (2011) What language teachers want - considering the evaluation of 18th biennial conference Babel, 47(1), pp. 32-38.
Alawneh, M. (2008). Factors Affecting Training Transfer: Participants' Motivation to transfer training Literature Review (p. 7): Penn State University.
Arellano, D. E., Goodman, D. A., Howlette, T., Kroelinger, C. D., Law, M., Phillips, D., Jones, J., Brantley, M. D. and Fitzgerald, M. (2014) Evaluation of the 2012 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference: Six Month Impact on Science, Program, and Policy Matern Child Health J, 18, pp.1565-1571. doi: 10.1007/s10995-014-1585-x. https://doi.org/10.1007/s10995-014-1585-x DOI: https://doi.org/10.1007/s10995-014-1585-x
ASTD, American Society for Training and Development (2009) The value of evaluation: Making training evaluation more effective.
Burke, L. A., and Hutchins, H. M. (2007). Training Transfer: An Integrative Literature Review Human Resource Development Review, 6(3), pp. 263-296. https://doi.org/10.1177/1534484307303035 DOI: https://doi.org/10.1177/1534484307303035
Chapman, D. D., Wiessner, C. A., Storberg-Walker, J., and Hatcher, T. (2007) New Learning: a different way of approaching conference evaluation Knowledge Management Research and Practice 5, pp. 261-270. doi: 10.1057/palgrave.kmrp.8500147. https://doi.org/10.1057/palgrave.kmrp.8500147 DOI: https://doi.org/10.1057/palgrave.kmrp.8500147
Chapman, D. D., Wiessner, C. Aalsburg, M., Janet, F., Nancy, J., Stevenson, L. and Majekodunmi, D. (2009) Crossing scholarly divides: Barriers and bridges for doctoral students attending scholarly conferences New Horizons in Adult Education and Human Resource Development, 23(1), pp. 6-24. https://doi.org/10.1002/nha3.10325 DOI: https://doi.org/10.1002/nha3.10325
Danske-Regioner. (2009). Evaluering af ViS-konferencen den 7. maj 2009. pp.1-16.
Elmegaard, L. (2011). Evaluering - Idékonference om Socialt Entreprenorskab http://www.udvindvaekst.aau.dk/, pp. 1-12.
EVA, Danmarks Evalueringsinstitut (2011) Evaluering af VEU konferencen i 2010.
EVA, Danmarks Evalueringsinstitut (2012) Evaluering af VEU konferencen i 2011.
EVA, Danmarks Evalueringsinstitut (2013) Evaluering af VEU konferencen i 2012.
EVA, Danmarks Evalueringsinstitut (2014) Evaluering af VEU konferencen i 2013.
Gessler, M. (2009) The correllation of participant satisfaction, learning success and learning transfer: an empirical investigation of correlation assumptions in Kirkpatrick's four-level model International Journal Management in Education, 3(3/4). https://doi.org/10.1504/IJMIE.2009.027355 DOI: https://doi.org/10.1504/IJMIE.2009.027355
Harrison, R. (2010). Unique Benefits of Conference Attendance as a Method of Professional Development for LIS Professionals The Serials Librarian, 59, pp. 263-270. doi: 10.1080/0361526X.2010.489353. https://doi.org/10.1080/0361526X.2010.489353 DOI: https://doi.org/10.1080/0361526X.2010.489353
Hatcher, T., Wiessner, C. A., Storberg-Walker, J. and Chapman, D. (2006) How a research conference created new learning: a case study Journal of European Industrial Training, 30(4), pp. 256-271. doi: 10.1108/03090590610673632. https://doi.org/10.1108/03090590610673632 DOI: https://doi.org/10.1108/03090590610673632
Henn, S., and Bathelt, H. (2014). Knowledge generation and field reproduction in temporary clusters and the role of business conferences Geoforum, 58 (2015), pp. 104-113. https://doi.org/10.1016/j.geoforum.2014.10.015 DOI: https://doi.org/10.1016/j.geoforum.2014.10.015
Hoyt, J. E. and White, C. (2011). Increasing the Quality and Value of Conferences, Seminars, and Workshops The Journal of Continuing Higher Education, 59, pp. 97-103. doi: 10.1080/07377363.2011.568828. https://doi.org/10.1080/07377363.2011.568828 DOI: https://doi.org/10.1080/07377363.2011.568828
Kirkpatrick, D. L. (1970). Evaluation of short-term training in rehabilitation College of Education. Department of Special Education. University of Oregon. Eugene, Oregon 97403.
Kirkpatrick, D. L. (1994). Evaluating Training Programs San Francisco: Berrett-Koehler Publishers.
Louw, I., and Zuber-Skerritt, O. (2011) The learning conference: Knowledge creation through participation and publication The Learning Organization, 18(4), pp. 288-300. doi: 10.1108/09696471111132504. https://doi.org/10.1108/09696471111132504 DOI: https://doi.org/10.1108/09696471111132504
Mealy, K. A. (2013). 2013 APSA Teaching and Learning Conference and Track Summaries The Teacher, American Political Science Association, 2013. doi: 10.1017/S1049096513000772. https://doi.org/10.1017/S1049096513000772 DOI: https://doi.org/10.1017/S1049096513000772
Neves, J., Lavis, John N., Panisset, Ulysses and Klint, Markus Hultstrand. (2014) Evaluation of the international forum on evidence informed health policymaking: Addis Ababa, Ethiopia - 27 to 31 August 2013 Health Research Policy and Systems (12:14). doi: 10.1186/1478-4505-12-14. https://doi.org/10.1186/1478-4505-12-14 DOI: https://doi.org/10.1186/1478-4505-12-14
Nicholson, N., Shapley, K., Martin, P., Talkington, R. A., and Caraway, T. H. (2014) Trekking to the Top - Learning to Listen and Talk: Changes in Attitude and Knowledge After a Family Camp Intervention The Volta Review, 114(1), pp. 57-82. https://doi.org/10.17955/tvr.114.1.743 DOI: https://doi.org/10.17955/tvr.114.1.743
Pletcher, S. N. R., Scott W. (2011) Web-based Morbidity and Mortality Conferencing: A Model for Rural Medical Education Journal of continuing education in the health professions, 31(2), pp. 128-133. doi: 10.1002/chp.20117. https://doi.org/10.1002/chp.20117 DOI: https://doi.org/10.1002/chp.20117
Ravn, I., and Elsborg, S. (2011). Facilitating learning at conferences International Journal Learning and Change. https://doi.org/10.1504/IJLC.2011.041873 DOI: https://doi.org/10.1504/IJLC.2011.041873
Russ-Eft, D. (2002). A Typology of Training Design and Work Environment Factors Affecting Workplace Learning and Transfer Human Resource Development Review, 1(1), pp. 45-65. https://doi.org/10.1177/1534484302011003 DOI: https://doi.org/10.1177/1534484302011003
Stufflebeam, D.L., and Coryn, C.L.S. (2014). Evaluation Theory, Models, and Applications. Second edition. San Francisco. Jossey-Bass.
Trivette, M.C., and Dunst, C.J., Hamby, D.W. and O'Herin, C. E.. (2009) Characteristics and consequences of Adult Learning Strategies Research Brief Volume, 3(1), pp. 1-33.
Urada, D. I., Rawson, R. A. and Onuki, M. (2014) Peace Building Through a Substance Use Conference Structured on Peace Psychology Principles Peace and Conflict: Journal of Peace Psychology, 20(1), pp. 84-94. doi: 10.1037/a0035579. https://doi.org/10.1037/a0035579 DOI: https://doi.org/10.1037/a0035579
Wahlgren, B., and Aarkrog, V. (2012) Transfer - Kompetenceudvikling i en professionel sammenhaeng Kobenhavn og Aarhus: Aarhus Universitetsforlag. https://doi.org/10.2307/jj.608243 DOI: https://doi.org/10.2307/jj.608243
Wallach, T. (2014). What do Participants Learn at Group Relations Conferences? Organisational and Social Dynamics, 14(1), pp. 13-38.
Watkins, R., Leigh, D., Foshay, R., and Kaufman, R.. (1998) Kirckpatrick Plus: Evaluation and Continous Improvement with a community Focus ETR and D, vol. 46, No. 4, 1998, pp. 90-96, ISSN 1042-1629. https://doi.org/10.1007/BF02299676 DOI: https://doi.org/10.1007/BF02299676
Wiessner, C. A., Hatcher, T., Chapman, D. and Storberg-Walker, J. (2008) Creating new learning at professional conferences: an innovative approach to conference learning, knowledge construction and programme evaluation Human Resource Development International, 11(4), pp. 367-383. doi: 10.1080/13678860802261488. https://doi.org/10.1080/13678860802261488 DOI: https://doi.org/10.1080/13678860802261488
Zisook, S., Boland, R., Cowley, D., Cyr, R. L., Pato, M. T. and Thrall, G. (2013) Teaching Scholarly Activity in Psychiatric Training: Year 6 and 7 Academic Psychiatry, 37(2), pp. 82-86. https://doi.org/10.1176/appi.ap.11110205 DOI: https://doi.org/10.1176/appi.ap.11110205