Evaluating Application of Knowledge and Skills: The Use of Consensus Expert Review to Assess Conference Abstracts of Field Epidemiology Training Participants
Main Article Content
Abstract
Background: Often evaluations of training programs are limited — with many focusing on the aspects that are easy to measure (e.g., reaction of trainees) without addressing the important outcomes of training, such as how trainees applied their new knowledge, skills, and attitudes. Numerous evaluations fail to measure training’s effect on job performance because few effective methods are available to do so. Particularly difficult is the problem of evaluating multisite training programs that vary considerably in structure and implementation from one site to another.
Purpose: NA
Setting: NA
Intervention: NA
Research Design: We devised a method of a consensus expert review to evaluate the quality of conference abstracts submitted by participants in Field Epidemiology Training Programs – an approach that can provide useful information on how well trainees apply knowledge and skills gained in training, complementing data obtained from other sources and methods. This method is practical, minimally intrusive, and resource-efficient, and it may prove useful for evaluation practice in diverse fields that require training.
Data Collection and Analysis: NA
Findings: NA
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Callaham, M., & Tercier, J. (2007). The relationship of previous training and experience of journal peer reviewers to subsequent review quality. PLOS Medicine, 4(1): e40. https://doi.org/10.1371/journal.pmed.0040040 DOI: https://doi.org/10.1371/journal.pmed.0040040
Centers for Disease Control and Prevention. (2006).Field Epidemiology Training Program Development Handbook. Atlanta, Georgia: Author. Retrieved from: http://www.cdc.gov/globalhealth/fetp/pdf/fetp_development_handbook_508.pdf
Centers for Disease Control and Prevention. (2013). FETP -History and Value of Establishing Field Epidemiology Training Programs. Retrieved from: http://www.cdc.gov/globalhealth/fetp/history.html
Jones, D., MacDonald, G., Volkov,B.,& Herrera-Guibert,D.(2014).Multisite Evaluation of Field Epidemiology Training Programs: Findings and Recommendations. Centers for Disease Control and Prevention: Atlanta, Georgia.Retrieved from:http://www.cdc.gov/globalhealth/fetp/pdf/fetp_evaluation_report_may_2014.pdf
Cohen, I., & Patel, K. (2006). Peer review interrater concordance of scientific abstracts: A study of anesthesiology subspecialty and component societies. Anesthesia & Analgesia, 102(5), 1501-1503. https://doi.org/10.1213/01.ane.0000200314.73035.4d DOI: https://doi.org/10.1213/01.ane.0000200314.73035.4d
International Program for Development Evaluation Training (IPDET). (2007). IPDET Handbook. Module 7. Approaches to Development Evaluation. 2007. Retrieved from: http://www.worldbank.org/ieg/ipdet/modules/M_07-na.pdf
Kirkpatrick, J., & Kirkpatrick, W. (2010). Training on Trial. New York, NY: AMACOM.
Landis, J., & Koch, G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33,159-174. https://doi.org/10.2307/2529310 DOI: https://doi.org/10.2307/2529310
López, A., & Cáceres, V. (2008). Central America Field Epidemiology Training Program (CA FETP): A pathway to sustainable public health capacity development. Human Resources for Health, 6:27. https://doi.org/10.1186/1478-4491-6-27 DOI: https://doi.org/10.1186/1478-4491-6-27
Music, S., & Schultz, M. (1990). Field epidemiology training programs: New international health resources. Journal of American Medical Association, 263, 3309-3311. https://doi.org/10.1001/jama.1990.03440240099024 DOI: https://doi.org/10.1001/jama.1990.03440240099024
Patel, M. (2011). Vietnam's Field Epidemiology Training Program: An evaluation of the program for the first class of fellows 2009-2011. Unpublished report.
Patel, M., & Phillips C. (2009). Strengthening field-based training in low and middle-income countries to build public health capacity: Lessons from Australia's Master of Applied Epidemiology Program. Australia and New Zealand Health Policy, 6:5. https://doi.org/10.1186/1743-8462-6-5 DOI: https://doi.org/10.1186/1743-8462-6-5
Ragone, A., Mirylenka, K., Casati, F., & Marchese, M. (2011). A quantitative analysis of peer review. In Proceedings of the 13th conference of the international society for scientometrics and informetrics (issi). Durban: issi.
Rowe, B., Strome, T., Spooner, C., Blitz, S., Grafstein, E., & Worster, A. (2006). Reviewer agreement trends from four years of electronic submissions of conference abstract. BMC Medical Research Methodology, 6:14. https://doi.org/10.1186/1471-2288-6-14 DOI: https://doi.org/10.1186/1471-2288-6-14
Schneider, D., Evering-Watley, M., Walke, H., & Bloland, P. (2011). Training the global public health workforce through applied epidemiology training programs: CDC's experience, 1951-2011. Public Health Reviews.33, 190-203. https://doi.org/10.1007/BF03391627 DOI: https://doi.org/10.1007/BF03391627
Scriven, M. (2010). The evaluation of training: A checklist approach. Retrieved from: http://michaelscriven.info/images/EVALUATION_of_TRAINING.11-27-11.2.pdf
Traicoff, D., Walke, H., Jones, D., Gogstad, E., Imtiaz, R., & White, M. (2008). Replicating success: developing a standard FETP curriculum. Public Health Reports,123, S28-34. https://doi.org/10.1177/00333549081230S109 DOI: https://doi.org/10.1177/00333549081230S109
Wargnier, J. (2012). Evaluating and demonstrating the value of training: Challenges, practices and trends at the age of new learning technologies. Retrieved from: http://www.CrossKnowledge.com