Democratic Evaluation & Crowdsourcing: It's a Match!
Main Article Content
Abstract
Background: After attending professional evaluation conferences, and having the privilege of listening to the founders of the discipline of Evaluation, the author reflects on how the new generation of evaluators should aspire to upgrade their role in society by making the most of the tools and social dynamics of new technologies, and exploring ways in which evaluation could operate in both present and future scenarios.
Purpose: To foster democratic evaluation as a powerful tool for more democratic government, by expanding traditional ways of reaching the community, either as evaluation participants or traditional funders, leveraged through new technologies.
Setting: Not applicable.
Intervention: Not applicable.
Research Design: Not applicable.
Data Collection and Analysis: Not applicable.
Findings: There are powerful potential synergies that the evaluation community could explore between participatory evaluation approaches –such as democratic evaluation– and the democratization (democratic: for all those individuals who have internet access) of participation facilitated by new technologies –in terms of voting, giving opinion, donating or contributing in some way via internet. .
One of these possibilities is known as Crowdsourcing: asking services, ideas, or content to a large group of people, and especially from an online community. This alternative has started to be used in many disciplines. In particular, two crowdsourcing modalities have been found to be directly applicable:
- Crowdvoting: asking the public's opinion regarding certain matters, not only in the data collection phase of the evaluation, but in the phases of analysis and judging, or even in the evaluation design, as a way of introducing other voices into the evaluation process.
- Crowdfunding: asking citizens to contribute with small amounts of money to support the evaluation of public services and programmes, as an alternative to depending solely on the funding decisions of traditional decision-makers. This can be very pertinent in cases where decision-makers are not following the general interest and democratic evaluation appears to be the best approach to follow for citizens to try to induce a change of policy.
However, further research is needed to explore these and other modalities and synergies, with special emphasis on experimentation to test such hypotheses.
Downloads
Article Details

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Auget, A., & de Montyon, B. (n.d.). New advent. Retrieved February 25, 2012 from www.newadvent.org.
Azzam, T., & Jacobson, M. (2013). Finding a comparison group: Is online crowdsourcing a viable option? American Journal of Evaluation. https://doi.org/10.1177/1098214013490223 DOI: https://doi.org/10.1177/1098214013490223
Brabham, D. C. (2013). Crowdsourcing. Cambridge: MIT Press. https://doi.org/10.7551/mitpress/9693.001.0001 DOI: https://doi.org/10.7551/mitpress/9693.001.0001
Estellés-Arolas, E.; González-Ladrón-de-Guevara, F. (2012). Towards an Integrated Crowdsourcing Definition. Journal of Information Science, 38 (2), 189-200, doi:10.1177/0165551512437638 https://doi.org/10.1177/0165551512437638 DOI: https://doi.org/10.1177/0165551512437638
DeVun, L. (2009). Looking at how crowds produce and present art. Wired News. Retrieved February 26, 2012
van Ess, H. (2010). Crowdsourcing: How to find a crowd. ARD ZDF Akademie.
Grier, D.A. (2013) Crowdsourcing for Dummies. West Sussex: Wiley.
House, E. & Howe, K. (2000). Deliberative democratic evaluation. New Directions for Evaluation, 2000 (85), 3-12, doi: 10.1002/ev.1157 https://doi.org/10.1002/ev.1157 DOI: https://doi.org/10.1002/ev.1157
Howe, J. (2006). The Rise of crowdsourcing. Wired.com.
Howe, J. (2009). Crowdsourcing: Why the Power of the Crowd is driving the Future of Business. New York: Three Rivers Press
"Crowdsourcing - Definition and More". Merriam-Webster.com. August 31, 2012. Retrieved February 3, 2014.
Winchester, S. (1999). The surgeon of Crownthorne: A tale of murder, madness, and the Oxford English dictionary. London, England: Penguin Books.