Democratic Evaluation & Crowdsourcing: It's a Match!

Main Article Content

Sara Vaca
https://orcid.org/0000-0003-3619-9907

Abstract

Background: After attending professional evaluation conferences, and having the privilege of listening to the founders of the discipline of Evaluation, the author reflects on how the new generation of evaluators should aspire to upgrade their role in society by making the most of the tools and social dynamics of new technologies, and exploring ways in which evaluation could operate in both present and future scenarios.


Purpose: To foster democratic evaluation as a powerful tool for more democratic government, by expanding traditional ways of reaching the community, either as evaluation participants or traditional funders, leveraged through new technologies.


Setting: Not applicable.


Intervention: Not applicable.


Research Design: Not applicable.


Data Collection and Analysis: Not applicable.


Findings: There are powerful potential synergies that the evaluation community could explore between participatory evaluation approaches –such as democratic evaluation– and the democratization (democratic: for all those individuals who have internet access) of participation facilitated by new technologies –in terms of voting, giving opinion, donating or contributing in some way via internet. .


One of these possibilities is known as Crowdsourcing: asking services, ideas, or content to a large group of people, and especially from an online community. This alternative has started to be used in many disciplines. In particular, two crowdsourcing modalities have been found to be directly applicable:


-        Crowdvoting: asking the public's opinion regarding certain matters, not only in the data collection phase of the evaluation, but in the phases of analysis and judging, or even in the evaluation design, as a way of introducing other voices into the evaluation process.


-        Crowdfunding: asking citizens to contribute with small amounts of money to support the evaluation of public services and programmes, as an alternative to depending solely on the funding decisions of traditional decision-makers. This can be very pertinent in cases where decision-makers are not following the general interest and democratic evaluation appears to be the best approach to follow for citizens to try to induce a change of policy.


However, further research is needed to explore these and other modalities and synergies, with special emphasis on experimentation to test such hypotheses.

Downloads

Download data is not yet available.

Article Details

How to Cite
Vaca, S. (2015). Democratic Evaluation & Crowdsourcing: It’s a Match!. Journal of MultiDisciplinary Evaluation, 11(24), 84–89. https://doi.org/10.56645/jmde.v11i24.420
Section
Ideas to Consider in Evaluation
Author Biography

Sara Vaca, Independent Consultant, EvalQuality.com & VisualBrains.info

Bringing innovation into evaluation through data visualization.

References

Auget, A., & de Montyon, B. (n.d.). New advent. Retrieved February 25, 2012 from www.newadvent.org.

Azzam, T., & Jacobson, M. (2013). Finding a comparison group: Is online crowdsourcing a viable option? American Journal of Evaluation. https://doi.org/10.1177/1098214013490223 DOI: https://doi.org/10.1177/1098214013490223

Brabham, D. C. (2013). Crowdsourcing. Cambridge: MIT Press. https://doi.org/10.7551/mitpress/9693.001.0001 DOI: https://doi.org/10.7551/mitpress/9693.001.0001

Estellés-Arolas, E.; González-Ladrón-de-Guevara, F. (2012). Towards an Integrated Crowdsourcing Definition. Journal of Information Science, 38 (2), 189-200, doi:10.1177/0165551512437638 https://doi.org/10.1177/0165551512437638 DOI: https://doi.org/10.1177/0165551512437638

DeVun, L. (2009). Looking at how crowds produce and present art. Wired News. Retrieved February 26, 2012

van Ess, H. (2010). Crowdsourcing: How to find a crowd. ARD ZDF Akademie.

Grier, D.A. (2013) Crowdsourcing for Dummies. West Sussex: Wiley.

House, E. & Howe, K. (2000). Deliberative democratic evaluation. New Directions for Evaluation, 2000 (85), 3-12, doi: 10.1002/ev.1157 https://doi.org/10.1002/ev.1157 DOI: https://doi.org/10.1002/ev.1157

Howe, J. (2006). The Rise of crowdsourcing. Wired.com.

Howe, J. (2009). Crowdsourcing: Why the Power of the Crowd is driving the Future of Business. New York: Three Rivers Press

"Crowdsourcing - Definition and More". Merriam-Webster.com. August 31, 2012. Retrieved February 3, 2014.

Winchester, S. (1999). The surgeon of Crownthorne: A tale of murder, madness, and the Oxford English dictionary. London, England: Penguin Books.