Toward a General and Unified View of Educational Research and Evaluation Bridging Philosophy and Methodology
Main Article Content
Abstract
This paper addresses an important problem that may really be a pseudoproblem perpetuated by a current artificial or even political need to isolate researchers, evaluators, and theorists and put them in conceptual-methodological boxes. In this paper, we argue that scholars of all kinds should focus on the nouns (i.e., research, evaluation, theory) versus the adjectives (i.e., quantitative, qualitative, or mixed methods) used to qualify these nouns and core constructs. In a word, researchers, evaluators, measurement professionals, and theorists of all persuasions should strive to be neither qualitative nor quantitative, as that is like striving to be a single leg in a triangle. Following Hacking (1965), our view is that all forms of research methodology and evaluation methodology represent a “patchwork quilt” that is essentially “one fabric” with two connected but often unacknowledged sides to the quilt and that all methodology, analysis, and evaluations are essentially “qual-quantification” and “quant-qualification” and usually both at the same time. This general and unified or “one fabric” view of these debates and issues is discussed from a historical-philosophical perspective, and the need for a more general and inclusive evaluation and research epistemology is elucidated. Having outlined an epistemic framework and argument for a more comprehensive and complete view and model of evaluation and research that transcends a specific research paradigm, the paper concludes by outlining eight general key points that most (if not all) researchers and evaluators should consider.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright and Permissions
Authors retain full copyright for articles published in JMDE. JMDE publishes under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY - NC 4.0). Users are allowed to copy, distribute, and transmit the work in any medium or format for noncommercial purposes, provided that the original authors and source are credited accurately and appropriately. Only the original authors may distribute the article for commercial or compensatory purposes. To view a copy of this license, visit creativecommons.org
References
Aneshensel, C. S. (2002). Theory-based data analysis for the social sciences. Thousand Oaks, CA: Pine Forge Press.
https://doi.org/10.4135/9781412986342 DOI: https://doi.org/10.4135/9781412986342
Ashcraft, M. H. (2002). Cognition (3rd ed.). New Jersey: Prentice-Hall.
Brass, C. T., Nunez-Neto, B., & Williams, E. D. (2006). Congress and program evaluation: An overview of randomized control trials (RCTs) and related issues. Retrieved October 24, 2008, from http://digital.library.unt.edu/govdocs/crs/permalink/meta-crs-9145:1
Bryman, A. (2007). Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods Research, 1, 8-22. DOI: https://doi.org/10.1177/2345678906290531
https://doi.org/10.1177/1558689806290531 DOI: https://doi.org/10.1177/1558689806290531
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 54, 81-105.
https://doi.org/10.1037/h0046016 DOI: https://doi.org/10.1037/h0046016
Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.
Carifio, J. (2005, July). Towards a standard integrated information processing/cognitive model of learning. Paper presented at the meeting of the International History, Philosophy, and Science Teaching Group, Leeds, England.
Carifio, J., & Perla, R. J. (2008). Resolving the 50-year debate around using and misusing Likert scales. Medical Education, 42, 1150- 1152.
https://doi.org/10.1111/j.1365-2923.2008.03172.x DOI: https://doi.org/10.1111/j.1365-2923.2008.03172.x
Carnap, R. (1937). The logical syntax of language. London: Kegan Paul.
Coryn, C. L. S. (2007). The 'holy trinity' of methodological rigor: A skeptical view. Journal of MultiDisciplinary Evaluation, 4(7), 26-31.
https://doi.org/10.56645/jmde.v4i7.7 DOI: https://doi.org/10.56645/jmde.v4i7.7
Creswell, J. W. (1994). Research design: Qualitative and quantitative approaches. Thousand Oaks, CA: Sage.
Denzin, N., & Lincoln, Y. (Eds.). (2005). The Sage handbook of qualitative research. Thousand Oaks, CA: Sage.
Eldredge, N. & Gould, S. J. (1972). Punctuated equilibria: An alternative to phyletic gradualism. In J. M. Schopf (Ed.), Models in paleobiology (pp. 82-115). San Francisco: Freeman, Cooper.
https://doi.org/10.5531/sd.paleo.7 DOI: https://doi.org/10.5531/sd.paleo.7
Fleck, L. (1979). Genesis and development of a scientific fact (F. Bradley & T. Trenn, Trans.). Chicago: University of Chicago Press. (Original work published 1935)
Frank, P. (1949). Modern science and its history. New York: George Braziller.
Galison, P. (1987). How experiments end. Chicago: Chicago University Press.
Gigerenzer, G. (1991). From tools to theories: A heuristic of discovery in cognitive psychology. Psychological Review, 98, 254-267. DOI: https://doi.org/10.1037//0033-295X.98.2.254
https://doi.org/10.1037/0033-295X.98.2.254 DOI: https://doi.org/10.1037/0033-295X.98.2.254
Glesne, C. (1999). Becoming qualitative researchers: An introduction. New York: Addison Wesley Longman.
Hacking, I. (1965). The logic of statistical inference. Cambridge: Cambridge University Press. Hanson, N. R. (1958). Patterns of discovery. Cambridge: Cambridge University Press.
Helmer-Hirschberg, O., & Rescher, N. H. (1960). On the epistemology of the inexact sciences (Rand Corporation Document No. R-353). Retrieved November 24, 2008, from http://www.rand.org/pubs/reports/R353/
Joergensen, J. (1951). The development of logical empiricism. In International Encyclopedia of Unified Science, (Vol. II, No. 9). Chicago: University of Chicago Press.
Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed method research: A research paradigm whose time has come. Educational Researcher 33, 14-26.
https://doi.org/10.3102/0013189X033007014 DOI: https://doi.org/10.3102/0013189X033007014
Kerlinger, F. N., & Lee, H. B. (2000). Foundations of behavioral research. Orlando, FL: Harcourt.
Kleining, G. (1982). An outline for the methodology of qualitative social research. Hamburg: University of Hamburg. Retrieved October 22, 2008, from http://www1.uni-hamburg.de/abu//Archiv/QualitativeMethoden/Kleining/KleiningEng1982.htm
Kraft, V. (1953). The Vienna Circle: The origins of neopositivism. A chapter in the history of recent philosophy. New York: Philosophical Library.
Kuhn, T. S. (1970). Logic of discovery or psychology of research? In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 1-23). Cambridge: Cambridge University Press.
Kuhn, T. S. (1962/1996). The structure of scientific revolutions (3rd ed.). Chicago: University of Chicago Press.
Lakatos, I. (1970). Falsification and the methodology of scientific research programs. In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 309-330). Cambridge: Cambridge University Press.
Lincoln, Y. S., & Guba, G. (1985). Naturalistic inquiry. Thousand Oak, CA: Sage.
https://doi.org/10.1016/0147-1767(85)90062-8 DOI: https://doi.org/10.1016/0147-1767(85)90062-8
Matthews, M. R. (2004a). Thomas Kuhn's impact on science education: What lessons can be learned? Science Education, 88, 90-118.
https://doi.org/10.1002/sce.10111 DOI: https://doi.org/10.1002/sce.10111
Matthews, M. R. (2004b). Reappraising positivism and education: The arguments of Phillip Frank and Herbert Feigl. Science & Education, 13, 7-39.
https://doi.org/10.1023/B:SCED.0000018544.34295.8b DOI: https://doi.org/10.1023/B:SCED.0000018544.34295.8b
McCall, W. A. (1923). How to experiment in education. New York: Macmillan.
https://doi.org/10.1037/13551-000 DOI: https://doi.org/10.1037/13551-000
Pawson, R., & Tilley, N. (2007). Realistic Evaluation. Thousand Oaks, CA: Sage.
Perla, R. J. (2006). Use and augmentation of a formal model and theory to develop instructional materials to teach undergraduates about the nature of science, scientific knowledge and scientific change. Unpublished doctoral dissertation, University of Massachusetts, Lowell.
Phillips, F. (2005). The contested nature of empirical research (and why philosophy of education offers little help). Journal of Philosophy of Education, 39, 577-597.
https://doi.org/10.1111/j.1467-9752.2005.00457.x DOI: https://doi.org/10.1111/j.1467-9752.2005.00457.x
Pinker, S. (1997). How the mind works. New York: W. W. Norton.
Quine, W. V. O. (1953/1961). From a logical point of view. New York: Harper & Row.
Reichenbach, H. (1938). Experience and Prediction. Chicago: University of Chicago Press.
Rosenhan, D. (1973). On being sane in insane places. Science, 179, 250-258.
https://doi.org/10.1126/science.179.4070.250 DOI: https://doi.org/10.1126/science.179.4070.250
Ryle, G. (1949). The concept of mind. Chicago: University of Chicago Press.
Schick, T. (Ed.) (2000). Readings in the philosophy of science: From positivism to postmodernism. Mountain View, CA: Mayfield.
Shavelson, R .J. & Towne, L. (Eds.) (2002). Scientific research in education. Washington, DC: National Academy Press.
Sloane, F. (2008). Through the looking glass: Experiments, quasi-experiments and the medical model. Education Researcher, 37, 41- 46.
https://doi.org/10.3102/0013189X08314835 DOI: https://doi.org/10.3102/0013189X08314835
Stufflebeam, D. L., & Shinkfield, A. J. (2007). Evaluation theory, models and applications. San Francisco: Jossey-Bass.
Suppe, F. (1974). The structure of scientific theories. Urbana: University of Illinois Press.
Thagard, P. (1988). Computational philosophy of science. Cambridge, MA: MIT Press.
https://doi.org/10.7551/mitpress/1968.001.0001 DOI: https://doi.org/10.7551/mitpress/1968.001.0001
Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice, Science, 211, 453-458.
https://doi.org/10.1126/science.7455683 DOI: https://doi.org/10.1126/science.7455683
Wittgenstein, L. (2003). Tractatus logico- philosophicus. (C. K. Ogden, Trans.). New York: Barnes & Noble Books. (Original work published 1922)
https://doi.org/10.4324/9780203010341 DOI: https://doi.org/10.4324/9780203010341