STUDY ON CRITERIA TO EVALUATE RESEARCH PROJECTS IN EDUCATIONAL SCIENCE IN LINE WITH INTERNATIONAL STANDDARDS
Main Article Content
Abstract
This study focused on finding out the criteria to evaluate research projects in education. We used a mixed methods research, including a literature review, focus group interviews with experts, and a survey of 140 lecturers from 5 universities of education in Vietnam and 33 lecturers who are teaching four majors from the University of Education, Vietnam National University. The necessity, suitability, and reliability of the set of criteria in evaluating the thesis in the field of educational science were examined. Two independent experts reviewed 146 master theses based on the set of criteria. The results showed that the evaluation of the 2 experts for 38 evaluation criteria is very similar, matched 85.6% to 100%. The Kappa correlation coefficient was above 0.7. The set of criteria is highly reliable in evaluating the quality of scientific projects.
Keywords
criteria, international standards, educational science, evaluation, literature review
Article Details
References
Clissett, P. (2008). Evaluating qualitative research. Journal of Orthopaedic Nursing, 12(2), 99-105.
Creswell, J. W. (2002). Educational research: Planning, conducting, and evaluating quantitative. New Jersey: Upper Saddle River.
Fossey, E., Harvey, C., McDermott, F., & Davidson, L. (2002). Understanding and evaluating qualitative research. Australian and New Zealand journal of psychiatry, 36(6), 717-732.
Frankel, R. M., & Devers, K. (2000). Qualitative research: A consumer's guide. Education for Health, 13(1), 113.
Horsburgh, D. (2003). Evaluation of qualitative research. Journal of clinical nursing, 12(2),
307-312.
Howe, K., & Eisenhart, M. (1990). Standards for qualitative (and quantitative) research: A prolegomenon. Educational researcher, 19(4), 2-9.
Malterud, K. (2001). Qualitative research: standards, challenges, and guidelines. The lancet, 358(9280), 483-488.
McMillan, J. H., & Wergin, J. F. (1998). Understanding and Evaluating Educational Research. Prentice-Hall, Inc., One Lake Street, Upper Saddle River, NJ 07458.
Ministry of Science and Technology (2008). Decision on promulgating a number of scientific and technological statistical classification tables, No. 12/2008 / QD-BKHCN.
Minister of Science and Technology (2004). Circular No. 11/2014/TT-BKHCN.
Nair, P. R., & Nair, V. D. (2014). Organization of a Research Paper: The IMRAD Format. In Scientific Writing and Communication in Agriculture and Natural Resources (pp. 13-25). Springer, Cham.
Nguyen, Q. V. (2008). Building evaluation criteria for scientific research to perform the function of scientific research at Hai Duong Vocational College, Master thesis in Business and Management, University of Social Sciences and Humanities.
Nunnally, J. C., & Bernstein, I. H. (1994). Validity. Psychometric theory, 3, 99-132.
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: a synthesis of recommendations. Academic Medicine, 89(9), 1245-1251.
Peterson, R. A. (1994). A meta-analysis of Cronbach's coefficient alpha. Journal of consumer research, 21(2), 381-391.
Redfield, D. (2004). A closer look at scientifically based research: How to evaluate educational research. THE Journal, 31, 24-25.
Russell, C. L. (2005). Evaluating quantitative research reports. Nephrology Nursing Journal, 32(1), 61-64.
Slater, S. F. (1995). Issues in conducting marketing strategy research. Journal of strategic Marketing, 3(4), 257-270.
Stiles, W. B. (1993). Quality control in qualitative research. Clinical psychology review, 13(6), 593-618.
Sukamolson, S. (2010). Fundamentals of quantitative research. Language Institute, Chulalongkorn University.
Taylor, E. W., Beck, J., & Ainsworth, E. (2001). Publishing qualitative adult education research: A peer review perspective. Studies in the Education of Adults, 33(2), 163-179.
Tran, H. T. (2013). Building a system of criteria to evaluate the results of scientific research in social sciences at the University of Science, Thai Nguyen University, Master's thesis in Business and Management. University of Social Sciences and Humanities
Tran, M. T. (2007). Scientific research activities of lecturers in universities and methods of assessment and acceptance of the topic, Van Lang University - Journal of Science and Training, (6), 54-59.
Viera, A. J., & Garrett, J. M. (2005). Understanding interobserver agreement: the kappa statistic. Fam med, 37(5), 360-363.
Vu, D. C. (2014). Scientific research methodology, Science and Technology Publishing House.
Wu, Y. P., Thompson, D., Aroian, K. J., McQuaid, E. L., & Deatrick, J. A. (2016). Commentary: Writing and evaluating qualitative research reports. Journal of pediatric psychology, 41(5), 493-505.