Article Sidebar

Untitled
Date Published: 27/10/2020
Online Published: 30/10/2020
Abstract Views: 615
Views Untitled: 328
DOI: https://doi.org/10.54607/hcmue.js.17.10.2883(2020)
Issue
Vol. 17 No. 10 (2020)
Section
Articles
How to Cite
Nguyễn , V. C., & Nguyễn , P. H. (2020). ANALYZING AND SELECTING MULTIPLE-CHOICE TEST ITEMS BASED ON CLASSICAL TEST THEORY AND ITEM RESPONSE THEORY. HCMUE Journal of Science, 17(10), 1804. https://doi.org/10.54607/hcmue.js.17.10.2883(2020)

ANALYZING AND SELECTING MULTIPLE-CHOICE TEST ITEMS BASED ON CLASSICAL TEST THEORY AND ITEM RESPONSE THEORY

Văn Cảnh Nguyễn , Phước Hải Nguyễn

Main Article Content

Abstract

 

 

This study presents the results of analysis and selection of 50 multiple-choice items of English 1 course for the final test of 798 students at Dong Thap University in the academic year 2019-2020 based on IATA software. Using a combination of analytical methodology based on Classical Test Theory (CTT) and Item Response Theory (IRT), good items will be discovered and put into a test bank to assess the student learning outcomes. Unsatisfactory items will be discovered for adjustment or removal. The study results have shown that IATA software has many advantages such as: easy to use, time-saving, accurate and clearly visual output to analyse, assess, and select multiple-choice items. This study can be used not only to analyze and select multiple-choice items, but also to improve the quality of multiple-choice test items to build a test for an exam in order to meet the demands of radical and comprehensive innovation in education and training.

 

Keywords

multiple-choice items, IATA software, Classical Test Theory, Item Response Theory

Article Details

References

Baker, F. B. (2001). The basics of item response theory. For full text: http://ericae. net/irt/baker
Birnbaum, A. L. (1968). Some latent trait models and their use in inferring an examinee's ability. Statistical theories of mental test scores.
Bui, N. Q. (2017). Danh gia chat luong ngan hang de thi trac nghiem khach quan mon Nhan hoc dai cuong bang mo hinh Rasch va phan mem Quest [Evaluation of the quality of multiple choice test bank for the module of Introduction to Anthropology by using the RASCH model and QUEST software]. Science of Technology Development, 20(X3), 42-54.
Bui, A. K., & Bui, N. P. (2018). Su dung phan mem IATA de phan tich, danh gia va nang cao chat luong cau hoi trac nghiem khach quan trong chuong trinh ham so luy thua, ham so mu, ham so logarit [Using IATA to analyze, evaluate and improve the quality of the multiple-choice questions in chapter power functions, exponential functions and logarithmic functions]. Can Tho University Journal of Science, 54 (9C), 81-93.
Cartwright, F. (2007). IATA 3.0 Item and Test Analysis: a software tutorial and theoretical introduction.
Doan, H. C., Le, A. V., & Pham, H. U. (2016). Ap dung mo hinh IRT 3 tham so vao do luong va phan tich do kho, do phan biet va muc do du doan cua cac cau hoi trong de thi trac nghiem khach quan [Applying 3-parameter logistic model in validating the level of difficulty, discrimination and guessing of items in a multiple choice test]. Ho Chi Minh City University of Education Journal of Science, 7(85), 174-184.
Duong, T. T. (2005). Trac nghiem va do luong thanh qua hoc tap [Test and measure academic achievement]. Hanoi: Social Sciences Publishing House.
Lam, Q. T. (2011). Do luong trong giao duc li thuyet va ung dung [Measurement in Education - Theory and Application]. Hanoi: Vietnam National University Publishing House.
Le, A. V., Pham, H. U., Doan, H. C., Le, T. H. (2017). Ap dung lay mau GIBBS vao do luong va danh gia do kho cau hoi trong mo hinh Rasch [Using Gibbs Sampler to evaluate item difficulty in Rasch model]. Ho Chi Minh city University of Education Journal of Science, 14(4), 119-130.
Nguyen, B. H. T. (2008). Using Quest software to analyze objective test questions [Su dung phan mem Quest de phan tich cau hoi trac nghiem khach quan]. Journal of Science and Technology, Da Nang University, 2, 119-126.
Nguyen, P. H. (2017). Su dung bang GSP va phuong phap ROC de phan tich va lua chon cau hoi trac nghiem khach quan [Using GSP chart and ROC method to analyze and select mutiple choice items]. Dong Thap University Journal of Science, 24(2), 11-17.
Nguyen, P. H., & Du, T. N. (2015). Phan tich va lua chon cau hoi trac nghiem khach quan dua tren bang S-P, phan tich quan he xam va duong cong ROC [The analysis and selection of objective test items based on S-P chart, Grey Relational Analysis, and ROC curve]. Ho Chi Minh city University of Education Journal of Science, 6(72), 163-173.
Nguyen, T. H. M., & Nguyen, D. T. (2006). Do luong danh gia trong de thi trac nghiem khach quan: Do kho cau hoi va nang luc cua thi sinh [Measurement Assessment in the objective test: Question difficulty and Examinees’ ability]. Vietnam National University Journal of Science, 4, 34-47.
Nguyen, V. C., & Nguyen, Q. T. (2020). Ung dung phan mem ConQuest voi mo hinh IRT hai tham so vao viec danh gia chat luong de thi trac nghiem khach quan [Applying ConQuest software with the two-parameter IRT model to evaluate the quality of multiple-choice test]. HNUE Journal of Science, 65(7), 230-242.
Pham, T. M., & Bui, D. N. (2019). Ung dung phan mem IATA de phan tich, danh gia cau hoi trac nghiem khach quan o truong Dai hoc Thu do Ha Noi [The IATA software for analyzing, evaluation of multiple-choice questions at Ha Noi Metropolitan University]. Scientific Journal of Ha Noi Metropolitan University, 20, 97-108.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research.