대한언어학회 전자저널

Jin. Ming-Hao & Zheng, Mei-Xian. (2020). A study of content validity on grammar gap-filling tests in NMET II. The Linguistic Association of Korea Journal, 28(3), 71-81. Based on Bachman and Palmers (1996) Framework of Task Characteristics and Lis (1996) Test Point Validity Theory, this paper aims to analyze the test point quality and content validity of grammar gap-filling tests of the 2014-2019 National Matriculation English Test paper II (NMET II), in particular, concerning the content validity of tests in terms of the characteristics of input and expected responses, and test point validity. The results show that the grammar gap-filling tests in the NMET II are all in line with the language knowledge part required in the New Curriculum Standard and the Testing Syllabus and have a relatively high content validity. The test points are evenly distributed and reasonably designed, which can test students' grammar ability under the guidance of discourse with well designed length and reasonable test point validity. However, there are still some problems to be improved, such as the lack of man and nature and practical essay writing in terms of topic and genre. The readability fluctuated greatly. The expected response type is restricted to limited production. Furthermore, test points designed with discourse level and meaning factor are less examined, and lacking of test points used to measure a higher grammatical ability.

# content validity # grammar gap-filling tests # NMET II

• Alderson, J. C. (2000). Assessing reading. Cambridge: Cambridge University Press.
• Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
• Bachman. L. F., & Palmer. A. S. (1996). Language testing in practice. Oxford: Oxford University Press.
• Examination Center of the Ministry of Education. (2019). The national college entrance examination test syllabus of 2019. Beijing: Higher Educational Press.
• Guo, B. (2017). Contrastive analysis and enlightenment of English grammar cloze and essay correction in college entrance examination. Educational Measurement and Evaluation, 5, 18-23.
• Halliday, M. A .K., & Hasan, R. (1985) Language: Context and text. Burwood: Deaken University.
• Hughes, A. (2003). Testing for language teachers (2nd ed.). Cambridge: Cambridge University Press.
• Larsen-Freeman, D. (1991). Teaching grammar. In M. Celce-Murcia (Ed.). Teaching English as a second or foreign language (pp. 251-266). Boston MA: Heinle & Heinle Publishers.
• Liu, H. (2016). A construct validation study of grammar gap-filling task in NMET Guangdong. Unpublished MA thesis. Guangdong: Guangdong University of Foreign Studies.
• Liu, S. (2018). A study in the task characteristics of NMET grammar gap-filling task. Journal of Nanchang Education College, 2, 20-23.
• Li, X. (1997). Science and art of language testing. Changsha: Hunan Education Press.
• Liu, Z., & Jin, M. (2018). A study of content validity of reading comprehension tests in NMET II. The Linguistic Association of Korea Journal, 26(4), 103-124.
• Ministry of Education of the People\'s Republic of China. (2003). National English Curriculum Standards for general High School (Experimental edition). Beijing: People’s Education Press.
• Purpura. J. (2004). Assessing gammar. Cambridge: Cambridge University Press.
• Wang, X., & Yang, Z. (2018). A study on content validity of the application of examination items about English language knowledge from National Matriculation English Test in 2017. Educational Measurement and Evaluation. 4, 25-33.
• Zhang, C. (2015). A Rasch-based construct validation of GMET grammar gap-filling task. Modern Foreign Language, 6, 126-127.
• Zhang, H. (2016). Test method effects in grammar tests: The comparative study between grammar gap-filling tests and multiple-choice tests. Foreign Language Testing and Teaching, 2, 32-38.