대한언어학회 전자저널

Liu, Zhen-Jie & Jin, Ming-Hao. (2018). A study of the content validity of reading comprehension tests in NMET II. The Linguistic Association of Korea Journal, 26(4), 103-124. Based on Bachman and Palmers (1996) framework of task characteristics, this paper aims to compare the reading comprehension tests of the 2013-2017 National Matriculation English Test II (NMET II) with the requirements of the New Curriculum Standards and Testing Syllabus, in particular, concerning the content validity of the tests in terms of the characteristics of input and expected responses. The implications of this study are discussed for test designers, teachers, and students. The results show that reading comprehension tests from 2013 to 2017 basically meet the requirements of the New Curriculum Standard and Testing Syllabus and have a high content validity. In terms of the characteristics of input, the length, reading speed, and readability of comprehension passages are appropriate for students; however, the distribution of topics and genres in each year is uneven. In terms of the characteristics of expected responses, the wordings of questions and the design of question items are reasonable. However, the response type is mainly restricted to selected response questions (multiple-choice), and the measure of reading skills coverage is unbalanced.

# content validity # reading comprehension test # NMET II

• Alderson, J.C., Clapham, C., & Wall, D. (2000). Language test construction and evaluation. Beijing: Foreign Language Teaching and Research Press.
• Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
• Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Shanghai: Shanghai Foreign Language Teaching Press.
• Dong, M. X. (2010). Diachronic analysis and research on the reading comprehension test of National Matriculation English Test. Foreign Language Teaching in Primary and Secondary Schools (Middle School), 2, 31-37.
• Hu, B., & Wei, J. S. (2016). Research on content validity and difficulty of English reading comprehension of Matriculation English Test in Hubei. Overseas English, 15, 91-93.
• Kim, N., & Lee, H. (2017). An exploration of high school reading test items based on discriminant analysis. The Linguistic Association of Korea Journal, 25(1), 75-92.
• Kobayashi, M. (2002). Method effects on reading comprehension test performance: Text organization and response format. Language Testing, 19, 193-220.
• Liu, S. Y. (2016). A study of content validity on reading comprehension tests of NMET (2015). Unpublished master’s thesis, Jiangxi Normal University, Nanchang City, Jiangxi Province, China.
• Qiu, J. (2010). Content validity study on reading comprehension tests of NMET of Chongqing. Unpublished master’s thesis, Southwest University, Chongqing City, Chongqing Municipality, China.
• Shohamy, E. (1984). Does the testing method make a difference? The case of reading comprehension. Language Testing, 1(2), 147-170.
• The Ministry of Education of the People's Republic of China. (2013). Curriculum standards for full-time compulsory education and senior high schools (Trial Version). Beijing: People's Education Press.
• Tian, X. L. (2012). The content validity on the National Matriculation English Test (NMET) of the year 2011 guided by the new curriculum standard. Unpublished master’s thesis, Shanxi Normal University, Xi’an City, Shanxi Province, China.
• Weir, C. J. (1993). Understanding and developing language tests. Hemel Hemstead: Prentice Hall International (UK) Ltd.
• Widdowson, H. G. (1978). Teaching language as communication. Oxford: Oxford University Press.
• Wood, R. B. (2001). Assessment and testing: A survey of research. Beijing: Foreign Language Teaching and Research Press.
• Xiao,Y. N., & Lin, C. (2015). A study on content validity of reading comprehension test of Matriculation English Test in Hunan (2010-2014). Education Measurement and Evaluation, 3, 44-49.
• Zhang, X. H. (2013). Content validity study on reading expression tests of NMET (Shandong). Unpublished master’s thesis, Shandong Normal University, Jinan City, Shandong Province, China.