节点文献
题组项目功能差异(DIF)检验方法的应用探索——以篇章阅读测验为例
The Application Study of Testlet DIF Procedure in Chinese Passage-based Reading Testing
【Author】 Guo Congying Bian Yufang Beijing Normal University National Key Laboratory of Cognitive Neuroscience and Learning,Beijing Normal University National Key Laboratory of Cognitive Neuroscience and Learning,Haidian Districe,Beijing, 100875,
【机构】 北京师范大学认知神经科学与学习国家重点实验室,北京市海淀区北京师范大学认知所边玉芳课题组;
【摘要】 篇章形式的阅读测验在语文学科考试与语言能力测试中占有越来越重要的地位,该测验是一种典型的题组测验,因此需要采用能够处理题组效应的统计方法进行分析。在进行项目功能差异(DIF)检验时,也需要采用与之匹配的DIF检验方法。基于题组反应模型的DIF检验方法是真正能够处理题组效应的DIF检验方法,能够提供题组中每个项目的 DIF效应测量,因此本研究将Rasch题组DIF检验方法引入篇章阅读测验的DIF检验中,并与基于传统Rasch模型的DIF检验方法以及变通的题组DIF检验方法的研究结果进行比较。本研究首先使用Rasch题组DIF检验方法对某阅读成就测验进行题组DIF检验,并采用bootstrap法估计DIF参数的标准误,检验结果显示,该测验在内容维度和能力维度的部分子维度上出现了具有显著DIF效应的项目,并且大多数DIF项目利于男生,本研究从测验公平的角度对该测验的进一步修改以及编制提出了一定的建议。Rasch题组DIF检验方法与基于传统Rasch模型的DIF检验方法以及变通的题组DIF检验方法的比较结果进一步体现了进行题组DIF检验的必要性与优越性。研究结果表明,在篇章阅读测验中,能够真正处理题组效应的题组DIF检验方法更加具有理论优势且对于阅读测验的编制与质量的提高具有更重要的意义。
【Abstract】 With the development of test forms,testlet form test enjoys more and more popularity in Education and Psychological Testing.Passage-based form is a typical example of testlets,so the DIF procedures that are adopted must be able to handle the testlet effect properly.The testlet model-based DIF detection approach is methodically sound,it provides the DIF effect of each item rather than the whole testlet.The Rasch Testlet Model is derived from the testlet model-based approach,DIF is taken into account by adding DIF parameters into the Rasch testlet model.In this study,we first employed the Rasch Tesdet Model to detect testlet DIF in Chinese Passage-based reading testing.The bootstrap method is conducted to approximate the standard errors of the estimators for the DIF parameters so that the Wald statistic can be computed to test the null hypothesis of no DIF.The results indicated that some items on the content dimension and the capacity dimension had significant DIF effect,and most of the DIF items favor of boys.We then gave advice on the further modification of the test. The second part of the study was a comparison study between the Rasch Tesdet Model and the traditional Rasch Model and the alternative testlet DIF approach,the result displayed the necessity and advantage of the testlet model-based approach.The results indicated that the testlet model-based approach were more technically sound than the non-testlet DIF procedures and me alternative testlet DIF approach for passage-based testing.
【Key words】 DIF; Testlet DIF; Rasch testlet model; Passage-based;
- 【会议录名称】 增强心理学服务社会的意识和功能——中国心理学会成立90周年纪念大会暨第十四届全国心理学学术会议论文摘要集
- 【会议名称】中国心理学会成立90周年纪念大会暨第十四届全国心理学学术会议
- 【会议时间】2011-10-21
- 【会议地点】中国陕西西安
- 【分类号】B841.7
- 【主办单位】中国心理学会