K.K.Tatsuoka和她同事研究的规则空间模型(RSM)是一种在国内外有较大影响的认知诊断模型,但是Tatsuoka的RSM是由学科专家先从已编制的测验中抽取出属性,然后给出测验的关联Q阵,再由该Q阵导出属性间的层级关系。已有研究证明,这种做法所得到的属性间的层级关系难以保证是正确的,甚至难以保证属性间的层级关系是唯一确定的。这里利用贝叶斯网进行结构学习,从被试的属性掌握模式中挖掘出属性间的层级关系,学习所得到的层级关系可以用来验证由RSM中的方法得到的层级关系。模拟实验和实证研究的结果都显示了该方法所得到的属性层级关系是有参考价值的,可以为命题或测量专家带来有用的信息。
It's very significant to correctly identify the hierarchical relation among attributes correctly when constructing a diagnosis test.As we know,there are various methods to identify the hierarchical relation among attributes in different cognitive diagnosis models(CDMs).Rule Space Model(RSM) is a kind of great influence CDM which was developed by Tatsuoka and her associates.In RSM,the task of attribute identification is performed after the test items have already been developed.And then an incidence Q matrix can be determined which reflects hierarchical relation.However,in Leighton,Gierl and Hunka's(2004) Attribute Hierarchy Method(AHM) the organization of attributes(attributes,number of attributes and attribute hierarchical relation) should be determined before developing the test items.In RSM and AHM the importance of correctly identifying the attributes and their hierarchical relation cannot be overstated,and the attributes and their hierarchical relations serve as the most important input variables to the models because they provide the basis for interpreting the results.The hierarchical relation among attributes describes the domain knowledge structures.Understanding the domain knowledge structures in highly specific detail provides a rational basis for proposing and evaluating potential improvements in the measurement of general proficiency.Otherwise,improvement remains largely a trial-and-error process.It has been proved that is not reliable to get the hierarchical relation by analyzing the test items,even the resulting hierarchical relations are not unique.Now,structure learning of Bayesian Networks would be introduced to study the hierarchical relation from the examinees' attribute mastery patterns.On the one hand,this paper conducted a simulation study in which Cui,Leighton and Zheng(2006)'s attribute hierarchical relation was employed,and the sample size of 5000 was used.In the simulated study,different sliping rates was considered for the purpose of testing the robustnes