ENBIS-18 in Nancy

2 – 25 September 2018; Ecoles des Mines, Nancy (France) Abstract submission: 20 December 2017 – 4 June 2018

Binary Test of Latent Ability: Evaluation & Design Problems

5 September 2018, 11:30 – 11:50

Abstract

Submitted by
Emil Bashkansky
Authors
Emil Bashkansky (ORT Braude College of Engineering), Vladimir Turetsky (ORT Braude College of Engineering)
Abstract
In recent years substantial progress in the analysis and interpretation of the binary test results has been achieved. Recall that we are talking about the simplest issue of uni-dimensional ability - a, when the test item performance of the object under test (OUT) can be explained by a single latent ability. The test consists of a set of K test items, every test item response is estimated on the binary scale basis (pass/fail) and we need to evaluate the intrinsic ability of this OUT. Usually, it is assumed that the results of different test items, applied to the same OUT, are conditionally independent (i.e., the response to one test item does not affect the response to another). Given specific item response function (IRF) model, assessment of the tested ability usually is produced according to the principle of maximum likelihood estimation (MLE) or on the basis of Bayesian approach (if some preliminary information about the tested ability exists). When levels of test items difficulties are known beforehand, the problem solution is relatively easy, but when the amount of OUTs is bounded and levels of difficulties are unknown beforehand, analysis of the results faces significant computational difficulties. Nevertheless, in principle, the problem is solvable. However, at the moment when we think how to optimally allocate test resources, that is, how to choose the levels of test items difficulties, how many repetitions to perform for every level, what is the criterion of optimality etc., we come to the unexplored terra incognita. Our lecture is rather an attempt to describe a possible approaches and criteria to the test planning problem, than its complete solution. We will also treat some real applications of the proposed approach in education and antagonistic games.
View paper

Return to programme