Read the following scenarios and indicate the type of reliability in each scenario. Explain your answers
i) Test-retest reliability
ii) Parallel forms reliability
iii) Internal consistency reliability
iv) Interrater reliability
a) You want to evaluate the reliability of a critical thinking assessment. You create a large set of items that all pertain to critical thinking and then randomly split the questions into two sets of questionnaires. You administer both versions of the test to the same group of individuals. The scores from the two versions can then be correlated in order to evaluate the consistency of results across alternate versions.
b) You want to evaluate the degree to which the art portfolios in your 7th grade class meets the required standards. You ask 3 different art experts to evaluate the students' portfolios with the help of a rubric.
c) You are developing a math measure to test the constructs of number sense and logic of your 4th grade students. You want to make sure your measure is not testing other constructs like arithmetic skills. You would like to evaluate the degree to which different test items that probe the same constructs produce similar results.