Contains methods for criterion-referenced test analyses as described in Brown & Hudson (2002). This includes cut-score item discrimination analyses and measures of dependability.
rcrtan provides functions for criterion-referenced test analyses as described in Brown & Hudson (2002). Currently it supports the following item and test analyses:
Get the development version from github:
This package contains six unique functions for calculating item statistics and one omnibus function for estimating all of the six unique functions. The formulas have been adapted from Brown and Hudson (2002).
crt_iteman: omnibus function that estimates item facility, item facility for masters, item facility for non-masters, the B-index, the agreement statistic, and item phi.
if_total: estimates the item facility values for the entire group of test takers.
if_pass: estimates the item facility values for the test takers who scored above the cut-score (masters).
if_fail: estimates the item facility values for the test takers who scored below the cut-score (non-masters).
b_index: estimates the B-index values for each item. This is the difference in item facility for masters and non-masters.
agree_stat: estimates the agreement statistic.
item_phi: estimates item phi.
item_stats <- crt_iteman(data = brown_depend, items = 2:31, raw_cut_score = 21, scale = 'raw')
This package contains two functions for estimating test dependability. The formulas have been adapted from Brown and Hudson (2002).
subkoviak: This function uses Subkoviak's (1988) methods for estimating kappa and rho from a single test administration.
sub_estimate <- subkoviak(data = brown_depend, items = 2:31, raw_cut_score = 21, look_up = FALSE)
short_phi: This function uses Brennan's (1980) formula for a short-cut estimate of generalizability coefficients for absolute decisions.
phi_estimate <- short_phi(data = brown_depend, items = 2:31)