Criterion-Referenced Test Analysis

Contains methods for criterion-referenced test analyses as described in Brown & Hudson (2002). This includes cut-score item discrimination analyses and measures of dependability.


Build Status

rcrtan provides functions for criterion-referenced test analyses as described in Brown & Hudson (2002). Currently it supports the following item and test analyses:

  • Item discrimination

    • Item facility (including IF for passing test takers and failing test takers)
    • B-index
    • Agreement index
    • Item Phi
  • Test dependability

    • Subkoviak's (1988) single administration kappa coefficient
    • Subkoviak's (1988) single administration agreement coefficient
    • Brennan's (1980) short-cut estimate of the generalizability coefficient for absolute decisions

Installation & Documentation

Get the development version from github:

install.packages('devtools')
devtools::install_github('gtlaflair/rcrtan')

Item analysis functions

This package contains six unique functions for calculating item statistics and one omnibus function for estimating all of the six unique functions. The formulas have been adapted from Brown and Hudson (2002).

  • crt_iteman: omnibus function that estimates item facility, item facility for masters, item facility for non-masters, the B-index, the agreement statistic, and item phi.

  • if_total: estimates the item facility values for the entire group of test takers.

  • if_pass: estimates the item facility values for the test takers who scored above the cut-score (masters).
  • if_fail: estimates the item facility values for the test takers who scored below the cut-score (non-masters).
  • b_index: estimates the B-index values for each item. This is the difference in item facility for masters and non-masters.
  • agree_stat: estimates the agreement statistic.
  • item_phi: estimates item phi.
item_stats <- crt_iteman(data = brown_depend, items = 2:31, raw_cut_score = 21, scale = 'raw')

Test dependability functions

This package contains two functions for estimating test dependability. The formulas have been adapted from Brown and Hudson (2002).

  • subkoviak: This function uses Subkoviak's (1988) methods for estimating kappa and rho from a single test administration.
sub_estimate <- subkoviak(data = brown_depend, items = 2:31, raw_cut_score = 21, look_up = FALSE)
 
  • short_phi: This function uses Brennan's (1980) formula for a short-cut estimate of generalizability coefficients for absolute decisions.
phi_estimate <- short_phi(data = brown_depend, items  = 2:31)

News

rcrtan 0.1.1

Major changes

  • none

Bug fixes

  • The functions have been updated to avoid bugs related to the release of tibble 2.0

Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("rcrtan")

0.1.1 by Geoffrey T. LaFlair, a year ago


https://github.com/gtlaflair/rcrtan


Report a bug at https://github.com/gtlaflair/rcrtan/issues


Browse source code at https://github.com/cran/rcrtan


Authors: Geoffrey T. LaFlair


Documentation:   PDF Manual  


GPL-3 license


Imports dplyr, magrittr, purrrlyr, stats, tibble, tidyr

Suggests knitr, rmarkdown


See at CRAN