Stratified Evaluation of Subgroup Classification Accuracy

Enables simultaneous statistical inference for the accuracy of multiple classifiers in multiple subgroups (strata). For instance, allows to perform multiple comparisons in diagnostic accuracy studies with co-primary endpoints sensitivity and specificity (Westphal M, Zapf A. Statistical inference for diagnostic test accuracy studies with multiple comparisons. Statistical Methods in Medical Research. 2024;0(0). ).

{cases} R package: Stratified Evaluation of Subgroup Classification Accuracy

{cases} is an R package to simultaneously assess classification accuracy of multiple classifiers in several subgroups (strata). For instance, it allows to asses the accuracy of multiple candidate (index) diagnostic tests which is often measured with

sensitivity (accuracy in the diseased subgroup) and
specificity (accuracy in the healthy subgroup).

A widespread goal in diagnostic accuracy studies a so-called co-primary analysis of these two endpoints, i.e. to show a significant benefit (compared to some benchmark) in sensitivity and specificity for at least one of the candidate classifiers. The package implements different methods for multiplicity adjustment for that purpose (e.g. Bonferroni, maxT, pairs bootstrap). Theoretical background and an extensive simulation study is explained in the paper by Westphal & Zapf (2024).

Installation

To install the latest stable version from CRAN, use the following R command:

install.packages("cases")

You can install the latest development version from GitHub with:

# install.packages("remotes")
remotes::install_github("maxwestphal/cases",
  ref = "development",
  build_vignettes = TRUE
)

Usage

A vignette which explains the basic functionality of the {cases} package can be displayed as follows:

vignette(topic = "package_overview", package = "cases")

The following vignette shows an exemplary usage of the package in the context of biomarker assessment and prediction model evaluation:

vignette(topic = "example_wdbc", package = "cases")

References

Westphal M, Zapf A. Statistical inference for diagnostic test accuracy studies with multiple comparisons. Statistical Methods in Medical Research. 2024;0(0). doi:10.1177/09622802241236933