Tools for Post-Processing Predicted Values

Models can be improved by post-processing class probabilities, by: recalibration, conversion to hard probabilities, assessment of equivocal zones, and other activities. 'probably' contains tools for conducting these operations as well as calibration tools and conformal inference techniques for regression models.


probably probably website

Codecov testcoverage Lifecycle:experimental R-CMD-check

Introduction

probably contains tools to facilitate activities such as:

  • Conversion of probabilities to discrete class predictions.

  • Investigating and estimating optimal probability thresholds.

  • Calibration assessments and remediation for classification and regression models.

  • Inclusion of equivocal zones where the probabilities are too uncertain to report a prediction.

Installation

You can install probably from CRAN with:

install.packages("probably")

You can install the development version of probably from GitHub with:

# install.packages("pak")
pak::pak("tidymodels/probably")

Examples

Good places to look for examples of using probably are the vignettes.

  • vignette("equivocal-zones", "probably") discusses the new class_pred class that probably provides for working with equivocal zones.

  • vignette("where-to-use", "probably") discusses how probably fits in with the rest of the tidymodels ecosystem, and provides an example of optimizing class probability thresholds.

Contributing

This project is released with a Contributor Code of Conduct. By contributing to this project, you agree to abide by its terms.

Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("probably")

1.2.0 by Max Kuhn, a year ago


https://github.com/tidymodels/probably, https://probably.tidymodels.org


Report a bug at https://github.com/tidymodels/probably/issues


Browse source code at https://github.com/cran/probably


Authors: Max Kuhn [aut, cre] , Davis Vaughan [aut] , Edgar Ruiz [aut] , Posit Software , PBC [cph, fnd] (ROR: <https://ror.org/03wc8by49>)


Documentation:   PDF Manual  


MIT + file LICENSE license


Imports butcher, cli, dplyr, furrr, generics, ggplot2, hardhat, pillar, purrr, rlang, tidyr, tidyselect, tune, vctrs, withr, workflows, yardstick

Suggests betacal, covr, knitr, MASS, mgcv, modeldata, nnet, parsnip, quantregForest, randomForest, recipes, rmarkdown, rsample, testthat


Suggested by fastml, joinery, kerasnip, marginaleffects, orbital, predictset, propensity, tailor, tune, vetiver, workflows, yardstick.


See at CRAN