Bayesian Analysis to Compare Models using Resampling Statistics

Bayesian analysis used here to answer the question: "when looking at resampling results, are the differences between models 'real'?" To answer this, a model can be created were the performance statistic is the resampling statistics (e.g. accuracy or RMSE). These values are explained by the model types. In doing this, we can get parameter estimates for each model's affect on performance and make statistical (and practical) comparisons between models. The methods included here are similar to Benavoli et al (2017) < https://jmlr.org/papers/v18/16-305.html>.


Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("tidyposterior")

1.1.0 by Max Kuhn, 2 months ago


https://tidyposterior.tidymodels.org, https://github.com/tidymodels/tidyposterior


Report a bug at https://github.com/tidymodels/tidyposterior/issues


Browse source code at https://github.com/cran/tidyposterior


Authors: Max Kuhn [aut, cre] , Posit Software , PBC [cph, fnd] (ROR: <https://ror.org/03wc8by49>)


Documentation:   PDF Manual  


MIT + file LICENSE license


Imports dplyr, generics, ggplot2, patchwork, purrr, rlang, rsample, rstanarm, stats, tibble, tidyr, tune, utils, vctrs, workflowsets

Suggests covr, knitr, parsnip, rmarkdown, rstan, splines2, testthat, yardstick


See at CRAN