A Distributed Worker Launcher Framework

In computationally demanding analysis projects, statisticians and data scientists asynchronously deploy long-running tasks to distributed systems, ranging from traditional clusters to cloud services. The 'NNG'-powered 'mirai' R package by Gao (2023) is a sleek and sophisticated scheduler that efficiently processes these intense workloads. The 'crew' package extends 'mirai' with a unifying interface for third-party worker launchers. Inspiration also comes from packages. 'future' by Bengtsson (2021) , 'rrq' by FitzJohn and Ashton (2023) < https://github.com/mrc-ide/rrq>, 'clustermq' by Schubert (2019) ), and 'batchtools' by Lang, Bischel, and Surmann (2017) .


Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("crew")

1.3.3 by William Michael Landau, a month ago


https://wlandau.github.io/crew/, https://github.com/wlandau/crew


Report a bug at https://github.com/wlandau/crew/issues


Browse source code at https://github.com/cran/crew


Authors: William Michael Landau [aut, cre] (ORCID: , Daniel Woodie [ctb] , Eli Lilly and Company [cph, fnd]


Documentation:   PDF Manual  


MIT + file LICENSE license


Imports cli, collections, data.table, later, mirai, nanonext, processx, promises, ps, R6, rlang, stats, tibble, tidyselect, tools, utils

Suggests autometric, knitr, markdown, rmarkdown, testthat


Imported by crew.aws.batch, crew.cluster, tarpolyglot.

Suggested by fastreg, geotargets, targets.


See at CRAN