Task Queue for Parallel Computing Based on PostgreSQL

Implements a task queue system for asynchronous parallel computing using 'PostgreSQL' < https://www.postgresql.org/> as a backend. Designed for embarrassingly parallel problems where tasks do not communicate with each other. Dynamically distributes tasks to workers, handles uneven load balancing, and allows new workers to join at any time. Particularly useful for running large numbers of independent tasks on high-performance computing (HPC) clusters with 'SLURM' < https://slurm.schedmd.com/> job schedulers.


Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("taskqueue")

0.2.0 by Bangyou Zheng, a year ago


https://taskqueue.bangyou.me/, https://github.com/byzheng/taskqueue


Report a bug at https://github.com/byzheng/taskqueue/issues


Browse source code at https://github.com/cran/taskqueue


Authors: Bangyou Zheng [aut, cre]


Documentation:   PDF Manual  


MIT + file LICENSE license


Imports settings, stats, stringr, RPostgres, ggplot2, whisker, rlang, shiny, DBI, ssh

Suggests knitr, rmarkdown, testthat


See at CRAN