Persistent Large Data Array with Lazy-Loading on Demand

Multi-threaded serialization of compressed array that fully utilizes modern solid state drives. It allows to store and load extremely large data on demand within seconds without occupying too much memories. With data stored on hard drive, a lazy-array data can be loaded, shared across multiple R sessions. For arrays with partition mode on, multiple R sessions can write to a same array simultaneously along the last dimension (partition). The internal storage format is provided by 'fstcore' package geared by 'LZ4' and 'ZSTD' compressors.


News

Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("lazyarray")

1.1.0 by Zhengjia Wang, 3 months ago


https://github.com/dipterix/lazyarray


Report a bug at https://github.com/dipterix/lazyarray/issues


Browse source code at https://github.com/cran/lazyarray


Authors: Zhengjia Wang [aut, cre, cph] , Mark Klik [ctb, cph] (Copyright holder of fstcore package)


Documentation:   PDF Manual  


AGPL-3 license


Imports Rcpp, R6, fstcore, yaml

Suggests testthat, knitr, fst, rmarkdown, dipsaus

Linking to Rcpp, fstcore

System requirements: C++11 little-endian platform


Imported by raveio.


See at CRAN