Persistent Cache for 'ellmer' and 'shinychat' Large Language Model Interactions

Provides a persistent SQLite-based cache for user prompts and large language model (LLM) responses in applications built with the 'ellmer' and 'shinychat' packages. Reduces API (application programming interface) costs and latency by storing and retrieving identical or similar chat interactions across sessions and users.


Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("chatcache")

0.1.0 by Shekhar Chalwadi, 6 hours ago


https://github.com/shekharchalwadigrepo-hub/chatcache


Report a bug at https://github.com/shekharchalwadigrepo-hub/chatcache/issues


Browse source code at https://github.com/cran/chatcache


Authors: Shekhar Chalwadi [aut, cre]


Documentation:   PDF Manual  


MIT + file LICENSE license


Imports digest, jsonlite, DBI, RSQLite, cli, rlang

Suggests ellmer, shiny, shinychat, testthat, knitr, rmarkdown


See at CRAN