⚡ Accelerate chat and IDE workflows with a proxy for llama.cpp, managing slots and cached context for efficient, low-latency interactions.
-
Updated
Oct 14, 2026 - Python
⚡ Accelerate chat and IDE workflows with a proxy for llama.cpp, managing slots and cached context for efficient, low-latency interactions.
web-server university project with different features
Caching in pure Python: LRU + TTL, durable file cache, tiered cache, and a memoize decorator. Thread-safe, zero dependencies.
Cache function result to disk using pickle
Python caching library with file cache, SQLite cache, memory cache, and pluggable backends
To associate your repository with the file-cache topic, visit your repo's landing page and select "manage topics."