A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
-
Updated
Jun 30, 2025 - Python
#
semantic-cache
Here are 212 public repositories matching this topic...
Redis Vector Library. The AI-native Python client for Redis.
python search redis mcp openai embedding redis-search vector-search huggingface vector-database large-language-models llm anthropic semantic-cache retrieval-augmented-generation llmcache
-
Updated
Oct 20, 2026 - Python
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
docker self-hosted model-serving gpu-monitoring fastapi llm openai-proxy semantic-cache local-llm ollama llm-proxy ollama-api ai-gateway llm-router self-hosted-ai ai-cache
-
Updated
May 10, 2026 - Python
Drop-in AI memory layer with 2x faster retrieval and 10x lower cost. Fully compatible with Mem0 API. Migrate in 5 minutes without any code changes. Self-host for free.
ai mcp memory-management ai-agents long-term-memory rag fastapi vector-database hybrid-search qdrant llm semantic-cache llm-memory ai-memory memory-system agent-memory ai-agent-memory mem0-alternative mem0-compatible
-
Updated
Aug 17, 2026 - Python
Reliable and Efficient Semantic Prompt Caching with vCache
machine-learning consistency cache chatbot openai llama gpt verified memcache correctness semantic-search similarity-search rag vector-search guarantees vector-database llm vllm semantic-cache llm-memory
-
Updated
Jul 30, 2026 - Python
Own your LLM's web search: a local search->fetch->rank pipeline that replaces hosted web-search tools. Measured: matches hosted accuracy at 66% lower cost and up to 88% fewer tokens, plus a precision-tuned semantic caching with query-dependant TTL that no API offers.
mcp openai search-algorithms agents search-api web-search nli rag llm anthropic semantic-cache llm-tools agentic-workflow agent-skills agent-memory
-
Updated
Jul 23, 2026 - Python
Transparent, transport-layer semantic cache for LLM API calls, powered by Redis 8 Vector Sets.
-
Updated
Jul 10, 2026 - Python
Unified multi-layer caching library for AI/agent pipelines — LangChain, LangGraph, AutoGen, CrewAI, Agno, A2A
agent embeddings caching-strategies autogen rag caching-memory agno langchain semantic-cache langchain-python crewai langgraph aiagents llm-cache ai-cache gptcache-alternative
-
Updated
Jun 4, 2026 - Python
Redis integration for Google Agent Development Kit (ADK) - Memory, Sessions, Search Tools, MCP
redis memory semantic-search adk long-term-memory vector-search hybrid-search semantic-cache mcp-server agent-memory session-memory google-adk adk-python redis-agent-memory
-
Updated
Aug 20, 2026 - Python
Semantic caching layer for LLM apps: serves cached answers for paraphrased prompts, with pluggable vector stores and streaming support.
-
Updated
Oct 14, 2026 - Python
High-performance LLM query cache with semantic search. Reduce API costs 80% and latency from 8.5s to 1ms using Redis + Qdrant vector DB. Multi-provider support (OpenAI, Anthropic).
redis embeddings openai cost-optimization rag fastapi vector-database qdrant semantic-cache llm-caching
-
Updated
Dec 2, 2025 - Python
AI real-estate automation platform: Telegram bot, RAG, apartment search, CRM workflows, voice agent, Langfuse observability, and Dockerized AI runtime.
real-estate python docker redis telegram-bot crm ai-agents aiogram rag fastapi voice-ai hybrid-search livekit qdrant llm semantic-cache kommo langfuse langgraph bge-m3
-
Updated
Oct 20, 2026 - Python
ToolOps is a framework-agnostic middleware SDK that treats every tool call as a first-class operation. By wrapping your tools in a single decorator, you instantly upgrade them with industrial-grade caching, resilience, and observability.
python agent redis tools ai cache prometheus python3 retry cache-storage python-sdk circuit-breaker resilience ai-agents opentelemetry langchain semantic-cache valkey agent-tools agentic-ai
-
Updated
May 30, 2026 - Python
GenPark AI Agent Skill - Semantic prompt cache, cosine similarity threshold lookup, hit/miss metrics, and TTL cache expiration.
deduplication semantic-cache mcp-server latency-optimizer prompt-cache genpark-agent similarity-lookup
-
Updated
Sep 6, 2026 - Python
GenPark AI Agent Skill - Semantic prompt cache, cosine similarity threshold lookup, hit/miss metrics, and TTL cache expiration.
deduplication semantic-cache mcp-server latency-optimizer prompt-cache genpark-agent similarity-lookup
-
Updated
Sep 6, 2026 - Python
Entity-relation-object triplet extractor and multi-hop path reasoning kernel with Cypher and JSON-LD graph generation.
mcp knowledge-graph zero-dependency bm25 rag vector-search ai-agent semantic-cache model-context-protocol mcp-server memory-augmented
-
Updated
Sep 28, 2026 - Python
Context window attention optimizer reordering retrieved documents to place critical evidence at prompt boundaries, mitigating lost-in-the-middle degradation.
mcp knowledge-graph zero-dependency bm25 rag vector-search ai-agent semantic-cache model-context-protocol mcp-server memory-augmented
-
Updated
Sep 28, 2026 - Python
Zero-dependency hybrid retrieval engine fusing sparse lexical BM25 Okapi and dense Cosine vector similarities via Reciprocal Rank Fusion.
mcp knowledge-graph zero-dependency bm25 rag vector-search ai-agent semantic-cache model-context-protocol mcp-server memory-augmented
-
Updated
Sep 28, 2026 - Python
Cognitive multi-tier memory kernel managing working scratchpad, sliding dialogue buffer, and episodic memories with exponential recency decay.
mcp knowledge-graph zero-dependency bm25 rag vector-search ai-agent semantic-cache model-context-protocol mcp-server memory-augmented
-
Updated
Sep 28, 2026 - Python
High-throughput semantic query cache and approximate deduplicator combining exact SHA-256 and cosine similarity threshold matching with LRU eviction.
mcp knowledge-graph zero-dependency bm25 rag vector-search ai-agent semantic-cache model-context-protocol mcp-server memory-augmented
-
Updated
Sep 28, 2026 - Python
Add this topic to your repo
To associate your repository with the semantic-cache topic, visit your repo's landing page and select "manage topics."