Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
-
Updated
Jul 16, 2025 - Python
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
Agentic RAG for local and self-hosted document search: hybrid retrieval, reranking and multimodal RAG on embedded LanceDB, with Docling parsing and an MCP server
👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
An MCP server that executes Python code in isolated rootless containers with optional MCP server proxying. Implementation of Anthropic's and Cloudflare's ideas for reducing MCP tool definitions context bloat.
Discord bot for programming, runs code (600+ langs), queries/show docs and references
Code execution via Python package installation.
Helios: Automated XSS Testing
A secure file system for your agents to execute code
Unified execution environment for Python code, shell commands, and programmatic MCP tool calls.
Efficient multi-strategy Zotero search using code execution pattern
Recursive AI System
Ephemeral, stateless, capability-bound execution for untrusted AI and agent-generated code.
Give your AI agents clinical database access, research automation, and clinician-reviewed domain knowledge for MIMIC-IV, eICU, and more.
Universal shell supporting code highlighting, files, and interpretation without the need to download a language.
Library-friendly Agents
The official Python SDK for Judge0.
Runtime visibility for Python MCP servers. Captures tool calls, session lifecycle, module imports (SHA-256), and subprocess execution as structured NDJSON. No code changes.
Secure and lightweight Python code execution environment for LLMs
Official Python SDK for Runloop — secure Linux sandboxes (Devboxes) where AI agents run code, edit files, and expose ports
Security-posture-first list of sandboxes for running AI coding agents' code, ranked by isolation, egress control and secrets handling
To associate your repository with the code-execution topic, visit your repo's landing page and select "manage topics."