Real-time stream editing pipeline powered by the FLUX.2-klein-4B model, optimized for consumer GPUs
-
Updated
Jun 13, 2026 - Python
#
gpu-optimization
Here are 72 public repositories matching this topic...
GPU Profiler for AI agents
debugging machine-learning monitoring deep-learning gpu inference pytorch artificial-intelligence observability ai-agents gpu-monitoring gpu-kernels gpu-optimization
-
Updated
Oct 13, 2026 - Python
GPU 性能与 AI Infra 学习项目：CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构
ai gpu cuda pytorch triton cuda-kernels cuda-toolkit tensorrt pytorch-tutorial gpu-programming gpu-optimization cuda-programming deepspeed cuda-kernel tensorrt-engine llm vllm tensorrt-llm ms-swift sglang
-
Updated
Sep 8, 2026 - Python
GVProf: A Value Profiler for GPU-based Clusters
machine-learning patterns profiler gpu cuda data-flow instrumentation binary-analysis clusters redundancy gpu-optimization value-profiler
-
Updated
Mar 24, 2024 - Python
Forge kernels — fused Triton kernels for faster, leaner LLM fine-tuning. One-call patching into Hugging Face models via forge.patch(model), with FSDP2 multi-GPU support and a growing set of kernels and architectures. Every speedup backed by a committed benchmark. Apache-2.0.
cuda transformers pytorch triton lora gemma gpu-kernels fine-tuning gpu-optimization huggingface llm fsdp qwen
-
Updated
Aug 15, 2026 - Python
KeSSie HUGE Context Semantic recall for Large Language Models
state-management cuda high-throughput memory-efficiency rocm gpu-optimization long-term-memory inference-optimization transformer-architecture lossless-compression kv-cache large-language-models vllm llm-inference context-window enterprise-ai real-time-inference vram-optimization linear-serialization state-inference
-
Updated
Feb 21, 2026 - Python
Faster attention kernels for serving TML's Inkling model on vLLM. 2.7x over the shipping path on H100, and the only implementation that runs on A100.
gpu cuda inference attention hopper cuda-kernels cutlass kernels inkling gpu-optimization mlsys llm-serving vllm flash-attention h100
-
Updated
Sep 18, 2026 - Python
The GPU Optimizer for ML Models enhances GPU performance for machine learning. It offers advanced scheduling, real-time monitoring, and efficient resource management through a user-friendly web interface and robust API, integrating big data technologies for seamless data processing and model optimization. @NVIDIA
model-management gpu-optimization real-time-monitoring secure-api big-data-integration gpu-scheduling
-
Updated
Dec 28, 2025 - Python
A high-performance C++ backend for extreme-context LLM inference. It replaces item-count batching with dynamic, VRAM-aware First-Fit Decreasing (FFD) bin packing. By using PyBind11 for async queueing, 16-token alignment, and `cudaHostAlloc` for zero-copy FlashAttention-2 transfers, it mathematically eliminates OOMs and maximizes GPU throughput.
zero-copy bin-packing cpp17 memory-management pybind11 gpu-optimization llm-inference flash-attention-2
-
Updated
Aug 28, 2026 - Python
Hardware-aware Ollama fork with legacy NVIDIA support, controllable runtime tuning, Q4/Q8 KV cache, Flash Attention, CUDA Graphs and optimized multi-GPU inference.
gpu tesla cuda inference self-hosted nvidia multi-gpu maxwell gpu-optimization llm llama-cpp flash-attention ollama ai-infrastructure legacy-gpu cuda-graphs
-
Updated
Oct 9, 2026 - Python
用于复现和优化常见的深度学习算子，基于cuda和triton两种方案，可供学习和参考
-
Updated
Jun 1, 2026 - Python
Executive FinOps dashboard and automated governance engine using FOCUS 1.3 standards for AWS, Azure, and Snowflake.
automation power-bi data-engineering multi-cloud gpu-optimization finops platform-engineering cloud-governance cloud-ops cloud-economics azure-finops aws-finops ai-infrastructure focus-1-3 llmops-finance serverless-governance gcp-finops
-
Updated
Feb 14, 2026 - Python
Physics-based computation at scale — Hamiltonian dynamics, spectral theory, and statistical mechanics powering optimization, drug discovery, genomics, molecular proof, and agentic commerce.
genomics drug-discovery ising-model post-quantum-cryptography hamiltonian-dynamics gpu-optimization simulated-bifurcation blockchain-verification spectral-theory physics-based-computation
-
Updated
May 28, 2026 - Python
Comparative benchmark of 4 LLM inference engines (HuggingFace, vLLM, AWQ, Speculative Decoding) on AMD GPU. Streamlit dashboard with real-time GPU telemetry, concurrent load testing, and throughput/latency visualization.
python benchmark amd telemetry inference quantization rocm gpu-optimization streamlit llm vllm speculative-decoding
-
Updated
Jul 31, 2026 - Python
The NVIDIA driver's fan control logic wasn't doing it for me — too conservative, too opaque — so I built my own. This is a Linux GUI application for independent NVIDIA GPU fan control without requiring Coolbits. Uses pynvml via a root helper subprocess for direct fan management.
-
Updated
Mar 24, 2026 - Python
LLM pretraining from scratch on FineWeb dataset (architecture and all components explained), plus optimal use of GPU on SLURM cluster
rope model-evaluation gpu-optimization gqa layernorm rmsnorm llm-training llm-inference llm-evaluation swiglu bpe-tokenizer flashattention muon-optimizer
-
Updated
May 12, 2026 - Python
🚀 Achieve rapid training of NanoGPT (GPT-2 124M) on a single RTX 4090, targeting a validation loss below 3.28 with FineWeb-Edu data.
open-source benchmark machine-learning natural-language-processing deep-learning text-generation pytorch model-training gpu-optimization ai-research transformer-models single-gpu inference-speed nanogpt fast-training
-
Updated
Oct 14, 2026 - Python
Multi-GPU parallelized YOLOv5 training and inference pipeline — data-parallel scaling and throughput tuning.
-
Updated
Aug 10, 2026 - Python
A no-cost infrastructure benchmark measuring the VRAM and throughput impact of NF4 (4-bit) quantization on LLMs
-
Updated
Dec 7, 2025 - Python
🤖 NLP pipeline for low-resource machine translation using ByT5, advanced text normalization, custom training loops, and optimized Transformer inference.
natural-language-processing deep-learning machine-translation pytorch model-training gpu-optimization large-language-models
-
Updated
Jun 25, 2026 - Python
Add this topic to your repo
To associate your repository with the gpu-optimization topic, visit your repo's landing page and select "manage topics."