float8

Here are 2 public repositories matching this topic...

PyTorch native quantization for training and inference

training sparsity cuda inference pytorch transformer llama quantization mx brrr dtypes float8

Official Code for the paper ELMO : Efficiency via Low-precision and Peak Memory Optimization in Large Output Spaces (in ICML 2025)

To associate your repository with the float8 topic, visit your repo's landing page and select "manage topics."