NVIDIA/TransformerEngine

TransformerEngine is an open‑source library that speeds up Transformer workloads on NVIDIA GPUs by leveraging mixed‑precision formats—including 8‑bit (FP8) and