rocm

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Open Machine Learning Compiler Framework

NumPy & SciPy for GPU

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A nearly-live implementation of OpenAI's Whisper.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Stable Diffusion web UI

A deep learning package for many-body potential energy representation and molecular dynamics

Large-scale LLM inference engine

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.

stdgpu: Efficient STL-like Data Structures on the GPU

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU performance.

UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

RDNA-native LLM inference engine in Rust.