rocm

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Open Machine Learning Compiler Framework

NumPy & SciPy for GPU

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A nearly-live implementation of OpenAI's Whisper.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Stable Diffusion web UI

Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

A deep learning package for many-body potential energy representation and molecular dynamics

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

Large-scale LLM inference engine

Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.

stdgpu: Efficient STL-like Data Structures on the GPU

Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface. Now ZLUDA enhanced for better AMD GPU performance.

UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms