Bindings for RDMA ibverbs through rdma-core

🚀 Efficient implementations of state-of-the-art linear attention models

📊 An infographics generator with 30+ plugins and 300+ options to display stats about your GitHub account and render them as SVG, Markdown, PDF or JSON!

Muon is Scalable for LLM Training

gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep lear…

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

Bridge Megatron-Core to Hugging Face/Reinforcement Learning

(best/better) practices of megatron on veRL and tuning guide

Ongoing research training transformer models at scale

slime is a LLM post-training framework for RL Scaling.

A Quirky Assortment of CuTe Kernels

SGLang is a fast serving framework for large language models and vision language models.

Config files for my GitHub profile.

verl: Volcano Engine Reinforcement Learning for LLMs

Allow torch tensor memory to be released and resumed later

Nano vLLM

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

📄 Awesome CV is LaTeX template for your outstanding job application

cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it

Fast and memory-efficient exact attention

A toolkit to run Ray applications on Kubernetes

Allow torch tensor memory to be released and resumed later

Distributed RL System for LLM Reasoning

Run LLMs with MLX

NVIDIA curated collection of educational resources related to general purpose GPU programming.

verl: Volcano Engine Reinforcement Learning for LLMs

A next generation Python CMake adaptor and Python API for plugins