slime is a LLM post-training framework aiming at scaling RL.

Allow torch tensor memory to be released and resumed later

verl: Volcano Engine Reinforcement Learning for LLMs

SGLang is a fast serving framework for large language models and vision language models.

Nano vLLM

Fast and memory-efficient exact attention

My learning notes/codes for ML SYS.

An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)

Efficient Triton Kernels for LLM Training

Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.

主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

llama2 inference engine in Rust

Flyte Documentation 📖

《Designing Data-Intensive Application》DDIA中文翻译