🚀 Efficient implementations of state-of-the-art linear attention models

11 Lessons to Get Started Building AI Agents

A live reading list for LLM-synthetic-data.

verl: Volcano Engine Reinforcement Learning for LLMs

🐉 Loong: Synthesize Long CoTs at Scale through Verifiers.

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Use PEFT or Full-parameter to finetune 300+ LLMs or 60+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V-2.6, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

从零实现一个小参数量中文大语言模型。

[ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"

TextStarCraft2,a pure language env which support llms play starcraft2

A easy, reliable, fluid template for python packages complete with docs, testing suites, readme's, github workflows, linting and much much more

Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint

Robust recipes to align language models with human and AI preferences

《Effective Modern C++》- 完成翻译

LLM + 中文文本匹配 Chinese Question Matching Corpus

AGI资料汇总学习（主要包括LLM和AIGC），持续更新......

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调。

Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.

Example models using DeepSpeed

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

A curated list of reinforcement learning with human feedback resources (continually updated)

Tuning LLMs with no tears💦, sharing LLM-tools with love❤️.

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Perform crosstalk with Qian Yu

为GPT/GLM提供图形交互界面，特别优化论文阅读润色体验，模块化设计支持自定义快捷按钮&函数插件，支持代码块表格显示，Tex公式双显示，新增Python和C++项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持清华chatglm等本地模型

An open-source tool-augmented conversational language model from Fudan University

MiniGPT-4: Enhancing Vision-language Understanding with Advanced Large Language Models

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf