LitGPT - Deploy your AI System with Style, Create your own ChatGPT Alternative
LitGPT is an open-source system that offers more than 20 high performance LLMs with recipes to pretrain, finetune, and deploy you are system with full system scale support.
Every LLM is implemented from scratch with no abstractions and full control, making them blazing fast, minimal, and performant at enterprise scale.
LitGPT powers many great AI projects, initiatives, challenges and of course enterprises.
Features
- ✅ Enterprise ready - Apache 2.0 for unlimited enterprise use.
- ✅ Developer friendly - Easy debugging with no abstraction layers and single file implementations.
- ✅ Optimized performance - Models designed to maximize performance, reduce costs, and speed up training.
- ✅ Proven recipes - Highly-optimized training/fine-tuning recipes tested at enterprise scale
- ✅ From scratch implementations
- Rich command line set
- Super friendly user workflow
- ✅ No abstractions
- ✅ Beginner friendly
- ✅ Flash attention
- ✅ FSDP
- ✅ LoRA, QLoRA, Adapter
- ✅ Reduce GPU memory (fp4/8/16/32)
- ✅ 1-1000+ GPUs/TPUs
- ✅ 20+ LLMs
Install and use
To install
pip install 'litgpt[all]'Load and use any of the 20+ LLMs:
from litgpt import LLM
llm = LLM.load("microsoft/phi-2")
text = llm.generate("Fix the spelling: Every fall, the familly goes to the mountains.")
print(text)
# Corrected Sentence: Every fall, the family goes to the mountains. License
LitGPT is released under the Apache 2.0 license.
