Artificial Intelligence (AI)
AirLLM: Run Massive LLMs on Single 4GB GPU, Free and Open-source
What is AirLLM? AirLLM is a revolutionary Python library that shatters the hardware barrier for Generative AI, enabling developers to run massive 70B+ parameter models on standard consumer-grade hardware. By utilizing a "divide and conquer" strategy that loads model layers sequentially from disk, AirLLM allows a single 4GB