LLMlight’s documentation!
|
LLMlight is a Python package for running Large Language Models (LLMs) locally with minimal dependencies. It provides a simple interface to interact with various LLM models, including support for GGUF models and local API endpoints.
Tip
Medium Blog: How To Build Your Language Model: Local, Private, and Specialized for Specific Tasks.
Note
The LLMLight library is for free but powered by caffeine! Like it? Chip in what it’s worth ❤ and keep me developing cool stuff that you can use!
pip install LLMlight
Content
Background
Installation
Functions
Saving and Loading
Documentation