llama-cpp-python

Python bindings for llama.cpp that enable running large language models directly in Python applications. Makes it simple to add local LLM inference to Python projects without external services. Lightweight and efficient implementation. Works with all models supported by llama.cpp. Easy to integrate into existing Python applications and scripts. Popular choice for data scientists and Python developers. Free and well-maintained.

Browse tasks in this category · Category overview