Working with LLMs
Local LLMs
LLM Utility I'm a big fan of Simon Willison's llm package. It works nicely with llama-cpp. Inst...
LangChain and Zephyr
Zephyr is pretty powerful and it will quite happily use tools if you prompt it correctly. Zephy...
Embeddings and Llama.cpp
SQLite VSS - Lightweight Vector DB SQLite VSS is a SQLite extension that adds vector search on...
PyLLMCore
PyLLMCore is a python library for working with a variety of LLM models and it supports both OpenA...