Working with LLMs

Local LLMs

LLM Utility I'm a big fan of Simon Willison's llm package. It works nicely with llama-cpp. Inst...

LangChain and Zephyr

Zephyr is pretty powerful and it will quite happily use tools if you prompt it correctly.  Zephy...

Embeddings and Llama.cpp

SQLite VSS - Lightweight Vector DB SQLite VSS is a SQLite extension that adds vector search on...

PyLLMCore

PyLLMCore is a python library for working with a variety of LLM models and it supports both OpenA...

ModernBERT

The original BERT paper came out in 2018, around 7 years ago at time of writing. However, it is s...

ColBERT

ColBERT is a variation of BERT that is optimised for search/retrieval use cases which uses contex...