johnbean393/Sidekick

About

Chat with a local LLM that can respond with information from your files, folders and websites on your Mac without installing any other software. All conversations happen offline, and your data stays secure. Sidekick is a local first application –– with a built in inference engine for local models, while accommodating OpenAI compatible APIs for additional model options.

Sidekick supports modern GGUF local models such as Qwen3.5 out of the box through its built-in llama.cpp backend.

Let’s say you're collecting evidence for a History paper about interactions between Aztecs and Spanish troops, and you’re looking for text about whether the Aztecs used captured Spanish weapons.

Here, you can…

Excerpted from github.com/johnbean393/Sidekick