GhostSwitch
Local AI assistant
One open Qwen3.5 model plus a library of LoRA experts for code, finance, law, CAD and two dozen other fields. For every message it picks the expert that fits, writes the answer and checks it in code. Runs on a laptop with 16 GB of memory.
- 88.3%HumanEval+ with the coding expert, against 76.7% for the base model
- 16 GBof memory runs the whole expert library
- 27experts for Qwen3.5-9B
What it does
- A router picks the expert for each message, or answers with the base model when none fits
- The expert attaches to the model already in memory in 0.1–0.3 s, with no reload
- Answers are checked by code: completeness, arithmetic, citations, JSON fields; a failed check means a retry
- OpenAI-compatible API: works with the OpenAI SDKs and the OpenCode coding agent
- Chats stay on your computer; it works offline once the models are downloaded
- Python
- Qwen3.5
- LoRA
- MLX
- llama.cpp
- OpenAI API

