verson00/dsh-local-llm

Runs the local llama.cpp Qwen3.5-4B from a Settings page — Windows only, NVIDIA GPU (8 GB VRAM handles the 4B Q4) — with start, stop and restart, launch parameters, deployment paths with a presence check, provider-route and compaction-policy sync in the profile patch, a loopback request-capture proxy, and a local_worker tool that hands translation, OCR and video-frame chores to the local model by file path. Needs llama-server.exe (verified on b12069) and Qwen3.5-4B GGUF + mmproj files on disk; video frames also need ffmpeg.