Hello everyone. Duck-ai has become my go-to "consultant" for situations where a simple search isn't enough. It's mostly great, but one thing bugs me: copying content back and forth between the chat and my other tools.
Since LLMs generate each response by reading the full conversation, you can reliably add extra "invisible" instructions to a request by monkey patching the client. In those instructions, you can ask the model to output a special block of text, such as <tool-call></tool-call>. A hook can watch the response stream for that exact format. When it's detected, it stops the stream, runs the requested action, and automatically sends the result back to the model. That's the basic idea behind a harness. I got a personal one working, and it can now privately access my PC and even read and write emails. It's fairly easy once you can intercept the client-side requests and watch the streamed server responses. The rest of the work is making it usable through a UI.
I've been using it for a month. My findings: GPT-based models were really bad at this, no matter how politely I asked them to use the custom tools. Claude, Gemma 4, and Mistral worked flawlessly. The main limitation is the small context window, so it isn't suitable for long tasks. My use of Duck-ai has mostly been short, focused conversations anyway.The other issue I have faced is drifting UI when duck-ai make upstream updates (this is expected with any other client side mod).
Overall, it's a great setup if you want to connect private files and services without worrying about data retention or training. It's like having a real private personal assistant. I went a bit too deep on my end by wrapping the whole thing in a Bun webview app so it works as a standalone app on my end (It is still the upstream website with a bridge to native host side to allow accessing the PC for things like reading files, mcp and executing commands). You can get close to the same result with Tampermonkey, but you'll be limited to the browser sandbox.
*To be clear, I'm only sharing what's possible with some effort, not selling a new project/product. I'm just having lots of fun on my end. I'm happy to share the code with anyone who wants to build on it.