Connect To Your Own LLM Server
Connect your own OpenAI-compatible inference server (Ollama, LM Studio, llama.cpp, Jan, vLLM) and talk to it through this interface. Traffic stays between your browser and your server.
Connect to your LLM server
Pick the server you already run. We send requests from your browser straight to it. Nothing is proxied, inspected, or stored by Unwrite.
Mixed content note: if Unwrite is loaded over HTTPS and your server is plain HTTP on a LAN address, most browsers will block the request. Either run the server over HTTPS (tools like Tailscale or mkcert make this painless) or load Unwrite in a compatible mode.
Thank you to the open-source ecosystem powering this page.
We gratefully acknowledge Hugging Face Hub, Transformers.js, ONNX Runtime Web, the ONNX Community, and model authors/publishers including Hexgrad, Hugging Face, MBZUAI, Liquid AI, Microsoft, Meta, Alibaba, Google. Please review each model card and licence before use.