AI Chat
Private chat with on-device AI
About this tool
Have a conversation with an AI assistant that runs locally on your device. Pick Chrome's built-in Gemini Nano, or choose an open-source model (Llama, Qwen, Gemma, Phi, Mistral and more) that downloads once and runs in your browser via WebGPU with WebLLM. Either way there are no accounts, no API keys and no servers involved. Responses stream in as they are generated and the conversation keeps its context until you clear it.
On-device AI features are designed so prompts and documents can stay on your hardware when the browser AI stack is available. Availability depends on your browser and device capabilities.
How to use it
- Open the tool in a supported desktop browser.
- Follow on-screen status if a local model needs to download.
- Provide your prompt or document input.
- Review the result and copy or download what you need.
Common use cases
- Draft or brainstorm without sending chats to a cloud LLM.
- Summarize PDFs you prefer to keep local.
- Generate images with on-device pipelines when supported.
- Experiment with private AI workflows for development.
Frequently asked questions
Where do my messages go?
Nowhere. The model runs on your own device, so your conversation never leaves your browser.
Can I choose which model to use?
Yes. Use the selector to switch between Chrome's built-in Gemini Nano and open-source WebLLM models such as Llama, Qwen, Gemma, Phi or Mistral. WebLLM models download once (a few hundred MB to a few GB) and are cached for next time.
Do I need an API key or account?
No. There is nothing to sign up for. The built-in model needs a compatible Chrome, and WebLLM models need a browser with WebGPU support.
Why is it slower or less capable than cloud chatbots?
These are small models designed to run on your own hardware. They trade some capability for privacy, offline use and zero cost. Larger WebLLM models are more capable but need more memory and download time.
Does AI Chat upload my files or text?
No. Processing is designed to run in your browser. Your inputs are not uploaded to DevToolDeck servers for conversion.
Do I need an account?
No. You can use the tool immediately without signing up.
Is the tool free?
Yes. DevToolDeck tools are free to use in the browser. The site may show ads to keep the service available.