Private Browser-Based LLM Chatbot – Secret Llama

Experience private, secure AI conversations with Secret Llama's browser-based AI chatbot. Full free & Open Source. No data leaves your device. Try it now!

Secret Llama is a free, open-source, fully private AI chatbot web app that enables you to run a large language model (LLM) chatbot directly in your browser.

It was written in TypeScript/React.js and requires a modern browser with WebGPU support. The inference engine is provided by webllm.

Subscribe to our newsletter and get the top 10 AI tools and apps delivered straight to your inbox. Subscribe now!

Secret Llama supports various open-source models, such as Llama 3, Mistral, TinyLlama, and Phi-1.5, to give access to their conversational capability without releasing private details.

Unlike other chatbots (e.g., ChatGPT, Gemini, etc.), Secret Llama makes sure that your conversations are 100% private since all data processing takes place right in your browser.

This means you can chat openly and without anything held back, all without having the least fear of your words being stored or circulated on some server out of your control. Not to mention you can use it even without an internet connection.

How to use it:

1. Download the Secret Llama repository from Github and compile the React code. You can do this by running the following commands in your terminal:

yarn
yarn build-and-preview

2. Open the Secret Llama web app in your browser and select an LLM model from the dropdown:

You can also access the Secret Llama online here.

Secret Llama Chatbot Select LLM

3. Start chatting by typing your questions or prompts into the message box, similar to how you would with ChatGPT.

The first message might take a little longer to process as the model downloads fully to your computer. However, on subsequent visits, the model will load quickly from your local storage.

Secret Llama Chatbot First Message

Leave a Reply

Your email address will not be published. Required fields are marked *

Get the latest & top AI tools sent directly to your email.

Subscribe now to explore the latest & top AI tools and resources, all in one convenient newsletter. No spam, we promise!