23 OCT 2025 - We are back! If you have been following us over the last few years, you will know that the last 2 months have been rough. We website was practically not loading. Sorry for the mess. We are back though and everything should run smoothly now. New servers. Updated domains. And new owners. We invite you all to start uploading torrents again!
Cross-platform (Linux, Windows, MacOSX) Fast CPU based inference using ggml for GPT-J based models The UI is made to look and feel like you've come to expect from a chatty gpt Check for updates so you can alway stay fresh with latest models Easy to install with precompiled binaries available for all three major desktop platforms
Feature wishlist
Multi-chat - a list of current and past chats and the ability to save/delete/export and switch between Text to speech - have the AI response with voice Speech to text - give the prompt with your voice Multi-modal - Ability to load more than one model and switch between them Python bindings Typescript bindings Plugin support for langchain other developer tools Save your prompt/responses to disk Upload prompt/respones manually/automatically to nomic.ai to aid future training runs Syntax highlighting support for programming languages, etc. REST API with a built-in webserver in the chat gui itself with a headless operation mode as well Advanced settings for changing temperature, topk, etc
