The simplest way to use local and online LLMs
Interact with popular AI models with just a click of a button
Use offline models like Llama 3, Mixtral, Qwen, LlaVa, Gemma, Command R+, or online models like GPT 4, Gemini, Mistral, Groq, Claude, and more in an unified easy to use interface.
Focus on your productivity and not on the setup.
"I have tried MANY LLM (some paid ones) UI and I wonder why no one managed to build such beautiful, simple, and efficient before you ... ๐" - Olivier H. (@notan_ai)Fast Onboarding
We have sweated over the details and deliberately removed AI jargon to make it as easy as possible to get started with AI.
- Install-Click-Chat
- Get started in 3 clicks
- No prior LLM setup experience needed nor you need to know what they mean
"This is fantastic! I love how you've lowered the barrier to entry for us to get into working with AI." - @admiralnines
Split Chats
Get advice from multiple assistants, compare, and pick the best.
- Sync inputs across multiple models
- Compare model responses side-by-side
- Offline vs Online, Free vs Paid, Mixtral vs GPT-4, Google's vs Microsoft's; pick your models, choose the best response
Refinements
You can regenerate a model's response and get better results. You can even refine your own prompt before sending it to the model. Keep AI in track by editing in-place or removing hallucinating branches.
- Create multiple conversation branches and remove hallucinating branches
- Edit in-place to direct the conversation
- Regenerate AI response or refine your own prompt before sending
Quick Prompts
We have a library of prompts to help you get started. You can also create your own. They are easy to summon and use when you need them.
- +230 curated prompts
- Add your own prompts
- Bookmark your favorite prompts for even quicker access
Sticky Prompt
Use sticky prompt feature to quickly complete repetitive tasks.
- No need to type the same prompt again and again and again
- Maintain context throughout the conversation
Mix-and-Match Models
Download a variety of models depending on your requirements. Mix-and-match models in a single conversation to get the best results.
- A wide selection of models to choose from
- Chat with models offline
- No API keys needed for local models
- Use multiple models in a single conversation
And many more features...
Ollama Integration
Use your existing models with Msty
Ultimate Privacy
No personal information ever leaves your machine
Offline Mode
Use Msty when you're off the grid
Organization
Organize your chats into folders
Model Settings
Tweak temperatures, context length, system prompt, etc.
Theme
Choose from a variety of colors and appearances
See what people are saying
Yes, these are real comments from real users. Join our Discord to say hi to them.
Ready to get started?
We are available on Discord if you have any questions or need help.
Questions you may have
- Is it possible to use this app offline?
Yes! You can use this app offline. Making Msty work offline is our top priority. However, you'll need to download the models you want to use beforehand.
- What about privacy?
All your data remains on your computer including chat history, models, settings, and prompts.
- Why am I getting virus alert on Windows?
This is a false positive and, unfortunately, a big downside of being on Windows. Companies much bigger than us have faced this issue. We are working on ways to get it resolved. In the meantime, you can whitelist Msty in your antivirus software.
- How can I download models locally?
Models can be downloaded by going to the Local AI tab from the sidebar.
- Does Msty support GPUs?
Yes on MacOS. On Windows* only Nvidia GPU cards are supported; AMD GPUs will be supported soon.
- Can I use online models such as GPT-Turbo, Mixtral, Gemini, etc?
Yes! You can use your Open AI or Mistral API keys to chat with their models.
- What's the memory and storage requirements?
It mostly depends on the model you're using. For example, 3.8 GB storage and 16 GB memory is recommended for Llama2 model. Where as TinyLlama model requires only about 700MB storage and 2 GB memory.
- How can I get the latest updates?
Msty will automatically download the latest updates when you open it. If there is a new update, you can just restart the app to get the latest version.
- Why is Msty a desktop app and not a web app?
We believe that a desktop app provides a better user experience and performance for an app like Msty. It also allows us to provide offline support and better privacy. It also means the limit of which models you could use is only limited by how powerful your computer is.
- Why should I trust Msty?
We are a small team of developers who are passionate about AI and privacy. We have worked on projects before that have been used by thousands of people such as this. There are real faces behind the product. And come chat with us on our Discord server to know us better.
- I've some feedback. How can I get in touch?
Great! Please join our Discord server and share your thoughts. We'd love to hear from you!