The app need Markdown for LLM responses. Often time the LLM will output in markdown but the app doesn’t parse it. Other then that, this is the best LLM app for mobile! It has a lot of customizable settings and it supports a lot of quantized models. It also supports all the shortcuts. What other open source LLM app can compete with this? Its developer is active and constantly trying to improved the app. I love this app.

Love this app. Surprisingly powerful and has tons of tweaking options that many apps on full computers lack. I use it on phone and iPad. I would love to see support for newer Gemma models and the ability act as an inference server like ollama or LM studio so I can run local inference for Obsidian or other apps.

This app looks pretty promising, but it’s a little bit daunting to someone who’s not as familiar with setting up LLMs. For example, how do you download the LLMs and where do you go to get them? Which alarms are likely to work? It might be a good idea to include specific LLMs that have been tested on which devices. Some sort of tutorial or instructions would be really useful.