AnythingLLM
All-in-one private AI desktop and Docker app that lets you chat with any LLM and your own documents.
After going OS-wide, AnythingLLM turns back inward — image generation and the unglamorous fixes power users notice.
◆Recent moves
- 6d ago
Image generation via /img, folder drag-and-drop, real abort
v1.16.0 adds image generation via /img on supported providers, with attachments for edits and follow-ups, plus folder drag-and-drop that preserves hierarchy and lazy loading for large document sets. Two fixes matter more than they look: tools can be toggled mid-session, and aborting a response now genuinely terminates the inference instead of letting it run on. New modality, but routed through existing providers rather than changing the product's direction.
View source ↗ - 1mo ago
OS-wide Magic Features and the AnythingLLM Pro tier (v1.15.0)
⚡ SPARKv1.15.0 takes AnythingLLM out of its own window: Magic Echo (dictation), Magic Beacon (highlight-to-act with full agent/MCP access), and Magic Tab (autocomplete) now work in any app, fully on-device, alongside a new AnythingLLM Pro tier. It reframes the product as an OS-wide agent and adds its first paid layer.
View source ↗ - 1mo ago
Pre-1.15 patches: Brave/fastCRW search, Groq STT (1.14.2)
A pre-1.15 patch release migrating the AWS SDK to OpenAI, adding Groq STT, Brave Search and fastCRW web-search providers, and fixing temperature handling for Opus 4.7/4.8. Provider-breadth and maintenance work staging the larger 1.15 release.
View source ↗ - 2mo ago
Meeting Assistant overhaul: multi-GPU, diarization, API (1.14.1)
A substantial Meeting Assistant overhaul: Intel/AMD/NVIDIA GPU support for a 92% smaller binary and 15% faster processing, a transcription API endpoint, basic speaker identification, and dual-channel diarization, plus chat export and other fixes. A major efficiency-and-capability upgrade to an existing feature.
View source ↗ - 2mo ago
Tool-calling on by default, Cerebras, new STT/TTS engines (1.14.0)
v1.14.0 makes native tool calling opt-out by default, adds the Cerebras provider and new STT (Deepgram, OpenAI) and TTS (KokoroTTS) engines, and converts web-scraping output to markdown. Broad agent and provider improvements that smooth the path toward fully automatic tool use.
View source ↗ - 2mo ago
AnythingLLM v1.13.0 - A Hybrid AI Experience
⚡ SPARKv1.13.0 introduced the Model Router for user-defined hybrid local-cloud routing per message, Scheduled Jobs for cron-driven background agents, automatic memories/personalization, and agent surveys. It is the release that turned AnythingLLM from a chat app into an automated, hybrid agent platform — the foundation the OS-wide 1.15 work builds on.
View source ↗