I tried it once, and I couldn't run RAG without the GPU either (only using external APIs). Considering that they pull all the heavy deps even with the local compute flags disabled, I assume this is just a poorly supported case. Which is really unfortunate.

Not sure about the moat, it's mostly a SvelteKit web app with extra utils after all. But it has a rather unique combination of advanced features (RAG integrations, workspaces[1], pipelines[2], code execution[3], MCP integration[4], etc.) and a user-friendly "production grade" interface. I've built a dependency for OWUI using many of these advanced features, and now I'm trying to figure out where to migrate with no obvious alternatives.

My only gripe with the project was the (exorbitant) size of the docker containers, especially for cases where you need a tool with no local models, just a gateway to third-party APIs. Now another and more serious one has been added.

[1] https://docs.openwebui.com/features/workspace/

[2] https://docs.openwebui.com/pipelines/

[3] https://docs.openwebui.com/features/code-execution/

[4] https://docs.openwebui.com/openapi-servers/mcp

Open WebUI changed license from BSD-3 to Open WebUI license with CLA

Sorry for the resubmission, you beat me for a minute while I was typing the title.

#275727

Dozens of megabytes of text, jokes, arguments, dramas, casual and professional socialising, and hundreds of new acquaintances that have shaped my interests in life. Thanks for an interesting 2000s.