You must log in or register to comment.
This is cool, are there any decent ones that run in docker and have a web UI?
I’ve been using open webui (search for it with those terms) to run local models in a docker container served from Llama for the last few months and I love it.