You must log in or register to comment.
If you want a really simple way to run a variety of local models with a nice UI take a look at https://jan.ai/
This is cool, are there any decent ones that run in docker and have a web UI?
I’ve been using open webui (search for it with those terms) to run local models in a docker container served from Llama for the last few months and I love it.