Examples

chat -- private chat on your own hardware

Private chat via Open WebUI, backed by a self-hosted instruct model.

Run

marigold deployment start marigold-examples/chat

Open http://localhost:3000. Chat with the model using Open WebUI.

Models

  • qwen/qwen3-8b – instruct

Stop

marigold deployment stop marigold-examples/chat

Try it yourself.

All example code is in the repo. Clone it and run this tutorial locally.

View on GitHub Setup guide