Streaming, Structured Outputs, Observability, and Local Models
· 5 min read
Correction, 2026-08-28
This post was published against 1.0.0 and referred to the gateway image as
ghcr.io/dvarahq/dvara/dvara-llm-gateway. The package was renamed to
ghcr.io/dvarahq/dvara-gateway in 1.7.0, so the original command no longer pulls anything. The
commands below have been updated to the current image and tag; the rest of the post is unchanged.
In the previous post, you got DVARA running and sent requests to multiple providers through a single OpenAI SDK client. This post covers the next layer of governance platform capabilities — LLM streaming, structured JSON outputs, Prometheus observability, and local development with Ollama.
