Skip to main content

2 posts tagged with "getting-started"

View All Tags
Beyond the Basics: Streaming, Structured Outputs, Observability, and Local Models with DVARA

Beyond the Basics: Streaming, Structured Outputs, Observability, and Local Models with DVARA

· 5 min read
Correction, 2026-08-28

This post was published against 1.0.0 and referred to the gateway image as ghcr.io/dvarahq/dvara/dvara-llm-gateway. The package was renamed to ghcr.io/dvarahq/dvara-gateway in 1.7.0, so the original command no longer pulls anything. The commands below have been updated to the current image and tag; the rest of the post is unchanged.

In the previous post, you got DVARA running and sent requests to multiple providers through a single OpenAI SDK client. This post covers the next layer of governance platform capabilities — LLM streaming, structured JSON outputs, Prometheus observability, and local development with Ollama.

Getting Started with DVARA: Drop-In OpenAI Compatibility in 5 Minutes

Getting Started with DVARA: Drop-In OpenAI Compatibility in 5 Minutes

· 8 min read
Correction, 2026-08-28

This post was published against 1.0.0 and referred to the gateway image as ghcr.io/dvarahq/dvara/dvara-llm-gateway. The package was renamed to ghcr.io/dvarahq/dvara-gateway in 1.7.0, so the original command no longer pulls anything. The commands below have been updated to the current image and tag; the rest of the post is unchanged.

DVARA is an AI governance platform. It governs every LLM call your teams make — policy, PII, budgets, audit — under one control plane, and the LLM Gateway component is fully OpenAI-compatible so governance kicks in on the very first request. Every OpenAI SDK — Python, Node, Go, Java, Rust — lets you override the base URL. That single line of configuration is all it takes to route your LLM traffic through DVARA and unlock governance, multi-provider routing, and observability without touching your application code.