Backends
NotJev : Kev is the control plane. Pick a backend; keep the same wire format.
| Backend | Env | Best for |
|---|---|---|
| mock | KEV_BACKEND=mock | CI, demos, offline |
| ollama | KEV_BACKEND=ollama | Local GPU / free inference |
| openai | KEV_BACKEND=openai | OpenAI, Gemini-compat, vLLM OpenAI API |
Ollama example
KEV_BACKEND=ollama
KEV_OLLAMA_MODEL=qwen3.5:9b
KEV_OLLAMA_BASE_URL=http://127.0.0.1:11434Cascade & constraints
Large choice sets (e.g. Banking77, CLINC) use cascade / constrained decoding so the model picks from the label space instead of inventing strings. Short readouts stay constrained for speed and reliability.