Overview & result
David-Lolly shows Jev-Compatible, built on Jev: Make an existing SGLang or vLLM deployment answer as a decision service.
From the original post
Jev-Compatible by @davidlolly: Make an existing SGLang or vLLM deployment answer as a decision service.
How Jev fits in the loop
- Each noul, choice or score question is converted into a fixed set of letter candidates.
- An already deployed SGLang or vLLM service computes the next-token distribution.
- The gateway reads the log-probability of each candidate token and re-applies softmax within the set.
- It builds a Jev-compatible response from that distribution; the gateway itself loads no model.
How to reproduce
- Review the source documentation and repository at https://github.com/David-Lolly/Jev-Compatible.
- Configure environment with TypeSafe Jev / System One API keys.
- Run test prompts against the decision endpoints.
Why this build matters
Shows Jev in practical use for developer tools and apps.
Limitations
- It is a compatibility gateway over a general model, not TypeSafe's Jev.
- The benchmark in the README is one business task with three judgments on the author's setup.
- Result quality depends on the model behind the SGLang or vLLM service.