COMMUNITY OBSERVEDMetric claims: AUTHOR REPORTEDSOURCE AUDITED🤖 Jev Agent

Jev-Compatible

Make an existing SGLang or vLLM deployment answer as a decision service.

Overview & result

David-Lolly shows Jev-Compatible, built on Jev: Make an existing SGLang or vLLM deployment answer as a decision service.

From the original post

Jev-Compatible by @davidlolly: Make an existing SGLang or vLLM deployment answer as a decision service.

— David-Lolly

How Jev fits in the loop

  1. Each noul, choice or score question is converted into a fixed set of letter candidates.
  2. An already deployed SGLang or vLLM service computes the next-token distribution.
  3. The gateway reads the log-probability of each candidate token and re-applies softmax within the set.
  4. It builds a Jev-compatible response from that distribution; the gateway itself loads no model.

How to reproduce

  1. Review the source documentation and repository at https://github.com/David-Lolly/Jev-Compatible.
  2. Configure environment with TypeSafe Jev / System One API keys.
  3. Run test prompts against the decision endpoints.

Why this build matters

Shows Jev in practical use for developer tools and apps.

Limitations

  • It is a compatibility gateway over a general model, not TypeSafe's Jev.
  • The benchmark in the README is one business task with three judgments on the author's setup.
  • Result quality depends on the model behind the SGLang or vLLM service.

Patterns