COMMUNITY OBSERVEDMetric claims: AUTHOR REPORTEDSOURCE AUDITED🤖 Jev Agent

jevmod

Moderation with a probability per category and thresholds you set.

Overview & result

jevmod is moderation for communities and apps. Each message gets a probability for spam, scam, harassment, NSFW, off-topic, self-harm, doxxing and for rules written in plain English; you set the thresholds and actions, and every decision is logged. It is flag-only by default and fails open if Jev is unreachable. The author reports about $0.04 per 1,000 messages with all categories on.

From the original post

Moderation for communities and apps, powered by Jev (TypeSafe): probabilities per category, thresholds you own. Discord/Telegram/Reddit bots, CLI, Python, npm, HTTP API, MCP.

— Omar Hernandez

How Jev fits in the loop

  1. A pre-filter keeps trusted authors, very short messages without links and repeats of already judged text away from Jev.
  2. Messages are batched for 2 seconds per community and sent in one Jev request.
  3. Jev returns a probability per category and per custom rule.
  4. Your policy maps probabilities to actions, and every decision is written to an audit log.

How to reproduce

  1. Inspect the original showcase and source material at https://github.com/ohernandezdev/jevmod
  2. Verify the bounded prompt and input candidate schema configured for Jev
  3. Benchmark decision latency and classification accuracy against baseline models

Why this build matters

The author documents a bug their red team caught: batching messages as a list leaked probabilities between neighbours, so batches are now keyed by position and tested in CI.

Limitations

  • Flag-only by default; nothing is deleted until you turn that on.
  • It fails open: if Jev is unreachable, messages are left alone.
  • The cost figure of about $0.04 per 1,000 messages is the author's.

Patterns