End-to-end tests run by agents

MEDIA PREVIEW

Overview & Result

e2e + jev from @typesafeai ⚡ I'm building an open-source framework for running e2e tests with agents. supports web, mobile (and more!) available soon: tester.army/e2e

How Jev fits in the loop

1. Ingest real-time application state and relevant contextual parameters
2. Format the decision problem as a bounded Choice or Noul schema
3. Query Jev to receive a typed probability distribution in sub-50ms
4. Execute downstream actions or route tasks according to the winning choice

How to reproduce

1. Inspect the original showcase and source material at https://x.com/o_kwasniewski/status/2100966838905585687
2. Verify the bounded prompt and input candidate schema configured for Jev
3. Benchmark decision latency and classification accuracy against baseline models

Why this build matters

Demonstrates a real-world, cost-effective implementation of Jev in a browser automation agent scenario, replacing expensive generative calls with fast typed decisions.

Reported performance

Latency: Sub-50ms deterministic decision window

Limitations

• Task accuracy is bounded by the precision of the defined candidate choices
• Third-party external dependencies and network latency may affect total workflow duration

Patterns