MEDIA PREVIEW
Overview & Result
Aaaaaand this is now open-source here: A tiny AI pointer companion for your Mac driven by JEV or Gemini Live - Bring your own keys - Local OmniParser running on CoreML - Jev drives the pointer - Ctrl + K to type a task Voice mode next if people want it! https://github.com/milind-soni/tiptour-macos
How Jev fits in the loop
- Ingest real-time application state and relevant contextual parameters
- Format the decision problem as a bounded Choice or Noul schema
- Query Jev to receive a typed probability distribution in sub-50ms
- Execute downstream actions or route tasks according to the winning choice
How to reproduce
- Inspect the original showcase and source material at https://github.com/milind-soni/tiptour-macos
- Verify the bounded prompt and input candidate schema configured for Jev
- Benchmark decision latency and classification accuracy against baseline models
Why this build matters
Demonstrates a real-world, cost-effective implementation of Jev in a browser automation agent scenario, replacing expensive generative calls with fast typed decisions.
Reported performance
Reported by authorLatency: Sub-50ms deterministic decision window
Performance metrics and decision latency are reported by the original author and community benchmarks.
Limitations
- Task accuracy is bounded by the precision of the defined candidate choices
- Third-party external dependencies and network latency may affect total workflow duration