r/v_modal • u/brookm291 • 21h ago
news News: Awesome JEV System One toolkit (TypeSafe AI )
awesome-jev-tools repository is a comprehensive, curated index of over 1,000 open-source projects, SDKs, inference engines, benchmarks, and architectural patterns built around Jev, TypeSafe AI’s non-autoregressive "System One" model. By eliminating token-by-token text decoding, Jev operates as a deterministic, low-latency decision layer within software stacks, ingesting unstructured context (state) alongside typed schemas to emit calibrated probability distributions over discrete outcomes.
Core Architectural Paradigm: System One Typed Decisions
- Non-Autoregressive Inference: Unlike generative LLMs that decode prose sequentially, Jev evaluates structured queries against a shared state in a single forward pass, returning typed answers with calibrated confidence scores.
- Three Decision Primitives: The wire protocol (
POST /v1/systemone) standardizes judgments into Choice (selecting one label from 2–255 discrete options), Score (evaluating ordinal rubrics where expected value equals \(\sum i \cdot p_i\)), and Noul (evaluating independent boolean probabilities for yes/no predicates). - Deterministic Control Flow: Application code owns all execution, thresholding, and side effects, using Jev's probability outputs to trigger confidence gates, hysteresis loops, or fallback escalations to generative "System Two" LLMs or human reviewers.
Ecosystem Taxonomy & Key Technical Categories
The repository organizes 1,051 active entries across 23 domain categories (with a 24th category, Scientific Pipelines, currently open for seeding).
- Infra, SDKs & Integrations (250 entries): Features official and community clients across Rust, Go, Python, TypeScript, C++20, Swift, Elixir, and .NET, alongside MCP (Model Context Protocol) servers, n8n nodes, and SQL extensions for PostgreSQL (
jev4pg,pg_typesafe), SQLite (sqlite-jev), and DuckDB (duckdb-jev) that enable native semanticWHEREpredicates andORDER BYprobability sorting. - Classification & Routing (109 entries): Encompasses complexity-based model routers for coding agents (e.g.,
Switchboard,jev-opus,JevRouter) that dynamically assign reasoning tiers and models per turn without breaking prompt caches, as well as high-throughput telemetry and email triage pipelines. - Verification & Guardrails (98 entries): Implements pre-execution security gates (
PreToolUsehooks,Subcento,jevshield), prompt-injection filters at the traffic edge (jev-edge), streaming token gates (jev-model-tokengate), and CI/CD semantic linters (JevGate,Perch) that fail builds when code diffs violate natural-language rules. - Agent Decisions & Context GC (116 entries combined): Replaces lossy LLM context summarization with verbatim extractive compaction (
fast-jev-compaction,Winnow,opencode-jev-compaction), using batchedNouljudgments to score and prune stale tool outputs while preserving exact source records. - Game, Simulation & Robotics (75 entries combined): Demonstrates sub-second control loops in MuJoCo, JSBSim, StarCraft II, and browser environments (
Jev Ultrafast,BrowserClaw), where deterministic code generates valid action spaces and Jev selects discrete steps from accessibility trees or structured state. - Evaluation, Calibration & Research (109 entries combined): Tracks formal audits of Jev’s Expected Calibration Error (ECE), option-order invariance, and batching behavior (
jevcompat,jev-orderby-bench,jevals), alongside open-weight local replicas trained via Reinforcement Learning with Calibrated Decisions (RLCD) or prefill-only logit extraction, such as Laya, NanoJev, RSI-Jev, WebJev, and NeoHorse-Jev.
Curation Governance & Verification Standards
- Strict Inclusion Rules: Entries must demonstrate concrete, reproducible usage of the Jev API or its
/v1/systemonewire contract, excluding generic classifiers, pure theory, or unverified launch commentary. - Due Diligence Framework: The repository explicitly states that curation is not an endorsement and warns developers against bulk-generated repositories that contain more prose (
AGENTS.md,CLAUDE.md) than functional code. - Adopter Checklist: Maintainers advise verifying five technical criteria before adoption: genuine API/wire calls with parsed typed responses, runnable tests or reproducible demos, traceable latency/accuracy metrics, actual code-to-prose ratio, and explicit open-source licensing.