TechnicalDiscussion

Jev: 8 real use cases this fast, cheap model

How I AI

Claire Val and returning guest John Lindquist discuss Jev, a fast and cost-effective decision model from Type Safe AI, exploring eight real-world use cases including task management, data reconciliation, real-time routing, and agent coordination. They contrast Jev's structured decision-making approach with traditional LLMs, emphasizing how its speed and affordability unlock previously impractical applications.

Summary

In this episode of "How I AI," host Claire Val welcomes back AI engineer John Lindquist to discuss Jev, a newly released decision model that has captured their attention over the past week. Unlike traditional large language models that generate unstructured text, Jev takes unstructured input (natural language) and returns structured, type-safe outputs with confidence scores and limited predefined options.

John demonstrates eight practical use cases for Jev. First, he shows a voice-controlled to-do app where users can dictate tasks like "make an appointment with the dentist, go buy oat milk, complete request check, low priority" and Jev classifies the information in real-time while the user is still speaking, determining when enough data exists to execute a function call. The system performs multiple passes—verifying transcription accuracy, confirming task appropriateness, and matching to the correct operation—all instantaneously.

Second, John presents document and contact reconciliation, where Jev analyzes large datasets to identify duplicate or similar records (e.g., "Cedar Grove Office Products" matching "Cedar Grove Office"). This pairwise comparison works on massive scales with confidence scoring, allowing users to set thresholds for when merges should occur, and can process 60,000 or 600,000 objects in milliseconds.

Third, he demonstrates a command router or omnibar that intelligently directs user queries to the appropriate application or tool within a larger system. Rather than users remembering specific tool names, natural language queries are routed to the correct subsystem, which then executes the requested action.

Fourth, Jev is shown playing chess competitively, evaluating all possible moves, ranking the three best options, then evaluating subsequent moves, all within one second—10 times faster and four times cheaper than using traditional LLMs for the same task. This demonstrates how speed enables novel applications like real-time games.

Fifth, John shows a Wikipedia pathfinding demo where Jev navigates from any topic (e.g., LeBron James) to the Philosophy article by analyzing links, embodying goal-directed routing.

Sixth, a warehouse agent coordination system shows Jev managing three simultaneous agents with different tasks, ensuring they don't collide or interfere with each other, checking at each step whether tasks can be executed safely in parallel.

Seventh, the presentation trainer use case monitors a speaker's real-time speech against a prepared list of discussion points, checking off items as they're mentioned and alerting the speaker if time is running out and key points remain uncovered.

Eighth, John mentions YouTube comment clustering where Jev groups comments, ranks them, and enables real-time search across thousands of comments—a task prohibitively expensive with traditional LLMs.

Throughout the discussion, Claire and John emphasize Jev's pricing (approximately 4 cents per million input tokens, with some providers offering free access) and execution speed. They contrast Jev with LLMs: Jev excels when decisions involve a limited, defined set of options (routing, classification, ranking), while LLMs are better for open-ended, creative, or generative tasks where the output space is unlimited.

A key insight emerges: Jev enables "effective inefficiency," where computing all possible options, ranking them, and checking for conflicts is computationally intensive but now economically feasible, unlocking use cases that were previously deemed too expensive or slow to be worthwhile. John notes this is why developers feel more in control with Jev—they can see and reason about the decision paths, similar to traditional if-else programming logic.

Both speakers discuss limitations: Jev sometimes requires multiple passes or classification refinement, and users may initially misunderstand when to use single-pass vs. multi-pass approaches. However, since Jev is so cheap and fast, adding verification layers is practical.

The conversation concludes with John discussing broader AI trends: the challenge of local storage as developers work with multimedia and 3D files across Mac minis, and the paradigm shift toward agent-centric workflows (like Grok bots) where agents become the primary organizational unit rather than files and folders. Claire mentions running 40 different Grok bots across her business. John is working on mega.dev, an educational program teaching how to build, evaluate, and implement AI agents effectively.

Key Insights

  • Jev processes unstructured input text into structured, type-safe outputs with limited predefined options and confidence scores, operating as a classification and routing layer rather than a generative text model
  • John spent approximately 73 cents testing hundreds of Jev demos, and one user described Jev as a legacy to pass to their children, illustrating extreme cost-effectiveness compared to traditional LLMs
  • Jev enables pairwise comparison and clustering of massive datasets (60,000-600,000 objects) in milliseconds, making data reconciliation tasks that seemed economically unfeasible now practical
  • Jev defeated a free open-source LLM in real-time chess 10 times faster and four times cheaper per move, demonstrating speed advantages in scenarios requiring rapid multi-step decision trees
  • Developers feel more in control with Jev than LLMs because decision paths are explicit and reasonable like traditional if-else programming logic, whereas LLMs involve guesswork and prompt iteration

Topics

Jev decision model capabilities and architectureReal-time voice control and streaming data processingData reconciliation and duplicate detection at scaleRouting and navigation systems using classificationGame playing and multi-step decision treesAgent coordination and parallel task executionCost comparison between decision models and LLMsContrast between structured vs. unstructured AI outputsLimitations of Jev and when to use LLMs insteadAgent-centric AI engineering paradigms

Transcript

[0:00] To some extent, managers are indeed at risk. The concepts of organizational and role design can be used when creating agents, which is why I am currently running, seriously, 40 graph bots. When you have limited input data interacting with applications, Jev is a great choice. This is one of my favorite examples because it demonstrates a working environment with many agents, each with their own tasks, avoiding collisions so that they don't end up in the same space. At [0:30] each step, the system monitors these agents so that they complete their tasks as quickly as possible, without overlapping or interfering with each other. I really like this option because it's a performance trainer. I turn on the…

Full transcript available for MurmurCast members

Sign Up to Access

More from How I AI

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.