OpenAI makes its Jev competitor widely available as decision model competition heats up
First reported by TechCrunch ·
The cost of making AI decisions falls dramatically, enabling real-time applications previously too expensive to consider.
OpenAI has made its Decisions API, a competitor to TypeSafe's Jev model, widely available. This API, built by reconfiguring ChatGPT Luna, significantly reduces inference time from seconds to milliseconds and lowers costs for developers. Initially announced on September 29, it became generally available on Thursday, offering enhanced voice and visual modalities and geographically targeted inference for lower latency. Companies like Box, Datadog, and Ramp have already used it to replace slower, more expensive LLMs in their workflows. Speak, an AI language tutor company, reported cutting action time from 1.4 seconds to 0.13 seconds using the API. OpenAI also integrated it into its own Dots voice assistant. Despite its availability, the optimal configuration for decision models—balancing intelligence, cost, calibration, and speed—remains workload-dependent, with various models like Liquid's D1 Ultra and Base Lab's Elephant-1 showing strong performance on benchmarks. TypeSafe's Jev model, however, leads in certain specialized tests like playing Pac-Man and is heavily queried on OpenRouter.
The widespread availability of OpenAI's Decisions API signals an intensifying market competition for fast, low-cost AI decision-making tools, directly challenging established players like TypeSafe. This shift suggests a trend towards specialized, performant AI models that can replace more general-purpose LLMs for specific tasks, driven by the demand for efficiency and speed in AI-powered applications. Developers can now integrate these decision models into their products at a fraction of the previous cost and latency, unlocking new possibilities for user experience and operational efficiency.
The implications extend to a broader market democratization of advanced AI capabilities, where speed and cost-effectiveness become key differentiators. As more companies like OpenAI enter this space, the benchmark for AI performance will continue to rise, pushing innovation in areas like multi-modal AI and real-time inference. The focus is shifting from what AI *can* do to how quickly and affordably it can deliver specific outcomes, potentially leading to a proliferation of AI-driven tools across diverse industries.
AI-written summary. May contain errors.