読書リサーチレーダー投資フレームワーク
ログイン / 新規登録
← 読解に戻る
ニューストピック · 决策模型品类重大2 分で読めるDisconfirmAI 編集部

OpenAI Makes Decisions API Widely Available, Cutting Latency to Sub-Second Levels

OpenAI has opened its Decisions API to all customers, optimizing ChatGPT Luna to reduce inference latency from seconds to milliseconds, challenging TypeSafe's Jev models.

2026-10-23 03:00 GMT+8

OpenAI officially made its Decisions API available to all customers this Thursday (October 22, 2026). The service is based on a reconfigured ChatGPT Luna model designed to provide fast, low-cost intelligent decision-making capabilities, directly entering the "System One" decision model market pioneered by TypeSafe's Jev models.

Nikunj Handa, OpenAI's product lead for APIs, stated that after seeing Jev models, his team recognized numerous use cases. Instead of building a specifically calibrated decision model, they optimized Luna for faster inference and lower costs. Handa noted that this adjustment reduced response times from one to three seconds down to 100–180 milliseconds. While future training may further improve these metrics, current Luna configurations suffice for now.

In initial trials, customers such as Box, Datadog, Ramp, and Speak used the API to replace existing LLM workflows for higher throughput. Andrew Hsu, CTO at Speak, reported that the Decisions API allowed the company to cut the time between actions from 1.4 seconds to 0.13 seconds. OpenAI itself also utilized the product to enhance the responsiveness of its Dots voice assistant.

However, public benchmarks indicate OpenAI is not leading in this specific domain. On the AIM System One Index and the Artificial Analysis Decision Index, Liquid's D1 Ultra and Base Lab's Elephant-1 perform better, while OpenAI's Decision Model ranks eighth and fourteenth respectively. TypeSafe's Jev models remain competitive and are the most widely queried on OpenRouter. Furthermore, there is no universal standard for what constitutes a good decision model, as trade-offs between intelligence, cost, calibration, and speed vary significantly across different workloads.

ログイン / 新規登録
読書リサーチレーダー投資フレームワーク

ソース

  • techcrunch.comTechCrunch↗
トピック

决策模型品类

【背景】继 TypeSafe 于 9 月发布仅输出判断而非文本的 Jev 模型后,“决策模型”迅速成为 AI 基础设施的新品类。OpenAI、亚马逊 AWS、蚂蚁数科等厂商在两周内相继入场,将高频分类、路由和评分任务从通用大模型中剥离。

6 ステップ4 件更新日 2026-10-24 11:09

経緯

  1. 2026-09-15前 OpenAI 研究员 Diogo Almeida 创办的 TypeSafe AI 发布 Jev 模型,主打低成本、高并发的结构化判断,不生成文本。geekpark.net ↗
  2. 2026-09-28AWS 工程师 Marc Brooker 博客披露个人项目 Hobson,验证小参数模型在决策任务上的可行性,随后演变为 Amazon Strands Decider。brooker.co.za ↗
  3. 2026-10-01亚马逊 AWS 正式开源 Strands Decider 2B,基于 Qwen3.5-2B 底座,支持本地部署,直接对标 Jev。techcrunch.com ↗

未解決の問題

  • 决策模型的准确率是否真能显著超越通用大模型(如 GPT-6-Luna)在简单分类任务上的表现?目前缺乏独立的第三方对比数据。
  • 随着 OpenAI 等巨头入场,低壁垒的决策模型是否会迅速陷入价格战,导致初创公司(如 TypeSafe, StartLux)难以维持商业价值?
  • 本地部署模型(如 StartLux, Intern-Decision)在隐私敏感场景下的实际采用率能否抵消云端 API 的成本优势?

このスレッド内の他の記事

  • Ant Digital Technologies Releases LingDT-Decision-1.0 Model, Claims Over 90% Token Cost Reduction2026-10-23
  • GeekPark: From Jev to StartLux, How AI Decision Models Fill the 'Intuition Layer' for Local Deployment2026-10-22
トピック全文を読む →
リサーチを続ける →