LeituraPesquisaRadarFramework de investimento
Entrar / Cadastrar
← Voltar para a leitura
NotíciasTópico · Together AIMaterial2 min de leituraEditorial DisconfirmAI

Together AI Unveils 'Polymorphic Inference' Framework, Claims Compiler Already Optimizing Production Models

Together AI introduces 'Polymorphic Inference' and announces its AI-agent-driven compiler, Together Compiler, is running in production to adapt to rapidly changing models and hardware.

2026-11-04

AI infrastructure company Together AI published a blog post on November 4, 2026, formally introducing a new paradigm called "Polymorphic Inference" and announcing the deployment of its tool, Together Compiler, in parts of its production environment. The tool uses AI agents to automatically optimize inference performance, aiming to address the challenges posed by the rapid iteration of open-source model architectures, traffic patterns, and hardware platforms.

The research team at Together AI argues that the traditional "Static Inference" model relies on manually tuned kernels for specific configurations, which struggles to keep up with the current pace of open-source model releases, increasing architectural diversity, and frequent hardware updates. According to the company, 80% of traffic on OpenRouter goes to models released in the last three months, and the top ten most popular open-source models all use different architectures. The core of Polymorphic Inference is enabling systems to dynamically adapt to these changes rather than writing new static kernels for every scenario.

As a first step toward this goal, Together AI launched Together Compiler. Described as a "recursive self-improvement" (RSI) system, it is an AI-agent-driven performance optimization loop. The company claims that many models currently running through its endpoints are fully optimized by AI agents, calling it "the world's first production-scale recursive self-improvement (RSI) inference system." Together Compiler reframes the traditional compiler translation problem as an agentic search problem, using a swarm of agents paired with a high-fidelity persistent engine to automatically identify key optimization patterns and continuously adjust code to fit new traffic shapes and workloads.

Entrar / Cadastrar
LeituraPesquisaRadarFramework de investimento

It is important to note that the claims regarding being the "world's first" and the status of production deployment are self-reported by the vendor, with no independent benchmark data or specific performance improvement percentages provided. Together Compiler is currently available only to limited beta users. For readers tracking AI infrastructure efficiency, this move indicates that leading service providers are attempting to reduce reliance on manual kernel optimization through automation, though actual effectiveness remains subject to future independent verification.

Fontes

  • together.ai↗
Tópico

Together AI

美国AI云服务商Together AI于2026年11月4日正式推出“多态推理”(Polymorphic Inference)概念,并宣布其核心组件Together Compiler已在生产环境中运行。该框架旨在解决开源模型架构多样化、流量…

4 etapas1 peçasAtualizado 2026-11-05 11:11

Como chegamos aqui

  1. 2026-11-04Together AI发布博客文章《From Static to Polymorphic Inference》,正式提出“多态推理”概念,指出当前开源模型架构多样性(Top 10模型均不同)和硬件快速迭代使得传统静态优化失效。together.ai ↗
  2. 2026-11-04Together AI同步发布技术论文介绍Together Compiler (TKCC),称其为首个真正的持续优化循环系统,通过AI代理生成候选优化方案并在持久化引擎中测试,实验吞吐量比基线系统高252倍。together.ai ↗
  3. 2026-11-04美联社(AP)报道,Together Compiler已在部分生产工作负载中运行,声称能在不到24小时内将Kimi K3和GLM 5.3的峰值吞吐量分别提升至SemiAnalysis基准最佳结果的1.5倍和1.4倍。rutlandherald.com ↗

O que ainda está indefinido

  • Together Compiler目前主要服务于Together AI自身的端点,客户能否在其私有部署或专用实例上获得同等的自动化优化能力?
  • AI代理生成的内核代码在极端边缘情况下的稳定性如何?是否会出现难以复现的性能回退或正确性问题?
  • 随着NVIDIA Vera Rubin等新硬件即将部署,Together Compiler的适应速度能否跟上硬件代际更替的节奏?
Ler o tópico completo →
Continuar pesquisando →