독서리서치레이더투자 프레임워크
로그인 / 회원가입
← 읽기로 돌아가기
뉴스간단한 요점1 분 소요DisconfirmAI 편집부

Kernel fusion emerges as the shared answer to running trillion-parameter models

An open-source team and a vendor both bet on kernel fusion to run Kimi K3 within one week; all figures are self-reported and await third-party replication.

2026-09-30 18:00 GMT+8

Two teams, one in China and one abroad, sped up the 2.8-trillion-parameter Kimi K3 within the same week using kernel fusion.

Per Zhidx reporting, on September 21 Inspur released the SD200 Ultra supernode, claiming it hosts K3 on a single machine at 5.85 ms per token; on September 23 the team Inferact open-sourced tpu-megakernels, claiming 709 tokens/s decode throughput on 16 Google TPU v7 chips. All figures are self-reported.

Both merge operators to cut data movement. K3 officially recommends 64 accelerators and runs at roughly 10 tokens/s unoptimized; the claimed speedups still await third-party replication.

출처

  • zhidx.com↗
리서치 계속하기 →
로그인 / 회원가입
독서리서치레이더투자 프레임워크