ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · 谷歌GKE动态切片Material2 min readDisconfirmAI Editorial

Google Cloud GKE Dynamic Slicing Generally Available: Decouples TPU Nodepools, Cuts Startup Time by 5x

Google Cloud announced the general availability of GKE Dynamic Slicing, using optical circuit switching to enable on-demand TPU slice assembly and isolation, reducing AI workload startup times by up to 5x and accelerating recovery by 4.5x.

2026-11-09

Google Cloud announced on November 10, 2026, that "Dynamic Slicing" is now generally available on its Kubernetes Engine (GKE). The feature addresses efficiency bottlenecks caused by the tight coupling between physical hardware configuration and logical compute topologies when running large-scale AI workloads on Tensor Processing Units (TPUs).

In traditional setups, managing TPU capacity required creating separate, static nodepools for each slice topology. This meant platform teams had to manually delete and recreate nodepools as workload needs changed, increasing complexity and creating large failure domains where a single hardware fault could crash an entire slice. GKE Dynamic Slicing decouples physical hardware provisioning from logical slice formation, leveraging TPU Optical Circuit Switching (OCS) technology for flexible topology management.

The feature operates in two modes: "super-slicing" and "sub-slicing." Super-slicing dynamically connects multiple TPU cubes (each consisting of 16 VMs) at scheduling time to form larger slices exceeding a single cube's size, catering to massive training demands. Sub-slicing partitions a single pre-provisioned TPU cube into multiple independent smaller slices, allowing concurrent, isolated execution of different workloads within the same physical cube. This eliminates the traditional "delete-and-create" nodepool cycle, enabling zero-downtime topology agility.

According to Google Cloud, compared to static nodepools, dynamic slicing reduces AI workload startup times by up to 5x, as the system instantly assembles logical slices from pre-provisioned nodepools instead of waiting for new deployments. Additionally, because failures are isolated to individual TPU cubes and unhealthy cubes can be swapped in one to two minutes, workload recovery speed improves by 4.5x. The feature also supports provisioning partially healthy nodepools, further enhancing overall fleet resource utilization.

Sign in / Sign up
ReadingResearchRadarInvestment framework

For enterprises relying on TPUs for large model training and inference, this update signifies that the infrastructure layer can better adapt to rapid changes in model architectures, reducing operational complexity and improving fault tolerance. However, the cited performance improvements are based on Google Cloud's official testing, and actual results may vary depending on specific workload characteristics and environmental configurations.

Sources

  • cloud.google.comGoogle Cloud Blog↗
Topic

谷歌GKE动态切片

谷歌云(Google Cloud)于2026年11月10日正式推出GKE动态切片(Dynamic Slicing)功能,旨在解决大规模AI工作负载在TPU集群上的资源调度僵化问题。该功能通过光路交换技术(OCS),将逻辑TPU切片的形成与物…

3 steps1 piecesUpdated 2026-11-10 18:47

How it got here

  1. 2026-11-10谷歌云博客宣布GKE动态切片正式可用(Generally Available),介绍其通过解耦物理预置与逻辑切片形成来提升TPU效率和弹性。cloud.google.com ↗
  2. 2026-11-10第三方媒体AINewsTrend报道该功能上线,强调其消除手动删除和重建节点池的需求,并指出其支持部分健康节点池以提高容错性。ainewstrend.com ↗
  3. 2026-11-09AI Agent News报道GKE动态切片GA,指出该功能通过注解请求切片,由Slice控制器创建自定义资源,且仅在TPU All Capacity预留模式下支持。aiagentnews.io ↗

What is still unsettled

  • 动态切片在非All Capacity模式下的兼容性计划是否有官方时间表?
  • 除了Ironwood (TPU7x),旧一代TPU(如v5e/v6e)是否有任何路径支持类似的动态拓扑调整?
  • 在实际生产环境中,动态切片带来的网络配置开销对延迟敏感型推理任务的具体影响量化数据有哪些?
Read the full topic →
Continue researching →