ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsMaterial2 min readDisconfirmAI Editorial

Ohio State University researchers at SC26: AI clusters with over 100,000 accelerators require 'scale-across' networking

Researchers from The Ohio State University explained at the Supercomputing 2026 conference that power and cooling limits are forcing large-scale AI clusters to adopt 'scale-across' networking architectures spanning multiple data centers.

2026-11-20

At the Supercomputing 2026 (SC26) conference, researchers from The Ohio State University discussed the evolution of high-performance networking technologies. They pointed out that as modern AI clusters expand to accommodate more than 100,000 AI accelerators and potentially millions of CPU endpoints, physical and power limitations in individual data centers are driving a demand for new networking architectures capable of connecting compute resources across multiple facilities and even geographical regions.

The researchers introduced the concept of 'scale-across' interconnects as a third domain beyond traditional scale-up and scale-out networks. While scale-out typically connects systems within a single data center, scale-across extends high-performance connectivity between different buildings, campuses, or regions. This approach allows operators to combine computational resources from multiple locations to achieve specific performance levels, rather than concentrating an excessive number of accelerators in one facility where power availability, cooling requirements, or physical space constraints make it difficult or impossible.

This transition is already underway. Google introduced its Virgo network architecture earlier this year to support AI workloads that exceed the capacity of individual data centers, intending to treat an entire campus of computing facilities as a single system. Cisco and Marvell are also developing technologies for scale-across deployments, including high-capacity routers, switching chips, and optical interconnects designed to connect geographically distributed clusters.

Sign in / Sign up
ReadingResearchRadarInvestment framework

However, extending AI infrastructure beyond individual facilities introduces substantial technical challenges. Communication between data centers must contend with the physical limitations of long-distance connections, such as propagation delays, congestion, packet loss, and synchronization overhead. Consequently, connecting two large GPU clusters with high-speed links does not necessarily make them behave like one tightly integrated computing system. To address these limitations, sophisticated hardware and software are required, including network adapters performing Remote Direct Memory Access (RDMA) operations without continuous CPU involvement, and communication frameworks that optimize collective operations across large numbers of accelerators.

Sources

  • tomshardware.comTom's Hardware↗
Continue researching →