Ten Development Trends of Overseas Ultra-Large-Scale Intelligent Computing Cluster Architecture

Since 2012, the growth rate of intelligent computing has outpaced Moore’s Law, achieving an order-of-magnitude increase per year, which poses unprecedented challenges to the architecture of computer. Ultra-large-scale intelligent computing clusters have been proposed as national new infrastructure by “State Council Government of China” in 2026. Considering the characteristics of human intelligence, i.e “small computing power, large network”, the enabling technologies of optical transmission and switching with lower power consumption, and new architectures and mechanisms driven by technological innovation, we present ten preliminary judgments on overseas intelligent computing clusters development trends from four aspects: cluster architecture, computing nodes, network technology, and technical ecosystem. This paper aims to offer insights and contribute to the national implementation of ultra-large-scale intelligent computing clusters as new infrastructure.