InfiniBand-Based Multi-path Mesh/Torus Interconnection Network for Massively Parallel Systems

In the field of designing high performance computing system, the efficient implementation of interconnection network is mandatory because it has momentous influence on the performance of massively parallel computing systems. As a high performance switched interconnection network standard, InfiniBand is widely used in MPP systems. Compared with fat-tree topology which is commonly used in InfiniBand networks, mesh/torus topology can achieve better performance and scalability. However, according to our study, there are some challenges to use the traditional mesh/torus topology in building interconnection network. In this paper, we formulate the problem of traditional network topologies and propose an InfiniBand-based multi-link mesh/torus interconnection network which provides higher bandwidth than traditional networks by using multiple links between switches. In order to fully use the provided multi-link, the corresponding routing scheme for the improved network is also proposed. Simulation results show that the proposed routin scheme achieves better performance and scalability than other routing schemes.