Abstract: In the field of designing high performance computing system, the efficient implementation of interconnection network is mandatory because it has momentous influence on the performance of massively parallel computing systems. As a high performance switched interconnection network standard, InfiniBand is widely used in MPP systems. Compared with fat-tree topology which is commonly used in InfiniBand networks, mesh/torus topology can achieve better performance and scalability. However, according to our study, there are some challenges to use the traditional mesh/torus topology in building interconnection network. In this paper, we formulate the problem of traditional network topologies and propose an InfiniBand-based multi-link mesh/torus interconnection network which provides higher bandwidth than traditional networks by using multiple links between switches. In order to fully use the provided multi-link, the corresponding routing scheme for the improved network is also proposed. Simulation results show that the proposed routin scheme achieves better performance and scalability than other routing schemes.