An Efficient Data Transfer Protocol for P2P-Based High Performance Computing

For the high performance distributed computing platform named P2HP, the design and implementation of a fast data transfer protocol (FDTP) is presented in this paper. Based on a permanent connected pipeline, a network transfer pipe is constructed during each transformation between the client and the server, including a message channel for control and a data channel for data. The transfer process in FDTP is divided into 3 steps, such as pipe constructing, data transferring and pipe closing. The style of queries and the format of data stream are defined, and the management of the data pipe and the control of the fault tolerance during the transformation are also described. Through simplifying the control and reducing the connections, the communication latency is reduced and then the transformation efficiency of FDTP is enhanced, so as to boost the P2HP for its high performance computing.