Abstract: How to exploit fully the potential capacities of parallel computing network systems is a research area of load balancing, which consist of great amount of autonomous computing sources.Here described is a new dynamic load distributing algorithm based on a parallel computing network environment. It can distribute loads in terms of system load state and communication overhead among tasks to fulfill system dynamic load balancing. Experimental studies of some applications show that this algorithm has a better stability and performance than the stable sender initiated adaptive algorithm.