Patch-based texture synthesis methods have achieved significant progress. Nevertheless, there is still a serious problem in the seam of two adjacent patches. In order to preserve the texture border structures of adjacent patches sample, a new texture synthesis method is developed using irregular patches, a random overlapping method and an optimal matching algorithm. This new texture synthesis method is composed of two stages. In the first stage, an irregularly shaped feature patch is extracted by identifying a set of border structure features from the sample texture based on HVS using intelligent selecting tools. Then different irregular patches are obtained by introducing a small amount of deformation. In the second stage, guided by the irregular patch image, the random overlapping method and the optimal matching method are applied to texel-overlapped texture and texel-nonoverlapped texture respectively to decide how to paste the irregular patches into the output texture correctly. A variety of synthesis examples are shown, including structured texture, near-regular structured image and irregular texture. A comparison between the new method and Graphcut is given. Compared with be existing methods, the new method can preserve the border structures more efficiently and the results of the experiment also demonstrate that the new method can produce “texel-style texture” of high quality.