Visual Feature Attribution Based on Adversarial Feature Pairs

Visualizing the key feature of images is an important issue and requires in-depth study for computer vision. Its application ranges from weak supervision in the object localization task to understanding in the hidden features of the data. In medical and natural images data sets, the convolutional neural network-based model has become the latest technology for visualizing the regions of input, which are important for predictions from these models or visual explanations. However, their feature location is not accurate. In view of the limitations of the traditional neural network classifier in the region of the visual image key characteristics, we propose an effective adversarial feature pairs based method for visual feature attribution. In the proposed method, We firstly construct adversarial pair of key feature areas as the input of generative adversarial network (GAN). This makes the generator produce high corresponding key features, and can effectively filter redundant information and achieve accurate position. However, traditional GAN is difficult to produce images that are similar to real images. Therefore, Wasserstein distance and gradient penalty are employed to solve the problem and accelerate the convergence process. Experimental results on synthetic datasets, lung datasets and heart datasets show that our proposed method produces convincing real-world effects in both qualitative and quantitative visual displays.