ISSN 1000-1239 CN 11-1777/TP

Journal of Computer Research and Development ›› 2019, Vol. 56 ›› Issue (2): 385-393.doi: 10.7544/issn1000-1239.2019.20170897

Previous Articles     Next Articles

Inferring Ambient Occlusion from a Single Image

Guo Yuxiao1, Chen Leiting1,2, Dong Yue3   

  1. 1(School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731); 2(Institute of Electronic and Information Engineering in Guangdong, University of Electronic Science and Technology of China, Dongguan, Guangdong 523808); 3(Microsoft Research Asia, Beijing 100080)
  • Online:2019-02-01

Abstract: Ambient occlusion has been widely used in many graphics and vision tasks for approxi-mating low frequency global illumination, removing inter-reflection, and inferring scene geometry. Existing methods need either scene geometry or scene appearances under different lightings to compute the ambient occlusion of the scene, which limits the application of these methods in many real applications. In this paper, we present a new method for computing the ambient occlusion from a single image taken under unknown natural lighting. Our method needn’t any scene geometry or illumination information. To this end, we utilize a convolutional neural network (CNN), trained on a large amount of synthetic data, to directly recovery the pre-pixel ambient occlusion. We propose three network structures for ambient occlusion estimation, a cascade one and a parallel one that are based on previous CNN solution for intrinsic images, as well as an end-to-end neural network. We analyze their performance and demonstrate that comparing with parallel and cascade designs, the end-to-end design could achieve the best performance. We also valid the efficiency and effectiveness of our method on both synthetic and real images. It is not only faster, but also more accurate than previous methods.

Key words: ambient occlusion, intrinsic image, natural illumination, convolutional neural network, autoencoder

CLC Number: