• 中国精品科技期刊
  • CCF推荐A类中文期刊
  • 计算领域高质量科技期刊T1类
Advanced Search
Lin Xin, Tian Xin, Ji Yi, Xu Yunlong, Liu Chunping. Scene Graph Generation Based on Shuffle Residual Context Information[J]. Journal of Computer Research and Development, 2019, 56(8): 1721-1730. DOI: 10.7544/issn1000-1239.2019.20190329
Citation: Lin Xin, Tian Xin, Ji Yi, Xu Yunlong, Liu Chunping. Scene Graph Generation Based on Shuffle Residual Context Information[J]. Journal of Computer Research and Development, 2019, 56(8): 1721-1730. DOI: 10.7544/issn1000-1239.2019.20190329

Scene Graph Generation Based on Shuffle Residual Context Information

More Information
  • Published Date: July 31, 2019
  • Scene graphs play an important role in visual understanding. Existing scene graph generation methods focus on the research of the subjects, the objects as well as the predicates between them. However, human being abstracts the relationships using spatial relation context, semantic context and interaction between scene objects for better understanding and reasoning as whole. In order to obtain the better global context representation and reduce the impact of dataset bias, we propose a new framework of scene graph generation, called as residual shuffle sequence model (RSSQ). Our method is made up of object decoding, residual shuffle and position embedding modules. Residual shuffle module is stacked with two basic structures including the random shuffle operation and the residual bidirectional LSTM. We implement the random shuffle on the hidden state of bidirectional LSTM by the process of iterative operation to reduce the impact of dataset bias, and extract the shared global context information by the residual connection structure. To strengthen the spatial relationship between pair-wise objects, the encoding is achieved using the relative position and area ratio of objects in position embedding module. The experimental results of three sub-tasks of different difficulty performed on Visual Genome dataset, demonstrate that the poposed method can generate better scene graphs under Recall@50 and Recall@100 settings due to better global context and spatial information.
  • Related Articles

    [1]Qiu Jiefan, Xu Yifan, Xu Ruiji, Zhou Dongli, Chi Kaikai. An Optimization Method of Human Vital Signs Detection During the Non-Steady States[J]. Journal of Computer Research and Development, 2024, 61(2): 481-493. DOI: 10.7544/issn1000-1239.202220774
    [2]Ye Jing, Zou Bowei, Hong Yu, Shen Longxiang, Zhu Qiaoming, Zhou Guodong. Negation and Speculation Scope Detection in Chinese[J]. Journal of Computer Research and Development, 2019, 56(7): 1506-1516. DOI: 10.7544/issn1000-1239.2019.20180725
    [3]Huang Jipeng, Shi Yinghuan, Gao Yang. Multi-Scale Faster-RCNN Algorithm for Small Object Detection[J]. Journal of Computer Research and Development, 2019, 56(2): 319-327. DOI: 10.7544/issn1000-1239.2019.20170749
    [4]Zhang Hu, Tan Hongye, Qian Yuhua, Li Ru, Chen Qian. Chinese Text Deception Detection Based on Ensemble Learning[J]. Journal of Computer Research and Development, 2015, 52(5): 1005-1013. DOI: 10.7544/issn1000-1239.2015.20131552
    [5]Lan Mengwei, Li Cuiping, Wang Shaoqing, Zhao Kankan, Lin Zhixia, Zou Benyou, Chen Hong. Survey of Sign Prediction Algorithms in Signed Social Networks[J]. Journal of Computer Research and Development, 2015, 52(2): 410-422. DOI: 10.7544/issn1000-1239.2015.20140210
    [6]Gu Mingqin, Cai Zixing. Traffic Sign Recognition Based on Parameter-free Detector and DT-CWT[J]. Journal of Computer Research and Development, 2013, 50(9): 1893-1901.
    [7]Zheng Liming, Zou Peng, Han Weihong, Li Aiping, Jia Yan. Traffic Anomaly Detection Using Multi-Dimensional Entropy Classification in Backbone Network[J]. Journal of Computer Research and Development, 2012, 49(9): 1972-1981.
    [8]Zheng Liming, Zou Peng, Jia Yan. Anomaly Detection Using Multi-Level and Multi-Dimensional Analyzing of Network Traffic[J]. Journal of Computer Research and Development, 2011, 48(8): 1506-1516.
    [9]Zhang Yuhe, Huang Xi, Cui Li. WSN Nodes for Real-Time Traffic Information Detection[J]. Journal of Computer Research and Development, 2008, 45(1): 110-118.
    [10]Zhang Liangguo, Gao Wen, Chen Xilin, Chen Yiqiang, Wang Chunli. A Medium Vocabulary Visual Recognition System for Chinese Sign Language[J]. Journal of Computer Research and Development, 2006, 43(3): 476-482.

Catalog

    Article views (925) PDF downloads (443) Cited by()

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return