A Novel Approach for Abstractive Video Visualization

Peng Dichao; Liu Lin; Chen Guangyu; Chen Haidong; Zuo Wuheng; Chen Wei

Journal of Computer Research and Development > 2013 > 50(2): 371-378.

Peng Dichao, Liu Lin, Chen Guangyu, Chen Haidong, Zuo Wuheng, Chen Wei. A Novel Approach for Abstractive Video Visualization[J]. Journal of Computer Research and Development, 2013, 50(2): 371-378.

Citation:

Peng Dichao, Liu Lin, Chen Guangyu, Chen Haidong, Zuo Wuheng, Chen Wei. A Novel Approach for Abstractive Video Visualization[J]. Journal of Computer Research and Development, 2013, 50(2): 371-378.

Citation:

Peng Dichao, Liu Lin, Chen Guangyu, Chen Haidong, Zuo Wuheng, Chen Wei. A Novel Approach for Abstractive Video Visualization[J]. Journal of Computer Research and Development, 2013, 50(2): 371-378.

PDF (2760 KB)

A Novel Approach for Abstractive Video Visualization

1(State Key Laboratory of CAD & CG (Zhejiang University), Hangzhou 310058) 2(Sir Run Run Shaw Hospital, Hangzhou 310001) 3(Zhijiang College of Zhejiang University of Technology, Hangzhou 310024)

More Information

Published Date: February 14, 2013

Graphical Abstract

Abstract

Abstract

We present a novel approach for abstractive video visualization, which can help users understand the semantic information from the video in a fast and effective manner. We use the scale-invariant feature transform(SIFT) algorithm to detect features of each frame, together with a modified bag of words algorithm to construct a feature vocabulary in order to compute the feature frequencies. By mapping the video sequence onto a 3D curve in a high dimensional vocabulary space with the use of the multi-dimensional scaling (MDS) algorithm, the video is abstracted and embedded into a visually recognizable curve in 3D space. This generated visualization result can vividly illustrate the evolvement of the video contents, while well protecting and preserving the semantic meaning that are encoded within the video. Experimental results indicate that this curve-based visualization technique can uncover the semantic relationship between the frames, characterize the transition of video contents, and help the users understand the semantic structure of the underlying video sequence with a quick glance.
- visualization,
- video abstract,
- bag of word,
- low-dimensional embedding

FullText(HTML)

References (0)

[1]	Lü Wanli, Tang Yun, Yin Zhaoxia, Luo Bin. Reversible Data Hiding for 3D Mesh Model in Encrypted Domain Based on Vertex Partition and Coordinate Standardization[J]. Journal of Computer Research and Development, 2024, 61(6): 1536-1544. DOI: 10.7544/issn1000-1239.202221040
[2]	Zhang Yuhong, Zhi Wenwu, Li Peipei, Hu Xuegang. Semi-Supervised Method for Cross-Lingual Word Embedding Based on an Adversarial Model with Double Discriminators[J]. Journal of Computer Research and Development, 2023, 60(9): 2127-2136. DOI: 10.7544/issn1000-1239.202220036
[3]	Liang Yuzhu, Mei Yaxin, Yang Yi, Ma Ying, Jia Weijia, Wang Tian. A Low-Coupling Method in Sensor-Cloud Systems Based on Edge Computing[J]. Journal of Computer Research and Development, 2020, 57(3): 639-648. DOI: 10.7544/issn1000-1239.2020.20190588
[4]	Du Peng, Ding Shifei. A DGA Domain Name Detection Method Based on Deep Learning Models with Mixed Word Embedding[J]. Journal of Computer Research and Development, 2020, 57(2): 433-446. DOI: 10.7544/issn1000-1239.2020.20190160
[5]	Gong Daofu, Liu Fenlin, Luo Xiangyang. A Variable-Payload Self-Embedding Fragile Watermarking Algorithm for Image[J]. Journal of Computer Research and Development, 2014, 51(11): 2505-2512. DOI: 10.7544/issn1000-1239.2014.20130440
[6]	Chen Guanhua, Ma Xiuli, Yang Dongqing, Tang Shiwei, Shuai Meng, Xie Kunqing. Discovering Redundancy-Aware Top-k Anomalies in High Dimensional Data[J]. Journal of Computer Research and Development, 2010, 47(5): 788-795.
[7]	Xie Kunwu, Bi Xiaoling, and Ye Bin. Clustering Algorithm of High-Dimensional Data Based on Units[J]. Journal of Computer Research and Development, 2007, 44(9): 1618-1623.
[8]	Zeng Xianhua, Luo Siwei. A Dynamically Incremental Manifold Learning Algorithm[J]. Journal of Computer Research and Development, 2007, 44(9): 1462-1468.
[9]	Liu Tong, Li Huawei, Li Xiaowei, Gong Shuguang. A Sub-Tuple-Partition-Based Fast Two-Dimensional Packet Classification Algorithm[J]. Journal of Computer Research and Development, 2006, 43(10): 1797-1803.
[10]	Hou Yuexian, Ding Zheng, and He Pilian. Self-Organizing Isometric Embedding[J]. Journal of Computer Research and Development, 2005, 42(2): 188-195.