ISSN 1000-1239 CN 11-1777/TP

Journal of Computer Research and Development ›› 2018, Vol. 55 ›› Issue (12): 2764-2774.doi: 10.7544/issn1000-1239.2018.20170891

Previous Articles     Next Articles

Design and Research of Data Glove Based on Visual Information Fusion

Wang Fupan1, Wu Yadong1,2, Yang Wenchao3, Yang Fan4, Hou Jiaxin1, Liao Jing1   

  1. 1(School of Computer Science and Technology, Southwest University of Science and Technology, Mianyang, Sichuan 621010);2(Sichuan Civil-military Integration Institute, Southwest University of Science and Technology, Mianyang, Sichuan 621010);3(CloudMinds Chengdu Co., Ltd, Chengdu 610100);4(Laboratory of Electronic, Computing and Imaging Sciences, French National Centre for Scientific Research (LE2I-UMR CNRS 6306) (University of Burgundy), Dijon, France 21078)
  • Online:2018-12-01

Abstract: Gesture interaction based on data glove is an important way to realize human computer interaction . The effect of gesture recognition and spatial positioning has an important influence on the immersion and experience of virtual environment interaction tasks. The complex structure of typical products lead to high complexity of modeling and gesture recognition algorithm,and it’s hard to balance the cost and efficiency.Aiming at the requirements of application,we come up with a design of data glove system which combines the sensor data with visual information in this paper. A rapid mapping that convert the finger’s curvature value to virtual hand joints position is realized by a hierarchical template matching method,which simplifies the process of gesture’s modeling and matching effectively. In order to obtain the spatial information for gesture interaction, an efficient feature-checking Hough algorithm is proposed to locate the data glove. We use the camera to capture the circular contour of the luminous ball on the glove and calculate it’s position in three-dimensional space, and use a modified Hough-Circle-Detection algorithm based on diameter equation to reduce the circular detection complexity. For continuous frame image, the credibility based feature-checking rule is adopted to improve the overall efficiency of the algorithm.This scheme was applied in immersive virtual reality experiment system for middle school. Experimental results show that the system is stable and has a good interactive experience.

Key words: data glove, gesture recognition, visual information fusion, human-computer interaction, feature-checking

CLC Number: