• 中国精品科技期刊
  • CCF推荐A类中文期刊
  • 计算领域高质量科技期刊T1类
Advanced Search
Sun Li, Li Jing, Liu Guohua. Join Strategy Optimization in Column Storage Based Query[J]. Journal of Computer Research and Development, 2013, 50(8): 1647-1656.
Citation: Sun Li, Li Jing, Liu Guohua. Join Strategy Optimization in Column Storage Based Query[J]. Journal of Computer Research and Development, 2013, 50(8): 1647-1656.

Join Strategy Optimization in Column Storage Based Query

More Information
  • Published Date: August 14, 2013
  • The optimization of join strategies between columns is an important problem in column store based queries. Current column-oriented systems simplify the join strategy by changing storage structure, making the join strategy lack query optimization, which can not achieve the satisfied performance. On the basis of these problems, this paper presents a new join strategy optimization method with cost-based and rule-based method. Firstly, we use the rule-based optimization (RBO), setting the optimization rules to remove those candidate plans with too much cost. Then we design the cost-based optimization (CBO). We change the execution order by Huffman tree and left-deep tree principle. Then we summarize the execution strategies of each join node in the column-oriented query plan into pipeline strategy and parallel strategy. Based on that, a cost model is then proposed to select the better strategy. With small time and space complexity, the efficiency of the query execution in column-oriented systems is improved by focusing on estimating the cost of the pipeline and parallel strategies in this paper. The experimental results on the large-scale data warehouse benchmark data sets SSB verify the effectiveness of the proposed method.
  • Related Articles

    [1]Chen Shuping, Wei Hongmei, Wang Fei, Li Yi, He Wangquan, Qi Fengbin. Method to Create Aggregate Tree for Hardware Supported Collectives[J]. Journal of Computer Research and Development, 2024, 61(2): 503-517. DOI: 10.7544/issn1000-1239.202220684
    [2]Liu Shifang, Zhao Yonghua, Yu Tianyu, Huang Rongfeng. Efficient Implementation of Parallel Symmetric Matrix Tridiagonalization Algorithm on GPU Cluster[J]. Journal of Computer Research and Development, 2020, 57(12): 2635-2647. DOI: 10.7544/issn1000-1239.2020.20190731
    [3]Li Tao, Liu Xuechen, Zhang Shuai, Wang Kai, Yang Yulu. Parallel Support Vector Machine Training with Hybrid Programming Model[J]. Journal of Computer Research and Development, 2015, 52(5): 1098-1108. DOI: 10.7544/issn1000-1239.2015.20131492
    [4]Cao Hongjia, Lu Yutong, Xie Min, and Zhou Enqiang. Experiences and Scalability Analysis of Parallel Job Startup[J]. Journal of Computer Research and Development, 2013, 50(8): 1755-1761.
    [5]Li Qiang, Sun Ninghui, Huo Zhigang, Ma Jie. Optimizing MPI Alltoall Communications in Multicore Clusters[J]. Journal of Computer Research and Development, 2013, 50(8): 1744-1754.
    [6]Lü Huiwei, Cheng Yuan, Bai Lu, Chen Mingyu, Fan Dongrui, Sun Ninghui. Parallel Simulation of Many-Core Processor and Many-Core Clusters[J]. Journal of Computer Research and Development, 2013, 50(5): 1110-1117.
    [7]Xie Min, Lu Yutong, Zhou Enqiang, Cao Hongjia, and Yang Xuejun. Implementation and Evaluation of MPI Checkpointing System over Lustre File System[J]. Journal of Computer Research and Development, 2007, 44(10): 1709-1716.
    [8]Zhao Yonghua, Chi Xuebin, Cheng Qiang. Efficient Algorithms for Matrix Eigenproblem Solver on SMP Cluster[J]. Journal of Computer Research and Development, 2007, 44(2): 334-340.
    [9]Zhang Wenli, Chen Mingyu, and Fan Jianping. Emulation and Forecast of HPL Test Performance[J]. Journal of Computer Research and Development, 2006, 43(3): 557-562.
    [10]Zhou Enqiang, Lu Yutong, and Shen Zhiyu. Implementation of Checkpoint System Towards Large Scale Parallel Computing[J]. Journal of Computer Research and Development, 2005, 42(6): 987-992.

Catalog

    Article views (884) PDF downloads (611) Cited by()

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return