高级检索

    HPC海量存储系统Pass-Through访问策略研究

    An Access Pass-Through Policy of Storage Unit Under HPC Mass Storage System

    • 摘要: 为了解决海量信息处理中实时访问中的“I/O墙”的问题,提高海量信息分布式存储系统的性能,提出了一种基于高性能计算(high performance computing, HPC)的存储部件新型访问策略.首先,分析传统访问模型存在的问题;其次,研究存储部件直通路模式的工作机理, 建立存储系统分解为多层次、分布式的模型,根据不同的层次和映射策略实现存储空间物理地址、缓存地址、存储系统逻辑空间地址的连续映射;第三,分析直通路访问模式下的存储路径时间开销;第四,在模拟环境下存储部件访问的性能测试,在实际采用该策略的应用系统中进行验证.通过验证测试结果表明,该方法能有效提高存储系统的性能,能够不断满足海量信息处理实时需要.

       

      Abstract: To solve the “I/O wall” problem in the case of real-time accessing about mass information processing and improve the performance of distributed mass storage systems, an access policy based on storage unit pass-through is proposed. Firstly we analyse the problem of traditional access models. Then we study the mechanism of pass-through pattern, and build the model which divides the storage system into multi-level, distributed storage system. Next, the continuous mapping of physical address, cache address of storage space and logical space address of storage system is realized depending on the different levels and mapping strategies. Thirdly we analyse the time consuming of pass-through storage path in pass-through pattern. Fourthly we test the performance of the storage unit in the simulated environment, and validate the application system which employs the strategies. The validated results show that the method can improve the performance of storage system effectively, and can meet the needs of real-time accessing about massive information processing in the ubiquitous network architecture.

       

    /

    返回文章
    返回