ISSN 1000-1239 CN 11-1777/TP

计算机研究与发展 ›› 2020, Vol. 57 ›› Issue (2): 257-268.doi: 10.7544/issn1000-1239.2020.20190526

所属专题: 2020大数据与智能存储系统前沿技术专题

• 系统结构 • 上一篇    下一篇

基于冲突检测的高吞吐NVM存储系统

蔡 涛, 王 杰, 牛德姣, 刘佩瑶, 陈福丽   

  1. (江苏大学计算机科学与通信工程学院 江苏镇江 212013) (caitao@ujs.edu.cn)
  • 出版日期: 2020-02-01
  • 基金资助: 
    国家自然科学基金项目(61806086);国家重点研发计划项目(2018YFB0804204);中国博士后科学基金项目(2016M601737)

A High Throughput NVM Storage System Based on Access Request Conflict Detection

Cai Tao, Wang Jie, Niu Dejiao, Liu Peiyao, and Chen Fuli   

  1. (School of Computer Science and Communication Engineering, Jiangsu University, Zhenjiang, Jiangsu 212013)
  • Online: 2020-02-01
  • Supported by: 
    This work was supported by the National Natural Science Foundation of China (61806086), the National Key Research and Development Program of China (2018YFB0804204), and the China Postdoctoral Science Foundation (2016M601737).

摘要: 非易失性存储器(non-volatile memory, NVM)是解决计算机系统存储墙问题的有效手段,但现有的I/O栈缺乏相应的适应和优化机制,特别是基于文件系统的锁机制是影响NVM存储系统性能的重要因素.将存储系统访问请求的管理嵌入到存储设备中,利用NVM存储设备自主管理访问请求,使用基于冲突检测的方法代替基于文件系统的现有锁机制,提高操作系统执行访问请求的并发度,缓解设备接口带来的瓶颈问题.给出了高吞吐NVM存储系统的结构,设计了一种基于二维链表的访问请求管理方法减少访问请求管理中的冲突,一种基于冲突检测的访问请求调度算法用于管理NVM存储设备中共享的访问请求,并给出了新访问请求提交和已有访问请求释放流程,并基于Intel的开源NVM存储设备模拟器PMEM实现了HTPM的原型系统,使用Filebench中的多种负载和Fio测试了HTPM的吞吐率和I/O性能,实验结果表明:HTPM相比PMEM最大能提高31.9%的IOPS值和21.4%的I/O性能.

关键词: NVM存储系统, NVM存储设备, I/O栈, 存储系统, 操作系统

Abstract: The NVM storage is a useful way to improve the efficiency of storage system in computer. However, there is a lack of adaptation and optimization mechanisms for NVM storage devices in I/O stack of operating system. Especially, the file system-based lock mechanism becomes an important factor affecting the efficiency of NVM storage systems. In this paper, we embed the management function of the access request for storage system in the NVM storage device. In order to improve the access request concurrency of operating system and alleviate the performance bottleneck caused by the device interface, we remove the existing lock mechanism in file system and use the conflict detection algorithm in NVM storage devices. Firstly, the structure of the high-throughput NVM storage system is given. Then, an access request management method based on two-dimensional linked list is design to change the structure of access request management and reduce the conflict of management. And a conflict detection algorithm is design to manage the access requests for the sharing data stored in NVM storage device. The new submission and release process for access requests are designed. Finally, the prototype of high throughput NVM storage system named HTPM is implemented based on PMEM, which is the open source NVM storage device simulator from Intel. The I/O performance and throughput of HTPM are tested by Fio and Filebench. The results show that HTPM can improve the IOPS by 31.9% and the I/O performance by 21.4% compared with PMEM.

Key words: NVM storage system, NVM storage device, I/O stack, storage system, operating system

中图分类号: