• 中国精品科技期刊
  • CCF推荐A类中文期刊
  • 计算领域高质量科技期刊T1类
高级检索

基于冲突检测的高吞吐NVM存储系统

蔡涛, 王杰, 牛德姣, 刘佩瑶, 陈福丽

蔡涛, 王杰, 牛德姣, 刘佩瑶, 陈福丽. 基于冲突检测的高吞吐NVM存储系统[J]. 计算机研究与发展, 2020, 57(2): 257-268. DOI: 10.7544/issn1000-1239.2020.20190526
引用本文: 蔡涛, 王杰, 牛德姣, 刘佩瑶, 陈福丽. 基于冲突检测的高吞吐NVM存储系统[J]. 计算机研究与发展, 2020, 57(2): 257-268. DOI: 10.7544/issn1000-1239.2020.20190526
Cai Tao, Wang Jie, Niu Dejiao, Liu Peiyao, Chen Fuli. A High Throughput NVM Storage System Based on Access Request Conflict Detection[J]. Journal of Computer Research and Development, 2020, 57(2): 257-268. DOI: 10.7544/issn1000-1239.2020.20190526
Citation: Cai Tao, Wang Jie, Niu Dejiao, Liu Peiyao, Chen Fuli. A High Throughput NVM Storage System Based on Access Request Conflict Detection[J]. Journal of Computer Research and Development, 2020, 57(2): 257-268. DOI: 10.7544/issn1000-1239.2020.20190526
蔡涛, 王杰, 牛德姣, 刘佩瑶, 陈福丽. 基于冲突检测的高吞吐NVM存储系统[J]. 计算机研究与发展, 2020, 57(2): 257-268. CSTR: 32373.14.issn1000-1239.2020.20190526
引用本文: 蔡涛, 王杰, 牛德姣, 刘佩瑶, 陈福丽. 基于冲突检测的高吞吐NVM存储系统[J]. 计算机研究与发展, 2020, 57(2): 257-268. CSTR: 32373.14.issn1000-1239.2020.20190526
Cai Tao, Wang Jie, Niu Dejiao, Liu Peiyao, Chen Fuli. A High Throughput NVM Storage System Based on Access Request Conflict Detection[J]. Journal of Computer Research and Development, 2020, 57(2): 257-268. CSTR: 32373.14.issn1000-1239.2020.20190526
Citation: Cai Tao, Wang Jie, Niu Dejiao, Liu Peiyao, Chen Fuli. A High Throughput NVM Storage System Based on Access Request Conflict Detection[J]. Journal of Computer Research and Development, 2020, 57(2): 257-268. CSTR: 32373.14.issn1000-1239.2020.20190526

基于冲突检测的高吞吐NVM存储系统

基金项目: 国家自然科学基金项目(61806086);国家重点研发计划项目(2018YFB0804204);中国博士后科学基金项目(2016M601737)
详细信息
  • 中图分类号: TP316

A High Throughput NVM Storage System Based on Access Request Conflict Detection

Funds: This work was supported by the National Natural Science Foundation of China (61806086), the National Key Research and Development Program of China (2018YFB0804204), and the China Postdoctoral Science Foundation (2016M601737).
  • 摘要: 非易失性存储器(non-volatile memory, NVM)是解决计算机系统存储墙问题的有效手段,但现有的I/O栈缺乏相应的适应和优化机制,特别是基于文件系统的锁机制是影响NVM存储系统性能的重要因素.将存储系统访问请求的管理嵌入到存储设备中,利用NVM存储设备自主管理访问请求,使用基于冲突检测的方法代替基于文件系统的现有锁机制,提高操作系统执行访问请求的并发度,缓解设备接口带来的瓶颈问题.给出了高吞吐NVM存储系统的结构,设计了一种基于二维链表的访问请求管理方法减少访问请求管理中的冲突,一种基于冲突检测的访问请求调度算法用于管理NVM存储设备中共享的访问请求,并给出了新访问请求提交和已有访问请求释放流程,并基于Intel的开源NVM存储设备模拟器PMEM实现了HTPM的原型系统,使用Filebench中的多种负载和Fio测试了HTPM的吞吐率和I/O性能,实验结果表明:HTPM相比PMEM最大能提高31.9%的IOPS值和21.4%的I/O性能.
    Abstract: The NVM storage is a useful way to improve the efficiency of storage system in computer. However, there is a lack of adaptation and optimization mechanisms for NVM storage devices in I/O stack of operating system. Especially, the file system-based lock mechanism becomes an important factor affecting the efficiency of NVM storage systems. In this paper, we embed the management function of the access request for storage system in the NVM storage device. In order to improve the access request concurrency of operating system and alleviate the performance bottleneck caused by the device interface, we remove the existing lock mechanism in file system and use the conflict detection algorithm in NVM storage devices. Firstly, the structure of the high-throughput NVM storage system is given. Then, an access request management method based on two-dimensional linked list is design to change the structure of access request management and reduce the conflict of management. And a conflict detection algorithm is design to manage the access requests for the sharing data stored in NVM storage device. The new submission and release process for access requests are designed. Finally, the prototype of high throughput NVM storage system named HTPM is implemented based on PMEM, which is the open source NVM storage device simulator from Intel. The I/O performance and throughput of HTPM are tested by Fio and Filebench. The results show that HTPM can improve the IOPS by 31.9% and the I/O performance by 21.4% compared with PMEM.
  • 期刊类型引用(3)

    1. 李来存. 基于物联网技术的信息系统数据存储系统. 信息技术. 2024(05): 120-126+132 . 百度学术
    2. 王盈,蒋德钧,熊劲. 一种面向非易失性内存文件系统的数据读写粒度控制策略. 高技术通讯. 2021(07): 692-704 . 百度学术
    3. 贺庆建,蔡涛,王杰,牛德姣. 面向NVM存储系统的快速文件访问系统. 计算机应用. 2020(02): 541-546 . 百度学术

    其他类型引用(0)

计量
  • 文章访问数:  1022
  • HTML全文浏览量:  1
  • PDF下载量:  338
  • 被引次数: 3
出版历程
  • 发布日期:  2020-01-31

目录

    /

    返回文章
    返回