利用非对称锁的高并发NVM存储系统

doi:10.19665/j.issn1001-2400.2020.02.010

摘要/Abstract

摘要：

为了提高非易失性存储系统并发执行访问请求的能力,针对存储设备中的读写访问请求、文件数据和元数据的不同特性,设计了基于区间锁的文件数据并发写策略、基于读—拷贝修改的文件数据读写并发策略和基于最小自旋锁的元数据同步策略, 以提高访问请求执行的并发度;实现了利用非对称锁的高并发非易失存储系统原型,使用通用测试工具和方法进行了测试与分析,验证所实现的原型系统相比PMFS能提高40%~162%的吞吐率和61%~159%的每秒输入输出量。

关键词: 非易失性存储器, 区间锁, 并发访问

Abstract:

In order to improve the ability of the non-volatile memory storage device system to concurrently execute access requests, aiming at the diverse nature between read and write access requests and the different properties of file data and metadata in the storage device, we have designed a file-based parallel write-based file data concurrent write strategy, RCU based file data read and write concurrency strategy and a minimum spin lock-based metadata synchronization strategy to improve the degree of concurrency of requests execution. And then we have implemented a prototype of the asymmetric lock-based high concurrent non-volatile memory storage system, which has been tested and analyzed by common test tools and methods, the result shows that compared with the PMFS, the prototype system can increase the throughput by 40%~162% and input/output operations per second by 61%~159%.

Key words: non-volatile memory, region lock, concurrent accessing

中图分类号:

TP391

蔡涛,刘佩瑶,王杰,牛德姣,贺庆建,陈志鹏. 利用非对称锁的高并发NVM存储系统[J]. 西安电子科技大学学报, 2020, 47(2): 67-74.

CAI Tao,LIU Peiyao,WANG Jie,NIU Dejiao,HE Qingjian,CHEN Zhipeng. Highly concurrent NVM storage system based on the asymmetric lock[J]. Journal of Xidian University, 2020, 47(2): 67-74.

图/表 8

图1

图2

图3

图4

表1

图5

图6

图7

参考文献 17

[1]	王力玉, 陈岚, 郝晓冉 , 等. 利用SSD和DRAM构建的扩展内存架构[J]. 西安电子科技大学学报, 2017,44(3):144-150.
	WANG Liyu, CHEN Lan, HAO Xiaoran , et al. Memory-extended Architecture Based on the SSD and DRAM[J]. Journal of Xidian University, 2017,44(3):144-150.
[2]	LI J, LAM C . Phase Change Memory[J]. Science China Information Sciences, 2011,54(5):1061-1072.
[3]	JO S H, KUMAR T, NARAYANAN S , et al. 3D-stackable Crossbar Resistive Memory Based on Field Assisted Superlinear Threshold (FAST) Selector[C]// Proceedings of the 2014 IEEE International Electron Devices Meeting. Piscataway: IEEE, 2015: 7046999.
[4]	CAULFIELD A M, COBURN J, MOLLOV T , et al. Understanding the Impact of Emerging Non-volatile Memories on High-performance, IO-intensive Computing[C]// Proceeding of the 2010 IEEE/ACM International Conference for High Performance Computing, Networking, Storage and Analysis. Washington: IEEE Computer Society, 2010: 5645465.
[5]	DULLOOR S R, KUMAR S, KESHAVAMURTHY A , et al. System Software for Persistent Memory[C]// Proceedings of the 2014 9th European Conference on Computer Systems. New York: ACM, 2014: 15-28.
[6]	JIN P Q, WU Z L, YUE L H . A Page-based Storage Framework for Phase Change Memory[C]// Proceedings of the 2017 33rd International Conference on Massive Storage Systems and Technology. Piscataway: IEEE, 2017: 152-164.
[7]	FAN Z Q, WUF G, PARK D , et al. Hibachi: a Cooperative Hybrid Cache with NVRAM and DRAM for Storage Arrays[C]// Proceeding of the 2017 33rd IEEE Symposium on Mass Storage Systems and Technologies. Piscataway: IEEE, 2017: 90-101.
[8]	CAI T, NIU D J, HE Y , et al. NVMCFS: Complex File System for Hybrid NVM[C]// Proceeding of the 2016 International Conference on Parallel and Distributed Systems. Washington: IEEE Computer Society, 2016: 577-584.
[9]	XU J, SWANSON S . NOVA: a Log-structured File System for Hybrid Volatile/Non-volatile Main Memories[C]// Proceedings of the 2016 14th USENIX Conference on File and Storage Technologies. Berkeley: USENIX, 2016: 22-25.
[10]	OU J, SHU J W, LU Y Y . AHigh Performance File System for Non-volatile Main Memory[C]// Proceedings of the 2016 11th European Conference on Computer Systems. New York: ACM, 2016: 2901324.
[11]	NIU D J, He Q J, Cai T , et al. XPMFS: a New NVM File System for Vehicle Big Data[J]. IEEE Access, 2018,6:34863-34873.
[12]	ZHENG S G, MORTEZA H, STEVEN S . Ziggurat: a Tiered File System for Non-volatile Main Memories and Disks[C]// Proceedings of the 2019 17th USENIX Conference on File and Storage Technologies. Berkeley: USENIX, 2019: 207-219.
[13]	张在贵, 张立强, 李瑞东 , 等. 一种适用于集群文件系统分级存储的分布式锁设计与分析[J]. 计算机研究与发展, 2012,49(s1):234-239.
	ZHANG Zaigaui, ZHANG Liqiang, LI Ruidong , et al. A Distributed Lock Design and Analysis for Cluster File System Hierarchical Storage[J]. Journal of Computer Research and Development, 2012,49(s1):234-239.
[14]	WU X J, Reddy A L N . SCMFS:a File System for Storage Class Memory[C]// Proceedings of the 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. New York: ACM, 2011: 39-49.
[15]	VOLOS H, NALLI S, PANNEERSELVAM S , et al. Aerie: Flexible File-system Interfaces to Storage-class Memory[C]// Proceedings of the 9th European Conference on Computer Systems. New York: ACM, 2014: 14.
[16]	COBURN J, CAULFIELD A, GRUPP L , et al. NVTM: a Transactional Interface for Next-generation Non-volatile Memories: CS2009-0948[R]. San Diego: University of California:, 2009: 58-60.
[17]	KANNAN S, ARPACI-DUSSEAU A C, ARPACI-DUSSEAU R H , et al. Designing a True Direct-access File System with DevFS[C]// Proceedings of the 2018 16th USENIX Conference on File and Storage Technologies. Piscataway: IEEE, 2018: 241-255.

类型	配置
CPU	4核Intel(R) Xeon(R) E7-4830V2 2.2GHz
内存	256GB
硬盘	600GB SAS硬盘+120GB SAS SSD
操作系统	Red Hat Enterprise 6.5