Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
CN109739696A - Double-control storage array solid state disk cache acceleration method - Google Patents
[go: Go Back, main page]

CN109739696A - Double-control storage array solid state disk cache acceleration method - Google Patents

Double-control storage array solid state disk cache acceleration method Download PDF

Info

Publication number
CN109739696A
CN109739696A CN201811522575.4A CN201811522575A CN109739696A CN 109739696 A CN109739696 A CN 109739696A CN 201811522575 A CN201811522575 A CN 201811522575A CN 109739696 A CN109739696 A CN 109739696A
Authority
CN
China
Prior art keywords
cache
index
storage
caching
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811522575.4A
Other languages
Chinese (zh)
Other versions
CN109739696B (en
Inventor
田鹏
马建鹏
杨扬
万琨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Computer Technology and Applications
Original Assignee
Beijing Institute of Computer Technology and Applications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Computer Technology and Applications filed Critical Beijing Institute of Computer Technology and Applications
Priority to CN201811522575.4A priority Critical patent/CN109739696B/en
Publication of CN109739696A publication Critical patent/CN109739696A/en
Application granted granted Critical
Publication of CN109739696B publication Critical patent/CN109739696B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Memory System Of A Hierarchy Structure (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明涉及一种双控存储阵列固态硬盘缓存加速方法,涉及计算机存储技术领域。本发明提供一种双存储控制器的缓存加速方法,实现一个存储控制器失效以后,数据的存储操作由另一个控制器接管,即缓存系统仍旧可以继续在另一个控制器工作,并保证数据存储服务不中断。两个存储控制器中的缓存索引树实时同步,处于镜像状态。当一个存储控制器发生故障失效时,另一个控制器能够在故障点无缝接管该控制器上的存储服务。本发明既保证了SSD缓存存储的高效性能,又保证了SSD缓存存储的高可靠性。

The invention relates to a dual-control storage array solid-state hard disk cache acceleration method, and relates to the technical field of computer storage. The invention provides a cache acceleration method for dual storage controllers, which realizes that after one storage controller fails, the data storage operation is taken over by another controller, that is, the cache system can still continue to work in the other controller, and data storage is guaranteed. Service is not interrupted. The cache index trees in the two storage controllers are synchronized in real time and are in a mirrored state. When one storage controller fails, the other controller can seamlessly take over storage services on that controller at the point of failure. The invention not only ensures the high-efficiency performance of the SSD cache storage, but also ensures the high reliability of the SSD cache storage.

Description

A kind of dual control storage array solid state hard disk caching accelerated method
Technical field
The present invention relates to computer memory technical fields, and in particular to a kind of dual control storage array solid state hard disk caching acceleration Method.
Background technique
Traditional mechanical hard disk (HDD) has large capacity advantage, but performance is relatively relatively low, especially random I/O performance, The performance bottleneck for often becoming system, show under virtualized environment and becomes apparent, because virtualizing scene, to aggravate I/O random Change.Compared to HDD, solid state hard disk (SSD) advantage with high performance, especially in terms of random I/O, advantage clearly, still The hardware cost of SSD is relatively high.
Industry has done some optimizations in terms of combining the high-performance of large capacity and SSD of HDD at present, basic ideas be using Caching of the SSD as HDD.Dsc data is cached by SSD, when storage control reads and writes data, once hit caching, just directly It is read and write from caching.In SSD cold data caching can according to it is certain strategy under brush in HDD.It is utilized HDD's to reach Large capacity advantage, and promote the purpose of HDD performance.
In the storage system of double storage controllers, since the metadata being buffered in controller memory will not periodic refreshing To SSD, once master controller breaks down, storage service is switched to from controller, cache metadata do not update to from Controller can not reorganize caching from controller, to cause loss of data.Therefore, the caching for realization dual controller adds Speed will guarantee that the metadata of caching is lower in real time and brush to SSD.
Summary of the invention
(1) technical problems to be solved
The technical problem to be solved by the present invention is how to provide a kind of caching accelerated method of double storage controllers, realize After the failure of one storage control, the storage operation of data is taken over by another controller, i.e., caching system still can be after Continue and work in another controller, and guarantees that data storage service is not interrupted.
(2) technical solution
In order to solve the above-mentioned technical problems, the present invention provides a kind of dual control storage array solid state hard disks to cache acceleration side Method, comprising the following steps:
(1) it creation caching: initializes cache object respectively in the memory of two storage controls A, B, and establishes caching The caching of object indexes, and the corresponding caching index of each cache object, caching index is organized as a caching index tree, Cache object is stored in the caching index tree in non-leaf nodes and indexes key, corresponding cache object is found according to these key and exists Position on HDD;
The data cached mapping relations with HDD data of caching index record SSD, including HDD block data address, SSD Data block address, data block size, caching number and data access time;
Every four caching index organizations are a caching group, and each caching group is one piece of contiguous memory in memory, corresponding Unique caching group #;
The corresponding caching index tree of one rear end equipment, caching index tree are assigned with unique caching group #;
(2) caching read-write: traversal caching index updates the data access time of caching index, more for the caching of hit Another controller memory index tree is newly arrived, reads and writes data from the SSD data block address of index;For the caching in unnatural death, from HDD reads and writes data, and to memory index tree application available index, records the data to the corresponding SSD data block address of index;
(3) cache synchronization: the caching in storage control A memory is indexed by way of queue, is simultaneously sent to and deposits In the memory for storing up controller B, the caching of storage control B is indexed by way of queue, storage control A is simultaneously sent to In;
(4) it caches write-back: being executed by caching write-back thread, caching write-back thread statistics caching use space, caching uses Space is the sum of the size of data in all caching indexes, when caching use space higher than highest threshold value, caches write-back thread Start write-back buffer, by traversing the caching index tree, the caching group on index tree is cached described in poll, by each caching rope Draw the corresponding position that corresponding caching is written back to back-end logic volume, the caching index of write-back is by the synchronous setting of two storage controls Stop write-back buffer when spatial cache is lower than lowest threshold for available mode.
Preferably, in step (4), the corresponding caching of each caching index is written back to back-end logic volume by lru algorithm Corresponding position.
Preferably, the caching index tree tissue is a B+ tree.
(3) beneficial effect
The present invention provides a kind of caching accelerated method of double storage controllers, after realizing a storage control failure, The storage operation of data is taken over by another controller, i.e., caching system can still continue to work in another controller, and Guarantee that data storage service is not interrupted.Caching index tree real-time synchronization in two storage controls is in mirrored state.When one A storage control breaks down when failing, another controller can take in the storage on the fault point seamless pipe controller Business.The present invention both ensure that the efficient performance of SSD buffer memory, in turn ensure the high reliability of SSD buffer memory.This method can Applied to the business scenario in double storage controllers mixing storage array product, used simultaneously for SSD and HDD.It is total reducing On the basis of body possesses cost, while not only having ensure that reliability, but also the overall performance of product is improved.
Detailed description of the invention
Fig. 1 is caching index structure schematic diagram of the invention;
Fig. 2 is caching index tree of the invention and caching group structural schematic diagram;
Fig. 3 is that dual control of the invention caches accelerated method data flow figure.
Specific embodiment
To keep the purpose of the present invention, content and advantage clearer, with reference to the accompanying drawings and examples, to of the invention Specific embodiment is described in further detail.
As shown in Figure 1 to Figure 3, a kind of dual control storage array solid state hard disk caching accelerated method proposed by the present invention include with Lower step:
(1) it creation caching: initializes cache object respectively in the memory of two storage controls A, B, and establishes caching The caching of object indexes, and the corresponding caching index of each cache object, caching index is organized as a caching index tree, Cache object is stored in the caching index tree in non-leaf nodes and indexes key, corresponding cache object is found according to these key and exists Position on HDD creates following data structure in the present invention:
The caching index: the data cached mapping relations with HDD data of record SSD, including HDD block data address, SSD Data block address, data block size, caching number and data access time;
Caching group: every four caching index organizations are a caching group, and each caching group is in one piece continuous in memory It deposits, corresponding unique caching group #;
The caching index tree: the corresponding caching index tree of a rear end equipment, caching index tree tissue are a B+ Tree is assigned with unique caching group #;
(2) caching read-write: traversal caching index updates the data access time of caching index, more for the caching of hit Another controller memory index tree is newly arrived, reads and writes data from the SSD data block address of index;For the caching in unnatural death, from HDD reads and writes data, and to memory index tree application available index, records the data to the corresponding SSD data block address of index;
(3) cache synchronization: the caching in storage control A memory is indexed by way of queue, is simultaneously sent to and deposits In the memory for storing up controller B, the caching of storage control B is indexed by way of queue, storage control A is simultaneously sent to In;In this way, the caching index tree in two storage control memories keeps realtime uniform;
(4) cache write-back: caching write-back is executed by special caching write-back thread, and write-back thread statistics caching uses empty Between, caching use space is that the sum of the size of data in all caching indexes is delayed when caching use space is higher than highest threshold value It is stored back to and writes thread and start write-back buffer, by traversing the caching index tree, caching group on caching index tree described in poll will Each caching index is corresponding to cache the corresponding position that back-end logic volume is written back to by lru algorithm, and the caching of write-back indexes quilt Two storage controls synchronize and are set as available mode, when spatial cache is lower than lowest threshold, stop write-back buffer.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, without departing from the technical principles of the invention, several improvement and deformations can also be made, these improvement and deformations Also it should be regarded as protection scope of the present invention.

Claims (5)

1.一种双控存储阵列固态硬盘缓存加速方法,其特征在于,包括以下步骤:1. A dual-control storage array solid-state hard disk cache acceleration method, characterized in that, comprising the following steps: (1)创建缓存:在两个存储控制器A、B的内存中分别初始化缓存对象,并建立缓存对象的缓存索引,每个缓存对象对应一个缓存索引,缓存索引被组织为一颗缓存索引树,在所述缓存索引树中非叶子节点中存放缓存对象索引key,根据这些key找到对应缓存对象在HDD上的位置;(1) Create a cache: Initialize the cache objects in the memory of the two storage controllers A and B respectively, and establish a cache index of the cache object. Each cache object corresponds to a cache index, and the cache index is organized as a cache index tree. , store the cache object index key in the non-leaf node in the cache index tree, and find the position of the corresponding cache object on the HDD according to these keys; 所述缓存索引记录SSD缓存数据和HDD数据的映射关系,包括HDD块数据地址,SSD数据块地址、数据块大小、缓存编号和数据访问时间;The cache index records the mapping relationship between SSD cache data and HDD data, including HDD block data address, SSD data block address, data block size, cache number and data access time; 每四个缓存索引组织为一个缓存组,每个缓存组在内存中为一块连续内存,对应唯一的缓存组编号;Every four cache indexes are organized into a cache group, and each cache group is a continuous memory in memory, corresponding to a unique cache group number; 一个后端设备对应一颗缓存索引树,缓存索引树分配了唯一的缓存组编号;A backend device corresponds to a cache index tree, and the cache index tree is assigned a unique cache group number; (2)缓存读写:遍历缓存索引,对于命中的缓存,更新缓存索引的数据访问时间,更新到另一个控制器内存索引树,从索引的SSD数据块地址读写数据;对于非命中的缓存,从HDD读写数据,并向内存索引树申请可用索引,记录该数据到索引对应的SSD数据块地址;(2) Cache read and write: traverse the cache index, update the data access time of the cache index for the hit cache, update the memory index tree of another controller, and read and write data from the indexed SSD data block address; for the non-hit cache , read and write data from the HDD, apply for an available index to the memory index tree, and record the data to the SSD data block address corresponding to the index; (3)缓存同步:将存储控制器A内存中的缓存索引通过队列的方式,同步发送到存储控制器B的内存中,将存储控制器B的缓存索引通过队列的方式,同步发送到存储控制器A中;(3) Cache synchronization: The cache index in the memory of storage controller A is synchronously sent to the memory of storage controller B through a queue, and the cache index of storage controller B is synchronously sent to the storage controller through a queue. in device A; (4)缓存回写:由缓存回写线程执行,缓存回写线程统计缓存使用空间,缓存使用空间为所有缓存索引中的数据大小之和,当缓存使用空间高于最高阈值时,缓存回写线程开始回写缓存,通过遍历所述缓存索引树,轮询所述缓存索引树上的缓存组,将每个缓存索引对应的缓存回写到后端逻辑卷的对应位置,回写的缓存索引被两个存储控制器同步设置为可用状态,当缓存空间低于最低阈值时,停止回写缓存。(4) Cache write-back: executed by the cache write-back thread. The cache write-back thread counts the cache usage space. The cache usage space is the sum of the data sizes in all cache indexes. When the cache usage space is higher than the highest threshold, the cache write-back is performed. The thread starts to write back the cache, by traversing the cache index tree, polling the cache group on the cache index tree, and writing back the cache corresponding to each cache index to the corresponding position of the back-end logical volume, the cache index of the write-back Synchronously set to available state by both storage controllers, stop write-back caching when the cache space falls below the minimum threshold. 2.如权利要求1所述的方法,其特征在于,步骤(4)中,将每个缓存索引对应的缓存通过LRU算法回写到后端逻辑卷的对应位置。2 . The method according to claim 1 , wherein, in step (4), the cache corresponding to each cache index is written back to the corresponding position of the back-end logical volume through the LRU algorithm. 3 . 3.如权利要求1所述的方法,其特征在于,所述缓存索引树组织为一颗B+树。3. The method of claim 1, wherein the cache index tree is organized as a B+ tree. 4.如权利要求1所述的方法,其特征在于,两个存储控制器中的缓存索引树处于镜像状态。4. The method of claim 1, wherein the cache index trees in the two storage controllers are in a mirrored state. 5.如权利要求1所述的方法,其特征在于,该方法应用于双存储控制器混合存储阵列产品中。5. The method of claim 1, wherein the method is applied to a dual storage controller hybrid storage array product.
CN201811522575.4A 2018-12-13 2018-12-13 Double-control storage array solid state disk caching acceleration method Active CN109739696B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811522575.4A CN109739696B (en) 2018-12-13 2018-12-13 Double-control storage array solid state disk caching acceleration method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811522575.4A CN109739696B (en) 2018-12-13 2018-12-13 Double-control storage array solid state disk caching acceleration method

Publications (2)

Publication Number Publication Date
CN109739696A true CN109739696A (en) 2019-05-10
CN109739696B CN109739696B (en) 2022-05-13

Family

ID=66358939

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811522575.4A Active CN109739696B (en) 2018-12-13 2018-12-13 Double-control storage array solid state disk caching acceleration method

Country Status (1)

Country Link
CN (1) CN109739696B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111414321A (en) * 2020-02-24 2020-07-14 中国农业大学 A cache protection method and device based on dynamic mapping mechanism
CN112181705A (en) * 2020-10-12 2021-01-05 上海前瞻创新研究院有限公司 Management storage control method based on multiple controllers and storage equipment
WO2021012169A1 (en) * 2019-07-22 2021-01-28 华为技术有限公司 Method of improving reliability of storage system, and related apparatus
CN112597079A (en) * 2020-12-22 2021-04-02 上海安路信息科技有限公司 Data write-back system of convolutional neural network accelerator

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6134634A (en) * 1996-12-20 2000-10-17 Texas Instruments Incorporated Method and apparatus for preemptive cache write-back
CN102081584A (en) * 2009-11-30 2011-06-01 英业达股份有限公司 Cache mirroring system and method for dual-controller storage system
CN102364474A (en) * 2011-11-17 2012-02-29 中国科学院计算技术研究所 Metadata storage system for cluster file system and metadata management method
US20120278335A1 (en) * 2011-04-27 2012-11-01 Verisign, Inc. Systems and Methods for a Cache-Sensitive Index Using Partial Keys
CN103092775A (en) * 2013-01-31 2013-05-08 武汉大学 Spatial data double cache method and mechanism based on key value structure
US20160203180A1 (en) * 2014-03-10 2016-07-14 Hitachi, Ltd. Index tree search method and computer
US20170192892A1 (en) * 2016-01-06 2017-07-06 Netapp, Inc. High performance and memory efficient metadata caching
CN107193767A (en) * 2017-05-25 2017-09-22 北京计算机技术及应用研究所 A data transmission system for cache mirroring in a dual-controller storage system
CN107301021A (en) * 2017-06-22 2017-10-27 郑州云海信息技术有限公司 It is a kind of that the method and apparatus accelerated to LUN are cached using SSD
JP2017208113A (en) * 2017-06-30 2017-11-24 ▲ホア▼▲ウェイ▼技術有限公司Huawei Technologies Co.,Ltd. Data storage method, data storage apparatus, and storage device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6134634A (en) * 1996-12-20 2000-10-17 Texas Instruments Incorporated Method and apparatus for preemptive cache write-back
CN102081584A (en) * 2009-11-30 2011-06-01 英业达股份有限公司 Cache mirroring system and method for dual-controller storage system
US20120278335A1 (en) * 2011-04-27 2012-11-01 Verisign, Inc. Systems and Methods for a Cache-Sensitive Index Using Partial Keys
CN102364474A (en) * 2011-11-17 2012-02-29 中国科学院计算技术研究所 Metadata storage system for cluster file system and metadata management method
CN103092775A (en) * 2013-01-31 2013-05-08 武汉大学 Spatial data double cache method and mechanism based on key value structure
US20160203180A1 (en) * 2014-03-10 2016-07-14 Hitachi, Ltd. Index tree search method and computer
US20170192892A1 (en) * 2016-01-06 2017-07-06 Netapp, Inc. High performance and memory efficient metadata caching
CN107193767A (en) * 2017-05-25 2017-09-22 北京计算机技术及应用研究所 A data transmission system for cache mirroring in a dual-controller storage system
CN107301021A (en) * 2017-06-22 2017-10-27 郑州云海信息技术有限公司 It is a kind of that the method and apparatus accelerated to LUN are cached using SSD
JP2017208113A (en) * 2017-06-30 2017-11-24 ▲ホア▼▲ウェイ▼技術有限公司Huawei Technologies Co.,Ltd. Data storage method, data storage apparatus, and storage device

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021012169A1 (en) * 2019-07-22 2021-01-28 华为技术有限公司 Method of improving reliability of storage system, and related apparatus
US12066961B2 (en) 2019-07-22 2024-08-20 Huawei Technologies Co., Ltd. Method for improving reliability of storage system, and related apparatus
US12493571B2 (en) 2019-07-22 2025-12-09 Huawei Technologies Co., Ltd. Method for improving reliability of storage system, and related apparatus
CN111414321A (en) * 2020-02-24 2020-07-14 中国农业大学 A cache protection method and device based on dynamic mapping mechanism
CN111414321B (en) * 2020-02-24 2022-07-15 中国农业大学 A cache protection method and device based on dynamic mapping mechanism
CN112181705A (en) * 2020-10-12 2021-01-05 上海前瞻创新研究院有限公司 Management storage control method based on multiple controllers and storage equipment
CN112181705B (en) * 2020-10-12 2023-02-03 上海前瞻创新研究院有限公司 Management storage control method based on multiple controllers and storage equipment
CN112597079A (en) * 2020-12-22 2021-04-02 上海安路信息科技有限公司 Data write-back system of convolutional neural network accelerator
CN112597079B (en) * 2020-12-22 2023-10-17 上海安路信息科技股份有限公司 Data write-back system of convolutional neural network accelerator

Also Published As

Publication number Publication date
CN109739696B (en) 2022-05-13

Similar Documents

Publication Publication Date Title
CN105574104B (en) A kind of LogStructure storage system and its method for writing data based on ObjectStore
CN107943867B (en) High-performance hierarchical storage system supporting heterogeneous storage
EP3121703B1 (en) Data caching method, cache and computer system
US9152330B2 (en) NVRAM data organization using self-describing entities for predictable recovery after power-loss
CN104834607B (en) A kind of hit rate for improving distributed caching and the method for reducing solid state hard disc abrasion
CN109739696A (en) Double-control storage array solid state disk cache acceleration method
CN103150136B (en) Implementation method of least recently used (LRU) policy in solid state drive (SSD)-based high-capacity cache
CN103645859B (en) A kind of magnetic disk array buffer storage method of virtual SSD and SSD isomery mirror image
CN105872040A (en) Method for optimizing write performance of distributed block storage system by utilizing cache of gateway nodes
CN103885728A (en) Magnetic disk cache system based on solid-state disk
CN113553476B (en) Key value storage method for reducing write pause by utilizing hash
CN100362462C (en) Management Method of Disk Array Cache
WO2013071882A1 (en) Storage system and management method used for metadata of cluster file system
CN107615254A (en) The cache memory architectures and algorithm of blending objects storage device
CN102521330A (en) Mirror distributed storage method under desktop virtual environment
CN104850358A (en) Magnetic-optical-electric hybrid storage system and data acquisition and storage method thereof
CN107329696A (en) A kind of method and system for ensureing data corruption uniformity
JPWO2017149592A1 (en) Storage device
CN103106050A (en) Method for achieving layered storage and copy of data of storage system
CN111488125A (en) A Cache Tier cache optimization method based on Ceph cluster
US20260104817A1 (en) Random write instruction processing method, smr hard disk, and computer device
CN106527987A (en) Non-DRAM SSD master control reliability improving system and method
CN106227677A (en) A Method of Variable-Length Cache Metadata Management
CN106909323B (en) Page caching method suitable for DRAM/PRAM mixed main memory architecture and mixed main memory architecture system
CN102681792B (en) Solid-state disk memory partition method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant