JP7645557B2 - ブロックチェーンに基づくデータ高速処理装置及び方法 - Google Patents
ブロックチェーンに基づくデータ高速処理装置及び方法 Download PDFInfo
- Publication number
- JP7645557B2 JP7645557B2 JP2023069824A JP2023069824A JP7645557B2 JP 7645557 B2 JP7645557 B2 JP 7645557B2 JP 2023069824 A JP2023069824 A JP 2023069824A JP 2023069824 A JP2023069824 A JP 2023069824A JP 7645557 B2 JP7645557 B2 JP 7645557B2
- Authority
- JP
- Japan
- Prior art keywords
- value
- file
- index
- key
- blockchain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2246—Trees, e.g. B+trees
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2272—Management thereof
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/235—Update request formulation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/901—Indexing; Data structures therefor; Storage structures
- G06F16/9024—Graphs; Linked lists
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
- H04L9/0816—Key establishment, i.e. cryptographic processes or cryptographic protocols whereby a shared secret becomes available to two or more parties, for subsequent use
- H04L9/0819—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s)
- H04L9/083—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP]
- H04L9/0833—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP] involving conference or group key
- H04L9/0836—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP] involving conference or group key using tree structure or hierarchical structure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/50—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols using hash chains, e.g. blockchains or hash trees
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Description
100 キー管理部
200 バリュー管理部
Claims (2)
- ブロックチェーンに基づくデータ高速処理装置において、
<キー>:<バリュー>のペアのうちのキーを管理するキー管理部と、
<キー>:<バリュー>のペアのうちのバリューをValue Logファイルに格納して管理するバリュー管理部と、を含み、
前記キー管理部は、
<キー>と<索引(IX)>をDKI(direct key index)ファイルに登録し、
前記<索引(IX)>は、Value Indexファイルに格納し、
前記<索引(IX)>は、<キー>に対応する<バリュー>の位置情報であるFid,Offset及びEntrySizeを含み、
<キー>を用いてDKI(direct key index)ファイルから<索引(IX)>を探し出し、
前記<索引(IX)>を用いてValue Indexファイルから<バリュー>の位置情報を探し出し、
前記<バリュー>の位置情報のFidに該当するValue Logファイルを探し出し、前記Value Logファイルにおいて定められた方式のオフセットOffsetを計算した後、エントリーサイズEntrySizeに見合う分のデータを読み込んで、<バリュー>を照会し、
前記DKI(direct key index)ファイル及びValue IndexファイルはB+木資料構造型であり、
前記Value LogファイルはLSM木資料構造型である
ことを特徴とするブロックチェーンに基づくデータ高速処理装置。 - ブロックチェーンに基づくデータ高速処理装置がコンピューターで実現され得る方法において、
<キーKey>:<バリューvalue>の書き込み/読み込みを行う際、
状態はアクティブ(Active)、不変(Immutable)、及びフラッシュト(Flushed)のうちのいずれか一つであり、
同じデータをログ先行書き込み(WAL)ファイルとメモリー(MEMTable)の上に重複して格納し、
アクティブ(Active)状態のMEMTableとWALファイルを一定のサイズに設定し、
アクティブ(Active)状態のMEMTableの設定サイズが上限に達すると、MEMTableとWALファイルを不変(Immutable)のMEMTableに登録し、不変(Immutable)の状態に設定し、
不変(Immutable)状態のMEMTableとWALファイルを非同期的にValue IndexファイルとValue Logファイルへ移した後、削除し、
フラッシュト(Flushed)状態であるValue LogファイルにはバリューValueを格納し、バリューValueの検索情報であるエントリーEntryを索引IXとともにValue Indexファイルに格納し、
<キーKey>:<索引IX>をDKIファイル(Direct Key Index File)に登録し、
前記DKIファイル(Direct Key Index File)及びValue IndexファイルはB+木資料構造型であり、
前記Value LogファイルはLSM木資料構造型である
ことを特徴とするブロックチェーンに基づくデータ高速処理方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR10-2022-0123759 | 2022-09-28 | ||
| KR1020220123759A KR102917073B1 (ko) | 2022-09-28 | 2022-09-28 | 블록체인 기반 데이터 고속 처리 장치 및 방법 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2024049305A JP2024049305A (ja) | 2024-04-09 |
| JP7645557B2 true JP7645557B2 (ja) | 2025-03-14 |
Family
ID=90140549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2023069824A Active JP7645557B2 (ja) | 2022-09-28 | 2023-04-21 | ブロックチェーンに基づくデータ高速処理装置及び方法 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US12013833B2 (ja) |
| JP (1) | JP7645557B2 (ja) |
| KR (1) | KR102917073B1 (ja) |
| GB (1) | GB2622906B (ja) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109285005A (zh) | 2018-08-16 | 2019-01-29 | 北京京东尚科信息技术有限公司 | 区块链的拆分处理方法、装置、区块链节点及存储介质 |
| CN109407979A (zh) | 2018-09-27 | 2019-03-01 | 清华大学 | 多线程持久性b+树数据结构设计与实现方法 |
| US20200167345A1 (en) | 2019-07-31 | 2020-05-28 | Alibaba Group Holding Limited | Method and apparatus for storing blockchain state data and electronic device |
| US20200242103A1 (en) | 2019-01-24 | 2020-07-30 | EMC IP Holding Company LLC | Storing a non-ordered associative array of pairs using an append-only storage medium |
| US10885022B1 (en) | 2019-09-12 | 2021-01-05 | Advanced New Technologies Co., Ltd. | Log-structured storage systems |
| JP2021531564A (ja) | 2018-12-26 | 2021-11-18 | バイドゥ オンライン ネットワーク テクノロジー (ベイジン) カンパニー リミテッド | データ記憶方法、装置、機器及び記憶媒体 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109726206B (zh) | 2018-12-26 | 2021-03-30 | 百度在线网络技术(北京)有限公司 | 区块链节点的数据处理方法、装置、设备和存储介质 |
| CN109684334A (zh) | 2018-12-26 | 2019-04-26 | 百度在线网络技术(北京)有限公司 | 键值对存储系统的数据存储方法、装置、设备和存储介质 |
| CN110347660B (zh) | 2019-06-28 | 2020-08-11 | 阿里巴巴集团控股有限公司 | 基于区块链的分级存储方法及装置、电子设备 |
| EP3673376B1 (en) | 2019-09-12 | 2022-11-30 | Advanced New Technologies Co., Ltd. | Log-structured storage systems |
| WO2021174499A1 (zh) | 2020-03-05 | 2021-09-10 | 合肥达朴汇联科技有限公司 | 一种基于区块链的数据验证方法、装置及系统 |
| CN112988761B (zh) | 2021-05-07 | 2022-04-08 | 支付宝(杭州)信息技术有限公司 | 区块链数据存储方法及装置、电子设备 |
-
2022
- 2022-09-28 KR KR1020220123759A patent/KR102917073B1/ko active Active
- 2022-10-26 US US17/974,026 patent/US12013833B2/en active Active
-
2023
- 2023-03-21 GB GB2304089.2A patent/GB2622906B/en active Active
- 2023-04-21 JP JP2023069824A patent/JP7645557B2/ja active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109285005A (zh) | 2018-08-16 | 2019-01-29 | 北京京东尚科信息技术有限公司 | 区块链的拆分处理方法、装置、区块链节点及存储介质 |
| CN109407979A (zh) | 2018-09-27 | 2019-03-01 | 清华大学 | 多线程持久性b+树数据结构设计与实现方法 |
| JP2021531564A (ja) | 2018-12-26 | 2021-11-18 | バイドゥ オンライン ネットワーク テクノロジー (ベイジン) カンパニー リミテッド | データ記憶方法、装置、機器及び記憶媒体 |
| US20200242103A1 (en) | 2019-01-24 | 2020-07-30 | EMC IP Holding Company LLC | Storing a non-ordered associative array of pairs using an append-only storage medium |
| US20200167345A1 (en) | 2019-07-31 | 2020-05-28 | Alibaba Group Holding Limited | Method and apparatus for storing blockchain state data and electronic device |
| US10885022B1 (en) | 2019-09-12 | 2021-01-05 | Advanced New Technologies Co., Ltd. | Log-structured storage systems |
Also Published As
| Publication number | Publication date |
|---|---|
| US20240104078A1 (en) | 2024-03-28 |
| US12013833B2 (en) | 2024-06-18 |
| JP2024049305A (ja) | 2024-04-09 |
| GB2622906A (en) | 2024-04-03 |
| KR20240044230A (ko) | 2024-04-04 |
| GB2622906B (en) | 2024-11-20 |
| KR102917073B1 (ko) | 2026-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110825748B (zh) | 利用差异化索引机制的高性能和易扩展的键值存储方法 | |
| JP6639420B2 (ja) | フラッシュ最適化データ・レイアウトのための方法、フラッシュ最適化記憶のための装置、およびコンピュータ・プログラム | |
| US8161240B2 (en) | Cache management | |
| CN103902623B (zh) | 用于在存储系统上存取文件的方法和系统 | |
| CN102722449B (zh) | 基于SSD的Key-Value型本地存储方法及系统 | |
| US9996557B2 (en) | Database storage system based on optical disk and method using the system | |
| US9418094B2 (en) | Method and apparatus for performing multi-stage table updates | |
| US7689574B2 (en) | Index and method for extending and querying index | |
| CN104424219B (zh) | 一种数据文件的管理方法及装置 | |
| JP2006018632A (ja) | リレーショナルデータベースのインデックス追加プログラム,インデックス追加装置及びインデックス追加方法 | |
| WO2012083754A1 (zh) | 处理脏数据的方法及装置 | |
| WO2012169102A1 (ja) | データベース性能予測装置及びデータベース予測方法 | |
| CN113535670A (zh) | 一种虚拟化资源镜像存储系统及其实现方法 | |
| WO2025236959A1 (zh) | 分布式数据库的数据备份、恢复、查询方法及装置 | |
| CN102467523A (zh) | 索引文件的建立方法与利用索引文件查询数据区块的方法 | |
| CN111124258B (zh) | 全闪存阵列的数据存储方法、装置、设备及可读存储介质 | |
| Fevgas et al. | LB-Grid: An SSD efficient grid file | |
| CN108182244B (zh) | 一种基于多层次列式存储结构的时序数据存储方法 | |
| US10585802B1 (en) | Method and system for caching directories in a storage system | |
| JP7645557B2 (ja) | ブロックチェーンに基づくデータ高速処理装置及び方法 | |
| He et al. | Read as Needed: Building {WiSER}, a {Flash-Optimized} Search Engine | |
| JP2014130492A (ja) | インデックスの生成方法及び計算機システム | |
| KR20240044231A (ko) | Dki 기반 데이터 고속 처리 장치 및 방법 | |
| GB2504894B (en) | Data storage system | |
| WO2011099114A1 (ja) | ハイブリッド型データベースシステム及びその動作方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20230421 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20240625 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240925 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20241119 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20241128 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20250204 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20250225 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 7645557 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |