Efficiently storing and retrieving data and metadata
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-017/30
G06F-003/06
출원번호
US-0697409
(2015-04-27)
등록번호
US-9569518
(2017-02-14)
발명자
/ 주소
Sasson, Ben
Shalev, Ori
출원인 / 주소
INTERNATIONAL BUSINESS MACHINES CORPORATION
대리인 / 주소
Griffiths & Seaton PLLC
인용정보
피인용 횟수 :
0인용 특허 :
7
초록▼
For efficiently storing and retrieving data and metadata in phases, in a first phase, metadata tokens, which are assigned to metadata-emitting entities, are used for storing the data and the metadata together in a single input/output operation while piggybacking the metadata of least active metadata
For efficiently storing and retrieving data and metadata in phases, in a first phase, metadata tokens, which are assigned to metadata-emitting entities, are used for storing the data and the metadata together in a single input/output operation while piggybacking the metadata of least active metadata-emitting entities onto one of the metadata-emitting entities having one of the metadata tokens. In a second phase, the metadata is re-written to a metadata delta journal for reclaiming the metadata tokens. In a third phase, the metadata journal is applied to a metadata structure containing the metadata of the storage system, the metadata delta journal is then cleared after successfully updating the main metadata structure with the metadata of the metadata journal. The metadata journal is swapped with an empty metadata journal for concurrently adding metadata while retaining the metadata journal until applying the metadata delta journal to the metadata structure.
대표청구항▼
1. A method for efficiently storing and retrieving data and metadata in a plurality of phases in a storage system using a processor device, the method comprising: in a first phase, using metadata tokens assigned to metadata-emitting entities for storing the data and the metadata together in a single
1. A method for efficiently storing and retrieving data and metadata in a plurality of phases in a storage system using a processor device, the method comprising: in a first phase, using metadata tokens assigned to metadata-emitting entities for storing the data and the metadata together in a single input/output (I/O) operation while piggybacking the metadata of least active metadata-emitting entities onto one of the metadata-emitting entities having one of the metadata tokens. 2. The method of claim 1, wherein the metadata tokens are assigned to the most active metadata-emitting entities. 3. The method of claim 1, wherein the metadata tokens are limited in numbers and each are included in an active token set. 4. The method of claim 1, further including, in a second phase, re-writing the metadata to a metadata delta journal for reclaiming the metadata tokens. 5. The method of claim 4, further including, performing in a third phase at least one of: applying the metadata delta journal to a main metadata structure containing the metadata of the storage system,clearing the metadata delta journal after successfully updating the main metadata structure with the metadata of the metadata delta journal, andswapping the metadata delta journal with an empty metadata delta journal for concurrently adding metadata while retaining the metadata delta journal until applying the metadata delta journal to the main metadata structure. 6. The method of claim 2, further including, performing at least one of: sending a notification to the least most active metadata-emitting entities indicating the metadata that was piggybacking onto one of the most active metadata-emitting entities has been successfully stored, andif one of the metadata tokens has been revoked, notifying a pending revoke metadata token process that is waiting for one of the metadata tokens to become available. 7. The method of claim 5, further including, for one of loading and recovering the metadata from crash operation, performing at least one of: loading the main metadata structure into a memory,reading the metadata delta journal,applying the metadata delta journal to the main metadata structure, wherein if the metadata delta journal has been at least partially applied to the main metadata structure, performing at least one of: applying the metadata elements twice in the same order, wherein the metadata supports a double replay, anddetecting the metadata which has been previously applied to the main metadata structure, and only applying the metadata from the metadata delta journal which has not been previously applied,reading each of the metadata tokens and the metadata from locations associated with the metadata tokens,sorting the metadata in a chronological order according to a time of creation, andappending the metadata to a next update to the metadata delta journal. 8. The method of claim 2, further including, for piggybacking the metadata of least active metadata-emitting entities onto one of the most active metadata-emitting entities having one of the metadata tokens, selecting one of the most active metadata-emitting entities that is closest to issuing a write operation. 9. The method of claim 8, further including performing one of: revoking one of the metadata tokens from one of the most active metadata-emitting entities that has become less active, andswapping an active set of the metadata tokens with a new active set of the metadata tokens. 10. The method of claim 9, further including, for revoking one of the metadata tokens, performing one of: marking the one of the metadata tokens as invalid to prohibit use by the metadata,waiting for any active metadata write operations to complete,ensuring the metadata that is written reach a second phase by appending the metadata to the metadata delta journal,selecting an alternative one of the most active metadata-emitting entities, which is waiting for one of the metadata tokens to be assigned, for assigning the one of the metadata tokens that is revoked, andupdating an active token set with a new assignment of the metadata tokens. 11. The method of claim 9, further including, for swapping the active set of the metadata tokens with the new active set of the metadata tokens, performing one of: executing a revoke metadata token process for each one of the metadata tokens that are not part of the new active set of the metadata tokens,waiting for each of the metadata tokens that are revoked to be completed,writing the new active set of the metadata tokens to the metadata delta journal,updating an active token set pointer to a location of the new active set of the metadata tokens, andrevalidate each of the metadata tokens that are invalid on the new active set of the metadata tokens.
Brief David,ILX ; Fensore David J. ; Waterson Kent Bruce ; Dean Gregory Lewis, Apparatus and method for handling universal serial bus control transfers.
Dickey, Selwyn David; Klubertanz, Timothy John; McCright, Ginny Mahrer; Palm, Jeffrey William, Data storage performance enhancement through a write activity level metric recorded in high performance block storage metadata.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.