Distributed metadata servers for cluster file systems using shared low latency persistent key-value metadata store
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-017/30
G06F-011/14
출원번호
US-0663634
(2015-03-20)
등록번호
US-9852146
(2017-12-26)
발명자
/ 주소
Bent, John M.
Faibish, Sorin
Pedone, Jr., James M.
Tzelnic, Percy
Ting, Dennis P. J.
Ionkov, Latchesar A.
Grider, Gary
출원인 / 주소
EMC IP Holding Company LLC
대리인 / 주소
Ryan, Mason & Lewis, LLP
인용정보
피인용 횟수 :
2인용 특허 :
8
초록▼
A cluster file system is provided having a plurality of distributed metadata servers with shared access to one or more shared low latency persistent key-value metadata stores. A metadata server comprises an abstract storage interface comprising a software interface module that communicates with at l
A cluster file system is provided having a plurality of distributed metadata servers with shared access to one or more shared low latency persistent key-value metadata stores. A metadata server comprises an abstract storage interface comprising a software interface module that communicates with at least one shared persistent key-value metadata store providing a key-value interface for persistent storage of key-value metadata. The software interface module provides the key-value metadata to the at least one shared persistent key-value metadata store in a key-value format. The shared persistent key-value metadata store is accessed by a plurality of metadata servers. A metadata request can be processed by a given metadata server independently of other metadata servers in the cluster file system. A distributed metadata storage environment is also disclosed that comprises a plurality of metadata servers having an abstract storage interface to at least one shared persistent key-value metadata store.
대표청구항▼
1. A metadata server, comprising: at least one hardware device configured to provide an abstract storage interface comprising a software interface module that communicates with at least one shared persistent key-value metadata store providing a key-value interface for persistent storage of key-value
1. A metadata server, comprising: at least one hardware device configured to provide an abstract storage interface comprising a software interface module that communicates with at least one shared persistent key-value metadata store providing a key-value interface for persistent storage of key-value metadata, wherein said software interface module provides said key-value metadata to said at least one shared persistent key-value metadata store in a key-value format,wherein said shared persistent key-value metadata store is partitioned across a plurality of metadata servers and wherein a metadata request affecting multiple partitions of the namespace is processed by said metadata server independently of other metadata servers in said plurality of metadata servers. 2. The metadata server of claim 1, wherein said abstract storage interface provides a storage-specific interface for said at least one shared persistent key-value metadata store. 3. The metadata server of claim 1, wherein said software interface module processes at least one batch operation for processing metadata. 4. The metadata server of claim 1, wherein said metadata request is further processed by locking one or more directories in a namespace affected by said metadata request. 5. The metadata server of claim 4, wherein said locking of said one or more directories is performed using an atomic locking operation. 6. The metadata server of claim 4, wherein said locking of said one or more directories employs a failure detection mechanism to unlock said one or more directories if said metadata server processing said metadata request fails. 7. The metadata server of claim 4, wherein said metadata request from a file system client is processed by any of said plurality of metadata servers that are connected to a compute node that executes said file system client. 8. The metadata server of claim 1, wherein a processor in said shared persistent key-value metadata store performs one or more of index building, reorganization, resorting, deduplication and compression of said key-value metadata. 9. The metadata server of claim 1, wherein a key of a given key-value metadata item identifies a locked portion of the namespace and a value of the given key-value metadata identifies a particular metadata server holding the lock. 10. A distributed metadata storage environment, comprising: a plurality of compute nodes, wherein at least one of said compute nodes comprises a file system client that generates at least one metadata request;a plurality of metadata servers connected to said plurality of compute nodes using at least one network, wherein each of said plurality of metadata servers comprises an abstract storage interface comprising a software interface module that communicates with at least one shared persistent key-value metadata store providing a key-value interface for persistent storage of key-value metadata, wherein said software interface module provides said key-value metadata to said at least one shared persistent key-value metadata store in a key-value format,wherein said shared persistent key-value metadata store is partitioned across said plurality of said metadata servers and wherein a metadata request affecting multiple partitions of the namespace is processed by one of said metadata servers independently of other metadata servers in said plurality of metadata servers. 11. The distributed metadata storage environment of claim 10, wherein said abstract storage interface provides a storage-specific interface for said at least one shared persistent key-value metadata store. 12. The distributed metadata storage environment of claim 10, wherein said at least one metadata request is processed by locking one or more directories in a namespace affected by said metadata request using an atomic locking operation. 13. The distributed metadata storage environment of claim 10, wherein said metadata request from said file system client is processed by any one of said plurality of metadata servers that are connected to a compute node that executes said file system client. 14. The distributed metadata storage environment of claim 10, wherein a processor in said shared persistent key-value metadata store performs one or more of index building, reorganization, resorting, deduplication and compression of said key-value metadata. 15. The distributed metadata storage environment of claim 10, wherein a key of a given key-value metadata item identifies a locked portion of the namespace and a value of the given key-value metadata identifies a particular metadata server holding the lock. 16. A method performed by a metadata server in a distributed metadata storage environment, comprising the steps of: providing an abstract storage interface comprising a software interface module that communicates with at least one shared persistent key-value metadata store providing a key-value interface for persistent storage of key-value metadata, wherein said software interface module provides said key-value metadata to said at least one shared persistent key-value metadata store in a key-value format, wherein said shared persistent key-value metadata store is partitioned across a plurality of metadata servers;obtaining a metadata request from at least one file system client, wherein said metadata request affects multiple partitions of the namespace and is processed by one of said metadata servers independently of other metadata servers in said plurality of metadata servers; andprocessing said metadata request using said at least one shared persistent key-value metadata store using said key-value interface. 17. The method of claim 16, wherein said metadata request is processed by any one of said plurality of metadata servers that are connected to a compute node that executes said at least one file system client. 18. The method of claim 16, wherein said step of processing said metadata request further comprises a step of locking one or more directories in a namespace affected by said metadata request using an atomic locking operation. 19. A tangible machine-readable recordable storage medium, wherein one or more software programs when executed by one or more processing devices implement the steps of the method of claim 16. 20. The method of claim 16, wherein a key of a given key-value metadata item identifies a locked portion of the namespace and a value of the given key-value metadata identifies a particular metadata server holding the lock.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (8)
Nguyen, Long X., Asynchronous and idempotent distributed lock interfaces.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Pandey, Prashant; Sivasubramanian, Swaminathan; Shams, Khawaja Salman; Zaki, Omer Ahmed; Yanacek, David Craig; Olson, Johanna S; de Kock, Hendrik Jacobus; Wu, Johnny Ying; Gupta, Aanchal, Local emulation of distributed key-value data store.
Bent, John M.; Faibish, Sorin; Grider, Gary, Distributed metadata servers in a file system with separate metadata servers for file metadata and directory metadata.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.