Dedicated client-side signature generator in a networked storage system
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-017/30
G06F-011/14
출원번호
US-0067714
(2016-03-11)
등록번호
US-9858156
(2018-01-02)
발명자
/ 주소
Muller, Marcus S.
Ngo, David
출원인 / 주소
Commvault Systems, Inc.
대리인 / 주소
Knobbe, Martens, Olson & Bear, LLP
인용정보
피인용 횟수 :
6인용 특허 :
271
초록▼
A storage system according to certain embodiments includes a client-side signature repository that includes information representative of a set of data blocks stored in primary storage. During storage operations of a client, the system can generate signatures corresponding to data blocks that are be
A storage system according to certain embodiments includes a client-side signature repository that includes information representative of a set of data blocks stored in primary storage. During storage operations of a client, the system can generate signatures corresponding to data blocks that are being stored in primary storage. The system can store the generated signatures in the client-side signature repository along with information regarding the location of the corresponding data block within primary storage. As additional instances of the data block are stored in primary storage, the system can store the location of the additional instances in the client-side signature repository.
대표청구항▼
1. A method of maintaining a signature repository in a data storage system, the method comprising: tracking storage of a plurality of data units in a primary storage subsystem, the plurality of data units stored in a native format corresponding to one or more source applications, the primary storage
1. A method of maintaining a signature repository in a data storage system, the method comprising: tracking storage of a plurality of data units in a primary storage subsystem, the plurality of data units stored in a native format corresponding to one or more source applications, the primary storage subsystem in communication with a secondary storage subsystem that is separate from the primary storage subsystem and is configured to maintain secondary copies of at least some of the plurality of data units, the secondary copies stored in the secondary storage subsystem in a non-native format;generating, by a signature agent executing on one or more processors signatures corresponding to the plurality of data units in the primary storage subsystem during a copy operation to the secondary storage subsystem;maintaining a secondary storage signature repository in the secondary storage subsystem and a primary storage signature repository in the primary storage subsystem, wherein the secondary storage signature repository comprises signature blocks for one or more unique signatures associated with data units in the secondary storage subsystem;wherein the primary storage signature repository in the primary storage subsystem comprises signature blocks for one or more unique signatures of the generated signatures associated with data units in the primary storage subsystem, where the signature blocks in the primary storage signature repository comprise:the unique signature; andone or more data unit entries, each entry corresponding to at least one of the of the plurality of data units in the primary storage subsystem associated with the unique signature; andwherein when a first data unit stored in a first location in the primary storage subsystem has the same unique signature as a second data unit stored in a second location in the primary storage subsystem, modifying the associated signature block in the primary storage signature repository to comprise: a first data unit entry that identifies the first storage location in the primary storage subsystem, anda second data unit entry that identifies the second storage location in the primary storage subsystem. 2. The method of claim 1, further comprising storing in a signature block a first client identifier that identifies a first client device associated with the first data unit, and a second client identifier that identifies a second client device associated with the second data unit. 3. The method of claim 2, wherein the first client device uses a first data store in the primary storage subsystem that is different than a second data store used by the second client device. 4. The method of claim 1, further comprising: receiving a query including a plurality of signatures;comparing the plurality of signatures included in the query with signature blocks in the primary storage signature repository to identify a first set of signatures received in the query that correspond to data units that reside in a primary data store of at least one client computing device of the plurality of client computing devices; andfor at least some of the signatures in the first set of signatures, accessing the corresponding data units from the primary data store of the at least one client computing device. 5. The method of claim 4, further comprising accessing the corresponding data units from the secondary storage subsystem for the signatures included in the query that are not included in the first set of signatures. 6. The method of claim 4, wherein the plurality of signatures included in the query correspond to a set of data units which represent a backed up version of a set of the primary data that is to be restored to the first primary data store. 7. The method of claim 1, further comprising: in response to receipt of instructions to backup at least a subset of the plurality of data units in the primary storage subsystem, comparing a set of signatures corresponding to the subset of data units with entries in the primary storage signature repository;based at least in part on the comparing, identifying a set of matching data units that match the subset of data units; andaccessing the set of matching data units for retrieval. 8. The method of claim 6, further comprising: based at least in part on the comparing, identifying a first group of data units of the subset of data units that do not have a corresponding matching data unit; andcommunicating the first group of data units to the secondary storage subsystem. 9. The method of claim 1, wherein the secondary storage subsystem comprises deduplicated data. 10. The method of claim 1, wherein the primary data store of at least one of a plurality of client computing devices comprises deduplicated data. 11. A storage system, comprising: a signature repository agent executing on one or more processors,a primary storage subsystem that tracks storage of a plurality of data units stored in a native format in the primary storage subsystem, the plurality of data units corresponding to one or more source applications;a secondary storage subsystem in communication with the primary storage subsystem, the secondary storage subsystem is separate from the primary storage subsystem and maintains secondary copies of at least some of the plurality of data units, the secondary copies in the secondary storage subsystem stored in a non-native format; anda signature repository agent that generates signatures corresponding to the plurality of data units in the primary storage subsystem during a copy operation to the secondary storage subsystem, the signature repository agent further maintains a secondary storage signature repository in the secondary storage subsystem and a primary storage signature repository in the primary storage subsystem, wherein the secondary storage signature repository comprises signature blocks for one or more unique signatures associated with data units in the secondary storage subsystem;wherein the primary storage signature repository in the primary storage subsystem comprises signature blocks for one or more unique signatures of the generated signatures associated with data units in the primary storage subsystem, where the signature blocks in the primary storage signature respository comprises;the unique signature; andone or more data unit entries corresponding to at least one of the plurality of data units in the primary storage subsystem associated with the unique signature; andwherein when a first data unit stored in a first location in the primary storage subsystem has the same unique signature as a second data unit stored in a second location in the primary storage subsystem, the signature repository agent modifies the associated signature block in the primary storage signature repository to comprise: a first data unit entry that identifies the first storage location in the primary storage subsystem, anda second data unit entry that identifies the second storage location in the primary storage subsystem. 12. The system of claim 11, wherein the associated signature block further comprises a first client identifier that identifies a first client device associated with the first data unit, and a second client identifier that identifies a second client device associated with the second data unit. 13. The system of claim 12, wherein the first client device uses a first data store in the primary storage subsystem that is different than a second data store used by the second client device. 14. The system of claim 11, wherein the primary storage signature repository agent is further configured to: receive a query from the secondary storage subsystem, the query including a plurality of signatures;compare the plurality of signatures with signature blocks in the signature repository to identify a first set of signatures from the plurality of signatures that correspond to data units of the plurality of data units that reside in a primary data store of at least one client computing device of the plurality of client computing devices; andfor at least some signatures in the first set of signatures, request the corresponding data units from the at least one client computing device. 15. The system of claim 14, wherein the signature repository agent to accesses data units from the secondary storage subsystem for the signatures that are not included in the first set of signatures. 16. The system of claim 14, wherein the plurality of signatures included in the query correspond to a set of data units which represent a backed up version of a set of the primary data that is to be restored to the first primary data store. 17. The system of claim 11, wherein in response to receipt of instructions to backup at least a subset of the plurality of data units in the primary storage subsystem, the signature repository agent compares a set of signatures corresponding to the subset of data units with entries in the primary storage signature repository and based at least in part on the comparing, identifies a set of matching data units that match the subset of data units and accesses the set of matching data units for retrieval. 18. The system of claim 17, wherein based at least in part on the comparing, the signature repository agent identifies a first group of data units of the subset of data units that do not have a corresponding matching data unit, and communicates the first group of data units to the secondary storage subsystem. 19. The method of claim 11, wherein the secondary storage subsystem comprises deduplicated data. 20. The method of claim 11, wherein the primary data store of at least one of a plurality of client computing devices comprises deduplicated data.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (271)
Mitkar, Amit; Kumarasamy, Paramasivam; Kottomtharayil, Rajiv, Accessing a file system using tiered deduplication.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
Ofek,Yuval; Cakeljic,Zoran; Bitner,Haim; Galtzur,Sharon; Ish Shalom,Ariel J.; Kedem,Nadav; Krikler,Samuel; Arnon,Dan, Apparatus and methods for operating a computer storage system.
Griffin David (Maynard MA) Campbell Jonathan (Acton MA) Reilly Michael (Sterling MA) Rosenbaum Richard (Pepperell MA), Arrangement with cooperating management server node and network service node.
Nakano Toshio (Odawara JPX) Nozawa Masafumi (Odawara JPX) Kurano Akira (Odawara JPX) Hisano Kiyoshi (Odawara JPX) Hoshino Masayuki (Odawara JPX), Backup control method and system in data processing system using identifiers for controlling block data transfer.
Kitajima Hiroyuki (Yokohama) Yamamoto Akira (Yokohama) Doi Takashi (Hadano) Nozawa Masafumi (Odawara JPX), Buffered peripheral system and method for backing up and retrieving data to and from backup memory device.
Myers James J. (San Francisco CA) Wang Pong-Sheng (San Jose CA), CPU implemented method for backing up modified data sets in non-volatile store for recovery in the event of CPU failure.
Ludmila Cherkasova ; Martin F. Arlitt ; Richard J. Friedrich ; Tai Jin, Caching protocol method and system based on request frequency and relative storage duration.
Cole Leo J. (Raleigh NC) Frantz Curtis J. (Durham NC) Lee Jeannette (Raleigh NC) Ordanic Zvonimir (Raleigh NC) Plank Larry K. (Rochester MN), Centralized management in a computer network.
Carpenter Kelly S. (Fremont CA) Dearing Gerard M. (San Jose CA) Nick Jeffrey M. (Fishkill NY) Strickland Jimmy P. (Saratoga CA) Swanson Michael D. (Poughkeepsie NY) Wilkinson Wendell W. (Hyde Park NY, Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage.
Eric C. Peters ; Stanley Rabinowitz ; Herbert R. Jacobs ; Richard Baker Gillett, Jr. ; Peter J. Fasciano, Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner.
Senator Steven T. ; Fuller Billy J., Computer system method and apparatus providing for various versions of a file without requiring data copy or log operati.
Fecteau Jean G. (Toronto NY CAX) Gdaniec Joseph M. (Vestal NY) Hennessy James P. (Endicott NY) MacDonald John F. (Vestal NY) Osisek Damian L. (Vestal NY), Computer system which supports asynchronous commitment of data.
Van Huben Gary Alan ; Mueller Joseph Lawrence ; Siegel Michael Steven ; Warnock Thomas Bernard ; McDonald Darryl James, Data management system and process.
Prahlad, Anand; Muller, Marcus S.; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj, Data object store and server for a cloud storage environment, including data deduplication and data management across multiple cloud storage sites.
Dunphy William E. (Westminster CO) Halladay Steven M. (Louisville CO) Moy Michael E. (Lafayette CO) Munro Frederick G. (Broomfield CO), Data storage and protection system.
Yanai Moshe (Framingham MA) Vishlitzky Natan (Brookline MA) Alterescu Bruno (Newton MA) Castel Daniel (Framingham MA) Shklarsky Gadi (Brookline MA), Data storage system controlled remote data mirroring with respectively maintained data indices.
Fortier Richard W. (Acton MA) Mastors Robert M. (Ayer MA) Taylor Tracy M. (Upton MA) Wallace John J. (Franklin MA), Digital data processor with improved backup storage.
Kenley Gregory (Northboro MA) Ericson George (Schrewsbury MA) Fortier Richard (Acton MA) Holland Chuck (Northboro MA) Mastors Robert (Ayer MA) Pownell James (Natick MA) Taylor Tracy (Upton MA) Wallac, Digital data storage system with improved data migration.
Ashton Lyn Lequam ; Pearson Anthony Steve ; Pence Jerry Wayne ; West Stephen Charles, Dynamic reconfiguration of data storage devices to balance recycle throughput.
Christenson,Nikolai Paul; Fritchie,Scott Ernest Lystig; Larson,James Stephen, Electronic mail system with methodology providing distributed message store.
Belsan Jay S. (Nederland CO) Laughlin Jeffrey S. (Nederland CO) Pedersen Mogens H. (Longmont CO) Raicer Robert J. (Niwot CO) Rudeseal George A. (Boulder CO) Schafer Charles P. (Louisville CO) Steele , File server having snapshot application data groups.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Lagueux, Jr., Richard A.; Stave, Joel H.; Yeaman, John B.; Stevens, Brian E.; Higgins, Robert M.; Collins, James M., Graphical user interface for configuration of a storage system.
Urevig Paul D. ; Malnati James R. ; Ethen Donald J. ; Weber Herbert L., Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G.; May,Andreas; Schwartz,Jeremy, Hierarchical systems and methods for providing a unified view of storage information.
Cane David ; Hirschman David, High performance backup via selective file saving which can perform incremental backups and exclude files and uses a cha.
Dechant Thomas E. (Bainbridge OH) Glaser Edward L. (Santa Monica CA) Pitt Paul E. (Santa Monica CA) Way Frederick (Cleveland Heights OH), Information storage and retrieval system.
Barney Rock D. ; Schwols Keith ; Nelson Ellen M., Integration of a database into file management software for protecting, tracking and retrieving data.
Oshinsky, David Alan; Ignatius, Paul; Prahlad, Anand; May, Andreas, Logical view and access to data managed by a modular data and storage management system.
Ignatius, Paul; Theisen, Marjorie H.; Oshinsky, David Alan; Kavuri, Srinivas, Logical view and access to physical storage in modular data and storage management system.
Prahlad,Anand; De Meno,Randy; Schwartz,Jeremy A.; McGuigan,James J., Logical view with granular access to exchange data managed by a modular data and storage management system.
Martin Charles W. (Richardson TX) Reid Fredrick S. (Plano TX) Forbus Gary L. (Dallas TX) Adams Steve M. (Plano TX) Shannon C. Patrick (Garland TX) Pirpich Eric A. (Garland TX), Mass data storage and retrieval system.
Kedem Nadav,ILX, Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information .
Long Robert M., Media element library with non-overlapping subset of media elements and non-overlapping subset of media element drives accessible to first host and unaccessible to second host.
Kullick Steven E. ; Spirakis Charles S. ; Titus Diane J., Method and apparatus for transferring archival data among an arbitrarily large number of computer devices in a networked.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Kern Ronald M. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated backup copy ordering in a time zero backup copy session.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Micka William F. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated termination and resumption in a time zero backup copy process.
Walter A. Hubis ; William G. Deitz, Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access .
Pachet,Francois; Cazaly,Daniel; Roy,Pierre, Method and system for generating sequencing information representing a sequence of items selected in a database.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S.; Gokhale, Parag; Kottomtharayil, Rajiv, Method and system for offline indexing of content and classifying stored data.
Chron, Edward Gustav; Menon, Jaishankar Moothedath, Method and system for providing consistent data modification information to clients in a storage system.
Aoyama Yuki,JPX ; Takahashi Toru,JPX ; Wakayama Satoshi,JPX, Method of and an apparatus for displaying version information and configuration information and a computer-readable recording medium on which a version and configuration information display program i.
Haustein, Nils; Klein, Craig A.; Troppens, Ulf; Winarski, Daniel J., Method of and system for deduplicating backed up data in a client-server environment.
Wahlert, Brian M; Berkowitz, Brian T; van Ingen, Catharine; Rangegowda, Dharshan; Jazayeri, Mike, Method, system, and apparatus for creating saved searches and auto discovery groups for a data protection system.
Palliyil, Sudarshan; Venkateshamurthy, Shivakumara; Vijayaraghavan, Srinivas Belur; Aswathanarayana, Tejasvi, Methods, apparatus and computer programs for enhanced access to resources within a network.
Crescenti,John; Kavuri,Srinivas; Oshinsky,David Alan; Prahlad,Anand, Modular backup and retrieval system used in conjunction with a storage area network.
Pisello Thomas (De Bary FL) Crossmier David (Casselberry FL) Ashton Paul (Oviedo FL), Network management system having virtual catalog overview of files distributively stored across network domain.
Prahlad, Anand; May, Andreas; Lunde, Norman R.; Zhou, Lixin; Kumar, Avinash; Ngo, David, Snapshot storage and management system with indexing and user interface.
Crockett Robert N. (Tucson AZ) Kern Ronald M. (Tucson AZ) Micka William F. (Tucson AZ), Software directed microcode state save for distributed storage controller.
Retnamma,Manoj Vijayan; Amarendran,Arun; Kottomtharayil,Rajiv, System and method for combining data streams in pipelined storage operations in a storage network.
Kottomtharayil,Rajiv; Gokhale,Parag; Prahlad,Anand; Vijayan Retnamma,Manoj Kumar; Ngo,David; Devassy,Varghese, System and method for dynamically performing storage operations in a computer network.
Kottomtharayil,Rajiv; Gokhale,Parag; Prahlad,Anand; Vijayan Retnamma,Manoj Kumar; Ngo,David; Devassy,Varghese, System and method for dynamically sharing media in a computer network.
Friend,John; Belshe,Michael; Collins,Roger; Bennett,Mike, System and method for full wireless synchronization of a data processing apparatus with a messaging system.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahual; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahual; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahul S.; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahul S.; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Mutalik Madhav ; Senie Faith M., System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map.
Moulton, Gregory Hagan, System and method for unorchestrated determination of data sequences using sticky byte factoring to determine breakpoints in digital sequences.
Patel, Sujal M.; Mikesell, Paul A., System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system.
Huai ReiJane (Old Brookville NY) Daly Robert (Ronkonkoma NY) Curti Walter (Dix Hills NY) Mohan Deepak (Huntington NY) Chueh James Kuang-Ru (Bayside NY) Louie Larry (Forest Hills NY), System and parallel streaming and data stripping to back-up a network.
Stoppani ; Jr. Peter (Woodinville WA), System for allocating storage spaces based upon required and optional service attributes having assigned piorities.
Bamford Roger J. (Woodside CA) Howard Forrest W. (Berkeley CA) Kabcenell Dirk A. (Portola Valley CA) Miner Robert N. (San Francisco CA), System for database integrity with multiple logs assigned to client subsets.
Capozzi ; Anthony J. ; Cordi ; Vincent A. ; Edson ; Bruce A., System for facilitating the copying back of data in disc and tape units of a memory hierarchial system.
Flynn Rex A. (Belmont MA) Anick Peter G. (Marlboro MA), System for reconstructing prior versions of indexes using records indicating changes between successive versions of the.
Saether Christian D. (Seattle WA) Stoppani ; Jr. Peter (Woodinville WA), System of device independent file directories using a tag between the directories and file descriptors that migrate with.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for classifying and transferring information in a storage network.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G.; May,Andreas; Schwartz,Jeremy, Systems and methods for generating a storage-related metric.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G; May,Andreas; Schwartz,Jeremy, Systems and methods for storage modeling and costing.
Prahlad, Anand; Schwartz, Jeremy Alan; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for using metadata to enhance data identification operations.
Prahlad, Anand; Schwartz, Jeremy Alan; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for using metadata to enhance data management operations.
Borghetti, Stefano; Sgro', Antonio Mario; Corte, Gianluca Della; Gianfagna, Leonida, Thread based view and archive for simple mail transfer protocol (SMTP) clients devices and methods.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.