Systems and methods for retaining and using data block signatures in data protection operations
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-003/06
G06F-011/14
출원번호
US-0074109
(2016-03-18)
등록번호
US-9639289
(2017-05-02)
발명자
/ 주소
Vijayan, Manoj Kumar
Attarde, Deepak Raghunath
출원인 / 주소
Commvault Systems, Inc.
대리인 / 주소
Knobbe, Martens, Olson & Bear, LLP
인용정보
피인용 횟수 :
10인용 특허 :
151
초록▼
A system according to certain embodiments associates a signature value corresponding to a data block with one or more data blocks and a reference to the data block to form a signature/data word corresponding to the data block. The system further logically organizes the signature/data words into a pl
A system according to certain embodiments associates a signature value corresponding to a data block with one or more data blocks and a reference to the data block to form a signature/data word corresponding to the data block. The system further logically organizes the signature/data words into a plurality of files each comprising at least one signature/data word such that the signature values are embedded in the respective file. The system according to certain embodiments reads a previously stored signature value corresponding to a respective data block for sending from a backup storage system having at least one memory device to a secondary storage system. Based on an indication as to whether the data block is already stored on the secondary storage system, the system reads the data block from the at least one memory device for sending to the secondary storage system if the data block does not exist on the secondary storage system, wherein the signature value and not the data block is read from the at least one memory device if the data block exists on the secondary storage system.
대표청구항▼
1. A method of performing a copy operation, the method comprising: copying at least a first file comprising data blocks from a first storage device to a second storage device to create a secondary copy of the file comprising secondary copy data blocks that are a copy of the data blocks from the firs
1. A method of performing a copy operation, the method comprising: copying at least a first file comprising data blocks from a first storage device to a second storage device to create a secondary copy of the file comprising secondary copy data blocks that are a copy of the data blocks from the first storage device on the second storage device, and creating a plurality of deduplication signatures for the secondary copy data blocks, creating embedded deduplication signatures for the secondary copy data blocks, the embedded deduplication signatures are physically or logically contiguously embedded in the secondary copy of the file with respect to the secondary copy data blocks, wherein each secondary copy data block has a deduplication signature associated therewith; andin response to a command to copy one or more of the secondary copy data blocks to a third storage device: transmitting, to the third storage device, the stored deduplication signatures embedded in the secondary copy of the file to the third storage device, wherein the stored deduplication signatures are transmitted to the third storage device without re-generating the value of the stored deduplication signatures;if the embedded deduplication signatures sent to the third storage device indicates that a copy of the one or more of the secondary copy data blocks is already stored on the third storage device, storing a reference to the copy of the one or more secondary copy data blocks stored on the third storage device instead of transmitting the one or more secondary copy data blocks to the third storage device; andif the embedded deduplication signatures sent to the third storage device indicates that the copy of the one or more of the secondary copy data blocks is not stored on the third storage device, accessing the one or more secondary copy data blocks from the second storage device and transmitting the one or more secondary copy data blocks to the third storage device. 2. The method of claim 1, wherein the one or more secondary copy data blocks is not read from the second storage device if the embedded deduplication signatures sent to the third storage device indicates that the one or more secondary copy data blocks exist on the third storage device. 3. The method of claim 1, wherein the third storage device maintains a deduplication signature table associated with the copy of the one or more secondary copy data blocks that exist on the third storage device. 4. The method of claim 1, wherein copying the one or more secondary storage data blocks from the second storage device to the third storage device is part of an auxiliary copy operation. 5. The method of claim 1, wherein the stored deduplication signatures are stored in a deduplication signature table. 6. The method of claim 1, wherein the secondary storage data blocks are at least 512 times larger than corresponding embedded deduplication signatures. 7. The method of claim 1, wherein the copy of the one or more of the secondary copy data blocks are stored in association with the embedded deduplication signatures on the third storage device. 8. A system that performs a copy operation, the system comprising: a first storage device that stores at least a first file comprising a plurality of data blocks;a second storage device that stores a secondary copy of the file comprising secondary copy data blocks that are a copy of the data blocks on the first storage device;a plurality of embedded deduplication signatures in the secondary copy of the file, the embedded deduplication signatures are physically or logically contiguously embedded in the secondary copy of the file with respect to the secondary copy data blocks, wherein each secondary copy data block has a deduplication signature associated therewith; anda third storage device that stores a copy of one or more of the secondary copy data blocks copied from the second storage device to the third storage device;computer hardware in communication with the first storage device and also in communication with the second storage device and the third storage device, the computer hardware implementing a copy manager that directs: transmitting the embedded deduplication signatures stored in association with the one or more secondary copy data blocks to the third storage device, wherein the stored deduplication signatures are transmitted to the third storage device without re-generating the value of the stored deduplication signatures;if the embedded deduplication signatures sent to the third storage device indicates that a copy of the one or more of the secondary copy data blocks is already stored on the third storage device, storing a reference to the copy of the one or more secondary copy data blocks stored on the third storage device instead of transmitting the one or more secondary copy data blocks to the third storage device; andif the embedded deduplication signatures sent to the third storage device indicates that the copy of the one or more of the secondary copy data blocks is not stored on the third storage device, accessing the one or more secondary copy data blocks from the second storage device and transmitting the one or more secondary copy data blocks to the third storage device. 9. The system of claim 8, wherein the one or more secondary copy data blocks is not read from the second storage device if the stored deduplication signatures sent to the third storage device indicates that the one or more secondary copy data blocks exist on the third storage device. 10. The system of claim 8, further comprising a deduplication signature table associated with the copy of the one or more secondary copy data blocks that exist on the third storage device. 11. The system of claim 8, wherein copying the one or more secondary storage data blocks from the second storage device to the third storage device is part of an auxiliary copy operation. 12. The system of claim 8, wherein the stored deduplication signatures are stored in a deduplication signature table. 13. The system of claim 8, wherein the secondary storage data blocks are at least 512 times larger than corresponding embedded deduplication signatures. 14. The system of claim 8, wherein the copy of the one or more of the secondary copy data blocks are stored in association with the stored deduplication signatures on the third storage device.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (151)
Ranade, Dilip Madhusudan; Shelat, Radha; Kabra, Navin, Adaptive caching for a distributed file sharing system.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
Griffin David (Maynard MA) Campbell Jonathan (Acton MA) Reilly Michael (Sterling MA) Rosenbaum Richard (Pepperell MA), Arrangement with cooperating management server node and network service node.
Nakano Toshio (Odawara JPX) Nozawa Masafumi (Odawara JPX) Kurano Akira (Odawara JPX) Hisano Kiyoshi (Odawara JPX) Hoshino Masayuki (Odawara JPX), Backup control method and system in data processing system using identifiers for controlling block data transfer.
Kitajima Hiroyuki (Yokohama) Yamamoto Akira (Yokohama) Doi Takashi (Hadano) Nozawa Masafumi (Odawara JPX), Buffered peripheral system and method for backing up and retrieving data to and from backup memory device.
Ludmila Cherkasova ; Martin F. Arlitt ; Richard J. Friedrich ; Tai Jin, Caching protocol method and system based on request frequency and relative storage duration.
Cole Leo J. (Raleigh NC) Frantz Curtis J. (Durham NC) Lee Jeannette (Raleigh NC) Ordanic Zvonimir (Raleigh NC) Plank Larry K. (Rochester MN), Centralized management in a computer network.
Carpenter Kelly S. (Fremont CA) Dearing Gerard M. (San Jose CA) Nick Jeffrey M. (Fishkill NY) Strickland Jimmy P. (Saratoga CA) Swanson Michael D. (Poughkeepsie NY) Wilkinson Wendell W. (Hyde Park NY, Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage.
Senator Steven T. ; Fuller Billy J., Computer system method and apparatus providing for various versions of a file without requiring data copy or log operati.
Fecteau Jean G. (Toronto NY CAX) Gdaniec Joseph M. (Vestal NY) Hennessy James P. (Endicott NY) MacDonald John F. (Vestal NY) Osisek Damian L. (Vestal NY), Computer system which supports asynchronous commitment of data.
Dunphy William E. (Westminster CO) Halladay Steven M. (Louisville CO) Moy Michael E. (Lafayette CO) Munro Frederick G. (Broomfield CO), Data storage and protection system.
Yanai Moshe (Framingham MA) Vishlitzky Natan (Brookline MA) Alterescu Bruno (Newton MA) Castel Daniel (Framingham MA) Shklarsky Gadi (Brookline MA), Data storage system controlled remote data mirroring with respectively maintained data indices.
Fortier Richard W. (Acton MA) Mastors Robert M. (Ayer MA) Taylor Tracy M. (Upton MA) Wallace John J. (Franklin MA), Digital data processor with improved backup storage.
Kenley Gregory (Northboro MA) Ericson George (Schrewsbury MA) Fortier Richard (Acton MA) Holland Chuck (Northboro MA) Mastors Robert (Ayer MA) Pownell James (Natick MA) Taylor Tracy (Upton MA) Wallac, Digital data storage system with improved data migration.
Christenson,Nikolai Paul; Fritchie,Scott Ernest Lystig; Larson,James Stephen, Electronic mail system with methodology providing distributed message store.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Lagueux, Jr., Richard A.; Stave, Joel H.; Yeaman, John B.; Stevens, Brian E.; Higgins, Robert M.; Collins, James M., Graphical user interface for configuration of a storage system.
Urevig Paul D. ; Malnati James R. ; Ethen Donald J. ; Weber Herbert L., Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed.
Cane David ; Hirschman David, High performance backup via selective file saving which can perform incremental backups and exclude files and uses a cha.
Barney Rock D. ; Schwols Keith ; Nelson Ellen M., Integration of a database into file management software for protecting, tracking and retrieving data.
Martin Charles W. (Richardson TX) Reid Fredrick S. (Plano TX) Forbus Gary L. (Dallas TX) Adams Steve M. (Plano TX) Shannon C. Patrick (Garland TX) Pirpich Eric A. (Garland TX), Mass data storage and retrieval system.
Kedem Nadav,ILX, Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information .
Long Robert M., Media element library with non-overlapping subset of media elements and non-overlapping subset of media element drives accessible to first host and unaccessible to second host.
Kullick Steven E. ; Spirakis Charles S. ; Titus Diane J., Method and apparatus for transferring archival data among an arbitrarily large number of computer devices in a networked.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Kern Ronald M. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated backup copy ordering in a time zero backup copy session.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Micka William F. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated termination and resumption in a time zero backup copy process.
Walter A. Hubis ; William G. Deitz, Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access .
Chron, Edward Gustav; Menon, Jaishankar Moothedath, Method and system for providing consistent data modification information to clients in a storage system.
Aoyama Yuki,JPX ; Takahashi Toru,JPX ; Wakayama Satoshi,JPX, Method of and an apparatus for displaying version information and configuration information and a computer-readable recording medium on which a version and configuration information display program i.
Haustein, Nils; Klein, Craig A.; Troppens, Ulf; Winarski, Daniel J., Method of and system for deduplicating backed up data in a client-server environment.
Wahlert, Brian M; Berkowitz, Brian T; van Ingen, Catharine; Rangegowda, Dharshan; Jazayeri, Mike, Method, system, and apparatus for creating saved searches and auto discovery groups for a data protection system.
Palliyil, Sudarshan; Venkateshamurthy, Shivakumara; Vijayaraghavan, Srinivas Belur; Aswathanarayana, Tejasvi, Methods, apparatus and computer programs for enhanced access to resources within a network.
Pisello Thomas (De Bary FL) Crossmier David (Casselberry FL) Ashton Paul (Oviedo FL), Network management system having virtual catalog overview of files distributively stored across network domain.
Prahlad, Anand; May, Andreas; Lunde, Norman R.; Zhou, Lixin; Kumar, Avinash; Ngo, David, Snapshot storage and management system with indexing and user interface.
Crockett Robert N. (Tucson AZ) Kern Ronald M. (Tucson AZ) Micka William F. (Tucson AZ), Software directed microcode state save for distributed storage controller.
Friend,John; Belshe,Michael; Collins,Roger; Bennett,Mike, System and method for full wireless synchronization of a data processing apparatus with a messaging system.
Mutalik Madhav ; Senie Faith M., System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map.
Moulton, Gregory Hagan, System and method for unorchestrated determination of data sequences using sticky byte factoring to determine breakpoints in digital sequences.
Patel, Sujal M.; Mikesell, Paul A., System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system.
Huai ReiJane (Old Brookville NY) Daly Robert (Ronkonkoma NY) Curti Walter (Dix Hills NY) Mohan Deepak (Huntington NY) Chueh James Kuang-Ru (Bayside NY) Louie Larry (Forest Hills NY), System and parallel streaming and data stripping to back-up a network.
Stoppani ; Jr. Peter (Woodinville WA), System for allocating storage spaces based upon required and optional service attributes having assigned piorities.
Bamford Roger J. (Woodside CA) Howard Forrest W. (Berkeley CA) Kabcenell Dirk A. (Portola Valley CA) Miner Robert N. (San Francisco CA), System for database integrity with multiple logs assigned to client subsets.
Flynn Rex A. (Belmont MA) Anick Peter G. (Marlboro MA), System for reconstructing prior versions of indexes using records indicating changes between successive versions of the.
Saether Christian D. (Seattle WA) Stoppani ; Jr. Peter (Woodinville WA), System of device independent file directories using a tag between the directories and file descriptors that migrate with.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for classifying and transferring information in a storage network.
Borghetti, Stefano; Sgro', Antonio Mario; Corte, Gianluca Della; Gianfagna, Leonida, Thread based view and archive for simple mail transfer protocol (SMTP) clients devices and methods.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.