A content alignment system according to certain embodiments aligns a sliding window at the beginning of a data segment. The content alignment system performs a block alignment function on the data within the sliding window. A deduplication block is established if the output of the block alignment fu
A content alignment system according to certain embodiments aligns a sliding window at the beginning of a data segment. The content alignment system performs a block alignment function on the data within the sliding window. A deduplication block is established if the output of the block alignment function meets a predetermined criteria. At least part of a gap is established if the output of the block alignment function does not meet the predetermined criteria. The predetermined criteria is changed if a threshold number of outputs fail to meet the predetermined criteria.
대표청구항▼
1. A method for defining deduplication block alignments within a data segment, the method comprising: iteratively performing a block alignment function on data within a sliding window in the data segment and, for each iterative performance of the block alignment function: in response to determining
1. A method for defining deduplication block alignments within a data segment, the method comprising: iteratively performing a block alignment function on data within a sliding window in the data segment and, for each iterative performance of the block alignment function: in response to determining that an output of the block alignment function performed on a current window of data satisfies one or more predetermined criteria: establishing, with one or more computer processors, a deduplication data block having a predetermined block size; andmoving the sliding window relative to the data segment by an amount based at least in part on the predetermined block size before performing a next consecutive iteration; andin response to determining that the output of the block alignment function performed on the current window of data does not satisfy the one or more predetermined criteria: moving the sliding window relative to the data segment by an incremental amount that is distinct from the predetermined block size before performing the next consecutive iteration and without establishing a deduplication data block, wherein gaps of data not belonging to any deduplication data block exist between established deduplication data blocks following performance of the block alignment function across the data segment. 2. The method of claim 1, wherein each of the established deduplication data blocks has a same predetermined block size. 3. The method of claim 1, wherein the gaps of data comprise variable gap sizes. 4. The method of claim 1, further comprising changing at least one of the one or more predetermined criteria in response to determining, for a threshold number of consecutive iterations, that the output of the block alignment function performed on the data within the sliding window does not satisfy the one or more predetermined criteria. 5. The method of claim 4, wherein the one or more predetermined criteria comprise whether the output of the block alignment function falls within a predetermined range, and the changing the at least one of the one or more predetermined criteria comprises altering the predetermined range. 6. The method of claim 4, wherein the changing the at least one of the one or more predetermined criteria comprises altering the block alignment function. 7. The method of claim 6, wherein the block alignment function is a hash function and the altering the block alignment function comprises using a different hash function. 8. The method of claim 4, further comprising iteratively performing the block alignment function across at least a portion of the data segment again in response to the changing the at least one of the one or more predetermined criteria. 9. The method of claim 1, further comprising: in response to determining, for a threshold number of consecutive iterations, that the output of the block alignment function performed on the current window of data does not satisfy the one or more predetermined criteria: establishing the deduplication data block; andmoving the sliding window relative to the data segment by the incremental amount. 10. A deduplication system configured to define deduplication block alignments within a data segment, the system comprising: one or more processors implemented at least partially by hardware; anda deduplication block alignment module of executable instructions that when executed by the one or more processors, causes the one or more processors to iteratively perform a deduplication block alignment function on data within a sliding window in the data segment and, for each iterative performance of the deduplication block alignment function: based at least in part on a determination that an output of the deduplication block alignment function performed on the data within the sliding window satisfies one or more predetermined criteria, establish a deduplication block having a predetermined block size and move the sliding window relative to the data segment by an amount based at least in part on the predetermined block size before performing a next consecutive iteration; andbased at least in part on a determination that the output of the deduplication block alignment function performed on the data within the sliding window does not satisfy the one or more predetermined criteria, define at least a portion of data not belonging to the deduplication block and move the sliding window relative to the data segment by an incremental amount that is different from the predetermined block size before performing the next consecutive iteration. 11. The system of claim 10, wherein the deduplication block alignment module when executed by the one or more processors further causes the one or more processors to change at least one of the one or more predetermined criteria in response to determining, for a threshold number of consecutive iterations, that the output of the deduplication block alignment function performed on the data within the sliding window does not satisfy the one or more predetermined criteria. 12. The system of claim 11, wherein the deduplication block alignment module when executed by the one or more processors further causes the one or more processors to perform the deduplication block alignment function across at least a portion of the data segment again in response to a criteria adjustment module changing the at least one of the one or more predetermined criteria. 13. The system of claim 11, wherein to change the at least one of the one or more predetermined criteria, the deduplication block alignment module when executed by the one or more processors further causes the one or more processors to alter the deduplication block alignment function. 14. A deduplication system configured to define deduplication block alignments within a data segment, the system comprising: one or more processors implemented at least partially by hardware; anda deduplication block alignment module of executable instructions that when executed by the one or more processors, causes the one or more processors to iteratively perform a deduplication block alignment function on data within a sliding window in the data segment and, for each iterative performance of the deduplication block alignment function determine whether an output of the deduplication block alignment function performed on the data within the sliding window satisfies one or more predetermined criteria, wherein based at least in part on a determination that the output of the deduplication block alignment function performed on the data within the sliding window satisfies the one or more predetermined criteria, the deduplication block alignment module causes the one or more processors to establish a first deduplication block having a predetermined block size, andbased at least in part on a determination that the output of the deduplication block alignment function performed on a current window of data does not satisfy the one or more predetermined criteria for a threshold number of consecutive iterations, the deduplication block alignment module further causes the one or more processors to establish a second deduplication data block having the predetermined block size, and move the sliding window relative to the data segment by an incremental amount that is different from the predetermined block size. 15. A method for defining deduplication block alignments within a data segment, the method comprising: iteratively performing a deduplication block alignment function on data within a sliding window in the data segment and, for each iterative performance of the deduplication block alignment function: establishing, with one or more computer processors, a deduplication data block having a predetermined block size and moving the sliding window relative to the data segment by an amount that is based at least in part on the predetermined block size before performing a next consecutive iteration in response to determining that an output of the deduplication block alignment function performed on the data within the sliding window satisfies one or more predetermined criteria; anddefining, with the one or more computer processors, at least a portion of a gap of data not belonging to the deduplication data block and moving the sliding window relative to the data segment by an incremental amount that is different from the predetermined block size before performing the next consecutive iteration in response to determining that the output of the deduplication block alignment function performed on the data within the sliding window does not satisfy the one or more predetermined criteria. 16. The method of claim 15, further comprising changing the predetermined criteria in response to determining, for a threshold number of consecutive iterations, that the output of the deduplication block alignment function performed on the data within the sliding window does not satisfy the predetermined criteria. 17. The method of claim 16, further comprising iteratively performing the deduplication block alignment function across at least a portion of the data segment again in response to the changing the predetermined criteria. 18. A method for defining deduplication block alignments within a data segment, the method comprising: iteratively performing a deduplication block alignment function on data within a sliding window in the data segment and, for each iterative performance of the deduplication block alignment function determining whether an output of the deduplication block alignment function performed on the data within the sliding window satisfies one or more predetermined criteria, wherein based at least in part on a determination that the output of the deduplication block alignment function performed on the data within the sliding window satisfies one or more predetermined criteria, establishing, with one or more computer processors, a first deduplication data block having a predetermined block size, andbased at least in part on a determination that the output of the deduplication block alignment function performed on the data within the sliding window does not satisfy the one or more predetermined criteria, establishing, with the one or more computer processors, a second deduplication data block having the predetermined block size, and moving the sliding window relative to the data segment by an incremental amount that is different from the predetermined block size.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (150)
Ranade, Dilip Madhusudan; Shelat, Radha; Kabra, Navin, Adaptive caching for a distributed file sharing system.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
Griffin David (Maynard MA) Campbell Jonathan (Acton MA) Reilly Michael (Sterling MA) Rosenbaum Richard (Pepperell MA), Arrangement with cooperating management server node and network service node.
Nakano Toshio (Odawara JPX) Nozawa Masafumi (Odawara JPX) Kurano Akira (Odawara JPX) Hisano Kiyoshi (Odawara JPX) Hoshino Masayuki (Odawara JPX), Backup control method and system in data processing system using identifiers for controlling block data transfer.
Kitajima Hiroyuki (Yokohama) Yamamoto Akira (Yokohama) Doi Takashi (Hadano) Nozawa Masafumi (Odawara JPX), Buffered peripheral system and method for backing up and retrieving data to and from backup memory device.
Ludmila Cherkasova ; Martin F. Arlitt ; Richard J. Friedrich ; Tai Jin, Caching protocol method and system based on request frequency and relative storage duration.
Cole Leo J. (Raleigh NC) Frantz Curtis J. (Durham NC) Lee Jeannette (Raleigh NC) Ordanic Zvonimir (Raleigh NC) Plank Larry K. (Rochester MN), Centralized management in a computer network.
Carpenter Kelly S. (Fremont CA) Dearing Gerard M. (San Jose CA) Nick Jeffrey M. (Fishkill NY) Strickland Jimmy P. (Saratoga CA) Swanson Michael D. (Poughkeepsie NY) Wilkinson Wendell W. (Hyde Park NY, Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage.
Senator Steven T. ; Fuller Billy J., Computer system method and apparatus providing for various versions of a file without requiring data copy or log operati.
Fecteau Jean G. (Toronto NY CAX) Gdaniec Joseph M. (Vestal NY) Hennessy James P. (Endicott NY) MacDonald John F. (Vestal NY) Osisek Damian L. (Vestal NY), Computer system which supports asynchronous commitment of data.
Dunphy William E. (Westminster CO) Halladay Steven M. (Louisville CO) Moy Michael E. (Lafayette CO) Munro Frederick G. (Broomfield CO), Data storage and protection system.
Yanai Moshe (Framingham MA) Vishlitzky Natan (Brookline MA) Alterescu Bruno (Newton MA) Castel Daniel (Framingham MA) Shklarsky Gadi (Brookline MA), Data storage system controlled remote data mirroring with respectively maintained data indices.
Fortier Richard W. (Acton MA) Mastors Robert M. (Ayer MA) Taylor Tracy M. (Upton MA) Wallace John J. (Franklin MA), Digital data processor with improved backup storage.
Kenley Gregory (Northboro MA) Ericson George (Schrewsbury MA) Fortier Richard (Acton MA) Holland Chuck (Northboro MA) Mastors Robert (Ayer MA) Pownell James (Natick MA) Taylor Tracy (Upton MA) Wallac, Digital data storage system with improved data migration.
Christenson,Nikolai Paul; Fritchie,Scott Ernest Lystig; Larson,James Stephen, Electronic mail system with methodology providing distributed message store.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Lagueux, Jr., Richard A.; Stave, Joel H.; Yeaman, John B.; Stevens, Brian E.; Higgins, Robert M.; Collins, James M., Graphical user interface for configuration of a storage system.
Urevig Paul D. ; Malnati James R. ; Ethen Donald J. ; Weber Herbert L., Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed.
Cane David ; Hirschman David, High performance backup via selective file saving which can perform incremental backups and exclude files and uses a cha.
Barney Rock D. ; Schwols Keith ; Nelson Ellen M., Integration of a database into file management software for protecting, tracking and retrieving data.
Martin Charles W. (Richardson TX) Reid Fredrick S. (Plano TX) Forbus Gary L. (Dallas TX) Adams Steve M. (Plano TX) Shannon C. Patrick (Garland TX) Pirpich Eric A. (Garland TX), Mass data storage and retrieval system.
Kedem Nadav,ILX, Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information .
Long Robert M., Media element library with non-overlapping subset of media elements and non-overlapping subset of media element drives accessible to first host and unaccessible to second host.
Kullick Steven E. ; Spirakis Charles S. ; Titus Diane J., Method and apparatus for transferring archival data among an arbitrarily large number of computer devices in a networked.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Kern Ronald M. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated backup copy ordering in a time zero backup copy session.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Micka William F. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated termination and resumption in a time zero backup copy process.
Walter A. Hubis ; William G. Deitz, Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access .
Chron, Edward Gustav; Menon, Jaishankar Moothedath, Method and system for providing consistent data modification information to clients in a storage system.
Aoyama Yuki,JPX ; Takahashi Toru,JPX ; Wakayama Satoshi,JPX, Method of and an apparatus for displaying version information and configuration information and a computer-readable recording medium on which a version and configuration information display program i.
Haustein, Nils; Klein, Craig A.; Troppens, Ulf; Winarski, Daniel J., Method of and system for deduplicating backed up data in a client-server environment.
Wahlert, Brian M; Berkowitz, Brian T; van Ingen, Catharine; Rangegowda, Dharshan; Jazayeri, Mike, Method, system, and apparatus for creating saved searches and auto discovery groups for a data protection system.
Palliyil, Sudarshan; Venkateshamurthy, Shivakumara; Vijayaraghavan, Srinivas Belur; Aswathanarayana, Tejasvi, Methods, apparatus and computer programs for enhanced access to resources within a network.
Pisello Thomas (De Bary FL) Crossmier David (Casselberry FL) Ashton Paul (Oviedo FL), Network management system having virtual catalog overview of files distributively stored across network domain.
Prahlad, Anand; May, Andreas; Lunde, Norman R.; Zhou, Lixin; Kumar, Avinash; Ngo, David, Snapshot storage and management system with indexing and user interface.
Crockett Robert N. (Tucson AZ) Kern Ronald M. (Tucson AZ) Micka William F. (Tucson AZ), Software directed microcode state save for distributed storage controller.
Friend,John; Belshe,Michael; Collins,Roger; Bennett,Mike, System and method for full wireless synchronization of a data processing apparatus with a messaging system.
Mutalik Madhav ; Senie Faith M., System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map.
Moulton, Gregory Hagan, System and method for unorchestrated determination of data sequences using sticky byte factoring to determine breakpoints in digital sequences.
Patel, Sujal M.; Mikesell, Paul A., System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system.
Huai ReiJane (Old Brookville NY) Daly Robert (Ronkonkoma NY) Curti Walter (Dix Hills NY) Mohan Deepak (Huntington NY) Chueh James Kuang-Ru (Bayside NY) Louie Larry (Forest Hills NY), System and parallel streaming and data stripping to back-up a network.
Stoppani ; Jr. Peter (Woodinville WA), System for allocating storage spaces based upon required and optional service attributes having assigned piorities.
Bamford Roger J. (Woodside CA) Howard Forrest W. (Berkeley CA) Kabcenell Dirk A. (Portola Valley CA) Miner Robert N. (San Francisco CA), System for database integrity with multiple logs assigned to client subsets.
Flynn Rex A. (Belmont MA) Anick Peter G. (Marlboro MA), System for reconstructing prior versions of indexes using records indicating changes between successive versions of the.
Saether Christian D. (Seattle WA) Stoppani ; Jr. Peter (Woodinville WA), System of device independent file directories using a tag between the directories and file descriptors that migrate with.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for classifying and transferring information in a storage network.
Borghetti, Stefano; Sgro', Antonio Mario; Corte, Gianluca Della; Gianfagna, Leonida, Thread based view and archive for simple mail transfer protocol (SMTP) clients devices and methods.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.