Accessing a file system using tiered deduplication
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-017/30
G06F-003/06
출원번호
US-0399597
(2017-01-05)
등록번호
US-9934238
(2018-04-03)
발명자
/ 주소
Mitkar, Amit
Kumarasamy, Paramasivam
Kottomtharayil, Rajiv
출원인 / 주소
COMMVAULT SYSTEMS, INC.
대리인 / 주소
Commvault Systems, Inc.
인용정보
피인용 횟수 :
6인용 특허 :
286
초록▼
An illustrative pseudo-file-system driver uses deduplication functionality and resources in a storage management system to provide an application and/or a virtual machine with access to a locally-stored file system. From the perspective of the application/virtual machine, the file system appears to
An illustrative pseudo-file-system driver uses deduplication functionality and resources in a storage management system to provide an application and/or a virtual machine with access to a locally-stored file system. From the perspective of the application/virtual machine, the file system appears to be of virtually unlimited capacity. The pseudo-file-system driver instantiates the file system in primary storage, e.g., configured on a local disk. The application/virtual machine requires no configured settings or limits for the file system's storage capacity, and may thus treat the file system as “infinite.” The pseudo-file-system driver intercepts write requests and may use the deduplication infrastructure in the storage management system to offload excess data from local primary storage to deduplicated secondary storage, based on a deduplication database. The pseudo-file-system driver also intercepts read requests and in response may restore data from deduplicated secondary storage to primary storage, also based on the deduplication database.
대표청구항▼
1. A computer-readable medium, excluding transitory propagating signals, storing instructions that, when executed by a computing device having one or more processors and corresponding computer-readable memory, cause the computing device to perform a method comprising: executing a pseudo-file-system
1. A computer-readable medium, excluding transitory propagating signals, storing instructions that, when executed by a computing device having one or more processors and corresponding computer-readable memory, cause the computing device to perform a method comprising: executing a pseudo-file-system driver on the computing device, which hosts an application and an associated data agent component of a storage management system that comprises the computing device;instantiating a file system, by the pseudo-file-system driver, based on exposing a first mount point for the file system, wherein the file system resides in a primary storage device in communication with the computing device;configuring, by the pseudo-file-system driver, an association between the file system and a corresponding deduplication database component of the storage management system; andexecuting the application, wherein the pseudo-file system driver invokes at least one deduplication job, which (i) moves some data from the file system in the primary storage device to a secondary storage device component of the storage management system, and (ii) stores the moved data in deduplicated form thereto based at least in part on the deduplication database, andwherein based at least in part on invoking the at least one deduplication job the pseudo-file-system driver provides the application with access to the file system configured without a storage-capacity limit. 2. The computer-readable medium of claim 1 wherein executing the pseudo-file-system driver renders unnecessary configuring the file system with a storage-capacity limit relative to the application. 3. The computer-readable medium of claim 1 wherein executing the pseudo-file-system driver renders unnecessary configuring the application with a storage-capacity limit relative to the file system. 4. The computer-readable medium of claim 1 wherein the pseudo-file-system driver identifies excess data in the file system before invoking the at least one deduplication job relative to the excess data. 5. The computer-readable medium of claim 1 wherein the at least one deduplication job is performed at least in part by a media agent component of the storage management system, and wherein the media agent component maintains the deduplication database. 6. The computer-readable medium of claim 1 wherein the at least one deduplication job is performed at least in part by a media agent component of the storage management system in conjunction with the data agent on the computing device, and wherein the media agent component maintains the deduplication database. 7. The computer-readable medium of claim 1 wherein when the pseudo-file-system driver identifies data requested by the application that is not available from the file system in the primary storage device, the pseudo-file-system driver invokes a restore job that uses the deduplication database to retrieve the unavailable data from at least one of the deduplication database and a secondary storage device associated with a media agent component of the storage management system. 8. The computer-readable medium of claim 7 wherein the restore job is performed at least in part by the media agent component of the storage management system, and wherein the media agent maintains the deduplication database. 9. The computer-readable medium of claim 7 wherein the restore job is performed at least in part by the media agent component of the storage management system in conjunction with the data agent on the computing device, and wherein the media agent maintains the deduplication database. 10. A computer-readable medium, excluding transitory propagating signals, storing instructions that, when executed by a computing device having one or more processors and corresponding computer-readable memory, cause the computing device to perform a method for using deduplication in a storage management system to provide a virtual machine on the computing device with access to a file system, the method comprising: executing a pseudo-file-system driver on the computing device, which hosts the virtual machine and an associated data agent component of the storage management system;based on exposing a first mount point for the file system to the virtual machine, instantiating the file system, wherein the file system is stored in a primary storage device in communication with the computing device; andinvoking, by the pseudo-file-system driver, at least one deduplication job that: (a) moves some data from the file system in the primary storage device to a secondary storage device component of the storage management system,(b) stores the moved data in deduplicated form thereto based at least in part on a deduplication database component of the storage management system, andthereby providing the virtual machine with access to the file system without a predefined limit on storage capacity for the file system. 11. The computer-readable medium of claim 10 wherein the method further comprises: configuring, by the pseudo-file-system driver, an association between the file system and the deduplication database component of the storage management system. 12. The computer-readable medium of claim 10 wherein, based at least in part on the invoking of the at least one deduplication job, the file system appears to the virtual machine to be of virtually unlimited storage capacity. 13. The method of claim 10 wherein the at least one deduplication job is performed at least in part by a media agent component of the storage management system, and wherein the media agent component maintains the deduplication database. 14. The method of claim 10 further comprising: when the pseudo-file-system driver identifies data requested by the virtual machine that is not available from the file system in the primary storage device, invoking, by the pseudo-file-system driver, at least one restore job that moves the identified data from a secondary storage component of the storage management system to the file system in the primary storage device, wherein the restore job is based at least in part on the deduplication database, andwherein the secondary storage component of the storage management system is at least one of a media agent component and a secondary storage device component associated with the media agent component. 15. A storage management system for using deduplication to provide a virtual machine with access to a file system of seemingly unlimited storage capacity, the system comprising: a first computing device comprising the virtual machine, a data agent, a pseudo-file-system driver, and a mount point exposed by the pseudo-file-system driver to the virtual machine, wherein the first computing device comprises one or more processors and corresponding computer-readable memory;a primary storage device in communication with the first computing device, wherein the primary storage device comprises data of the file system;a second computing device comprising a media agent and a deduplication database that is associated with the file system, wherein the second computing device comprises one or more processors and corresponding computer-readable memory;a secondary storage device in communication with the second computing device, wherein the secondary storage device comprises data stored in deduplicated form based on the deduplication database;wherein the pseudo-file-system driver is configured to provide the virtual machine with access to the file system appearing to lack a storage-capacity limit, based at least in part on at least one deduplication job invoked by the pseudo-file-system driver to:(a) move some data from the file system in the primary storage device to at least one of the media agent and the secondary storage device, and(b) store the moved data in deduplicated form thereto based at least in part on the deduplication database. 16. The storage management system of claim 15 wherein the pseudo-file-system driver is further configured to invoke the at least one deduplication job for excess data identified by the pseudo-file-system driver in the file system. 17. The storage management system of claim 15 wherein the pseudo-file-system driver is further configured to invoke a restore job that uses the deduplication database to retrieve, from at least one of the deduplication database and a secondary storage device, data requested by the virtual machine which is not available from the file system in the primary storage device. 18. The storage management system of claim 15 wherein the virtual machine is configured without a storage-capacity limit for the file system. 19. The storage management system of claim 15 wherein the file system is configured without a storage-capacity limit for the virtual machine. 20. The storage management system of claim 15 wherein the at least one deduplication job is performed at least in part by the media agent on the second computing device in conjunction with the data agent on the first computing device, and wherein the media agent maintains the deduplication database.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (286)
Mitkar, Amit; Kumarasamy, Paramasivam; Kottomtharayil, Rajiv, Accessing a file system using tiered deduplication.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
Ofek,Yuval; Cakeljic,Zoran; Bitner,Haim; Galtzur,Sharon; Ish Shalom,Ariel J.; Kedem,Nadav; Krikler,Samuel; Arnon,Dan, Apparatus and methods for operating a computer storage system.
Griffin David (Maynard MA) Campbell Jonathan (Acton MA) Reilly Michael (Sterling MA) Rosenbaum Richard (Pepperell MA), Arrangement with cooperating management server node and network service node.
Nakano Toshio (Odawara JPX) Nozawa Masafumi (Odawara JPX) Kurano Akira (Odawara JPX) Hisano Kiyoshi (Odawara JPX) Hoshino Masayuki (Odawara JPX), Backup control method and system in data processing system using identifiers for controlling block data transfer.
Kitajima Hiroyuki (Yokohama) Yamamoto Akira (Yokohama) Doi Takashi (Hadano) Nozawa Masafumi (Odawara JPX), Buffered peripheral system and method for backing up and retrieving data to and from backup memory device.
Myers James J. (San Francisco CA) Wang Pong-Sheng (San Jose CA), CPU implemented method for backing up modified data sets in non-volatile store for recovery in the event of CPU failure.
Ludmila Cherkasova ; Martin F. Arlitt ; Richard J. Friedrich ; Tai Jin, Caching protocol method and system based on request frequency and relative storage duration.
Cole Leo J. (Raleigh NC) Frantz Curtis J. (Durham NC) Lee Jeannette (Raleigh NC) Ordanic Zvonimir (Raleigh NC) Plank Larry K. (Rochester MN), Centralized management in a computer network.
Carpenter Kelly S. (Fremont CA) Dearing Gerard M. (San Jose CA) Nick Jeffrey M. (Fishkill NY) Strickland Jimmy P. (Saratoga CA) Swanson Michael D. (Poughkeepsie NY) Wilkinson Wendell W. (Hyde Park NY, Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage.
Eric C. Peters ; Stanley Rabinowitz ; Herbert R. Jacobs ; Richard Baker Gillett, Jr. ; Peter J. Fasciano, Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner.
Senator Steven T. ; Fuller Billy J., Computer system method and apparatus providing for various versions of a file without requiring data copy or log operati.
Fecteau Jean G. (Toronto NY CAX) Gdaniec Joseph M. (Vestal NY) Hennessy James P. (Endicott NY) MacDonald John F. (Vestal NY) Osisek Damian L. (Vestal NY), Computer system which supports asynchronous commitment of data.
Van Huben Gary Alan ; Mueller Joseph Lawrence ; Siegel Michael Steven ; Warnock Thomas Bernard ; McDonald Darryl James, Data management system and process.
Prahlad, Anand; Muller, Marcus S.; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj, Data object store and server for a cloud storage environment, including data deduplication and data management across multiple cloud storage sites.
Dunphy William E. (Westminster CO) Halladay Steven M. (Louisville CO) Moy Michael E. (Lafayette CO) Munro Frederick G. (Broomfield CO), Data storage and protection system.
Yanai Moshe (Framingham MA) Vishlitzky Natan (Brookline MA) Alterescu Bruno (Newton MA) Castel Daniel (Framingham MA) Shklarsky Gadi (Brookline MA), Data storage system controlled remote data mirroring with respectively maintained data indices.
Fortier Richard W. (Acton MA) Mastors Robert M. (Ayer MA) Taylor Tracy M. (Upton MA) Wallace John J. (Franklin MA), Digital data processor with improved backup storage.
Kenley Gregory (Northboro MA) Ericson George (Schrewsbury MA) Fortier Richard (Acton MA) Holland Chuck (Northboro MA) Mastors Robert (Ayer MA) Pownell James (Natick MA) Taylor Tracy (Upton MA) Wallac, Digital data storage system with improved data migration.
Ashton Lyn Lequam ; Pearson Anthony Steve ; Pence Jerry Wayne ; West Stephen Charles, Dynamic reconfiguration of data storage devices to balance recycle throughput.
Christenson,Nikolai Paul; Fritchie,Scott Ernest Lystig; Larson,James Stephen, Electronic mail system with methodology providing distributed message store.
Belsan Jay S. (Nederland CO) Laughlin Jeffrey S. (Nederland CO) Pedersen Mogens H. (Longmont CO) Raicer Robert J. (Niwot CO) Rudeseal George A. (Boulder CO) Schafer Charles P. (Louisville CO) Steele , File server having snapshot application data groups.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Lagueux, Jr., Richard A.; Stave, Joel H.; Yeaman, John B.; Stevens, Brian E.; Higgins, Robert M.; Collins, James M., Graphical user interface for configuration of a storage system.
Urevig Paul D. ; Malnati James R. ; Ethen Donald J. ; Weber Herbert L., Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G.; May,Andreas; Schwartz,Jeremy, Hierarchical systems and methods for providing a unified view of storage information.
Cane David ; Hirschman David, High performance backup via selective file saving which can perform incremental backups and exclude files and uses a cha.
Dechant Thomas E. (Bainbridge OH) Glaser Edward L. (Santa Monica CA) Pitt Paul E. (Santa Monica CA) Way Frederick (Cleveland Heights OH), Information storage and retrieval system.
Barney Rock D. ; Schwols Keith ; Nelson Ellen M., Integration of a database into file management software for protecting, tracking and retrieving data.
Oshinsky, David Alan; Ignatius, Paul; Prahlad, Anand; May, Andreas, Logical view and access to data managed by a modular data and storage management system.
Ignatius, Paul; Theisen, Marjorie H.; Oshinsky, David Alan; Kavuri, Srinivas, Logical view and access to physical storage in modular data and storage management system.
Prahlad,Anand; De Meno,Randy; Schwartz,Jeremy A.; McGuigan,James J., Logical view with granular access to exchange data managed by a modular data and storage management system.
Cannon, David Maxwell; Dawson, Colin Scott; Edwards, Jr., Robert Clair; Kaczmarski, Michael Allen; Zaremba, Christopher, Management of redundant objects in storage systems.
Cannon, David Maxwell; Dawson, Colin Scott; Edwards, Jr., Robert Clair; Kaczmarski, Michael Allen; Zaremba, Christopher, Management of redundant objects in storage systems.
Martin Charles W. (Richardson TX) Reid Fredrick S. (Plano TX) Forbus Gary L. (Dallas TX) Adams Steve M. (Plano TX) Shannon C. Patrick (Garland TX) Pirpich Eric A. (Garland TX), Mass data storage and retrieval system.
Kedem Nadav,ILX, Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information .
Long Robert M., Media element library with non-overlapping subset of media elements and non-overlapping subset of media element drives accessible to first host and unaccessible to second host.
Kullick Steven E. ; Spirakis Charles S. ; Titus Diane J., Method and apparatus for transferring archival data among an arbitrarily large number of computer devices in a networked.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Kern Ronald M. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated backup copy ordering in a time zero backup copy session.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Micka William F. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated termination and resumption in a time zero backup copy process.
Walter A. Hubis ; William G. Deitz, Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access .
Pachet,Francois; Cazaly,Daniel; Roy,Pierre, Method and system for generating sequencing information representing a sequence of items selected in a database.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S.; Gokhale, Parag; Kottomtharayil, Rajiv, Method and system for offline indexing of content and classifying stored data.
Chron, Edward Gustav; Menon, Jaishankar Moothedath, Method and system for providing consistent data modification information to clients in a storage system.
Aoyama Yuki,JPX ; Takahashi Toru,JPX ; Wakayama Satoshi,JPX, Method of and an apparatus for displaying version information and configuration information and a computer-readable recording medium on which a version and configuration information display program i.
Haustein, Nils; Klein, Craig A.; Troppens, Ulf; Winarski, Daniel J., Method of and system for deduplicating backed up data in a client-server environment.
Wahlert, Brian M; Berkowitz, Brian T; van Ingen, Catharine; Rangegowda, Dharshan; Jazayeri, Mike, Method, system, and apparatus for creating saved searches and auto discovery groups for a data protection system.
Palliyil, Sudarshan; Venkateshamurthy, Shivakumara; Vijayaraghavan, Srinivas Belur; Aswathanarayana, Tejasvi, Methods, apparatus and computer programs for enhanced access to resources within a network.
Crescenti,John; Kavuri,Srinivas; Oshinsky,David Alan; Prahlad,Anand, Modular backup and retrieval system used in conjunction with a storage area network.
Pisello Thomas (De Bary FL) Crossmier David (Casselberry FL) Ashton Paul (Oviedo FL), Network management system having virtual catalog overview of files distributively stored across network domain.
Payette, Vincent; Desmarais, Richard Roger; Price, James Marik; Weaver, Michael C.; Corbett, Richard J.; Bodell, Barton W.; Pernsteiner, William P., Network-based system and method for accessing and processing emails and other electronic legal documents that may include duplicate information.
Prahlad, Anand; May, Andreas; Lunde, Norman R.; Zhou, Lixin; Kumar, Avinash; Ngo, David, Snapshot storage and management system with indexing and user interface.
Crockett Robert N. (Tucson AZ) Kern Ronald M. (Tucson AZ) Micka William F. (Tucson AZ), Software directed microcode state save for distributed storage controller.
Retnamma,Manoj Vijayan; Amarendran,Arun; Kottomtharayil,Rajiv, System and method for combining data streams in pipelined storage operations in a storage network.
Kottomtharayil,Rajiv; Gokhale,Parag; Prahlad,Anand; Vijayan Retnamma,Manoj Kumar; Ngo,David; Devassy,Varghese, System and method for dynamically performing storage operations in a computer network.
Kottomtharayil,Rajiv; Gokhale,Parag; Prahlad,Anand; Vijayan Retnamma,Manoj Kumar; Ngo,David; Devassy,Varghese, System and method for dynamically sharing media in a computer network.
Friend,John; Belshe,Michael; Collins,Roger; Bennett,Mike, System and method for full wireless synchronization of a data processing apparatus with a messaging system.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahual; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahual; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahul S.; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Prahlad, Anand; Ngo, David; Varadharajan, Prakash; Pawar, Rahul S.; Kumar, Avinash, System and method for performing an image level snapshot and for restoring partial volume data.
Mutalik Madhav ; Senie Faith M., System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map.
Moulton, Gregory Hagan, System and method for unorchestrated determination of data sequences using sticky byte factoring to determine breakpoints in digital sequences.
Patel, Sujal M.; Mikesell, Paul A., System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system.
Huai ReiJane (Old Brookville NY) Daly Robert (Ronkonkoma NY) Curti Walter (Dix Hills NY) Mohan Deepak (Huntington NY) Chueh James Kuang-Ru (Bayside NY) Louie Larry (Forest Hills NY), System and parallel streaming and data stripping to back-up a network.
Stoppani ; Jr. Peter (Woodinville WA), System for allocating storage spaces based upon required and optional service attributes having assigned piorities.
Bamford Roger J. (Woodside CA) Howard Forrest W. (Berkeley CA) Kabcenell Dirk A. (Portola Valley CA) Miner Robert N. (San Francisco CA), System for database integrity with multiple logs assigned to client subsets.
Capozzi ; Anthony J. ; Cordi ; Vincent A. ; Edson ; Bruce A., System for facilitating the copying back of data in disc and tape units of a memory hierarchial system.
Flynn Rex A. (Belmont MA) Anick Peter G. (Marlboro MA), System for reconstructing prior versions of indexes using records indicating changes between successive versions of the.
Saether Christian D. (Seattle WA) Stoppani ; Jr. Peter (Woodinville WA), System of device independent file directories using a tag between the directories and file descriptors that migrate with.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for classifying and transferring information in a storage network.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G.; May,Andreas; Schwartz,Jeremy, Systems and methods for generating a storage-related metric.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G; May,Andreas; Schwartz,Jeremy, Systems and methods for storage modeling and costing.
Prahlad, Anand; Schwartz, Jeremy Alan; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for using metadata to enhance data identification operations.
Prahlad, Anand; Schwartz, Jeremy Alan; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for using metadata to enhance data management operations.
Borghetti, Stefano; Sgro', Antonio Mario; Corte, Gianluca Della; Gianfagna, Leonida, Thread based view and archive for simple mail transfer protocol (SMTP) clients devices and methods.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.