Assignment of data agent proxies for executing virtual-machine secondary copy operations including streaming backup jobs
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-011/14
H04L-029/08
H04L-012/24
출원번호
US-0744952
(2015-06-19)
등록번호
US-10084873
(2018-09-25)
발명자
/ 주소
Dornemann, Henry Wallace
출원인 / 주소
COMMVAULT SYSTEMS, INC.
대리인 / 주소
Commvault Systems, Inc.
인용정보
피인용 횟수 :
0인용 특허 :
153
초록▼
A comprehensive approach to streaming backups for virtual machines (“VMs”) in a storage management system comprises improvements to the assignment of data agent proxies for VM secondary copy operations. New considerations in performing a VM streaming backup job include without limitation: determinin
A comprehensive approach to streaming backups for virtual machines (“VMs”) in a storage management system comprises improvements to the assignment of data agent proxies for VM secondary copy operations. New considerations in performing a VM streaming backup job include without limitation: determining and enforcing a system-wide per-proxy limit of concurrent data streams; generating an ordered priority list of the VMs to be backed up as a basis for choosing which proxies will back up the respective VM, though the illustrative system may not strictly adhere to the priority list based on further considerations; identifying a next available proxy based on data stream utilization at the proxy; and dynamically re-generating the priority list and re-evaluating considerations if some VMs become “stranded” due to a failure to be backed up. Secondary copy operations are distributed to proxies in ways that improve the chances of successfully completing VM streaming backups.
대표청구항▼
1. A method for determining a per-proxy limit of concurrent data streams allowed for backup operations in a storage management system, the method comprising: designating, by a storage manager component of the storage management system, a first data agent to act as coordinator of a first backup job,
1. A method for determining a per-proxy limit of concurrent data streams allowed for backup operations in a storage management system, the method comprising: designating, by a storage manager component of the storage management system, a first data agent to act as coordinator of a first backup job, wherein the first backup job is configured to perform secondary copy operations for a first set of virtual machines in the storage management system,wherein the coordinator data agent executes on a first virtual machine, and wherein the first virtual machine is designated a first proxy, andwherein the first virtual machine executes on a first computing device having one or more processors and non-transitory computer-readable memory;designating, by the storage manager, a second data agent to act as controller in the first backup job, wherein the controller data agent executes on a second computing device having one or more processors and non-transitory computer-readable memory, and wherein the second computing device is designated a second proxy; anddetermining, by the coordinator data agent, a respective maximum limit of concurrent data streams assignable by the coordinator data agent to each of the first proxy and the second proxy for performing one or more backup jobs in the storage management system, including the first backup job, wherein for a given proxy the respective maximum limit of concurrent data streams is based on a processing capacity and an amount of random-access memory of the given proxy. 2. The method of claim 1 further comprising: assigning, by the coordinator data agent, a first data stream to the first proxy in the course of performing the first backup job, wherein the first data stream originates at a first storage device comprising virtual-machine data being backed up in the first backup job and terminates at the coordinator data agent that executes on the first proxy; andwherein the first proxy concurrently uses no more than the maximum limit of concurrent data streams determined by the coordinator data agent for the first proxy. 3. The method of claim 1, wherein the coordinator data agent and the controller data agent are virtual-server data agents, which are configured for backup of virtual machines in the storage management system. 4. The method of claim 1, wherein the first set of virtual machines comprises a first subset of virtual machines that execute on a first host computing device, and a second subset of virtual machines that execute on a second host computing device. 5. The method of claim 4, wherein the first proxy which hosts the coordinator data agent executes on the same computing device as the first subset of virtual machines, such that the first computing device coincides with the first host computing device. 6. The method of claim 1 further comprising: collecting, by the coordinator data agent, job-related information for executing the first backup job; andwherein the job-related information for executing the first backup job comprises one or more of: identities of the first set of virtual machines to be backed up, one or more operational properties of each virtual machine in the first set, information about one or more storage devices storing virtual-machine data to be backed up, and a maximum number of concurrent data streams allowed to be used concurrently while performing the first backup job. 7. The method of claim 1, wherein for a given proxy the respective maximum limit of concurrent data streams is further based on a number of processors that the given proxy comprises. 8. A computer-readable medium, excluding transitory propagating signals, storing instructions that, when executed by a computing device, cause the computing device to perform a method for managing backup operations in a storage management system, the method comprising: collecting, by a designated coordinator for a first backup job in the storage management system, information about operational properties, comprising a respective processing capacity and a respective amount of random-access memory, of a first proxy and a second proxy, wherein the coordinator operates as the first proxy,wherein a designated controller operates as the second proxy, andwherein the first backup job is associated with one or more secondary copy operations for a first set of virtual machines; anddetermining, by the coordinator, a respective maximum limit of concurrent data streams assignable by the coordinator to each of the first proxy and the second proxy for performing one or more backup jobs including the first backup job, wherein for a given proxy the respective maximum limit of concurrent data streams is based on the operational properties of the given proxy. 9. The computer-readable medium of claim 8 wherein the coordinator is a data agent that executes on a first computing device having one or more processors and non-transitory computer-readable memory, and wherein the controller is a data agent that executes on a first virtual machine, and wherein the first virtual machine executes on a second computing device having one or more processors and non-transitory computer-readable memory. 10. The computer-readable medium of claim 8 wherein for a given proxy the operational properties further include how many processors the given proxy comprises. 11. A computer-readable medium, excluding transitory propagating signals, storing instructions that, when executed by a computing device having one or more processors and non-transitory computer-readable memory, cause the computing device to perform a method comprising: establishing inter-process communications between a coordinator component of a storage management system and one or more controller components of the storage management system in regard to one or more backup jobs to be performed in the storage management system;collecting information about the one or more backup jobs to be performed;further collecting information about operational properties of one or more proxy components of the storage management system that are candidates for executing at least part of the one or more backup jobs to be performed, wherein for the given candidate proxy the operational properties include a processing capacity and an amount of random-access memory of the given candidate proxy; anddetermining a respective maximum limit of concurrent data streams assignable by the coordinator component to each candidate proxy for transferring data in the one or more backup jobs to be performed, wherein for a given candidate proxy the respective maximum limit of concurrent data streams is based on the operational properties collected about the given candidate proxy. 12. The computer-readable medium of claim 11, wherein each proxy may concurrently use no more than the respective maximum limit of concurrent data streams while performing the one or more backup jobs in the storage management system. 13. The computer-readable medium of claim 11, wherein the information about a backup job comprises one or more of: identities of virtual machines to be backed up in the backup job, operational properties of virtual machines to be backed up in the backup job, and a number of concurrent data streams allowed for performing the backup job. 14. The computer-readable medium of claim 11, wherein for the given candidate proxy the operational properties further include how many processors the given proxy comprises. 15. The computer-readable medium of claim 11, wherein one of the candidate proxies hosts the coordinator component.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (153)
Gokhale, Geeta; Clayton-Luce, Timothy J.; Venkatesh, Umesh, Apparatus and method for providing virtualized hardware resources within a virtual execution environment.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
Griffin David (Maynard MA) Campbell Jonathan (Acton MA) Reilly Michael (Sterling MA) Rosenbaum Richard (Pepperell MA), Arrangement with cooperating management server node and network service node.
Nakano Toshio (Odawara JPX) Nozawa Masafumi (Odawara JPX) Kurano Akira (Odawara JPX) Hisano Kiyoshi (Odawara JPX) Hoshino Masayuki (Odawara JPX), Backup control method and system in data processing system using identifiers for controlling block data transfer.
Kitajima Hiroyuki (Yokohama) Yamamoto Akira (Yokohama) Doi Takashi (Hadano) Nozawa Masafumi (Odawara JPX), Buffered peripheral system and method for backing up and retrieving data to and from backup memory device.
Cole Leo J. (Raleigh NC) Frantz Curtis J. (Durham NC) Lee Jeannette (Raleigh NC) Ordanic Zvonimir (Raleigh NC) Plank Larry K. (Rochester MN), Centralized management in a computer network.
Carpenter Kelly S. (Fremont CA) Dearing Gerard M. (San Jose CA) Nick Jeffrey M. (Fishkill NY) Strickland Jimmy P. (Saratoga CA) Swanson Michael D. (Poughkeepsie NY) Wilkinson Wendell W. (Hyde Park NY, Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage.
Senator Steven T. ; Fuller Billy J., Computer system method and apparatus providing for various versions of a file without requiring data copy or log operati.
Fecteau Jean G. (Toronto NY CAX) Gdaniec Joseph M. (Vestal NY) Hennessy James P. (Endicott NY) MacDonald John F. (Vestal NY) Osisek Damian L. (Vestal NY), Computer system which supports asynchronous commitment of data.
Prahlad, Anand; Muller, Marcus S.; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj, Data object store and server for a cloud storage environment, including data deduplication and data management across multiple cloud storage sites.
Dunphy William E. (Westminster CO) Halladay Steven M. (Louisville CO) Moy Michael E. (Lafayette CO) Munro Frederick G. (Broomfield CO), Data storage and protection system.
Yanai Moshe (Framingham MA) Vishlitzky Natan (Brookline MA) Alterescu Bruno (Newton MA) Castel Daniel (Framingham MA) Shklarsky Gadi (Brookline MA), Data storage system controlled remote data mirroring with respectively maintained data indices.
Fortier Richard W. (Acton MA) Mastors Robert M. (Ayer MA) Taylor Tracy M. (Upton MA) Wallace John J. (Franklin MA), Digital data processor with improved backup storage.
Kenley Gregory (Northboro MA) Ericson George (Schrewsbury MA) Fortier Richard (Acton MA) Holland Chuck (Northboro MA) Mastors Robert (Ayer MA) Pownell James (Natick MA) Taylor Tracy (Upton MA) Wallac, Digital data storage system with improved data migration.
Dwarampudi, Bheemesh R.; Kottomtharayil, Rajiv; Pawar, Rahul S.; Gokhale, Parag, Efficient data management improvements, such as docking limited-feature data management modules to a full-featured data management system.
Dwarampudi, Rama Naga Bheemeswara Reddy; Kottomtharayil, Rajiv; Pawar, Rahul S.; Gokhale, Parag, Efficient data management improvements, such as docking limited-feature data management modules to a full-featured data management system.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Lagueux, Jr., Richard A.; Stave, Joel H.; Yeaman, John B.; Stevens, Brian E.; Higgins, Robert M.; Collins, James M., Graphical user interface for configuration of a storage system.
Urevig Paul D. ; Malnati James R. ; Ethen Donald J. ; Weber Herbert L., Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G.; May,Andreas; Schwartz,Jeremy, Hierarchical systems and methods for providing a unified view of storage information.
Barney Rock D. ; Schwols Keith ; Nelson Ellen M., Integration of a database into file management software for protecting, tracking and retrieving data.
Gaonkar, Shravan; Iyer, Rahul; Kenchammana, Deepak, Mapping of logical start addresses to physical start addresses in a system having misalignment between logical and physical data blocks.
Martin Charles W. (Richardson TX) Reid Fredrick S. (Plano TX) Forbus Gary L. (Dallas TX) Adams Steve M. (Plano TX) Shannon C. Patrick (Garland TX) Pirpich Eric A. (Garland TX), Mass data storage and retrieval system.
Kedem Nadav,ILX, Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information .
Long Robert M., Media element library with non-overlapping subset of media elements and non-overlapping subset of media element drives accessible to first host and unaccessible to second host.
Kullick Steven E. ; Spirakis Charles S. ; Titus Diane J., Method and apparatus for transferring archival data among an arbitrarily large number of computer devices in a networked.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Kern Ronald M. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated backup copy ordering in a time zero backup copy session.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Micka William F. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated termination and resumption in a time zero backup copy process.
Walter A. Hubis ; William G. Deitz, Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access .
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S.; Gokhale, Parag; Kottomtharayil, Rajiv, Method and system for offline indexing of content and classifying stored data.
Goggin, Edward J.; Subramanian, Hariharan; Aswani, Sanjana, Method for configuring a physical adapter with virtual function (VF) and physical function (PF) for controlling address translation between virtual disks and physical storage regions.
Aoyama Yuki,JPX ; Takahashi Toru,JPX ; Wakayama Satoshi,JPX, Method of and an apparatus for displaying version information and configuration information and a computer-readable recording medium on which a version and configuration information display program i.
Kumarasamy, Paramasivam; Mitkar, Amit; Degaonkar, Sumedh P.; Pawar, Rahul S.; Bhagi, Sri Karthik, Migration of existing computing systems to cloud computing sites or virtual machines.
Crescenti,John; Kavuri,Srinivas; Oshinsky,David Alan; Prahlad,Anand, Modular backup and retrieval system used in conjunction with a storage area network.
Pawlowski, Brian; Srinivasan, Mohan; Lee, Herman; Rajan, Vijayan; Pittman, Joseph C., Multi-protocol storage appliance that provides integrated support for file and block access protocols.
Pisello Thomas (De Bary FL) Crossmier David (Casselberry FL) Ashton Paul (Oviedo FL), Network management system having virtual catalog overview of files distributively stored across network domain.
Prahlad, Anand; Muller, Marcus S.; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj, Performing data storage operations with a cloud environment, including containerized deduplication, data pruning, and data transfer.
Crockett Robert N. (Tucson AZ) Kern Ronald M. (Tucson AZ) Micka William F. (Tucson AZ), Software directed microcode state save for distributed storage controller.
Rajan,Vijayan; Srinivasan,Mohan; Pawlowski,Brian; Bolen,David Brittain; Lewis,Blake H., Storage virtualization by layering virtual disk objects on a file system.
Retnamma,Manoj Vijayan; Amarendran,Arun; Kottomtharayil,Rajiv, System and method for combining data streams in pipelined storage operations in a storage network.
Kottomtharayil,Rajiv; Gokhale,Parag; Prahlad,Anand; Vijayan Retnamma,Manoj Kumar; Ngo,David; Devassy,Varghese, System and method for dynamically performing storage operations in a computer network.
Mutalik Madhav ; Senie Faith M., System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map.
Lent, Arthur F.; Pawlowski, Brian; Rajan, Vijayan; Kimmel, Jeffrey S.; Srinivasan, Mohan, System and method for transparently accessing a virtual disk using a file-based protocol.
Huai ReiJane (Old Brookville NY) Daly Robert (Ronkonkoma NY) Curti Walter (Dix Hills NY) Mohan Deepak (Huntington NY) Chueh James Kuang-Ru (Bayside NY) Louie Larry (Forest Hills NY), System and parallel streaming and data stripping to back-up a network.
Stoppani ; Jr. Peter (Woodinville WA), System for allocating storage spaces based upon required and optional service attributes having assigned piorities.
Flynn Rex A. (Belmont MA) Anick Peter G. (Marlboro MA), System for reconstructing prior versions of indexes using records indicating changes between successive versions of the.
Saether Christian D. (Seattle WA) Stoppani ; Jr. Peter (Woodinville WA), System of device independent file directories using a tag between the directories and file descriptors that migrate with.
Brunet, Jeffrey; Chowdhary, Yousuf; Collins, Ian; Pan, Hai Sheng; Kusov, Valeriy, Systems and methods for converting a media player into a backup device.
Mikesell, Paul A.; Anderson, Rob; Passey, Aaron James; Godman, Peter John; Khan, Hassan F.; Schack, Darren P., Systems and methods for restriping files in a distributed file system.
Scott W. Devine ; Edouard Bugnion ; Mendel Rosenblum, Virtualization system including a virtual machine monitor for a computer with a segmented architecture.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.