System and method for performing multistream storage operations
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-015/16
G06F-015/173
출원번호
US-0366082
(2012-02-03)
등록번호
US-8281028
(2012-10-02)
발명자
/ 주소
Gokhale, Parag
Kottomtharayil, Rajiv
Pawar, Rahul S.
Prahlad, Anand
출원인 / 주소
Commvault Systems, Inc.
대리인 / 주소
Knobbe, Martens, Olson & Bear LLP
인용정보
피인용 횟수 :
1인용 특허 :
139
초록▼
Systems and methods for performing storage operations over multi-stream data paths are provided. A first agent receives a request for a storage operation from a storage manager, identifies folders of a client computing device based on one or more file types of files in the folders of the client comp
Systems and methods for performing storage operations over multi-stream data paths are provided. A first agent receives a request for a storage operation from a storage manager, identifies folders of a client computing device based on one or more file types of files in the folders of the client computing device, weights the folders based on the amount of data in the folders, and groups the folders into two or more sets of folders based at least in part on a file type of one or more of the files in the folders and the weight of the folders. A second agent transmits data from each of the two or more sets of folders to one or more storage devices in via at least one of two or more streaming communications paths based on pathway characteristics.
대표청구항▼
1. A method for performing a dynamic multi-stream storage operation to transmit data from a client computing device to one or more storage devices, the method comprising: receiving a request for a storage operation from a storage manager;identifying folders of an information store associated with a
1. A method for performing a dynamic multi-stream storage operation to transmit data from a client computing device to one or more storage devices, the method comprising: receiving a request for a storage operation from a storage manager;identifying folders of an information store associated with a client computing device based on one or more file types of files in the folders of the information store;weighting the folders, using one or more processors, based on the amount of data in the folders;grouping the folders into two or more sets of folders based at least in part on a file type of one or more of files in the folders and on the weighting of the folders; andtransmitting data from each of the two or more sets of folders to one or more storage devices via at least one of two or more streaming communications paths based on pathway characteristics, whereinthe pathway characteristics include a determination of whether a transmission time threshold is exceeded by transmitting data over at least one of the two or more streaming communication paths. 2. The method of claim 1, further comprising determining whether storage network resources within the two or more streaming communication paths are available. 3. The method of claim 1, further comprising determining whether performing a multi-stream storage operation over only one streaming communication path would exceed a load threshold. 4. The method of claim 1, wherein grouping the folders into the two or more sets of folders further comprises grouping the folders based at least in part on a priority level of the folders. 5. The method of claim 1, wherein grouping the folders into the two or more sets of folders further comprises grouping the folders based at least in part on an impact of scheduled data transmissions. 6. The method of claim 1, wherein grouping the folders into the two or more sets of folders further comprises grouping the folders based at least in part on the number of items in the folders. 7. The method of claim 1, wherein grouping the folders into the two or more sets of folders further comprises grouping the folders based at least in part on available storage devices within the streaming communication paths. 8. The method of claim 7, wherein grouping the folders into the two or more sets of folders further comprises grouping the folders based at least in part on a capacity of the available storage devices. 9. The method of claim 1, wherein grouping the folders into the two or more sets of folders further comprises grouping the folders based at least in part on a transmission time of data associated with the first sub-client. 10. The method of claim 1, further comprising allocating each of the two or more sets of folders to a respective one of the two or more streaming communication paths dynamically based at least in part on a number of the sets of folders. 11. The method of claim 1, wherein the each folder of the client is transmitted via a separate streaming communication path. 12. The method of claim 1, further comprising allocating a first set of folders of the two or more sets of folders to a first streaming communication path based at least in part on the characteristics of the first streaming communication path and on the weight associated with the folders of the first set of folders. 13. A multi-stream storage operation system comprising: one or more processors on a computing device;a first agent, executing in the one or more processors on the computing device, the executing comprising:receiving a request for a storage operation from a storage manager,identifying folders of a client computing device based on one or more file types of files in the folders of the client computing device,weighting the folders based on the amount of data in the folders, andgrouping the folders into two or more sets of folders based at least in part on a file type of one or more of the files in the folders and on the weighting of the folders; anda second agent, executing in the one or more processors on the computing device, the executing of the second agent comprising:transmitting data from each of the two or more sets of folders to one or more storage devices via at least one of two or more streaming communications paths based on pathway characteristics, whereinthe pathway characteristics include a determination of whether a transmission time threshold is exceeded by transmitting data over at least one of the two or more streaming communication paths. 14. The system of claim 13, wherein the first agent is a data agent and the computing device is the client computing device. 15. The system of claim 13, wherein the first agent groups the folders based at least in part on a bandwidth of the storage network. 16. The system of claim 13, wherein the first agent groups the folders based at least in part on an impact of scheduled data transmissions. 17. The system of claim 13, wherein the first agent groups the folders based at least in part on an availability of the storage network resources. 18. A non-transitory computer-readable storage medium having one or more computer-executable modules for multi-stream storage operations, the one or more computer-executable modules comprising: a weighting module, wherein the weighting module:receives a request for a storage operation from a storage manager,identifies folders of a client computing device based on one or more file types of files in the folders of the client computing device,weights the folders based on the amount of data in the folders, andgroups the folders into two or more sets of folders based at least in part on a file type of one or more of files in the folders and on the weights of the folders; anda transmission module, wherein the transmission module:transmits data from each of the two or more sets of folders to one or more storage devices via at least one of two or more streaming communications paths based on pathway characteristics, whereinthe pathway characteristics include a determination of whether a transmission time threshold is exceeded by transmitting data over at least one of the two or more streaming communication paths. 19. The non-transitory computer-readable storage medium of claim 18, wherein the weighting module groups the folders based at least in part on an impact of scheduled data transmissions. 20. The non-transitory computer-readable storage medium of claim 18, wherein the weighting module groups the folders based at least in part on the number of items in the folders.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (139)
Prasad Rama R. (Beaverton OR) Chary Ram V. (Beaverton OR), Apparatus and method for event tagging for multiple audio, video, and data streams.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
Griffin David (Maynard MA) Campbell Jonathan (Acton MA) Reilly Michael (Sterling MA) Rosenbaum Richard (Pepperell MA), Arrangement with cooperating management server node and network service node.
Nakano Toshio (Odawara JPX) Nozawa Masafumi (Odawara JPX) Kurano Akira (Odawara JPX) Hisano Kiyoshi (Odawara JPX) Hoshino Masayuki (Odawara JPX), Backup control method and system in data processing system using identifiers for controlling block data transfer.
Burk John L. (Poughkeepsie NY) Cormier Roger L. (Pleasant Valley NY) Hartung Michael H. (Tucson AZ) Larner Ray A. (Georgetown TX) Lucas Donald J. (Poughkeepsie NY) Lynch Kenneth R. (Rhinebeck NY) Moo, Block transfers of information in data processing networks.
Kitajima Hiroyuki (Yokohama) Yamamoto Akira (Yokohama) Doi Takashi (Hadano) Nozawa Masafumi (Odawara JPX), Buffered peripheral system and method for backing up and retrieving data to and from backup memory device.
Cole Leo J. (Raleigh NC) Frantz Curtis J. (Durham NC) Lee Jeannette (Raleigh NC) Ordanic Zvonimir (Raleigh NC) Plank Larry K. (Rochester MN), Centralized management in a computer network.
Carpenter Kelly S. (Fremont CA) Dearing Gerard M. (San Jose CA) Nick Jeffrey M. (Fishkill NY) Strickland Jimmy P. (Saratoga CA) Swanson Michael D. (Poughkeepsie NY) Wilkinson Wendell W. (Hyde Park NY, Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage.
Eric C. Peters ; Stanley Rabinowitz ; Herbert R. Jacobs ; Richard Baker Gillett, Jr. ; Peter J. Fasciano, Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner.
Senator Steven T. ; Fuller Billy J., Computer system method and apparatus providing for various versions of a file without requiring data copy or log operati.
Fecteau Jean G. (Toronto NY CAX) Gdaniec Joseph M. (Vestal NY) Hennessy James P. (Endicott NY) MacDonald John F. (Vestal NY) Osisek Damian L. (Vestal NY), Computer system which supports asynchronous commitment of data.
Meier Stephan G. ; Juffa Norbert ; Achenbach Michael D. ; Weber Frederick D., Converting register data from a first format type to a second format type if a second type instruction consumes data produced by a first type instruction.
Witt David B. ; Hattangadi Rajiv M., Data cache which speculatively updates a predicted data cache storage location with store data and subsequently correct.
Koseki, Michihiko; Yokoyama, Mamoru; Sumi, Masashi; Yamaguchi, Satoru; Taniwaki, Sadayoshi; Hamanaka, Seishiro, Data processing system with mechanism for restoring file systems based on transaction logs.
Dunphy William E. (Westminster CO) Halladay Steven M. (Louisville CO) Moy Michael E. (Lafayette CO) Munro Frederick G. (Broomfield CO), Data storage and protection system.
Yanai Moshe (Framingham MA) Vishlitzky Natan (Brookline MA) Alterescu Bruno (Newton MA) Castel Daniel (Framingham MA) Shklarsky Gadi (Brookline MA), Data storage system controlled remote data mirroring with respectively maintained data indices.
Fortier Richard W. (Acton MA) Mastors Robert M. (Ayer MA) Taylor Tracy M. (Upton MA) Wallace John J. (Franklin MA), Digital data processor with improved backup storage.
Kenley Gregory (Northboro MA) Ericson George (Schrewsbury MA) Fortier Richard (Acton MA) Holland Chuck (Northboro MA) Mastors Robert (Ayer MA) Pownell James (Natick MA) Taylor Tracy (Upton MA) Wallac, Digital data storage system with improved data migration.
Chai Philip K. (San Jose CA) Ng Chan Y. (San Jose CA) Paveza John R. (Morgan Hill CA) Shipman ; Jr. Lloyd R. (San Jose CA) Xydes Christ J. (Gilroy CA), Fault tolerant data storage subsystem employing hierarchically arranged controllers.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Lagueux, Jr., Richard A.; Stave, Joel H.; Yeaman, John B.; Stevens, Brian E.; Higgins, Robert M.; Collins, James M., Graphical user interface for configuration of a storage system.
Urevig Paul D. ; Malnati James R. ; Ethen Donald J. ; Weber Herbert L., Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed.
Barney Rock D. ; Schwols Keith ; Nelson Ellen M., Integration of a database into file management software for protecting, tracking and retrieving data.
Oshinsky, David Alan; Ignatius, Paul; Prahlad, Anand; May, Andreas, Logical view and access to data managed by a modular data and storage management system.
Ignatius, Paul; Theisen, Marjorie H.; Oshinsky, David Alan; Kavuri, Srinivas, Logical view and access to physical storage in modular data and storage management system.
Martin Charles W. (Richardson TX) Reid Fredrick S. (Plano TX) Forbus Gary L. (Dallas TX) Adams Steve M. (Plano TX) Shannon C. Patrick (Garland TX) Pirpich Eric A. (Garland TX), Mass data storage and retrieval system.
Kedem Nadav,ILX, Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information .
Long Robert M., Media element library with non-overlapping subset of media elements and non-overlapping subset of media element drives accessible to first host and unaccessible to second host.
Harrison David F. (Boulder Creek CA) Williams Russell T. (San Jose CA) Saulpaugh Thomas E. (San Jose CA), Method and apparatus for consolidated buffer handling for computer device input/output.
Amundson Daniel L. ; Halley Donald Ray ; Koeller Paul Douglas ; Koser Leonard William ; Smith Lynda Marie, Method and apparatus for data backup and recovery.
Kullick Steven E. ; Spirakis Charles S. ; Titus Diane J., Method and apparatus for transferring archival data among an arbitrarily large number of computer devices in a networked.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Kern Ronald M. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated backup copy ordering in a time zero backup copy session.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Micka William F. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated termination and resumption in a time zero backup copy process.
Walter A. Hubis ; William G. Deitz, Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access .
Aoyama Yuki,JPX ; Takahashi Toru,JPX ; Wakayama Satoshi,JPX, Method of and an apparatus for displaying version information and configuration information and a computer-readable recording medium on which a version and configuration information display program i.
Crescenti,John; Kavuri,Srinivas; Oshinsky,David Alan; Prahlad,Anand, Modular backup and retrieval system used in conjunction with a storage area network.
Pisello Thomas (De Bary FL) Crossmier David (Casselberry FL) Ashton Paul (Oviedo FL), Network management system having virtual catalog overview of files distributively stored across network domain.
Clapp, Doug; Mulder, David, Peripheral video conferencing system with control unit for adjusting the transmission bandwidth of the communication channel.
Rohler David P. ; Dechant Thomas E. ; Boasten Michelle F., Phone-assisted clinical document information computer system for use in home healthcare, post-acute clinical care, hospice and home infusion applications.
Fecteau Jean Gilles (Toronto CAX) Kligerman Eugene (North York CAX) Kollar Lubor (North York CAX), Product for global updating modified data object represented in concatenated multiple virtual space by segment mapping.
Crockett Robert N. (Tucson AZ) Kern Ronald M. (Tucson AZ) Micka William F. (Tucson AZ), Software directed microcode state save for distributed storage controller.
Kottomtharayil,Rajiv; Gokhale,Parag; Prahlad,Anand; Vijayan Retnamma,Manoj Kumar; Ngo,David; Devassy,Varghese, System and method for dynamically performing storage operations in a computer network.
Richard J. Huebsch ; Robert J. Prieve ; Leonard Kampa, System and method for multiplexed data back-up to a storage tape and restore operations using client identification tags.
Mutalik Madhav ; Senie Faith M., System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map.
Huai ReiJane (Old Brookville NY) Daly Robert (Ronkonkoma NY) Curti Walter (Dix Hills NY) Mohan Deepak (Huntington NY) Chueh James Kuang-Ru (Bayside NY) Louie Larry (Forest Hills NY), System and parallel streaming and data stripping to back-up a network.
Stoppani ; Jr. Peter (Woodinville WA), System for allocating storage spaces based upon required and optional service attributes having assigned piorities.
Tran Nghia ; Li Ying Xuan ; Balicki Janusz ; Costello John, System for coupling programmable logic device to external circuitry which selects a logic standard and uses buffers to m.
Flynn Rex A. (Belmont MA) Anick Peter G. (Marlboro MA), System for reconstructing prior versions of indexes using records indicating changes between successive versions of the.
Saether Christian D. (Seattle WA) Stoppani ; Jr. Peter (Woodinville WA), System of device independent file directories using a tag between the directories and file descriptors that migrate with.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.