Data object store and server for a cloud storage environment, including data deduplication and data management across multiple cloud storage sites
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-017/30
G06Q-030/02
G06Q-050/18
G06F-003/06
H04L-029/08
G06F-011/34
H04L-029/06
출원번호
US-0494674
(2014-09-24)
등록번호
US-9454537
(2016-09-27)
발명자
/ 주소
Prahlad, Anand
Muller, Marcus S.
Kottomtharayil, Rajiv
Kavuri, Srinivas
Gokhale, Parag
Vijayan, Manoj Kumar
출원인 / 주소
Commvault Systems, Inc.
대리인 / 주소
Perkins Coie LLP
인용정보
피인용 횟수 :
7인용 특허 :
143
초록▼
Data storage operations, including content-indexing, containerized deduplication, and policy-driven storage, are performed within a cloud environment. The systems support a variety of clients and cloud storage sites that may connect to the system in a cloud environment that requires data transfer ov
Data storage operations, including content-indexing, containerized deduplication, and policy-driven storage, are performed within a cloud environment. The systems support a variety of clients and cloud storage sites that may connect to the system in a cloud environment that requires data transfer over wide area networks, such as the Internet, which may have appreciable latency and/or packet loss, using various network protocols, including HTTP and FTP. Methods are disclosed for content indexing data stored within a cloud environment to facilitate later searching, including collaborative searching. Methods are also disclosed for performing containerized deduplication to reduce the strain on a system namespace, effectuate cost savings, etc. Methods are disclosed for identifying suitable storage locations, including suitable cloud storage sites, for data files subject to a storage policy. Further, systems and methods for providing a cloud gateway and a scalable data object store within a cloud environment are disclosed, along with other features.
대표청구항▼
1. A system for storing a set of data files to a cloud storage site, the system comprising memory and a processor that are configured to: provide multiple requests for cloud storage to two or more cloud storage sites, wherein the multiple requests each include a request for data storage to a cloud s
1. A system for storing a set of data files to a cloud storage site, the system comprising memory and a processor that are configured to: provide multiple requests for cloud storage to two or more cloud storage sites, wherein the multiple requests each include a request for data storage to a cloud storage site;wherein the multiple requests each include— information associated with a total size of the set of data files to be stored, andrequirements for the data storage for the set of files;wherein the multiple requests each include at least one pricing rate request; and,wherein the two or more cloud storage sites are respectively operated by two or more independent organizations;receive a response from each at least two of the two or more cloud storage sites, wherein each of the responses from the at least two cloud storage sites includes: a current capacity that is determined based at least in part on: a capacity policy that specifies preferences or criteria associated with data storage for that cloud storage site, anda quotation policy that includes a set of preferences and criteria associated with generating a quote in response to received requests; anda pricing quote for a data storage job at that cloud storage site;select one of the at least two cloud storage sites based on the received responses, wherein the selecting is based at least in part on the pricing quote and the current capacity; and,provide to the selected cloud storage site the set of data files to be stored according to the provided request, the selected received response, or both the provided request and the selected received response. 2. The system of claim 1, wherein the requirements for the data storage for the set of files includes requirements regarding access times, security, or type of data storage medium. 3. The system of claim 1, wherein the selecting includes considering a reliability of the cloud storage site. 4. The system of claim 1, wherein the pricing quote includes at least two different quotes associated with uploading, downloading, searching, or maintenance. 5. A system for identifying storage locations for a set of data files subject to a storage policy, wherein the set of data files is generated within a storage operation cell that has multiple client computers, and wherein the storage operation cell is coupled to multiple cloud storage sites via a network, the system comprising a processor that is configured to: group the data files into at least one logical group of data files using a storage policy, wherein the storage policy defines performance-based classes of storage locations on which the set of data files may be stored,wherein the logical grouping of the set of data files facilitates deduplication of the set of data files;determine aggregate storage requirements of a logical group of data files based at least in part on the storage policy;estimate storage costs for each of two or more candidate storage sites based on historical or projected cost information stored within a storage manager computing device, wherein the storage manager computing device tracks and directs storage operations between client computing devices and secondary storage devices for the storage operation cell;based on the estimated storage costs, identify some of the two or more candidate cloud storage sites to store a copy of the logical group of data files, wherein each of the two or more candidate cloud storage sites are operated by independent organizations;generate a request for quotes for storing a copy of the logical group of data files on one of the candidate cloud storage sites, wherein the request for quotes includes the aggregate storage requirements of the logical group of data files;identify a target cloud storage site from the two or more candidate cloud storage sites by evaluating, based at least in part on received quotes, storage costs of storing a copy of the logical group of data files; wherein the received quotes are based on quotation polices that include a set of preferences and criteria associated with generating a quote in response to received requests and further comprise at least two of: a first pricing rate for an initial upload to the candidate cloud storage sites,a second pricing rate for downloads from the candidate cloud storage sites,a third pricing rate for searching or accessing the candidate cloud storage sites, anda fourth pricing rate for continued storage and maintenance of data on the candidate cloud storage sites;wherein the storage costs include estimated monetary expenses associated with storing the logical group of data objects; andtransmit to storage at least some of the logical group of data files from a client computer to the target cloud storage site. 6. A non-transitory computer-readable medium storing computer-implementable instructions for identifying storage locations for a set of data files, the method comprising: determining storage requirements of a group of data files, wherein the group of data files are logically organized in a primary storage device to facilitate deduplication of the group of data files;estimating storage costs for each of two or more candidate storage sites based on historical or projected cost information stored within a storage manager computing device, wherein the storage manager computing device tracks and directs storage operations between client computing devices and secondary storage devices for a storage operation cell;based on estimating the storage costs, identifying some of the two or more candidate cloud storage sites to store a copy of the group of data files, wherein each of the two or more candidate cloud storage sites are operated by independent organizations;generating a request for quotes for storing a copy of the group of data files on one of the candidate cloud storage sites, wherein the request for quotes includes the aggregate storage requirements of the group of data files, andwherein the request for quotes is provided to the two or more candidate cloud storage sites;receiving one or more quotes from each of the two or more candidate cloud storage sites, wherein the received quotes are based on quotation polices that include a set of preferences and criteria associated with generating a quote in response to received requests,wherein the received quotes include a least price rates for different types of storage media used at the two or more candidate cloud storage sites, andwherein received quotes from individual candidate cloud storage sites further comprise at least two of: a first pricing rate for an initial upload to the candidate cloud storage sites,a second pricing rate for downloads from the candidate cloud storage sites,a third pricing rate for searching or accessing the candidate cloud storage sites, anda fourth pricing rate for continued storage and maintenance of data on the candidate cloud storage sites;identifying a target cloud storage site from the two or more candidate cloud storage sites by evaluating, based at least in part on the received quotes, storage costs of storing a copy of the group of data files, wherein the storage costs include estimated monetary expenses associated with storing the group of data objects, andwherein evaluating storage costs is based at least in part on a reputation or reliability of the candidate cloud storage sites; andcausing at least some of the group of data files to be sent to the target cloud storage site for storage. 7. The computer-readable medium of claim 6, wherein identifying the target cloud storage site includes consideration of fault-tolerance and access speed. 8. The computer-readable medium of claim 6, wherein identifying the target cloud storage site includes consideration of different categories of data files and classes of storage locations on which the different categories of data files may be stored. 9. The computer-readable medium of claim 6, further comprising grouping the data files into a set of data files based at least in part on a particular class of storage location. 10. The computer-readable medium of claim 6, wherein a quote received from a candidate cloud storage site further comprises at least two of: a first pricing rate for an initial upload to the candidate cloud storage site;a second pricing rate for downloads from the candidate cloud storage site;a third pricing rate for searching or accessing the candidate cloud storage site; anda fourth pricing rate for continued storage and maintenance of data on the candidate cloud storage site. 11. The computer-readable medium of claim 6, wherein a quote received from a candidate cloud storage site further comprises a time window during which the group of data files are to be transmitted to the candidate cloud storage site. 12. The computer-readable medium of claim 6, further comprising transmitting the request for quotes to a data storage dealer-broker, or a site that aggregates information related to cloud storage costs. 13. The computer-readable medium of claim 6, further comprising accessing information related to local storage devices within the storage operation cell, including information related to at least two of: current or projected power consumption of the storage devices,current or projected power rates,acquisition cost of the storage devices,mean operating time of the storage devices,mean repair time of the storage devices, andmean data access rates of the storage devices. 14. The computer-readable medium of claim 6 further comprising transmitting at least one counteroffer quote request in response to receiving the one or more quotes from each of the two or more candidate cloud storage sites.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (143)
Wang Lichen (150 Tennyson Ave. Palo Alto CA 94301), Apparatus and method for supplying power and wake-up signal using host port\s signal lines of opposite polarities.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
Fung, Henry T., Apparatus, architecture, and method for integrated modular server system providing dynamically power-managed and work-load managed network devices.
Griffin David (Maynard MA) Campbell Jonathan (Acton MA) Reilly Michael (Sterling MA) Rosenbaum Richard (Pepperell MA), Arrangement with cooperating management server node and network service node.
Nakano Toshio (Odawara JPX) Nozawa Masafumi (Odawara JPX) Kurano Akira (Odawara JPX) Hisano Kiyoshi (Odawara JPX) Hoshino Masayuki (Odawara JPX), Backup control method and system in data processing system using identifiers for controlling block data transfer.
Kitajima Hiroyuki (Yokohama) Yamamoto Akira (Yokohama) Doi Takashi (Hadano) Nozawa Masafumi (Odawara JPX), Buffered peripheral system and method for backing up and retrieving data to and from backup memory device.
Cole Leo J. (Raleigh NC) Frantz Curtis J. (Durham NC) Lee Jeannette (Raleigh NC) Ordanic Zvonimir (Raleigh NC) Plank Larry K. (Rochester MN), Centralized management in a computer network.
Carpenter Kelly S. (Fremont CA) Dearing Gerard M. (San Jose CA) Nick Jeffrey M. (Fishkill NY) Strickland Jimmy P. (Saratoga CA) Swanson Michael D. (Poughkeepsie NY) Wilkinson Wendell W. (Hyde Park NY, Coherence controls for store-multiple shared data coordinated by cache directory entries in a shared electronic storage.
Fellenstein,Craig William; Hamilton, II,Rick Allen; Joseph,Joshy; Seaman,James W., Computer implemented method for automatically controlling selection of a grid provider for a grid job.
Mogi, Kazuhiko; Nishikawa, Norifumi; Idei, Hideomi, Computer system for managing performances of storage apparatus and performance management method of the computer system.
Senator Steven T. ; Fuller Billy J., Computer system method and apparatus providing for various versions of a file without requiring data copy or log operati.
Fecteau Jean G. (Toronto NY CAX) Gdaniec Joseph M. (Vestal NY) Hennessy James P. (Endicott NY) MacDonald John F. (Vestal NY) Osisek Damian L. (Vestal NY), Computer system which supports asynchronous commitment of data.
Prahlad, Anand; Muller, Marcus S.; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj, Data object store and server for a cloud storage environment, including data deduplication and data management across multiple cloud storage sites.
Dunphy William E. (Westminster CO) Halladay Steven M. (Louisville CO) Moy Michael E. (Lafayette CO) Munro Frederick G. (Broomfield CO), Data storage and protection system.
Yanai Moshe (Framingham MA) Vishlitzky Natan (Brookline MA) Alterescu Bruno (Newton MA) Castel Daniel (Framingham MA) Shklarsky Gadi (Brookline MA), Data storage system controlled remote data mirroring with respectively maintained data indices.
Mega, Cataldo; Veliah, Sundar, Determining, transmitting, and receiving performance information with respect to an operation performed locally and at remote nodes.
Fortier Richard W. (Acton MA) Mastors Robert M. (Ayer MA) Taylor Tracy M. (Upton MA) Wallace John J. (Franklin MA), Digital data processor with improved backup storage.
Kenley Gregory (Northboro MA) Ericson George (Schrewsbury MA) Fortier Richard (Acton MA) Holland Chuck (Northboro MA) Mastors Robert (Ayer MA) Pownell James (Natick MA) Taylor Tracy (Upton MA) Wallac, Digital data storage system with improved data migration.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Lagueux, Jr., Richard A.; Stave, Joel H.; Yeaman, John B.; Stevens, Brian E.; Higgins, Robert M.; Collins, James M., Graphical user interface for configuration of a storage system.
Urevig Paul D. ; Malnati James R. ; Ethen Donald J. ; Weber Herbert L., Grouping shared resources into one or more pools and automatically re-assigning shared resources from where they are not currently needed to where they are needed.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G.; May,Andreas; Schwartz,Jeremy, Hierarchical systems and methods for providing a unified view of storage information.
Barney Rock D. ; Schwols Keith ; Nelson Ellen M., Integration of a database into file management software for protecting, tracking and retrieving data.
Martin Charles W. (Richardson TX) Reid Fredrick S. (Plano TX) Forbus Gary L. (Dallas TX) Adams Steve M. (Plano TX) Shannon C. Patrick (Garland TX) Pirpich Eric A. (Garland TX), Mass data storage and retrieval system.
Kedem Nadav,ILX, Mass storage subsystem and backup arrangement for digital data processing system which permits information to be backed up while host computer(s) continue(s) operating in connection with information .
Long Robert M., Media element library with non-overlapping subset of media elements and non-overlapping subset of media element drives accessible to first host and unaccessible to second host.
Kullick Steven E. ; Spirakis Charles S. ; Titus Diane J., Method and apparatus for transferring archival data among an arbitrarily large number of computer devices in a networked.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Kern Ronald M. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated backup copy ordering in a time zero backup copy session.
Eastridge Lawrence E. (Tucson AZ) Kern Robert F. (Tucson AZ) Micka William F. (Tucson AZ) Mikkelsen Claus W. (Morgan Hill CA) Ratliff James M. (Tucson AZ), Method and system for automated termination and resumption in a time zero backup copy process.
Walter A. Hubis ; William G. Deitz, Method and system for controlling access share storage devices in a network environment by configuring host-to-volume mapping data structures in the controller memory for granting and denying access .
Aoyama Yuki,JPX ; Takahashi Toru,JPX ; Wakayama Satoshi,JPX, Method of and an apparatus for displaying version information and configuration information and a computer-readable recording medium on which a version and configuration information display program i.
Crescenti,John; Kavuri,Srinivas; Oshinsky,David Alan; Prahlad,Anand, Modular backup and retrieval system used in conjunction with a storage area network.
Pisello Thomas (De Bary FL) Crossmier David (Casselberry FL) Ashton Paul (Oviedo FL), Network management system having virtual catalog overview of files distributively stored across network domain.
Prahlad, Anand; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj, Performing data storage operations in a cloud storage environment, including searching, encryption and indexing.
Prahlad, Anand; Muller, Marcus S.; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj, Performing data storage operations with a cloud environment, including containerized deduplication, data pruning, and data transfer.
Meijer, Henricus Johannes Maria; Bergstraesser, Thomas F.; Brumme, Christopher W.; Cheng, Lili; Gounares, Alexander G.; Larus, James R.; Mishra, Debi P.; Snyder, Jr., Ira L., Resource standardization in an off-premise environment.
Crockett Robert N. (Tucson AZ) Kern Ronald M. (Tucson AZ) Micka William F. (Tucson AZ), Software directed microcode state save for distributed storage controller.
Chidlovskii Boris,FRX ; Glance Natalie S.,FRX ; Grasso Antonietta,FRX, System and method for collaborative ranking of search results employing user and group profiles derived from document collection content analysis.
Pinheiro, Eduardo; Bianchini, Ricardo; Dubnicki, Cezary, System and method for dynamically changing the power mode of storage disks based on redundancy and system load.
Kottomtharayil,Rajiv; Gokhale,Parag; Prahlad,Anand; Vijayan Retnamma,Manoj Kumar; Ngo,David; Devassy,Varghese, System and method for dynamically performing storage operations in a computer network.
Keagy, John Martin; Carr, Jeffery; Lappas, Paul, System and method for monitoring a grid of hosting resources in order to facilitate management of the hosting resources.
Mutalik Madhav ; Senie Faith M., System and method for performing file-handling operations in a digital data processing system using an operating system-independent file map.
Prahlad, Anand; Gokhale, Parag; Kottomtharayil, Rajiv; Vijayan Retnamma, Manoj K.; Attarde, Deepak R., System and method for storing redundant information.
Huai ReiJane (Old Brookville NY) Daly Robert (Ronkonkoma NY) Curti Walter (Dix Hills NY) Mohan Deepak (Huntington NY) Chueh James Kuang-Ru (Bayside NY) Louie Larry (Forest Hills NY), System and parallel streaming and data stripping to back-up a network.
Stoppani ; Jr. Peter (Woodinville WA), System for allocating storage spaces based upon required and optional service attributes having assigned piorities.
Flynn Rex A. (Belmont MA) Anick Peter G. (Marlboro MA), System for reconstructing prior versions of indexes using records indicating changes between successive versions of the.
Saether Christian D. (Seattle WA) Stoppani ; Jr. Peter (Woodinville WA), System of device independent file directories using a tag between the directories and file descriptors that migrate with.
Prahlad, Anand; Schwartz, Jeremy A.; Ngo, David; Brockway, Brian; Muller, Marcus S., Systems and methods for classifying and transferring information in a storage network.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G.; May,Andreas; Schwartz,Jeremy, Systems and methods for generating a storage-related metric.
Prahlad, Anand; Kavuri, Srinivas; Madeira, Andre Duque; Lunde, Norman R.; Bunte, Alan G.; May, Andreas; Schwartz, Jeremy, Systems and methods for storage modeling and costing.
Prahlad,Anand; Kavuri,Srinivas; Madeira,Andre Duque; Lunde,Norman R.; Bunte,Alan G; May,Andreas; Schwartz,Jeremy, Systems and methods for storage modeling and costing.
Prahlad, Anand; Muller, Marcus S.; Kottomtharayil, Rajiv; Kavuri, Srinivas; Gokhale, Parag; Vijayan, Manoj Kumar, Data object store and server for a cloud storage environment, including data deduplication and data management across multiple cloud storage sites.
Vijayan, Manoj Kumar; Chen, Ho-Chi; Attarde, Deepak Raghunath; Joshi, Hetalkumar N., Information management of data associated with multiple cloud services.
Vijayan, Manoj Kumar; Chen, Ho-Chi; Attarde, Deepak Raghunath; Joshi, Hetalkumar N., Information management of data associated with multiple cloud services.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.