Cross-data-store operations in log-coordinated storage systems
원문보기
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06Q-020/14
G06F-017/30
출원번호
US-0491454
(2014-09-19)
등록번호
US-9799017
(2017-10-24)
발명자
/ 주소
Vermeulen, Allan Henry
Zaki, Omer Ahmed
출원인 / 주소
Amazon Technologies, Inc.
대리인 / 주소
Kowert, Robert C.
인용정보
피인용 횟수 :
1인용 특허 :
10
초록▼
Data stores that are to be configured as members of a storage group on behalf of a client are identified. The client indicates one or more types of cross-data-store operations to be performed. A transaction manager that makes acceptance decisions for write requests directed to the members based at l
Data stores that are to be configured as members of a storage group on behalf of a client are identified. The client indicates one or more types of cross-data-store operations to be performed. A transaction manager that makes acceptance decisions for write requests directed to the members based at least partly on contents of a log is instantiated, and respective write transformers are set up for at least some of the types of cross-data-store operations. During a particular time period, the workload at the storage group is monitored, and the number and types of cross-data-store operations is determined. The results of the monitoring are used to determine a billing amount for the client based on a selected pricing policy.
대표청구항▼
1. A system, comprising: one or more computing devices configured to: receive configuration data from a client to configure a log-coordinated storage group of a provider network, the configuration data indicating: a plurality of data stores including a first data store and a second data store to be
1. A system, comprising: one or more computing devices configured to: receive configuration data from a client to configure a log-coordinated storage group of a provider network, the configuration data indicating: a plurality of data stores including a first data store and a second data store to be included as members of the log-coordinated storage group, wherein the first data store responds to read requests formatted in accordance with a first read interface, wherein the second data store responds to read requests received in accordance with a different read interface, and a transaction manager of the log-coordinated storage group that determines whether to accept write requests directed to one or more data stores of the plurality of data stores based at least in part on contents of a write record log; anda cross-data-store operation for the log-coordinated storage group, wherein the cross-data-store operation comprises propagating a write of the first data store to the second data store; andconfigure the log-coordinated storage group according to the configuration data, wherein the configuration comprises determining a write transformer for the log-coordinated storage group used to transform a first representation of data stored in the first data store to a representation of data stored in the second data store. 2. The system as recited in claim 1, wherein the one or more computing devices is configured to register the write transformer as a listener to be notified when the write is applied to the first data store. 3. The system as recited in claim 1, wherein the one or more computing devices is configured to receive code to extend functionality of the write transformer. 4. The system as recited in claim 1, wherein the one or more computing devices is configured to trigger the write transformer based on one or more time-based triggering conditions. 5. The system as recited in claim 1, wherein the first and second data stores comprise one of: a non-relational database system, a relational database system, a storage service that implements a web services interface to allow access to unstructured data objects, an in-memory database, or an instance of distributed cache. 6. A method, comprising: performing, by one or more computing devices: receiving configuration data from a client to configure a log-coordinated storage group of a provider network, the configuration data indicating: a plurality of data stores including a first data store and a second data store to be included as members of the log-coordinated storage group, wherein the first data store responds to read requests formatted in accordance with a first read interface, wherein the second data store responds to read requests received in accordance with a different read interface, and a transaction manager of the log-coordinated storage group that determines whether to accept write requests directed to the plurality of data stores based at least in part on contents of a write record log; anda cross-data-store operation for the log-coordinated storage group, wherein the cross-data-store operation comprises propagating a write of the first data store to the second data store; andconfiguring the log-coordinated storage group according to the configuration data, wherein the configuring comprises determining a write transformer for the log-coordinated storage group used to transform a first representation of data stored in the first data store to a representation of data stored in the second data store. 7. The method as recited in claim 6, wherein configuring the log-coordinated storage group comprises registering the write transformer as a listener to be notified when the write is applied to the first data store. 8. The method as recited in claim 6, further comprising extending functionality of the write transformer based on code received from the client. 9. The method as recited in claim 6, wherein configuring the log-coordinated storage group comprises configuring the write transformer to be triggered based on one or more time-based triggering conditions. 10. The method as recited in claim 6, wherein configuring the log-coordinated storage group comprises configuring the write transformer to be performed as part of a lifecycle workflow operation to transition data from the first data store to the second data store based on elapsed time. 11. The method as recited in claim 6, further comprising collecting metrics data associated with client operations directed to members of the log-coordinated storage group during a time period, wherein the metrics data classify the client operations into a plurality of categories including a cross-data-store category and a single-data-store category; anddetermining a usage metric for the client based at least in part on the metrics data. 12. The method as recited in claim 11, wherein the metrics data includes of a number of client operations performed during the time period for each category, and the usage metric is based at least in part on the number of client operations for each category. 13. The method as recited in claim 11, wherein the metrics data includes of an amount of network traffic generated for client operations, and the usage metric indicates a network bandwidth usage for the client. 14. The method as recited in claim 6, wherein configuring the log-coordinated storage group is based least in part on one or more of a latency requirement, a data durability requirement, or a data availability requirement specified in the configuration data. 15. The method as recited in claim 6, wherein configuring the log-coordinated storage group is based least in part on one or more of an expected request rate for the cross-data-store operation. 16. The method as recited in claim 6, wherein configuring the log-coordinated storage group is based least in part on a mode of resource allocation specified in the configuration data. 17. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors: receive configuration data from a client to configure a log-coordinated storage group of a provider network, the configuration data indicating: a plurality of data stores including a first data store and a second data store to be included as members of the log-coordinated storage group, wherein the first data store responds to read requests formatted in accordance with a first read interface, wherein the second data store responds to read requests received in accordance with a different read interface, and a transaction manager of the log-coordinated storage group that determines whether to accept write requests directed to the plurality of data stores based at least in part on contents of a write record log; anda cross-data-store operation for the log-coordinated storage group, wherein the cross-data-store operation comprises propagating a write of the first data store to the second data store; andconfigure the log-coordinated storage group according to the configuration data, wherein the configuring comprises determining a write transformer for the log-coordinated storage group used to transform a first representation of data stored in the first data store to a representation of data stored in the second data store. 18. The non-transitory computer-accessible storage medium storing program instructions as recited in claim 17, wherein to configure the log-coordinated storage group, the program instructions when executed cause the one or more processors to register the write transformer as a listener to be notified when the write is applied to the first data store. 19. The non-transitory computer-accessible storage medium storing program instructions as recited in claim 17, wherein to configure the log-coordinated storage group, the program instructions when executed cause the one or more processors to configure the write transformer to be triggered based on one or more time-based triggering conditions. 20. The non-transitory computer-accessible storage medium storing program instructions as recited in claim 17, wherein the program instructions when executed cause the one or more processors to: collect metrics data associated with client operations directed to members of the log-coordinated storage group, wherein the metrics data classify the client operations into a plurality of categories including a cross-data-store category and a single-data-store category; anddetermine a usage metric for the client based at least in part on the metrics data. 21. The non-transitory computer-accessible storage medium storing program instructions as recited in claim 17, wherein the program instructions when executed cause the one or more processors to configure the log-coordinated storage group based least in part an expected request rate specified in the configuration data.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (10)
Corbin, Scott Roger; Shepherd, Joel; Pareek, Alok; McAllister, Chris, Apparatus and method for log based replication of distributed transactions using globally acknowledged commits.
Wang, Rui; Byrne, Peter; Stewart, Leigh M.; Dhamankar, Robin D.; Guo, Qun; Habben, Michael E.; Jiang, Xiaowei, Data change ordering in multi-log based replication.
Wu, Tsong-Ho; Li, Wen-Jui, Context-aware virtualized control decision support system for providing quality of experience assurance for internet protocol streaming video services.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.