초록 ▼

Some embodiments dynamically test capacity of a streaming server under test (SUT). The dynamic testing involves a test server generating different test scenarios. Each test scenario specifies a mix of different streaming protocols, content streams, and content stream upload to download ratio. The te

Some embodiments dynamically test capacity of a streaming server under test (SUT). The dynamic testing involves a test server generating different test scenarios. Each test scenario specifies a mix of different streaming protocols, content streams, and content stream upload to download ratio. The test server tests the SUT with a gradually increasing traffic load from each test scenario while monitoring SUT performance under each load. The test server records each load from each test scenario under which the SUT becomes saturated. The test server produces a grid mapping the observed SUT saturation points to the test loads that caused them. The grid is used when the SUT is deployed to a production environment to determine if SUT saturation is imminent based on current traffic patterns being serviced by the SUT in the production environment. If so, a remedial action is dynamically performed to prevent the saturation from occurring.

대표청구항 ▼

1. A method comprising: testing a streaming server under test (SUT) with a plurality of different test scenarios, each test scenario of the plurality of test scenarios specifying a different traffic mix with which to test SUT streaming capacity, wherein said testing comprises increasing each traffic

1. A method comprising: testing a streaming server under test (SUT) with a plurality of different test scenarios, each test scenario of the plurality of test scenarios specifying a different traffic mix with which to test SUT streaming capacity, wherein said testing comprises increasing each traffic mix from each test scenario of the plurality of test scenarios until the traffic mix achieves one of a plurality of SUT saturation points, wherein the traffic mix of each test scenario of the plurality of test scenarios comprises a different ratio of content streams and a different set of streaming protocols to simultaneously publish to the SUT and download from the SUT, and wherein increasing the traffic mix of each particular test scenario comprises increasing a number of content streams being simultaneously published to and downloaded from the SUT according to the ratio for the particular test scenario;tracking for each SUT saturation point from the plurality of SUT saturation points, a particular traffic mix from each test scenario of the plurality of test scenarios achieving the SUT saturation point;monitoring a real-time traffic mix placed on the SUT by a plurality of customers when the SUT operates in a production environment; andperforming a preemptive action as a result of a particular SUT saturation point of the plurality of SUT saturation points becoming imminent due to the real-time traffic mix mirroring any particular traffic mix from any test scenario of the plurality of test scenarios achieving said particular SUT saturation point. 2. The method of claim 1, wherein performing the preemptive action comprises redirecting a subset of the real-time traffic mix from the SUT to another streaming server operating in the production environment. 3. The method of claim 1, wherein performing the preemptive action comprises dynamically allocating additional resources to the SUT. 4. The method of claim 3 further comprising identifying at least one particular SUT resource from a plurality of resources that is affected by the particular SUT saturation point. 5. The method of claim 4, wherein dynamically allocating additional resources to the SUT comprises increasing the at least one particular SUT resource affected by the particular SUT saturation point. 6. The method of claim 1, wherein performing the preemptive action comprises performing a first action as a result of the real-traffic mix mirroring a particular traffic mix from a test scenario achieving a first SUT saturation point from the plurality of SUT saturation points and performing a different second action as a result of the real-traffic mix mirroring a particular traffic mix from a test scenario achieving a second SUT saturation point from the plurality of SUT saturation points. 7. The method of claim 1, wherein each SUT saturation point of the plurality of SUT saturation points is linked to a different one of processor, memory, and network resources of the SUT becoming saturated. 8. The method of claim 1, wherein each SUT saturation point of the plurality of SUT saturation points is linked to a different failure or decrease in SUT performance. 9. The method of claim 1, wherein the traffic mix of each test scenario of the plurality of test scenarios further comprises using a different set of content streams for said publishing and downloading, wherein the different set of content streams comprises different bitrates, codecs, and formats. 10. A method comprising discovering streaming server capacity under a first test scenario of a plurality of test scenarios, wherein said discovering comprises generating a first load on the streaming server by (i) emulating client-side operation of a first set of clients simultaneously publishing to and downloading from the streaming server, a first set of content streams using a first set of streaming protocols, (ii) increasing the first load until achieving a failure or performance degradation associated with each saturation point of a set of streaming server saturation points, and (iii) recording a load at which the first test scenario achieves each saturation point of the set of streaming server saturation points;discovering streaming server capacity under a second test scenario of the plurality of test scenarios, wherein said discovering comprises generating a second load on the streaming server by (i) emulating client-side operation of a different second set of clients simultaneously publishing to and downloading from the streaming server, a different second set of content streams using a different second set of streaming protocols, (ii) increasing the second load until achieving a failure or performance degradation associated with each saturation point of the set of streaming server saturation points, and (iii) recording a load at which the second test scenario achieves each saturation point of the set of streaming server saturation points; andproducing a grid with each particular saturation point of the set of streaming server saturation points and a corresponding load of the first test scenario and the second test scenario achieving the particular saturation point. 11. The method of claim 10 further comprising monitoring performance of the streaming server in a production environment by periodically taking snapshots of real-world traffic patterns imposed on the streaming server. 12. The method of claim 11 further comprising mapping said snapshots to the grid and identifying a real-world traffic pattern snapshot mirroring a load from any of the first test scenario and the second test scenario achieving a specific streaming server saturation point from the set of streaming server saturation points that is imminent. 13. The method of claim 12 further comprising outputting a warning identifying the specific streaming server saturation point that is imminent based on the real-world traffic pattern snapshot. 14. The method of claim 13, wherein said outputting comprises highlighting a region of the grid corresponding to the specific streaming server saturation point and the load from any of the first test scenario and the second test scenario achieving the streaming server saturation point. 15. The method of claim 12, performing a remedial action to prevent the specific streaming server saturation point from occurring, wherein said remedial action comprises one of dynamically increasing streaming server resources in imminent risk of saturation and dynamically routing real-world traffic away from the streaming server. 16. A dynamic load test system comprising: a network interface communicably coupled to a streaming server under test (SUT);a memory storing a plurality of test streams;a processor dynamically load testing the SUT by generating a plurality of different test scenarios from the plurality of test streams and determining a load at which each test scenario of the plurality of test scenarios saturates the SUT, wherein determining the load at which each test scenario saturates the SUT comprises gradually increasing a load imposed on the SUT by each test scenario of the plurality of test scenarios until SUT performance degrades or fails and recording to said memory, the load at which each of the plurality of test scenarios causes SUT performance to degrade or fail,wherein the plurality of test scenarios comprises (i) a first test scenario generating a first load on the SUT by uploading to the SUT, a first set of the plurality of test streams using a first set of streaming protocols while simultaneously downloading from the SUT, a second set of the plurality of test streams using a second set of network protocols and (ii) a second test scenario generating a second load on the SUT by uploading to the SUT, a third set of the plurality of test streams using a third set of streaming protocols while simultaneously downloading from the SUT, a fourth set of the plurality of test streams using a fourth set of streaming protocols. 17. The dynamic load test system of claim 16, wherein the processor further monitors performance of the SUT under differing loads of the plurality of test scenarios. 18. The dynamic load test system of claim 16 further comprising a display presenting a plurality of different SUT saturation points and loads from each of the plurality of test scenarios producing each of the plurality of SUT saturation points.