초록 ▼

A distributed server system is disclosed which includes a load balancer and a plurality of host processors. The load balancer receives requests for service and distributes task assignments among the plurality of processors based upon the amount of work associated with the respective requests for ser

A distributed server system is disclosed which includes a load balancer and a plurality of host processors. The load balancer receives requests for service and distributes task assignments among the plurality of processors based upon the amount of work associated with the respective requests for service. More specifically, each host processor services requests for service within a predefined task size interval and the load balancer assigns to each host processor only those requests for service which involve task sizes within the particular task size interval associated with the respective processor. In the foregoing manner, the variability of the task sizes assigned to any given host processor is minimized and performance of the distributed server system is improved. In one embodiment of the invention, the thresholds defining the task size intervals served by respective host processors are selected using the task size distribution so as to attempt to allocate substantially the same amount of work to each of the host processors. In another embodiment of the invention, the thresholds defining the task size intervals served by the respective host processors are selected so as to intentionally vary the amount of work performed by the respective processors. This embodiment of the invention is intended to service requests for service in the nature of heavy tailed distributions. Task size interval assignments are skewed such that requests for service corresponding to smaller tasks are serviced by a host processor which is more lightly loaded than other processors. In this manner, mean slowdown metrics are improved.

대표청구항 ▼

[ What is claimed is:] [1.]1. Load balancing apparatus for assigning for processing received requests for service, said load balancing apparatus comprising:a plurality of host processors for processing requests for service, wherein each of said host processors is operative to process requests for se

[ What is claimed is:] [1.]1. Load balancing apparatus for assigning for processing received requests for service, said load balancing apparatus comprising:a plurality of host processors for processing requests for service, wherein each of said host processors is operative to process requests for service within a predetermined task size interval;a request dispatch processor operative to receive a request for service and to ascertain, based upon such request, the task size of the respective request;said request dispatch processor operative to dispatch the request for service to one of said plurality of host processors for which the task size interval encompasses the task size for the respective request.