专利名称：LOAD BALANCING USING PROGRESSIVE
SAMPLING BASED ON LOAD BALANCINGQUALITY TARGETS
发明人：Garret Swart,Smriti R. Ramakrishnan申请号：US13561383申请日：20120730
公开号：US20140033223A1公开日：20140130
专利附图：
摘要：A method, system, and computer program product for of load balancing in aparallel map/reduce paradigm. The method commences by sampling a first set of input
records, and forming a prospective load balancing assignment by assigning the first setof input records to the plurality of worker tasks based on a workload estimate for eachof the worker tasks. To measure the prospective load balancing assignment, the methodcompares the workload variance over the plurality of worker tasks to a workloadvariance target, and also calculates a confidence level based on the sampled first set ofinput records. If the measured quality of the prospective load balancing assignment isnot yet achieved, then the method samples additional input records; for example whenthe calculated workload variance is greater than the maximum workload variance targetor when the calculated confidence level is lower than a confidence level threshold.
申请人：Garret Swart,Smriti R. Ramakrishnan
地址：Palo Alto CA US,Palo Alto CA US
国籍：US,US
更多信息请下载全文后查看
因篇幅问题不能全部显示，请点此查看更多更全内容