Advanced Eager Scheduling for Java-Based
Adaptively Parallel Computing
Michael O. Neary Peter Cappello
Abstract
Javelin 3 is a software system for developing large-scale, fault tolerant,
adaptively parallel applications. When all or part of their application
can be cast as a master-worker or branch-and-bound computation, Javelin
3 frees application developers from concerns about inter-processor communication
and fault tolerance among networked hosts, allowing them to focus on the
underlying application. The paper describes a fault tolerant task scheduler
and its performance analysis. The task scheduler integrates work
stealing with an advanced form of eager scheduling. It enables dynamic
task decomposition, which improves host
load-balancing in the presence of tasks whose non-uniform computational
load is evident only at execution time. Speedup measurements are presented
of actual performance on up to 1,000 hosts. We analyze the expected
performance degradation due to unresponsive hosts, and measure actual performance
degradation due to unresponsive hosts.
BibTex
@inproceedings{cappello:advanced,
author = {Michael O. Neary
and Peter Cappello},
title = {{Advanced Eager
Scheduling for Java-Based Adaptively Parallel
Computing}},
booktitle = {Proc. ACM Java Grande/ISCOPE Conference},
year = {2002},
pages = {56 - 65},
month = {November}
}
Full version
Presentation
|