edu.snu.coral.runtime.master.scheduler

Class BatchSingleJobScheduler

java.lang.Object

edu.snu.coral.runtime.master.scheduler.BatchSingleJobScheduler

All Implemented Interfaces:

Scheduler

public final class BatchSingleJobScheduler
extends Object
implements Scheduler

BatchSingleJobScheduler receives a single PhysicalPlan to execute and schedules the TaskGroups. The policy by which it schedules them is dependent on the implementation of SchedulingPolicy.

Constructor Summary

Constructors

Constructor and Description
BatchSingleJobScheduler(SchedulingPolicy schedulingPolicy, SchedulerRunner schedulerRunner, PendingTaskGroupQueue pendingTaskGroupQueue, BlockManagerMaster blockManagerMaster, PubSubEventHandlerWrapper pubSubEventHandlerWrapper, UpdatePhysicalPlanEventHandler updatePhysicalPlanEventHandler)

Method Summary

Modifier and Type	Method and Description
void	onExecutorAdded(String executorId) Called when an executor is added to Runtime, so that the extra resource can be used to execute the job.
void	onExecutorRemoved(String executorId) Called when an executor is removed from Runtime, so that faults related to the removal can be handled.
void	onTaskGroupStateChanged(String executorId, String taskGroupId, TaskGroupState.State newState, int attemptIdx, String taskPutOnHold, TaskGroupState.RecoverableFailureCause failureCause) Receives a ControlMessage.TaskGroupStateChangedMsg from an executor.
void	scheduleJob(PhysicalPlan jobToSchedule, JobStateManager scheduledJobStateManager) Receives a job to schedule.
void	terminate() To be called when a job should be terminated.
void	updateJob(String jobId, PhysicalPlan newPhysicalPlan, Pair<String,String> taskInfo) Receives and updates the scheduler with a new physical plan for a job.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BatchSingleJobScheduler

@Inject
public BatchSingleJobScheduler(SchedulingPolicy schedulingPolicy,
                                       SchedulerRunner schedulerRunner,
                                       PendingTaskGroupQueue pendingTaskGroupQueue,
                                       BlockManagerMaster blockManagerMaster,
                                       PubSubEventHandlerWrapper pubSubEventHandlerWrapper,
                                       UpdatePhysicalPlanEventHandler updatePhysicalPlanEventHandler)

Method Detail

scheduleJob

public void scheduleJob(PhysicalPlan jobToSchedule,
                        JobStateManager scheduledJobStateManager)

Receives a job to schedule.

Specified by:

scheduleJob in interface Scheduler

Parameters:

jobToSchedule - the physical plan for the job.

scheduledJobStateManager - to keep track of the submitted job's states.

updateJob

public void updateJob(String jobId,
                      PhysicalPlan newPhysicalPlan,
                      Pair<String,String> taskInfo)

Description copied from interface: Scheduler

Receives and updates the scheduler with a new physical plan for a job.

Specified by:

updateJob in interface Scheduler

Parameters:

jobId - the ID of the job to change the physical plan.

newPhysicalPlan - new physical plan for the job.

taskInfo - pair containing the information of the executor id and task group id to mark as complete after the update.

onTaskGroupStateChanged

public void onTaskGroupStateChanged(String executorId,
                                    String taskGroupId,
                                    TaskGroupState.State newState,
                                    int attemptIdx,
                                    @Nullable
                                    String taskPutOnHold,
                                    TaskGroupState.RecoverableFailureCause failureCause)

Receives a ControlMessage.TaskGroupStateChangedMsg from an executor. The message is received via communicator where this method is called.

Specified by:

onTaskGroupStateChanged in interface Scheduler

Parameters:

executorId - the id of the executor where the message was sent from.

taskGroupId - whose state has changed

newState - the state to change to

taskPutOnHold - the ID of task that are put on hold. It is null otherwise.

attemptIdx - the number of times this TaskGroup has executed. the below parameters are only valid for failures *****************

failureCause - for which the TaskGroup failed in the case of a recoverable failure.

onExecutorAdded

public void onExecutorAdded(String executorId)

Description copied from interface: Scheduler

Called when an executor is added to Runtime, so that the extra resource can be used to execute the job.

Specified by:

onExecutorAdded in interface Scheduler

Parameters:

executorId - of the executor that has been added.

onExecutorRemoved

public void onExecutorRemoved(String executorId)

Description copied from interface: Scheduler

Called when an executor is removed from Runtime, so that faults related to the removal can be handled.

Specified by:

onExecutorRemoved in interface Scheduler

Parameters:

executorId - of the executor that has been removed.

terminate

public void terminate()

Description copied from interface: Scheduler

To be called when a job should be terminated. Any clean up code should be implemented in this method.

Specified by:

terminate in interface Scheduler