edu.snu.coral.runtime.master.scheduler

Interface Scheduler

All Known Implementing Classes:

BatchSingleJobScheduler

@DefaultImplementation(value=BatchSingleJobScheduler.class)
public interface Scheduler

Receives jobs to execute and schedules ScheduledTaskGroup to executors.

Method Summary

Modifier and Type	Method and Description
void	onExecutorAdded(String executorId) Called when an executor is added to Runtime, so that the extra resource can be used to execute the job.
void	onExecutorRemoved(String executorId) Called when an executor is removed from Runtime, so that faults related to the removal can be handled.
void	onTaskGroupStateChanged(String executorId, String taskGroupId, TaskGroupState.State newState, int attemptIdx, String taskPutOnHold, TaskGroupState.RecoverableFailureCause failureCause) Called when a TaskGroup's execution state changes.
void	scheduleJob(PhysicalPlan physicalPlan, JobStateManager jobStateManager) Schedules the given job.
void	terminate() To be called when a job should be terminated.
void	updateJob(String jobId, PhysicalPlan newPhysicalPlan, Pair<String,String> taskInfo) Receives and updates the scheduler with a new physical plan for a job.

Method Detail

scheduleJob

void scheduleJob(PhysicalPlan physicalPlan,
                 JobStateManager jobStateManager)

Schedules the given job.

Parameters:

physicalPlan - of the job being submitted.

jobStateManager - to manage the states of the submitted job.

updateJob

void updateJob(String jobId,
               PhysicalPlan newPhysicalPlan,
               Pair<String,String> taskInfo)

Receives and updates the scheduler with a new physical plan for a job.

Parameters:

jobId - the ID of the job to change the physical plan.

newPhysicalPlan - new physical plan for the job.

taskInfo - pair containing the information of the executor id and task group id to mark as complete after the update.

onExecutorAdded

void onExecutorAdded(String executorId)

Called when an executor is added to Runtime, so that the extra resource can be used to execute the job.

Parameters:

executorId - of the executor that has been added.

onExecutorRemoved

void onExecutorRemoved(String executorId)

Called when an executor is removed from Runtime, so that faults related to the removal can be handled.

Parameters:

executorId - of the executor that has been removed.

onTaskGroupStateChanged

void onTaskGroupStateChanged(String executorId,
                             String taskGroupId,
                             TaskGroupState.State newState,
                             int attemptIdx,
                             @Nullable
                             String taskPutOnHold,
                             TaskGroupState.RecoverableFailureCause failureCause)

Called when a TaskGroup's execution state changes.

Parameters:

executorId - of the executor in which the TaskGroup is executing.

taskGroupId - of the TaskGroup whose state must be updated.

newState - for the TaskGroup.

attemptIdx - the number of times this TaskGroup has executed. the below parameters are only valid for failures *****************

taskPutOnHold - the ID of task that are put on hold. It is null otherwise.

failureCause - for which the TaskGroup failed in the case of a recoverable failure.

terminate

void terminate()

To be called when a job should be terminated. Any clean up code should be implemented in this method.