edu.snu.coral.runtime.master

Class RuntimeMaster

java.lang.Object

edu.snu.coral.runtime.master.RuntimeMaster

public final class RuntimeMaster
extends Object

Runtime Master is the central controller of Runtime. Compiler submits an PhysicalPlan to Runtime Master to execute a job. Runtime Master handles: a) Scheduling the job with Scheduler, SchedulerRunner, PendingTaskGroupQueue. b) Managing resources with ContainerManager. c) Managing blocks with BlockManagerMaster. d) Receiving and sending control messages with MessageEnvironment. e) Metric using MetricMessageHandler.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	RuntimeMaster.MasterControlMessageReceiver Handler for control messages received by Master.

Constructor Summary

Constructors

Constructor and Description
RuntimeMaster(Scheduler scheduler, SchedulerRunner schedulerRunner, PendingTaskGroupQueue pendingTaskGroupQueue, ContainerManager containerManager, BlockManagerMaster blockManagerMaster, MetricMessageHandler metricMessageHandler, MessageEnvironment masterMessageEnvironment, String dagDirectory)

Method Summary

Modifier and Type	Method and Description
void	accumulateBarrierMetric(List<Long> blockSizeInfo, String srcVertexId, String blockId) Accumulates the metric data for a barrier vertex.
static edu.snu.coral.runtime.common.comm.ControlMessage.BlockStateFromExecutor	convertBlockState(BlockState.State state)
static BlockState.State	convertBlockState(edu.snu.coral.runtime.common.comm.ControlMessage.BlockStateFromExecutor state)
void	execute(PhysicalPlan plan, int maxScheduleAttempt) Submits the PhysicalPlan to Runtime.
void	onContainerAllocated(String executorId, org.apache.reef.driver.evaluator.AllocatedEvaluator allocatedEvaluator, org.apache.reef.tang.Configuration executorConfiguration) Called when a container is allocated for this runtime.
void	onExecutorFailed(String failedExecutorId) Called when an executor fails due to container failure on this runtime.
boolean	onExecutorLaunched(org.apache.reef.driver.context.ActiveContext activeContext) Called when an executor is launched on a container for this runtime.
void	requestContainer(String resourceSpecificationString)
void	terminate()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RuntimeMaster

@Inject
public RuntimeMaster(Scheduler scheduler,
                             SchedulerRunner schedulerRunner,
                             PendingTaskGroupQueue pendingTaskGroupQueue,
                             ContainerManager containerManager,
                             BlockManagerMaster blockManagerMaster,
                             MetricMessageHandler metricMessageHandler,
                             MessageEnvironment masterMessageEnvironment,
                             String dagDirectory)

Method Detail

execute

public void execute(PhysicalPlan plan,
                    int maxScheduleAttempt)

Submits the PhysicalPlan to Runtime.

Parameters:

plan - to execute.

maxScheduleAttempt - the max number of times this plan/sub-part of the plan should be attempted.

terminate

public void terminate()

requestContainer

public void requestContainer(String resourceSpecificationString)

onContainerAllocated

public void onContainerAllocated(String executorId,
                                 org.apache.reef.driver.evaluator.AllocatedEvaluator allocatedEvaluator,
                                 org.apache.reef.tang.Configuration executorConfiguration)

Called when a container is allocated for this runtime. A wrapper function for ContainerManager.

Parameters:

executorId - to use for the executor to be launched on this container.

allocatedEvaluator - to be used as the container.

executorConfiguration - to use for the executor to be launched on this container.

onExecutorLaunched

public boolean onExecutorLaunched(org.apache.reef.driver.context.ActiveContext activeContext)

Called when an executor is launched on a container for this runtime.

Parameters:

activeContext - of the launched executor.

Returns:

true if all requested executors have been launched, false otherwise.

onExecutorFailed

public void onExecutorFailed(String failedExecutorId)

Called when an executor fails due to container failure on this runtime.

Parameters:

failedExecutorId - of the failed executor.

accumulateBarrierMetric

public void accumulateBarrierMetric(List<Long> blockSizeInfo,
                                    String srcVertexId,
                                    String blockId)

Accumulates the metric data for a barrier vertex. TODO #511: Refactor metric aggregation for (general) run-rime optimization. TODO #513: Replace MetricCollectionBarrierVertex with a Customizable IRVertex.

Parameters:

blockSizeInfo - the block size info to accumulate.

srcVertexId - the ID of the source vertex.

blockId - the ID of the block.

convertBlockState

public static BlockState.State convertBlockState(edu.snu.coral.runtime.common.comm.ControlMessage.BlockStateFromExecutor state)

convertBlockState

public static edu.snu.coral.runtime.common.comm.ControlMessage.BlockStateFromExecutor convertBlockState(BlockState.State state)