edu.snu.coral.runtime.master

Class BlockManagerMaster

java.lang.Object

edu.snu.coral.runtime.master.BlockManagerMaster

@ThreadSafe
public final class BlockManagerMaster
extends Object

Master-side block manager.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	BlockManagerMaster.PartitionManagerMasterControlMessageReceiver Handler for control messages received.

Method Summary

Modifier and Type	Method and Description
CompletableFuture<String>	getBlockLocationFuture(String blockId) Returns a CompletableFuture of block location, which is not yet resolved in SCHEDULED state.
Set<String>	getProducerTaskGroupIds(String blockId) Gets the ids of the task groups which already produced or will produce data for a specific block.
void	initializeState(String blockId, String producerTaskGroupId) Initializes the states of a block which will be produced by producer task(s).
void	onBlockStateChanged(String blockId, BlockState.State newState, String location) Deals with state change of a block.
void	onProducerTaskGroupFailed(String failedTaskGroupId) To be called when a potential producer task group fails.
void	onProducerTaskGroupScheduled(String scheduledTaskGroupId) To be called when a potential producer task group is scheduled.
Set<String>	removeWorker(String executorId) Manages the block information when a executor is removed.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

initializeState

public void initializeState(String blockId,
                            String producerTaskGroupId)

Initializes the states of a block which will be produced by producer task(s).

Parameters:

blockId - the id of the block to initialize.

producerTaskGroupId - the id of the producer task group.

removeWorker

public Set<String> removeWorker(String executorId)

Manages the block information when a executor is removed.

Parameters:

executorId - the id of removed executor.

Returns:

the set of task groups have to be recomputed.

getBlockLocationFuture

public CompletableFuture<String> getBlockLocationFuture(String blockId)

Returns a CompletableFuture of block location, which is not yet resolved in SCHEDULED state.

Parameters:

blockId - id of the specified block.

Returns:

CompletableFuture of block location, which completes exceptionally when the block is not SCHEDULED or COMMITTED.

getProducerTaskGroupIds

public Set<String> getProducerTaskGroupIds(String blockId)

Gets the ids of the task groups which already produced or will produce data for a specific block.

Parameters:

blockId - the id of the block.

Returns:

the ids of the producer task groups.

onProducerTaskGroupScheduled

public void onProducerTaskGroupScheduled(String scheduledTaskGroupId)

To be called when a potential producer task group is scheduled. To be precise, it is called when the task group is enqueued to PendingTaskGroupQueue.

Parameters:

scheduledTaskGroupId - the ID of the scheduled task group.

onProducerTaskGroupFailed

public void onProducerTaskGroupFailed(String failedTaskGroupId)

To be called when a potential producer task group fails. Only the TaskGroups that have not yet completed (i.e. blocks not yet committed) will call this method.

Parameters:

failedTaskGroupId - the ID of the task group that failed.

onBlockStateChanged

public void onBlockStateChanged(String blockId,
                                BlockState.State newState,
                                @Nullable
                                String location)

Deals with state change of a block.

Parameters:

blockId - the id of the block.

newState - the new state of the block.

location - the location of the block (e.g., worker id, remote store). null if not committed or lost.