public final class DataTransferFactory extends Object
InputReader and OutputWriter.| Constructor and Description |
|---|
DataTransferFactory(int hashRangeMultiplier,
BlockManagerWorker blockManagerWorker) |
| Modifier and Type | Method and Description |
|---|---|
InputReader |
createLocalReader(int dstTaskIdx,
RuntimeEdge runtimeEdge)
Creates a local
InputReader between two task in a single task group. |
OutputWriter |
createLocalWriter(Task srcTask,
int srcTaskIdx,
RuntimeEdge<?> runtimeEdge)
Creates an local
OutputWriter between two task in a single task group. |
InputReader |
createReader(int dstTaskIdx,
IRVertex srcIRVertex,
RuntimeEdge runtimeEdge)
Creates an
InputReader between two stages. |
OutputWriter |
createWriter(Task srcTask,
int srcTaskIdx,
IRVertex dstIRVertex,
RuntimeEdge<?> runtimeEdge)
Creates an
OutputWriter between two stages. |
@Inject
public DataTransferFactory(int hashRangeMultiplier,
BlockManagerWorker blockManagerWorker)
public OutputWriter createWriter(Task srcTask, int srcTaskIdx, @Nullable IRVertex dstIRVertex, RuntimeEdge<?> runtimeEdge)
OutputWriter between two stages.srcTask - the Task that outputs the data to be written.srcTaskIdx - the index of the source task.dstIRVertex - the IRVertex that will take the output data as its input.runtimeEdge - that connects the srcTask to the tasks belonging to dstIRVertex.OutputWriter created.public OutputWriter createLocalWriter(Task srcTask, int srcTaskIdx, RuntimeEdge<?> runtimeEdge)
OutputWriter between two task in a single task group.srcTask - the Task that outputs the data to be written.srcTaskIdx - the index of the source task.runtimeEdge - that connects the srcTask to the tasks belonging to dstIRVertex.OutputWriter created.public InputReader createReader(int dstTaskIdx, @Nullable IRVertex srcIRVertex, RuntimeEdge runtimeEdge)
InputReader between two stages.dstTaskIdx - the index of the destination task.srcIRVertex - the IRVertex that output the data to be read.runtimeEdge - that connects the tasks belonging to srcIRVertex to dstTask.InputReader created.public InputReader createLocalReader(int dstTaskIdx, RuntimeEdge runtimeEdge)
InputReader between two task in a single task group.dstTaskIdx - the index of the destination task.runtimeEdge - that connects the tasks belonging to srcRuntimeVertex to dstTask.InputReader created.Copyright © 2018. All rights reserved.