public final class DataTransferFactory extends Object
InputReader
and OutputWriter
.Constructor and Description |
---|
DataTransferFactory(int hashRangeMultiplier,
BlockManagerWorker blockManagerWorker) |
Modifier and Type | Method and Description |
---|---|
InputReader |
createLocalReader(int dstTaskIdx,
RuntimeEdge runtimeEdge)
Creates a local
InputReader between two task in a single task group. |
OutputWriter |
createLocalWriter(Task srcTask,
int srcTaskIdx,
RuntimeEdge<?> runtimeEdge)
Creates an local
OutputWriter between two task in a single task group. |
InputReader |
createReader(int dstTaskIdx,
IRVertex srcIRVertex,
RuntimeEdge runtimeEdge)
Creates an
InputReader between two stages. |
OutputWriter |
createWriter(Task srcTask,
int srcTaskIdx,
IRVertex dstIRVertex,
RuntimeEdge<?> runtimeEdge)
Creates an
OutputWriter between two stages. |
@Inject public DataTransferFactory(int hashRangeMultiplier, BlockManagerWorker blockManagerWorker)
public OutputWriter createWriter(Task srcTask, int srcTaskIdx, @Nullable IRVertex dstIRVertex, RuntimeEdge<?> runtimeEdge)
OutputWriter
between two stages.srcTask
- the Task
that outputs the data to be written.srcTaskIdx
- the index of the source task.dstIRVertex
- the IRVertex
that will take the output data as its input.runtimeEdge
- that connects the srcTask to the tasks belonging to dstIRVertex.OutputWriter
created.public OutputWriter createLocalWriter(Task srcTask, int srcTaskIdx, RuntimeEdge<?> runtimeEdge)
OutputWriter
between two task in a single task group.srcTask
- the Task
that outputs the data to be written.srcTaskIdx
- the index of the source task.runtimeEdge
- that connects the srcTask to the tasks belonging to dstIRVertex.OutputWriter
created.public InputReader createReader(int dstTaskIdx, @Nullable IRVertex srcIRVertex, RuntimeEdge runtimeEdge)
InputReader
between two stages.dstTaskIdx
- the index of the destination task.srcIRVertex
- the IRVertex
that output the data to be read.runtimeEdge
- that connects the tasks belonging to srcIRVertex to dstTask.InputReader
created.public InputReader createLocalReader(int dstTaskIdx, RuntimeEdge runtimeEdge)
InputReader
between two task in a single task group.dstTaskIdx
- the index of the destination task.runtimeEdge
- that connects the tasks belonging to srcRuntimeVertex to dstTask.InputReader
created.Copyright © 2018. All rights reserved.