Modifier and Type | Class and Description |
---|---|
class |
BytesCoder
A
Coder which is used for an array of bytes. |
static class |
Coder.DummyCoder
Dummy coder implementation which is not supposed to be used.
|
Modifier and Type | Field and Description |
---|---|
static Coder |
Coder.DUMMY_CODER
Dummy coder.
|
Modifier and Type | Method and Description |
---|---|
Coder |
IREdge.getCoder() |
Constructor and Description |
---|
IREdge(DataCommunicationPatternProperty.Value commPattern,
IRVertex src,
IRVertex dst,
Coder coder)
Constructor of IREdge.
|
IREdge(DataCommunicationPatternProperty.Value commPattern,
IRVertex src,
IRVertex dst,
Coder coder,
Boolean isSideInput)
Constructor of IREdge.
|
Modifier and Type | Class and Description |
---|---|
class |
BeamCoder<T>
Coder from Coder . |
Modifier and Type | Class and Description |
---|---|
class |
SparkCoder<T>
Kryo Spark Coder for serialization.
|
Modifier and Type | Method and Description |
---|---|
Coder |
RuntimeEdge.getCoder() |
Constructor and Description |
---|
RuntimeEdge(String runtimeEdgeId,
ExecutionPropertyMap edgeProperties,
V src,
V dst,
Coder coder)
Constructs the edge given the below parameters.
|
RuntimeEdge(String runtimeEdgeId,
ExecutionPropertyMap edgeProperties,
V src,
V dst,
Coder coder,
Boolean isSideInput)
Constructs the edge given the below parameters.
|
Constructor and Description |
---|
PhysicalStageEdge(String runtimeEdgeId,
ExecutionPropertyMap edgeProperties,
IRVertex srcVertex,
IRVertex dstVertex,
PhysicalStage srcStage,
PhysicalStage dstStage,
Coder coder,
Boolean isSideInput)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
StageEdgeBuilder |
StageEdgeBuilder.setCoder(Coder c)
Setter for coder.
|
Constructor and Description |
---|
StageEdge(String irEdgeId,
ExecutionPropertyMap edgeProperties,
Stage srcStage,
Stage dstStage,
Coder coder,
Boolean isSideInput,
IRVertex srcVertex,
IRVertex dstVertex)
Represents the edge between stages.
|
Modifier and Type | Method and Description |
---|---|
Coder |
CoderManager.getCoder(String runtimeEdgeId)
Return the coder for the specified runtime edge.
|
Modifier and Type | Method and Description |
---|---|
static <K extends Serializable> |
DataUtil.convertToNonSerPartitions(Coder coder,
Iterable<SerializedPartition<K>> partitionsToConvert)
|
static <K extends Serializable> |
DataUtil.convertToSerPartitions(Coder coder,
Iterable<NonSerializedPartition<K>> partitionsToConvert)
|
static <K extends Serializable> |
DataUtil.deserializePartition(long elementsInPartition,
Coder coder,
K key,
InputStream inputStream)
Reads the data of a partition from an input stream and deserializes it.
|
void |
CoderManager.registerCoder(String runtimeEdgeId,
Coder coder)
Register a coder for runtime edge.
|
static long |
DataUtil.serializePartition(Coder coder,
NonSerializedPartition nonSerializedPartition,
ByteArrayOutputStream bytesOutputStream)
Serializes the elements in a non-serialized partition into an output stream.
|
Constructor and Description |
---|
InputStreamIterator(InputStream inputStream,
Coder<T> coder)
|
InputStreamIterator(InputStream inputStream,
Coder<T> coder,
long limit)
|
Constructor and Description |
---|
FileBlock(Coder coder,
String filePath,
FileMetadata<K> metadata)
Constructor.
|
NonSerializedMemoryBlock(Coder coder)
Constructor.
|
SerializedMemoryBlock(Coder coder)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
Coder |
AbstractBlockStore.getCoderFromWorker(String blockId)
Gets data coder for a block from the
CoderManager . |
Copyright © 2018. All rights reserved.