edu.snu.coral.runtime.executor.data.partitioner

Interface Partitioner

All Known Implementing Classes:

DataSkewHashPartitioner, HashPartitioner, IntactPartitioner

public interface Partitioner

This interface represents the way of partitioning output data from a source task. It takes an iterable of elements and divide the data into multiple Partitions, according to the number of destination tasks, the key of each element, etc.

Method Summary

Modifier and Type	Method and Description
List<Partition>	partition(Iterable elements, int dstParallelism, KeyExtractor keyExtractor) Divides the output data from a task into multiple blocks.

Method Detail

partition

List<Partition> partition(Iterable elements,
                          int dstParallelism,
                          KeyExtractor keyExtractor)

Divides the output data from a task into multiple blocks.

Parameters:

elements - the output data from a source task.

dstParallelism - the number of destination tasks.

keyExtractor - extracts keys from elements.

Returns:

the list of partitioned blocks.