edu.snu.coral.compiler.optimizer.pass.compiletime.reshaping

Class DataSkewReshapingPass

java.lang.Object

edu.snu.coral.compiler.optimizer.pass.compiletime.reshaping.ReshapingPass

edu.snu.coral.compiler.optimizer.pass.compiletime.reshaping.DataSkewReshapingPass

All Implemented Interfaces:

CompileTimePass, Serializable, Function<DAG<IRVertex,IREdge>,DAG<IRVertex,IREdge>>

public final class DataSkewReshapingPass
extends ReshapingPass

Pass to modify the DAG for a job to perform data skew. It adds a MetricCollectionBarrierVertex before Shuffle edges, to make a barrier before it, and to use the metrics to repartition the skewed data. NOTE: we currently put the DataSkewCompositePass at the end of the list for each policies, as it needs to take a snapshot at the end of the pass. This could be prevented by modifying other passes to take the snapshot of the DAG at the end of each passes for metricCollectionVertices.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
DataSkewReshapingPass() Default constructor.

Method Summary

Modifier and Type	Method and Description
DAG<IRVertex,IREdge>	apply(DAG<IRVertex,IREdge> dag)

Methods inherited from class edu.snu.coral.compiler.optimizer.pass.compiletime.reshaping.ReshapingPass

getPrerequisiteExecutionProperties

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.function.Function

andThen, compose, identity

Constructor Detail

DataSkewReshapingPass

public DataSkewReshapingPass()

Default constructor.

Method Detail

apply

public DAG<IRVertex,IREdge> apply(DAG<IRVertex,IREdge> dag)