Package org.apache.wayang.flink.operators

Class FlinkDoWhileOperator<InputType,ConvergenceType>

java.lang.Object

org.apache.wayang.core.plan.wayangplan.OperatorBase

org.apache.wayang.basic.operators.DoWhileOperator<InputType,ConvergenceType>

org.apache.wayang.flink.operators.FlinkDoWhileOperator<InputType,ConvergenceType>

All Implemented Interfaces:

Serializable, ActualOperator, ElementaryOperator, ExecutionOperator, LoopHeadOperator, Operator, FlinkExecutionOperator

public class FlinkDoWhileOperator<InputType,ConvergenceType>
extends DoWhileOperator<InputType,ConvergenceType>
implements FlinkExecutionOperator

Flink implementation of the DoWhileOperator.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

OperatorBase.GsonSerializer

Nested classes/interfaces inherited from interface org.apache.wayang.core.plan.wayangplan.LoopHeadOperator

LoopHeadOperator.State

Field Summary

Fields inherited from class org.apache.wayang.basic.operators.DoWhileOperator

CONVERGENCE_INPUT_INDEX, criterionDescriptor, FINAL_OUTPUT_INDEX, INITIAL_INPUT_INDEX, ITERATION_INPUT_INDEX, ITERATION_OUTPUT_INDEX

Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

inputSlots, outputSlots, STANDARD_OPERATOR_ARGS

Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

FIRST_EPOCH

Constructor Summary

Constructors

Constructor	Description
FlinkDoWhileOperator(DoWhileOperator<InputType,ConvergenceType> that)	Creates a new instance.
FlinkDoWhileOperator(DataSetType<InputType> inputType, DataSetType<ConvergenceType> convergenceType, FunctionDescriptor.SerializablePredicate<Collection<ConvergenceType>> criterionPredicate, Integer numExpectedIterations)	Creates a new instance.
FlinkDoWhileOperator(DataSetType<InputType> inputType, DataSetType<ConvergenceType> convergenceType, PredicateDescriptor<Collection<ConvergenceType>> criterionDescriptor, Integer numExpectedIterations)

Method Summary

Modifier and Type	Method	Description
boolean	containsAction()	Tell whether this instances is a Flink action.
protected ExecutionOperator	createCopy()
Optional<LoadProfileEstimator>	createLoadProfileEstimator(Configuration configuration)	Developers of ExecutionOperators can provide a default LoadProfileEstimator via this method.
Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>>	evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, FlinkExecutor flinkExecutor, OptimizationContext.OperatorContext operatorContext)
String	getLoadProfileEstimatorConfigurationKey()
List<ChannelDescriptor>	getSupportedInputChannels(int index)	Display the supported Channels for a certain InputSlot.
List<ChannelDescriptor>	getSupportedOutputChannels(int index)	Display the supported Channels for a certain OutputSlot.

Methods inherited from class org.apache.wayang.basic.operators.DoWhileOperator

beginIteration, createCardinalityEstimator, endIteration, getConditionInputSlots, getConditionOutputSlots, getConvergenceType, getCriterionDescriptor, getFinalLoopOutputs, getForwards, getInputType, getLoopBodyInputs, getLoopBodyOutputs, getLoopInitializationInputs, getNumExpectedIterations, getState, initialize, isReading, outputConnectTo, setNumExpectedIterations, setState

Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, copy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator

accept

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator

createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ExecutionOperator

copy, createOutputChannelInstances, getLimitBaseKey, getLoadProfileEstimatorConfigurationKeys, getOriginal, getOutputChannelDescriptor, isFiltered

Methods inherited from interface org.apache.wayang.flink.operators.FlinkExecutionOperator

getBroadCastFunction, getPlatform

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.LoopHeadOperator

getCardinalityPusher, getFinalizationPusher, getInitializationPusher

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isConversion, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, replaceWith, setContainer, setEpoch, setInput, setName, setOutput

Constructor Details

FlinkDoWhileOperator

public FlinkDoWhileOperator(DataSetType<InputType> inputType,
 DataSetType<ConvergenceType> convergenceType,
 FunctionDescriptor.SerializablePredicate<Collection<ConvergenceType>> criterionPredicate,
 Integer numExpectedIterations)

Creates a new instance.

FlinkDoWhileOperator

public FlinkDoWhileOperator(DataSetType<InputType> inputType,
 DataSetType<ConvergenceType> convergenceType,
 PredicateDescriptor<Collection<ConvergenceType>> criterionDescriptor,
 Integer numExpectedIterations)

FlinkDoWhileOperator

public FlinkDoWhileOperator(DoWhileOperator<InputType,ConvergenceType> that)

Creates a new instance.

Method Details

evaluate

public Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>> evaluate(ChannelInstance[] inputs,
 ChannelInstance[] outputs,
 FlinkExecutor flinkExecutor,
 OptimizationContext.OperatorContext operatorContext)

Specified by:

evaluate in interface FlinkExecutionOperator

containsAction

public boolean containsAction()

Description copied from interface: FlinkExecutionOperator

Tell whether this instances is a Flink action. This is important to keep track on when Flink is actually initialized.

Specified by:

containsAction in interface FlinkExecutionOperator

Returns:

whether this instance issues Flink actions

getLoadProfileEstimatorConfigurationKey

public String getLoadProfileEstimatorConfigurationKey()

Specified by:

getLoadProfileEstimatorConfigurationKey in interface ExecutionOperator

createLoadProfileEstimator

public Optional<LoadProfileEstimator> createLoadProfileEstimator(Configuration configuration)

Description copied from interface: ExecutionOperator

Developers of ExecutionOperators can provide a default LoadProfileEstimator via this method.

Specified by:

createLoadProfileEstimator in interface ExecutionOperator

Parameters:

configuration - in which the LoadProfile should be estimated.

Returns:

an Optional that might contain the LoadProfileEstimator (but Optional.empty() by default)

createCopy

protected ExecutionOperator createCopy()

Overrides:

createCopy in class OperatorBase

getSupportedInputChannels

public List<ChannelDescriptor> getSupportedInputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain InputSlot.

Specified by:

getSupportedInputChannels in interface ExecutionOperator

Parameters:

index - the index of the InputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

getSupportedOutputChannels

public List<ChannelDescriptor> getSupportedOutputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain OutputSlot.

Specified by:

getSupportedOutputChannels in interface ExecutionOperator

Parameters:

index - the index of the OutputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

See Also:

• ExecutionOperator.getOutputChannelDescriptor(int)