Package org.apache.wayang.flink.operators

Class FlinkPageRankOperator

java.lang.Object

org.apache.wayang.core.plan.wayangplan.OperatorBase

org.apache.wayang.core.plan.wayangplan.UnaryToUnaryOperator<Tuple2<java.lang.Long,java.lang.Long>,Tuple2<java.lang.Long,java.lang.Float>>

org.apache.wayang.basic.operators.PageRankOperator

org.apache.wayang.flink.operators.FlinkPageRankOperator

All Implemented Interfaces:

java.io.Serializable, ActualOperator, ElementaryOperator, ExecutionOperator, Operator, FlinkExecutionOperator

public class FlinkPageRankOperator
extends PageRankOperator
implements FlinkExecutionOperator

Flink implementation of the PageRankOperator.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	FlinkPageRankOperator.BuildOutgoingEdgeList	A reduce function that takes a sequence of edges and builds the adjacency list for the vertex where the edges originate.
static class	FlinkPageRankOperator.Dampener	The function that applies the page rank dampening formula.
static class	FlinkPageRankOperator.EpsilonFilter	Filter that filters vertices where the rank difference is below a threshold.
static class	FlinkPageRankOperator.JoinVertexWithEdgesMatch	Join function that distributes a fraction of a vertex's rank to all neighbors.
static class	FlinkPageRankOperator.RankAssigner	A map function that assigns an initial rank to all pages.

Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

OperatorBase.GsonSerializer

Field Summary

Fields inherited from class org.apache.wayang.basic.operators.PageRankOperator

dampingFactor, DEFAULT_DAMPING_FACTOR, DEFAULT_GRAPH_DENSITIY, graphDensity, numIterations

Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

inputSlots, outputSlots, STANDARD_OPERATOR_ARGS

Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

FIRST_EPOCH

Constructor Summary

Constructors

Constructor	Description
FlinkPageRankOperator(java.lang.Integer numIterations)
FlinkPageRankOperator(PageRankOperator pageRankOperator)

Method Summary

Modifier and Type	Method	Description
boolean	containsAction()	Tell whether this instances is a Flink action.
protected ExecutionOperator	createCopy()
Tuple<java.util.Collection<ExecutionLineageNode>,java.util.Collection<ChannelInstance>>	evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, FlinkExecutor flinkExecutor, OptimizationContext.OperatorContext operatorContext)
java.util.Collection<java.lang.String>	getLoadProfileEstimatorConfigurationKeys()	Provide the Configuration keys for the LoadProfileEstimator specification of this instance.
java.util.List<ChannelDescriptor>	getSupportedInputChannels(int index)	Display the supported Channels for a certain InputSlot.
java.util.List<ChannelDescriptor>	getSupportedOutputChannels(int index)	Display the supported Channels for a certain OutputSlot.

Methods inherited from class org.apache.wayang.basic.operators.PageRankOperator

createCardinalityEstimator, getDampingFactor, getGraphDensity, getNumIterations

Methods inherited from class org.apache.wayang.core.plan.wayangplan.UnaryToUnaryOperator

getInput, getInputType, getOutput, getOutputType

Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, copy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator

accept

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator

createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ExecutionOperator

copy, createLoadProfileEstimator, createOutputChannelInstances, getLimitBaseKey, getLoadProfileEstimatorConfigurationKey, getOriginal, getOutputChannelDescriptor, isFiltered

Methods inherited from interface org.apache.wayang.flink.operators.FlinkExecutionOperator

getBroadCastFunction, getPlatform

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, setContainer, setEpoch, setInput, setName, setOutput

Constructor Detail

FlinkPageRankOperator

public FlinkPageRankOperator(java.lang.Integer numIterations)

FlinkPageRankOperator

public FlinkPageRankOperator(PageRankOperator pageRankOperator)

Method Detail

evaluate

public Tuple<java.util.Collection<ExecutionLineageNode>,java.util.Collection<ChannelInstance>> evaluate(ChannelInstance[] inputs,
                                                                                                              ChannelInstance[] outputs,
                                                                                                              FlinkExecutor flinkExecutor,
                                                                                                              OptimizationContext.OperatorContext operatorContext)

Specified by:

evaluate in interface FlinkExecutionOperator

containsAction

public boolean containsAction()

Description copied from interface: FlinkExecutionOperator

Tell whether this instances is a Flink action. This is important to keep track on when Flink is actually initialized.

Specified by:

containsAction in interface FlinkExecutionOperator

Returns:

whether this instance issues Flink actions

getLoadProfileEstimatorConfigurationKeys

public java.util.Collection<java.lang.String> getLoadProfileEstimatorConfigurationKeys()

Description copied from interface: ExecutionOperator

Provide the Configuration keys for the LoadProfileEstimator specification of this instance.

Specified by:

getLoadProfileEstimatorConfigurationKeys in interface ExecutionOperator

Returns:

the Configuration keys

getSupportedInputChannels

public java.util.List<ChannelDescriptor> getSupportedInputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain InputSlot.

Specified by:

getSupportedInputChannels in interface ExecutionOperator

Parameters:

index - the index of the InputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

getSupportedOutputChannels

public java.util.List<ChannelDescriptor> getSupportedOutputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain OutputSlot.

Specified by:

getSupportedOutputChannels in interface ExecutionOperator

Parameters:

index - the index of the OutputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

See Also:

ExecutionOperator.getOutputChannelDescriptor(int)

createCopy

protected ExecutionOperator createCopy()

Overrides:

createCopy in class OperatorBase