Class GlobalReduceOperator<Type>
- java.lang.Object
-
- org.apache.wayang.core.plan.wayangplan.OperatorBase
-
- org.apache.wayang.core.plan.wayangplan.UnaryToUnaryOperator<Type,Type>
-
- org.apache.wayang.basic.operators.GlobalReduceOperator<Type>
-
- All Implemented Interfaces:
java.io.Serializable
,ActualOperator
,ElementaryOperator
,Operator
- Direct Known Subclasses:
FlinkGlobalReduceOperator
,JavaGlobalReduceOperator
,SparkGlobalReduceOperator
public class GlobalReduceOperator<Type> extends UnaryToUnaryOperator<Type,Type>
This operator groups the elements of a data set and aggregates the groups.- See Also:
- Serialized Form
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase
OperatorBase.GsonSerializer
-
-
Field Summary
Fields Modifier and Type Field Description protected ReduceDescriptor<Type>
reduceDescriptor
-
Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase
inputSlots, outputSlots, STANDARD_OPERATOR_ARGS
-
Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator
FIRST_EPOCH
-
-
Constructor Summary
Constructors Constructor Description GlobalReduceOperator(GlobalReduceOperator<Type> that)
Copies an instance (exclusive of broadcasts).GlobalReduceOperator(FunctionDescriptor.SerializableBinaryOperator<Type> reduceFunction, java.lang.Class<Type> typeClass)
Creates a new instance.GlobalReduceOperator(ReduceDescriptor<Type> reduceDescriptor)
Creates a new instance.GlobalReduceOperator(ReduceDescriptor<Type> reduceDescriptor, DataSetType<Type> type)
Creates a new instance.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description java.util.Optional<CardinalityEstimator>
createCardinalityEstimator(int outputIndex, Configuration configuration)
ReduceDescriptor<Type>
getReduceDescriptor()
DataSetType<Type>
getType()
-
Methods inherited from class org.apache.wayang.core.plan.wayangplan.UnaryToUnaryOperator
getInput, getInputType, getOutput, getOutputType
-
Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase
accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, copy, createCopy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
-
Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator
accept
-
Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator
getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator
-
Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator
addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, setContainer, setEpoch, setInput, setName, setOutput
-
-
-
-
Field Detail
-
reduceDescriptor
protected final ReduceDescriptor<Type> reduceDescriptor
-
-
Constructor Detail
-
GlobalReduceOperator
public GlobalReduceOperator(FunctionDescriptor.SerializableBinaryOperator<Type> reduceFunction, java.lang.Class<Type> typeClass)
Creates a new instance.
-
GlobalReduceOperator
public GlobalReduceOperator(ReduceDescriptor<Type> reduceDescriptor)
Creates a new instance.- Parameters:
reduceDescriptor
- describes the reduction to be performed on the elements
-
GlobalReduceOperator
public GlobalReduceOperator(GlobalReduceOperator<Type> that)
Copies an instance (exclusive of broadcasts).- Parameters:
that
- that should be copied
-
GlobalReduceOperator
public GlobalReduceOperator(ReduceDescriptor<Type> reduceDescriptor, DataSetType<Type> type)
Creates a new instance.- Parameters:
reduceDescriptor
- describes the reduction to be performed on the elementstype
- type of the reduce elements (i.e., type ofUnaryToUnaryOperator.getInput()
andUnaryToUnaryOperator.getOutput()
)
-
-
Method Detail
-
getType
public DataSetType<Type> getType()
-
getReduceDescriptor
public ReduceDescriptor<Type> getReduceDescriptor()
-
createCardinalityEstimator
public java.util.Optional<CardinalityEstimator> createCardinalityEstimator(int outputIndex, Configuration configuration)
Description copied from interface:ElementaryOperator
- Parameters:
outputIndex
- index of theOutputSlot
for that theCardinalityEstimator
is requestedconfiguration
- if theCardinalityEstimator
depends on further ones, use this to obtain the latter- Returns:
- an
Optional
that might provide the requested instance
-
-