Package org.apache.wayang.java.operators

Interface JavaExecutionOperator

All Superinterfaces:

ActualOperator, ElementaryOperator, ExecutionOperator, Operator, Serializable

All Known Implementing Classes:

GenericSqlToStreamOperator, JavaAmazonS3Source, JavaAzureBlobStorageSource, JavaCartesianOperator, JavaCoGroupOperator, JavaCollectionSource, JavaCollectOperator, JavaCountOperator, JavaCSVTableSource, JavaDistinctOperator, JavaDoWhileOperator, JavaFilterOperator, JavaFlatMapOperator, JavaGlobalMaterializedGroupOperator, JavaGlobalReduceOperator, JavaGoogleCloudStorageSource, JavaIEJoinOperator, JavaIESelfJoinOperator, JavaIntersectOperator, JavaJoinOperator, JavaKafkaTopicSink, JavaKafkaTopicSource, JavaLocalCallbackSink, JavaLoopOperator, JavaMapOperator, JavaMapPartitionsOperator, JavaMaterializedGroupByOperator, JavaObjectFileSink, JavaObjectFileSource, JavaPageRankOperator, JavaParquetSource, JavaRandomSampleOperator, JavaReduceByOperator, JavaRepeatOperator, JavaReservoirSampleOperator, JavaSortOperator, JavaTextFileSink, JavaTextFileSource, JavaTsvFileSink, JavaTsvFileSource, JavaUnionAllOperator, SqlToStreamOperator

public interface JavaExecutionOperator
extends ExecutionOperator

Execution operator for the Java platform.

Field Summary

Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

FIRST_EPOCH

Method Summary

Modifier and Type	Method	Description
Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>>	evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, JavaExecutor javaExecutor, OptimizationContext.OperatorContext operatorContext)	Evaluates this operator.
static void	forward(ChannelInstance input, ChannelInstance output)	Utility method to forward a JavaChannelInstance to another.
default JavaPlatform	getPlatform()

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator

accept

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator

createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ExecutionOperator

copy, createLoadProfileEstimator, createOutputChannelInstances, getLimitBaseKey, getLoadProfileEstimatorConfigurationKey, getLoadProfileEstimatorConfigurationKeys, getOriginal, getOutputChannelDescriptor, getSupportedInputChannels, getSupportedOutputChannels, isFiltered

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isConversion, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, replaceWith, setContainer, setEpoch, setInput, setName, setOutput

Method Details

getPlatform

default JavaPlatform getPlatform()

Specified by:

getPlatform in interface ExecutionOperator

Returns:

the platform that can run this operator

evaluate

Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>> evaluate(ChannelInstance[] inputs,
 ChannelInstance[] outputs,
 JavaExecutor javaExecutor,
 OptimizationContext.OperatorContext operatorContext)

Evaluates this operator. Takes a set of Java Streams according to the operator inputs and produces a set of Streams according to the operator outputs -- unless the operator is a sink, then it triggers execution.

In addition, this method should give feedback of what this instance was doing by wiring the LazyExecutionLineageNodes of input and ouput ChannelInstances and providing a Collection of executed OptimizationContext.OperatorContexts.

Parameters:

inputs - ChannelInstances that satisfy the inputs of this operator

outputs - ChannelInstances that collect the outputs of this operator

javaExecutor - that executes this instance

operatorContext - optimization information for this instance

Returns:

Collections of what has been executed and produced

forward

static void forward(ChannelInstance input,
 ChannelInstance output)

Utility method to forward a JavaChannelInstance to another.

Parameters:

input - that should be forwarded

output - to that should be forwarded