Package org.apache.wayang.jdbc.operators
Class SqlToRddOperator
- java.lang.Object
-
- org.apache.wayang.core.plan.wayangplan.OperatorBase
-
- org.apache.wayang.core.plan.wayangplan.UnaryToUnaryOperator<Record,Record>
-
- org.apache.wayang.jdbc.operators.SqlToRddOperator
-
- All Implemented Interfaces:
java.io.Serializable
,ActualOperator
,ElementaryOperator
,ExecutionOperator
,Operator
,JsonSerializable
,SparkExecutionOperator
public class SqlToRddOperator extends UnaryToUnaryOperator<Record,Record> implements SparkExecutionOperator, JsonSerializable
- See Also:
- Serialized Form
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase
OperatorBase.GsonSerializer
-
Nested classes/interfaces inherited from interface org.apache.wayang.core.util.JsonSerializable
JsonSerializable.Serializer<T extends JsonSerializable>
-
-
Field Summary
-
Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase
inputSlots, outputSlots, STANDARD_OPERATOR_ARGS
-
Fields inherited from interface org.apache.wayang.core.util.JsonSerializable
uncheckedSerializer
-
Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator
FIRST_EPOCH
-
-
Constructor Summary
Constructors Modifier Constructor Description protected
SqlToRddOperator(SqlToRddOperator that)
SqlToRddOperator(JdbcPlatformTemplate jdbcPlatform)
SqlToRddOperator(JdbcPlatformTemplate jdbcPlatform, DataSetType<Record> dataSetType)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description boolean
containsAction()
Tell whether this instances is a Spark action.Tuple<java.util.Collection<ExecutionLineageNode>,java.util.Collection<ChannelInstance>>
evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, SparkExecutor executor, OptimizationContext.OperatorContext operatorContext)
Evaluates this operator.java.util.List<ChannelDescriptor>
getSupportedInputChannels(int index)
java.util.List<ChannelDescriptor>
getSupportedOutputChannels(int index)
Display the supportedChannel
s for a certainOutputSlot
.WayangJsonObj
toJson()
Convert this instance to aWayangJsonObj
.-
Methods inherited from class org.apache.wayang.core.plan.wayangplan.UnaryToUnaryOperator
getInput, getInputType, getOutput, getOutputType
-
Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase
accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, copy, createCopy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
-
Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator
accept
-
Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator
createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator
-
Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ExecutionOperator
copy, createLoadProfileEstimator, createOutputChannelInstances, getLimitBaseKey, getLoadProfileEstimatorConfigurationKey, getLoadProfileEstimatorConfigurationKeys, getOriginal, getOutputChannelDescriptor, isFiltered
-
Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator
addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, setContainer, setEpoch, setInput, setName, setOutput
-
Methods inherited from interface org.apache.wayang.spark.operators.SparkExecutionOperator
getPlatform, name, name
-
-
-
-
Constructor Detail
-
SqlToRddOperator
public SqlToRddOperator(JdbcPlatformTemplate jdbcPlatform)
-
SqlToRddOperator
public SqlToRddOperator(JdbcPlatformTemplate jdbcPlatform, DataSetType<Record> dataSetType)
-
SqlToRddOperator
protected SqlToRddOperator(SqlToRddOperator that)
-
-
Method Detail
-
getSupportedInputChannels
public java.util.List<ChannelDescriptor> getSupportedInputChannels(int index)
Description copied from interface:ExecutionOperator
- Specified by:
getSupportedInputChannels
in interfaceExecutionOperator
- Parameters:
index
- the index of theInputSlot
- Returns:
- an
List
ofChannel
s'Class
es, ordered by their preference of use
-
getSupportedOutputChannels
public java.util.List<ChannelDescriptor> getSupportedOutputChannels(int index)
Description copied from interface:ExecutionOperator
Display the supportedChannel
s for a certainOutputSlot
.- Specified by:
getSupportedOutputChannels
in interfaceExecutionOperator
- Parameters:
index
- the index of theOutputSlot
- Returns:
- an
List
ofChannel
s'Class
es, ordered by their preference of use - See Also:
ExecutionOperator.getOutputChannelDescriptor(int)
-
evaluate
public Tuple<java.util.Collection<ExecutionLineageNode>,java.util.Collection<ChannelInstance>> evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, SparkExecutor executor, OptimizationContext.OperatorContext operatorContext)
Description copied from interface:SparkExecutionOperator
Evaluates this operator. Takes a set ofChannelInstance
s according to the operator inputs and manipulates a set ofChannelInstance
s according to the operator outputs -- unless the operator is a sink, then it triggers execution.In addition, this method should give feedback of what this instance was doing by wiring the
LazyExecutionLineageNode
s of input and ouputChannelInstance
s and providing aCollection
of executedExecutionLineageNode
s.- Specified by:
evaluate
in interfaceSparkExecutionOperator
- Parameters:
inputs
-ChannelInstance
s that satisfy the inputs of this operatoroutputs
-ChannelInstance
s that accept the outputs of this operatorexecutor
-SparkExecutor
that executes this instanceoperatorContext
- optimization information for this instance- Returns:
Collection
s of what has been executed and produced
-
containsAction
public boolean containsAction()
Description copied from interface:SparkExecutionOperator
Tell whether this instances is a Spark action. This is important to keep track on when Spark is actually initialized.- Specified by:
containsAction
in interfaceSparkExecutionOperator
- Returns:
- whether this instance issues Spark actions
-
toJson
public WayangJsonObj toJson()
Description copied from interface:JsonSerializable
Convert this instance to aWayangJsonObj
.- Specified by:
toJson
in interfaceJsonSerializable
- Returns:
- the
WayangJsonObj
-
-