Package org.apache.wayang.java.operators

Class JavaKafkaTopicSource

java.lang.Object

org.apache.wayang.core.plan.wayangplan.OperatorBase

org.apache.wayang.core.plan.wayangplan.UnarySource<String>

org.apache.wayang.basic.operators.KafkaTopicSource

org.apache.wayang.java.operators.JavaKafkaTopicSource

All Implemented Interfaces:

Serializable, ActualOperator, ElementaryOperator, ExecutionOperator, Operator, JavaExecutionOperator

public class JavaKafkaTopicSource
extends KafkaTopicSource
implements JavaExecutionOperator

Reads Kafka topics for the JavaPlatform.

See Also:

• JavaKafkaTopicSink
• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.wayang.basic.operators.KafkaTopicSource

KafkaTopicSource.CardinalityEstimator

Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

OperatorBase.GsonSerializer

Field Summary

Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

inputSlots, outputSlots, STANDARD_OPERATOR_ARGS

Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

FIRST_EPOCH

Constructor Summary

Constructors

Constructor	Description
JavaKafkaTopicSource(String topicName)
JavaKafkaTopicSource(String topicName, String encoding)
JavaKafkaTopicSource(KafkaTopicSource that)

Method Summary

Modifier and Type	Method	Description
JavaKafkaTopicSource	copy()
Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>>	evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, JavaExecutor javaExecutor, OptimizationContext.OperatorContext operatorContext)	Evaluates this operator.
Collection<String>	getLoadProfileEstimatorConfigurationKeys()	Provide the Configuration keys for the LoadProfileEstimator specification of this instance.
List<ChannelDescriptor>	getSupportedInputChannels(int index)	Display the supported Channels for a certain InputSlot.
List<ChannelDescriptor>	getSupportedOutputChannels(int index)	Display the supported Channels for a certain OutputSlot.

Methods inherited from class org.apache.wayang.basic.operators.KafkaTopicSource

createCardinalityEstimator, getConsumer, getConsumer, getDefaultProperties, getEncoding, getTopicName, initConsumer, loadConfig, startConsuming

Methods inherited from class org.apache.wayang.core.plan.wayangplan.UnarySource

getOutput, getType

Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, createCopy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator

accept

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator

createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ExecutionOperator

createLoadProfileEstimator, createOutputChannelInstances, getLimitBaseKey, getLoadProfileEstimatorConfigurationKey, getOriginal, getOutputChannelDescriptor, isFiltered

Methods inherited from interface org.apache.wayang.java.operators.JavaExecutionOperator

getPlatform

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isConversion, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, replaceWith, setContainer, setEpoch, setInput, setName, setOutput

Constructor Details

JavaKafkaTopicSource

public JavaKafkaTopicSource(String topicName)

JavaKafkaTopicSource

public JavaKafkaTopicSource(String topicName,
 String encoding)

JavaKafkaTopicSource

public JavaKafkaTopicSource(KafkaTopicSource that)

Method Details

getLoadProfileEstimatorConfigurationKeys

public Collection<String> getLoadProfileEstimatorConfigurationKeys()

Description copied from interface: ExecutionOperator

Provide the Configuration keys for the LoadProfileEstimator specification of this instance.

Specified by:

getLoadProfileEstimatorConfigurationKeys in interface ExecutionOperator

Returns:

the Configuration keys

copy

public JavaKafkaTopicSource copy()

Specified by:

copy in interface ExecutionOperator

Overrides:

copy in class OperatorBase

Returns:

a copy of this instance; it's Slots will not be connected

See Also:

• ExecutionOperator.copy()

getSupportedInputChannels

public List<ChannelDescriptor> getSupportedInputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain InputSlot.

Specified by:

getSupportedInputChannels in interface ExecutionOperator

Parameters:

index - the index of the InputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

getSupportedOutputChannels

public List<ChannelDescriptor> getSupportedOutputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain OutputSlot.

Specified by:

getSupportedOutputChannels in interface ExecutionOperator

Parameters:

index - the index of the OutputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

See Also:

• ExecutionOperator.getOutputChannelDescriptor(int)

evaluate

public Tuple<Collection<ExecutionLineageNode>,Collection<ChannelInstance>> evaluate(ChannelInstance[] inputs,
 ChannelInstance[] outputs,
 JavaExecutor javaExecutor,
 OptimizationContext.OperatorContext operatorContext)

Description copied from interface: JavaExecutionOperator

Evaluates this operator. Takes a set of Java Streams according to the operator inputs and produces a set of Streams according to the operator outputs -- unless the operator is a sink, then it triggers execution.

In addition, this method should give feedback of what this instance was doing by wiring the LazyExecutionLineageNodes of input and ouput ChannelInstances and providing a Collection of executed OptimizationContext.OperatorContexts.

Specified by:

evaluate in interface JavaExecutionOperator

Parameters:

inputs - ChannelInstances that satisfy the inputs of this operator

outputs - ChannelInstances that collect the outputs of this operator

javaExecutor - that executes this instance

operatorContext - optimization information for this instance

Returns:

Collections of what has been executed and produced