Package org.apache.wayang.tensorflow.operators

Class TensorflowCollectionSource<Type>

java.lang.Object

org.apache.wayang.core.plan.wayangplan.OperatorBase

org.apache.wayang.core.plan.wayangplan.UnarySource<T>

org.apache.wayang.basic.operators.CollectionSource<Type>

org.apache.wayang.tensorflow.operators.TensorflowCollectionSource<Type>

All Implemented Interfaces:

java.io.Serializable, ActualOperator, ElementaryOperator, ExecutionOperator, Operator, TensorflowExecutionOperator

public class TensorflowCollectionSource<Type>
extends CollectionSource<Type>
implements TensorflowExecutionOperator

Provides a Collection to a Tensorflow job. Can also be used to convert CollectionChannels of the JavaPlatform into TensorChannels.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

OperatorBase.GsonSerializer

Field Summary

Fields inherited from class org.apache.wayang.basic.operators.CollectionSource

collection

Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

inputSlots, outputSlots, STANDARD_OPERATOR_ARGS

Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

FIRST_EPOCH

Constructor Summary

Constructors

Constructor	Description
TensorflowCollectionSource(java.util.Collection<Type> collection, DataSetType<Type> type)
TensorflowCollectionSource(CollectionSource that)
TensorflowCollectionSource(DataSetType<Type> type)

Method Summary

Modifier and Type	Method	Description
protected ExecutionOperator	createCopy()
Tuple<java.util.Collection<ExecutionLineageNode>,java.util.Collection<ChannelInstance>>	evaluate(ChannelInstance[] inputs, ChannelInstance[] outputs, TensorflowExecutor tensorflowExecutor, OptimizationContext.OperatorContext operatorContext)	Evaluates this operator.
java.util.List<ChannelDescriptor>	getSupportedInputChannels(int index)	Display the supported Channels for a certain InputSlot.
java.util.List<ChannelDescriptor>	getSupportedOutputChannels(int index)	Display the supported Channels for a certain OutputSlot.

Methods inherited from class org.apache.wayang.basic.operators.CollectionSource

createCardinalityEstimator, empty, getCollection, singleton

Methods inherited from class org.apache.wayang.core.plan.wayangplan.UnarySource

getOutput, getType

Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, copy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator

accept

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator

createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ExecutionOperator

copy, createLoadProfileEstimator, createOutputChannelInstances, getLimitBaseKey, getLoadProfileEstimatorConfigurationKey, getLoadProfileEstimatorConfigurationKeys, getOriginal, getOutputChannelDescriptor, isFiltered

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, setContainer, setEpoch, setInput, setName, setOutput

Methods inherited from interface org.apache.wayang.tensorflow.operators.TensorflowExecutionOperator

getPlatform

Constructor Detail

TensorflowCollectionSource

public TensorflowCollectionSource(DataSetType<Type> type)

TensorflowCollectionSource

public TensorflowCollectionSource(java.util.Collection<Type> collection,
                                  DataSetType<Type> type)

TensorflowCollectionSource

public TensorflowCollectionSource(CollectionSource that)

Method Detail

createCopy

protected ExecutionOperator createCopy()

Overrides:

createCopy in class OperatorBase

getSupportedInputChannels

public java.util.List<ChannelDescriptor> getSupportedInputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain InputSlot.

Specified by:

getSupportedInputChannels in interface ExecutionOperator

Parameters:

index - the index of the InputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

getSupportedOutputChannels

public java.util.List<ChannelDescriptor> getSupportedOutputChannels(int index)

Description copied from interface: ExecutionOperator

Display the supported Channels for a certain OutputSlot.

Specified by:

getSupportedOutputChannels in interface ExecutionOperator

Parameters:

index - the index of the OutputSlot

Returns:

an List of Channels' Classes, ordered by their preference of use

See Also:

ExecutionOperator.getOutputChannelDescriptor(int)

evaluate

public Tuple<java.util.Collection<ExecutionLineageNode>,java.util.Collection<ChannelInstance>> evaluate(ChannelInstance[] inputs,
                                                                                                              ChannelInstance[] outputs,
                                                                                                              TensorflowExecutor tensorflowExecutor,
                                                                                                              OptimizationContext.OperatorContext operatorContext)

Description copied from interface: TensorflowExecutionOperator

Evaluates this operator. Takes a set of inputs and produces a set of outputs.

In addition, this method should give feedback of what this instance was doing by wiring the LazyExecutionLineageNodes of input and ouput ChannelInstances and providing a Collection of executed OptimizationContext.OperatorContexts.

Specified by:

evaluate in interface TensorflowExecutionOperator

Parameters:

inputs - ChannelInstances that satisfy the inputs of this operator

outputs - ChannelInstances that collect the outputs of this operator

operatorContext - OptimizationContext.OperatorContext of this instance

Returns:

Collections of what has been executed and produced