Package org.apache.wayang.spark.channels

Class DatasetChannel.Instance

java.lang.Object

org.apache.wayang.core.util.AbstractReferenceCountable

org.apache.wayang.core.platform.ExecutionResourceTemplate

org.apache.wayang.core.platform.AbstractChannelInstance

org.apache.wayang.spark.channels.DatasetChannel.Instance

All Implemented Interfaces:

ChannelInstance, ExecutionResource, ReferenceCountable

Enclosing class:

DatasetChannel

public class DatasetChannel.Instance
extends AbstractChannelInstance

ChannelInstance for DatasetChannels.

Constructor Summary

Constructors

Constructor	Description
Instance(SparkExecutor executor, OptimizationContext.OperatorContext producerOperatorContext, int producerOutputIndex)

Method Summary

Modifier and Type	Method	Description
void	accept(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset, SparkExecutor sparkExecutor)	Store a Dataset in this channel and optionally measure its cardinality.
protected void	doDispose()	Performs the actual disposing work of this instance.
DatasetChannel	getChannel()
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>	provideDataset()	Provide the stored Dataset.

Methods inherited from class org.apache.wayang.core.platform.AbstractChannelInstance

getLineage, getMeasuredCardinality, getProducerOperatorContext, markProduced, setMeasuredCardinality, toString, wasProduced

Methods inherited from class org.apache.wayang.core.platform.ExecutionResourceTemplate

dispose, disposeUnreferenced

Methods inherited from class org.apache.wayang.core.util.AbstractReferenceCountable

disposeIfUnreferenced, getNumReferences, isDisposed, noteDiscardedReference, noteObtainedReference

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.core.platform.ChannelInstance

isMarkedForInstrumentation

Methods inherited from interface org.apache.wayang.core.platform.ExecutionResource

dispose

Methods inherited from interface org.apache.wayang.core.util.ReferenceCountable

disposeIfUnreferenced, getNumReferences, isDisposed, noteDiscardedReference, noteObtainedReference

Constructor Details

Instance

public Instance(SparkExecutor executor,
 OptimizationContext.OperatorContext producerOperatorContext,
 int producerOutputIndex)

Method Details

accept

public void accept(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataset,
 SparkExecutor sparkExecutor)

Store a Dataset in this channel and optionally measure its cardinality.

Parameters:

dataset - the Dataset to store

sparkExecutor - the SparkExecutor handling this channel

provideDataset

public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> provideDataset()

Provide the stored Dataset.

Returns:

the stored Dataset

doDispose

protected void doDispose()

Description copied from class: ExecutionResourceTemplate

Performs the actual disposing work of this instance.

Specified by:

doDispose in class ExecutionResourceTemplate

getChannel

public DatasetChannel getChannel()

Returns:

the Channel that is implemented by this instance