Package org.apache.wayang.basic.channels

Class FileChannel

java.lang.Object

org.apache.wayang.core.plan.executionplan.Channel

org.apache.wayang.basic.channels.FileChannel

public class FileChannel
extends Channel

Represents a Channel that is realized via a file/set of files.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	FileChannel.Descriptor	ChannelDescriptor for FileChannels.
class	FileChannel.Instance	ChannelInstance implementation for FileChannels.

Field Summary

Fields

Modifier and Type	Field	Description
static final FileChannel.Descriptor	HDFS_OBJECT_FILE_DESCRIPTOR
static final FileChannel.Descriptor	HDFS_TSV_DESCRIPTOR

Fields inherited from class org.apache.wayang.core.plan.executionplan.Channel

logger

Constructor Summary

Constructors

Constructor	Description
FileChannel(FileChannel.Descriptor descriptor)
FileChannel(ChannelDescriptor descriptor, OutputSlot<?> outputSlot)

Method Summary

Modifier and Type	Method	Description
FileChannel	copy()	Create a copy of this instance.
ChannelInstance	createInstance(Executor executor, OptimizationContext.OperatorContext producerOperatorContext, int producerOutputIndex)	Create a ChannelInstance for this instance.
FileChannel.Descriptor	getDescriptor()
String	toString()

Methods inherited from class org.apache.wayang.core.plan.executionplan.Channel

addConsumer, addSibling, getCardinalityEstimate, getConsumers, getCorrespondingSlots, getDataSetType, getOriginal, getProducer, getProducerOperator, getProducerSlot, getSiblings, isBetweenStages, isCopy, isExecutionBreaker, isMarkedForInstrumentation, isReusable, isSuitableForBreakpoint, markForInstrumentation, mergeIntoOriginal, removeSiblings, removeSiblingsWhere, retain, withSiblings

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

HDFS_TSV_DESCRIPTOR

public static final FileChannel.Descriptor HDFS_TSV_DESCRIPTOR

HDFS_OBJECT_FILE_DESCRIPTOR

public static final FileChannel.Descriptor HDFS_OBJECT_FILE_DESCRIPTOR

Constructor Details

FileChannel

public FileChannel(FileChannel.Descriptor descriptor)

FileChannel

public FileChannel(ChannelDescriptor descriptor,
 OutputSlot<?> outputSlot)

Method Details

copy

public FileChannel copy()

Description copied from class: Channel

Create a copy of this instance. Mimics everything apart from the consumers. Also delimits already executed ExecutionTasks and those that are not executed yet. Be careful when revising this invariant.

Specified by:

copy in class Channel

toString

public String toString()

Overrides:

toString in class Channel

getDescriptor

public FileChannel.Descriptor getDescriptor()

Overrides:

getDescriptor in class Channel

createInstance

public ChannelInstance createInstance(Executor executor,
 OptimizationContext.OperatorContext producerOperatorContext,
 int producerOutputIndex)

Description copied from class: Channel

Create a ChannelInstance for this instance.

Specified by:

createInstance in class Channel

Parameters:

executor - that manages the resource or null if none