Package org.apache.wayang.basic.operators

Class GoogleCloudStorageSource

java.lang.Object

org.apache.wayang.core.plan.wayangplan.OperatorBase

org.apache.wayang.core.plan.wayangplan.UnarySource<String>

org.apache.wayang.basic.operators.GoogleCloudStorageSource

All Implemented Interfaces:

Serializable, ActualOperator, ElementaryOperator, Operator

Direct Known Subclasses:

JavaGoogleCloudStorageSource

public class GoogleCloudStorageSource
extends UnarySource<String>

See Also:

• Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
protected class	GoogleCloudStorageSource.CardinalityEstimator	Custom CardinalityEstimator for FlatMapOperators.

Nested classes/interfaces inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

OperatorBase.GsonSerializer

Field Summary

Fields inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

inputSlots, outputSlots, STANDARD_OPERATOR_ARGS

Fields inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

FIRST_EPOCH

Constructor Summary

Constructors

Constructor	Description
GoogleCloudStorageSource(String bucket, String blobName, String filePathToCredentialsFile)
GoogleCloudStorageSource(String bucket, String blobName, String filePathToCredentialsFile, String encoding)
GoogleCloudStorageSource(GoogleCloudStorageSource that)	Copies an instance (exclusive of broadcasts).

Method Summary

Modifier and Type	Method	Description
com.google.cloud.storage.Blob	getBlob()
OptionalLong	getBlobByteSize()
String	getBlobName()
String	getBucket()
String	getEncoding()
String	getfilePathToCredentialsFile()
InputStream	getInputStream()

Methods inherited from class org.apache.wayang.core.plan.wayangplan.UnarySource

getOutput, getType

Methods inherited from class org.apache.wayang.core.plan.wayangplan.OperatorBase

accept, addBroadcastInput, addTargetPlatform, at, collectMappedInputSlots, collectMappedOutputSlots, copy, createCopy, getAllInputs, getAllOutputs, getCardinalityEstimator, getContainer, getEpoch, getName, getOriginal, getSimpleClassName, getTargetPlatforms, isAuxiliary, isSupportingBroadcastInputs, propagateInputCardinality, propagateOutputCardinality, setAuxiliary, setCardinalityEstimator, setContainer, setEpoch, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ActualOperator

accept

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.ElementaryOperator

createCardinalityEstimator, getCardinalityEstimator, isAuxiliary, setAuxiliary, setCardinalityEstimator

Methods inherited from interface org.apache.wayang.core.plan.wayangplan.Operator

addBroadcastInput, addTargetPlatform, broadcastTo, broadcastTo, collectMappedInputSlots, collectMappedOutputSlots, connectTo, connectTo, getAllInputs, getAllOutputs, getCardinalityPusher, getContainer, getEffectiveOccupant, getEffectiveOccupant, getEpoch, getEstimationContextProperties, getForwards, getInnermostLoop, getInput, getInput, getLoopStack, getName, getNumBroadcastInputs, getNumInputs, getNumOutputs, getNumRegularInputs, getOuterInputSlot, getOutermostInputSlot, getOutermostOutputSlots, getOutput, getOutput, getParent, getTargetPlatforms, isAlternative, isConversion, isElementary, isExecutionOperator, isFeedbackInput, isFeedforwardOutput, isLoopHead, isLoopSubplan, isOwnerOf, isReading, isSink, isSource, isSubplan, isSupportingBroadcastInputs, isUnconnected, propagateInputCardinality, propagateOutputCardinality, propagateOutputCardinality, replaceWith, setContainer, setEpoch, setInput, setName, setOutput

Constructor Details

GoogleCloudStorageSource

public GoogleCloudStorageSource(String bucket,
 String blobName,
 String filePathToCredentialsFile)

GoogleCloudStorageSource

public GoogleCloudStorageSource(String bucket,
 String blobName,
 String filePathToCredentialsFile,
 String encoding)

GoogleCloudStorageSource

public GoogleCloudStorageSource(GoogleCloudStorageSource that)

Copies an instance (exclusive of broadcasts).

Parameters:

that - that should be copied

Method Details

getBlobByteSize

public OptionalLong getBlobByteSize()

getInputStream

public InputStream getInputStream()
                           throws IOException

Throws:

IOException

getEncoding

public String getEncoding()

getBucket

public String getBucket()

getBlobName

public String getBlobName()

getfilePathToCredentialsFile

public String getfilePathToCredentialsFile()

getBlob

public com.google.cloud.storage.Blob getBlob()
                                      throws IOException

Throws:

IOException