Uses of Interface
org.apache.wayang.spark.operators.SparkExecutionOperator

Packages that use SparkExecutionOperator

Package	Description
org.apache.wayang.iejoin.operators
org.apache.wayang.jdbc.operators
org.apache.wayang.profiler.spark
org.apache.wayang.spark.compiler
org.apache.wayang.spark.execution
org.apache.wayang.spark.operators
org.apache.wayang.spark.operators.ml

Uses of SparkExecutionOperator in org.apache.wayang.iejoin.operators

Classes in org.apache.wayang.iejoin.operators that implement SparkExecutionOperator

Modifier and Type	Class	Description
class	SparkIEJoinOperator<Type0 extends java.lang.Comparable<Type0>,Type1 extends java.lang.Comparable<Type1>,Input extends Copyable<Input>>	Spark implementation of the IEJoinOperator.
class	SparkIESelfJoinOperator<Type0 extends java.lang.Comparable<Type0>,Type1 extends java.lang.Comparable<Type1>,Input extends Copyable<Input>>	Spark implementation of the IESelfJoinOperator.

Uses of SparkExecutionOperator in org.apache.wayang.jdbc.operators

Classes in org.apache.wayang.jdbc.operators that implement SparkExecutionOperator

Modifier and Type	Class	Description
class	SqlToRddOperator

Uses of SparkExecutionOperator in org.apache.wayang.profiler.spark

Fields in org.apache.wayang.profiler.spark declared as SparkExecutionOperator

Modifier and Type	Field	Description
protected SparkExecutionOperator	SparkOperatorProfiler.operator

Fields in org.apache.wayang.profiler.spark with type parameters of type SparkExecutionOperator

Modifier and Type	Field	Description
protected java.util.function.Supplier<SparkExecutionOperator>	SparkOperatorProfiler.operatorGenerator

Methods in org.apache.wayang.profiler.spark with parameters of type SparkExecutionOperator

Modifier and Type	Method	Description
protected void	SparkOperatorProfiler.evaluate(SparkExecutionOperator operator, ChannelInstance[] inputs, ChannelInstance[] outputs)	Utility method to invoke evaluate(ChannelInstance[], ChannelInstance[], SparkExecutor, OptimizationContext.OperatorContext).

Constructor parameters in org.apache.wayang.profiler.spark with type arguments of type SparkExecutionOperator

Constructor	Description
BinaryOperatorProfiler(java.util.function.Supplier<SparkExecutionOperator> operatorGenerator, Configuration configuration, java.util.function.Supplier<?> dataQuantumGenerator0, java.util.function.Supplier<?> dataQuantumGenerator1)
SinkProfiler(java.util.function.Supplier<SparkExecutionOperator> operatorGenerator, Configuration configuration, java.util.function.Supplier<?> dataQuantumGenerator)
SparkOperatorProfiler(java.util.function.Supplier<SparkExecutionOperator> operatorGenerator, Configuration configuration, java.util.function.Supplier<?>... dataQuantumGenerators)
SparkSourceProfiler(java.util.function.Supplier<SparkExecutionOperator> operatorGenerator, Configuration configuration, java.util.function.Supplier<?> dataQuantumGenerator)
SparkUnaryOperatorProfiler(java.util.function.Supplier<SparkExecutionOperator> operatorGenerator, Configuration configuration, java.util.function.Supplier<?> dataQuantumGenerator)

Uses of SparkExecutionOperator in org.apache.wayang.spark.compiler

Methods in org.apache.wayang.spark.compiler with parameters of type SparkExecutionOperator

Modifier and Type	Method	Description
<I,O> org.apache.spark.api.java.function.FlatMapFunction<I,O>	FunctionCompiler.compile(FlatMapDescriptor<I,O> descriptor, SparkExecutionOperator operator, OptimizationContext.OperatorContext operatorContext, ChannelInstance[] inputs)	Create an appropriate FlatMapFunction for deploying the given FlatMapDescriptor on Apache Spark.
<I,O> org.apache.spark.api.java.function.FlatMapFunction<java.util.Iterator<I>,O>	FunctionCompiler.compile(MapPartitionsDescriptor<I,O> descriptor, SparkExecutionOperator operator, OptimizationContext.OperatorContext operatorContext, ChannelInstance[] inputs)	Create an appropriate Function for deploying the given MapPartitionsDescriptor on Apache Spark's AbstractJavaRDDLike.mapPartitions(FlatMapFunction).
<Type> org.apache.spark.api.java.function.Function<Type,java.lang.Boolean>	FunctionCompiler.compile(PredicateDescriptor<Type> predicateDescriptor, SparkExecutionOperator operator, OptimizationContext.OperatorContext operatorContext, ChannelInstance[] inputs)	Create an appropriate Function-based predicate for deploying the given PredicateDescriptor on Apache Spark.
<T> org.apache.spark.api.java.function.Function2<T,T,T>	FunctionCompiler.compile(ReduceDescriptor<T> descriptor, SparkExecutionOperator operator, OptimizationContext.OperatorContext operatorContext, ChannelInstance[] inputs)	Create an appropriate Function for deploying the given ReduceDescriptor on Apache Spark.
<I,O> org.apache.spark.api.java.function.Function<I,O>	FunctionCompiler.compile(TransformationDescriptor<I,O> descriptor, SparkExecutionOperator operator, OptimizationContext.OperatorContext operatorContext, ChannelInstance[] inputs)	Create an appropriate Function for deploying the given TransformationDescriptor on Apache Spark.

Uses of SparkExecutionOperator in org.apache.wayang.spark.execution

Constructors in org.apache.wayang.spark.execution with parameters of type SparkExecutionOperator

Constructor	Description
SparkExecutionContext(SparkExecutionOperator operator, ChannelInstance[] inputs, int iterationNumber)	Creates a new instance.

Uses of SparkExecutionOperator in org.apache.wayang.spark.operators

Classes in org.apache.wayang.spark.operators that implement SparkExecutionOperator

Modifier and Type	Class	Description
class	SparkBernoulliSampleOperator<Type>	Spark implementation of the SparkBernoulliSampleOperator.
class	SparkBroadcastOperator<Type>	Takes care of creating a Broadcast that can be used later on.
class	SparkCacheOperator<Type>	Converts an uncached RddChannel into a cached RddChannel.
class	SparkCartesianOperator<InputType0,InputType1>	Spark implementation of the CartesianOperator.
class	SparkCoGroupOperator<In0,In1,Key>	Spark implementation of the JoinOperator.
class	SparkCollectionSource<Type>	Provides a Collection to a Spark job.
class	SparkCollectOperator<Type>	Converts a RddChannel into a CollectionChannel of the JavaPlatform.
class	SparkCountOperator<Type>	Spark implementation of the CountOperator.
class	SparkDistinctOperator<Type>	Spark implementation of the DistinctOperator.
class	SparkDoWhileOperator<InputType,ConvergenceType>	Spark implementation of the DoWhileOperator.
class	SparkFilterOperator<Type>	Spark implementation of the FilterOperator.
class	SparkFlatMapOperator<InputType,OutputType>	Spark implementation of the FlatMapOperator.
class	SparkGlobalMaterializedGroupOperator<Type>	Spark implementation of the GlobalMaterializedGroupOperator.
class	SparkGlobalReduceOperator<Type>	Spark implementation of the GlobalReduceOperator.
class	SparkIntersectOperator<Type>	Spark implementation of the JoinOperator.
class	SparkJoinOperator<InputType0,InputType1,KeyType>	Spark implementation of the JoinOperator.
class	SparkKafkaTopicSink<T>	Implementation of the KafkaTopicSink operator for the Spark platform.
class	SparkKafkaTopicSource	Provides a Collection to a Spark job.
class	SparkLocalCallbackSink<T extends java.io.Serializable>	Implementation of the LocalCallbackSink operator for the Spark platform.
class	SparkLoopOperator<InputType,ConvergenceType>	Spark implementation of the LoopOperator.
class	SparkMapOperator<InputType,OutputType>	Spark implementation of the MapOperator.
class	SparkMapPartitionsOperator<InputType,OutputType>	Spark implementation of the MapPartitionsOperator.
class	SparkMaterializedGroupByOperator<Type,KeyType>	Spark implementation of the MaterializedGroupByOperator.
class	SparkObjectFileSink<T>	Operator for the SparkPlatform that creates a sequence file.
class	SparkObjectFileSource<T>	Operator for the SparkPlatform that creates a sequence file.
class	SparkRandomPartitionSampleOperator<Type>	Spark implementation of the SampleOperator.
class	SparkReduceByOperator<Type,KeyType>	Spark implementation of the ReduceByOperator.
class	SparkRepeatOperator<Type>	Spark implementation of the RepeatOperator.
class	SparkShufflePartitionSampleOperator<Type>	Spark implementation of the SparkShufflePartitionSampleOperator.
class	SparkSortOperator<Type,Key>	Spark implementation of the SortOperator.
class	SparkTextFileSink<T>	Implementation of the TextFileSink operator for the Spark platform.
class	SparkTextFileSource	Provides a Collection to a Spark job.
class	SparkTsvFileSink<T extends Tuple2<?,?>>	Operator for the SparkPlatform that creates a TSV file.
class	SparkTsvFileSource<T>	Operator for the SparkPlatform that creates a sequence file.
class	SparkUnionAllOperator<Type>	Spark implementation of the UnionAllOperator.
class	SparkZipWithIdOperator<InputType>	Spark implementation of the MapOperator.

Uses of SparkExecutionOperator in org.apache.wayang.spark.operators.ml

Classes in org.apache.wayang.spark.operators.ml that implement SparkExecutionOperator

Modifier and Type	Class	Description
class	SparkDecisionTreeClassificationOperator
class	SparkKMeansOperator
class	SparkLinearRegressionOperator
class	SparkModelTransformOperator<X,Y>	Deprecated.
class	SparkPredictOperator<X,Y>