Package org.apache.wayang.spark.operators
package org.apache.wayang.spark.operators
-
ClassDescriptionSpark implementation of the
SparkBernoulliSampleOperator.SparkBroadcastOperator<Type>Takes care of creating aBroadcastthat can be used later on.SparkCacheOperator<Type>Converts an uncachedRddChannelinto a cachedRddChannel.SparkCartesianOperator<InputType0,InputType1> Spark implementation of theCartesianOperator.SparkCoGroupOperator<In0,In1, Key> Spark implementation of theCoGroupOperator.SparkCollectionSource<Type>Provides aCollectionto a Spark job.SparkCollectOperator<Type>SparkCountOperator<Type>Spark implementation of theCountOperator.Conversion operator fromDatasetChanneltoRddChannel.SparkDistinctOperator<Type>Spark implementation of theDistinctOperator.SparkDoWhileOperator<InputType,ConvergenceType> Spark implementation of theDoWhileOperator.Execution operator for theSparkPlatform.SparkFilterOperator<Type>Spark implementation of theFilterOperator.SparkFlatMapOperator<InputType,OutputType> Spark implementation of theFlatMapOperator.Spark implementation of theGlobalMaterializedGroupOperator.Spark implementation of theGlobalReduceOperator.SparkIntersectOperator<Type>Spark implementation of theIntersectOperator.SparkJoinOperator<InputType0,InputType1, KeyType> Spark implementation of theJoinOperator.Implementation of theKafkaTopicSinkoperator for the Spark platform.Spark implementation of theKafkaTopicSource.SparkLocalCallbackSink<T extends Serializable>Implementation of theLocalCallbackSinkoperator for the Spark platform.SparkLoopOperator<InputType,ConvergenceType> Spark implementation of theLoopOperator.SparkMapOperator<InputType,OutputType> Spark implementation of theMapOperator.SparkMapPartitionsOperator<InputType,OutputType> Spark implementation of theMapPartitionsOperator.SparkMaterializedGroupByOperator<Type,KeyType> Spark implementation of theMaterializedGroupByOperator.Operatorfor theSparkPlatformthat creates a sequence file.Operatorfor theSparkPlatformthat creates a sequence file.Writes records to Parquet using Spark.Spark implementation of theParquetSourceoperator.Spark implementation of theSampleOperator.Conversion operator fromRddChanneltoDatasetChannel.SparkReduceByOperator<Type,KeyType> Spark implementation of theReduceByOperator.SparkRepeatOperator<Type>Spark implementation of theRepeatOperator.Spark implementation of theSparkShufflePartitionSampleOperator.SparkSortOperator<Type,Key> Spark implementation of theSortOperator.Implementation of theTextFileSinkoperator for the Spark platform.ExecutionOperatorfor theSparkPlatformthat reads from a text file from a URL.Operatorfor theSparkPlatformthat creates a TSV file.Operatorfor theSparkPlatformthat creates a TSV text file.SparkUnionAllOperator<Type>Spark implementation of theUnionAllOperator.SparkZipWithIdOperator<InputType>Spark implementation of theZipWithIdOperator.