Package org.apache.wayang.basic.operators

Class Summary

Class	Description
CartesianOperator<InputType0,InputType1>	This operator returns the cartesian product of elements of input datasets.
CoGroupOperator<InputType0,InputType1,Key>	This operator groups both inputs by some key and then matches groups with the same key.
CollectionSource<T>	This source takes as input a Java Collection.
CountOperator<Type>	This operator returns the count of elements in this stream.
DecisionTreeClassificationOperator
DistinctOperator<Type>	This operator returns the distinct elements in this dataset.
DLTrainingOperator<X,Y>
DLTrainingOperator.Option
DoWhileOperator<InputType,ConvergenceType>	This operator has three inputs and two outputs.
FilterOperator<Type>	This operator returns a new dataset after filtering by applying predicateDescriptor.
FlatMapOperator<InputType,OutputType>	A flatmap operator represents semantics as they are known from frameworks, such as Spark and Flink.
GlobalMaterializedGroupOperator<Type>	This operator groups the elements of a data set into a single data quantum.
GlobalReduceOperator<Type>	This operator groups the elements of a data set and aggregates the groups.
GroupByOperator<Input,Key>	This is the auxiliary GroupBy operator, i.e., it behaves differently depending on its context.
IntersectOperator<Type>	This operator returns the set intersection of elements of input datasets.
JoinOperator<InputType0,InputType1,Key>	This operator returns the cartesian product of elements of input datasets.
KafkaTopicSink<T>	This UnarySink writes all incoming data quanta to a single Kafka topic.
KafkaTopicSource	This source reads messages from a Kafka topic and outputs the messages as data units.
KMeansOperator
LinearRegressionOperator
LocalCallbackSink<T>	This sink executes a callback on each received data unit into a Java Collection.
LoopOperator<InputType,ConvergenceType>	This operator has three inputs and three outputs.
MapOperator<InputType,OutputType>	A map operator represents semantics as they are known from frameworks, such as Spark and Flink.
MapPartitionsOperator<InputType,OutputType>	This operator takes as input potentially multiple input data quanta and outputs multiple input data quanta.
MaterializedGroupByOperator<Type,Key>	This operator collocates the data units in a data set w.r.t. a key function.
ModelTransformOperator<X,Y>	Deprecated.
ObjectFileSink<T>	This UnarySink writes all incoming data quanta to a Object file.
ObjectFileSource<T>	This source reads a text file and outputs the lines as data units.
PageRankOperator	Operator for the PageRank algorithm.
PredictOperator<X,Y>
PredictOperators
PyWayangReduceByOperator<Type,Key>
ReduceByOperator<Type,Key>	This operator groups the elements of a data set and aggregates the groups.
ReduceOperator<Type>	This operator is context dependent: after a GroupByOperator, it is meant to be a ReduceByOperator; otherwise, it is a GlobalReduceOperator.
RepeatOperator<Type>	This Operator repeats a certain subplan of Operators for a given number of times.
SampleOperator<Type>	A random sample operator randomly selects its inputs from the input slot and pushes that element to the output slot.
SortOperator<Type,Key>	This operator sorts the elements in this dataset.
TableSource	UnarySource that provides the tuples from a database table.
TextFileSink<T>	This UnarySink writes all incoming data quanta to a text file.
TextFileSource	This source reads a text file and outputs the lines as data units.
UnionAllOperator<Type>	This Operator creates the union (bag semantics) of two .
ZipWithIdOperator<InputType>	This operators attaches a unique ID to each input data quantum.

Enum Summary

Enum	Description
SampleOperator.Methods