Package org.apache.wayang.profiler.spark

Class SinkProfiler

java.lang.Object

org.apache.wayang.profiler.spark.SparkOperatorProfiler

org.apache.wayang.profiler.spark.SinkProfiler

public class SinkProfiler
extends SparkOperatorProfiler

SparkOperatorProfiler implementation for SparkExecutionOperators with one input and no outputs.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.wayang.profiler.spark.SparkOperatorProfiler

SparkOperatorProfiler.Result

Field Summary

Fields inherited from class org.apache.wayang.profiler.spark.SparkOperatorProfiler

cpuMhz, dataQuantumGenerators, executionPaddingTime, functionCompiler, inputCardinalities, logger, numCoresPerMachine, numMachines, numPartitions, operator, operatorGenerator, sparkExecutor

Constructor Summary

Constructors

Constructor	Description
SinkProfiler(java.util.function.Supplier<SparkExecutionOperator> operatorGenerator, Configuration configuration, java.util.function.Supplier<?> dataQuantumGenerator)

Method Summary

Modifier and Type	Method	Description
protected SparkOperatorProfiler.Result	executeOperator()	Executes the profiling task.
protected void	prepareInput(int inputIndex, long inputCardinality)

Methods inherited from class org.apache.wayang.profiler.spark.SparkOperatorProfiler

cleanUp, createChannelInstance, createChannelInstance, evaluate, partition, prepare, prepareInputRdd, prepareInputRddInDriver, prepareInputRddInWorker, provideCpuCycles, provideDiskBytes, provideNetworkBytes, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SinkProfiler

public SinkProfiler(java.util.function.Supplier<SparkExecutionOperator> operatorGenerator,
                    Configuration configuration,
                    java.util.function.Supplier<?> dataQuantumGenerator)

Method Detail

prepareInput

protected void prepareInput(int inputIndex,
                            long inputCardinality)

Specified by:

prepareInput in class SparkOperatorProfiler

executeOperator

protected SparkOperatorProfiler.Result executeOperator()

Description copied from class: SparkOperatorProfiler

Executes the profiling task. Requires that this instance is prepared.

Specified by:

executeOperator in class SparkOperatorProfiler