Package org.apache.wayang.flink.execution

Class FlinkExecutor

java.lang.Object

org.apache.wayang.core.util.AbstractReferenceCountable

org.apache.wayang.core.platform.ExecutorTemplate

org.apache.wayang.core.platform.PushExecutorTemplate

org.apache.wayang.flink.execution.FlinkExecutor

All Implemented Interfaces:

CompositeExecutionResource, ExecutionResource, Executor, ReferenceCountable

public class FlinkExecutor
extends PushExecutorTemplate

Executor implementation for the FlinkPlatform.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.wayang.core.platform.PushExecutorTemplate

PushExecutorTemplate.StageExecution

Nested classes/interfaces inherited from interface org.apache.wayang.core.platform.Executor

Executor.Factory

Field Summary

Fields

Modifier and Type	Field	Description
FunctionCompiler	compiler	Compiler to create flink UDFs.
org.apache.flink.api.java.ExecutionEnvironment	fee	The ExecutionEnvironment to be used by this instance.

Fields inherited from class org.apache.wayang.core.platform.PushExecutorTemplate

job

Fields inherited from class org.apache.wayang.core.platform.ExecutorTemplate

logger

Constructor Summary

Constructors

Constructor	Description
FlinkExecutor(FlinkPlatform flinkPlatform, Job job)

Method Summary

Modifier and Type	Method	Description
void	dispose()	Releases any instances acquired by this instance to execute ExecutionStages.
protected Tuple<List<ChannelInstance>,PartialExecution>	execute(ExecutionTask task, List<ChannelInstance> inputChannelInstances, OptimizationContext.OperatorContext producerOperatorContext, boolean isRequestEagerExecution)	Executes the given task and return the output ChannelInstances.
FunctionCompiler	getCompiler()	Provide a FunctionCompiler.
int	getNumDefaultPartitions()
Platform	getPlatform()

Methods inherited from class org.apache.wayang.core.platform.PushExecutorTemplate

execute, getJob

Methods inherited from class org.apache.wayang.core.platform.ExecutorTemplate

createPartialExecution, disposeUnreferenced, getConfiguration, getCrossPlatformExecutor, register, registerMeasuredCardinalities, registerMeasuredCardinality, toString, unregister

Methods inherited from class org.apache.wayang.core.util.AbstractReferenceCountable

disposeIfUnreferenced, getNumReferences, isDisposed, noteDiscardedReference, noteObtainedReference

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.wayang.core.util.ReferenceCountable

disposeIfUnreferenced, getNumReferences, isDisposed, noteDiscardedReference, noteObtainedReference

Field Details

fee

public org.apache.flink.api.java.ExecutionEnvironment fee

The ExecutionEnvironment to be used by this instance.

compiler

public FunctionCompiler compiler

Compiler to create flink UDFs.

Constructor Details

FlinkExecutor

public FlinkExecutor(FlinkPlatform flinkPlatform,
 Job job)

Method Details

execute

protected Tuple<List<ChannelInstance>,PartialExecution> execute(ExecutionTask task,
 List<ChannelInstance> inputChannelInstances,
 OptimizationContext.OperatorContext producerOperatorContext,
 boolean isRequestEagerExecution)

Description copied from class: PushExecutorTemplate

Executes the given task and return the output ChannelInstances.

Specified by:

execute in class PushExecutorTemplate

Parameters:

task - that should be executed

inputChannelInstances - inputs into the task

isRequestEagerExecution - whether the ExecutionTask should be executed eagerly if possible

Returns:

the ChannelInstances created as output of task

dispose

public void dispose()

Description copied from interface: Executor

Releases any instances acquired by this instance to execute ExecutionStages.

Specified by:

dispose in interface ExecutionResource

Specified by:

dispose in interface Executor

Overrides:

dispose in class ExecutorTemplate

getPlatform

public Platform getPlatform()

Returns:

the Platform this instance belongs to

getCompiler

public FunctionCompiler getCompiler()

Provide a FunctionCompiler.

Returns:

the FunctionCompiler

getNumDefaultPartitions

public int getNumDefaultPartitions()