Class FlinkExecutor
- java.lang.Object
-
- org.apache.wayang.core.util.AbstractReferenceCountable
-
- org.apache.wayang.core.platform.ExecutorTemplate
-
- org.apache.wayang.core.platform.PushExecutorTemplate
-
- org.apache.wayang.flink.execution.FlinkExecutor
-
- All Implemented Interfaces:
CompositeExecutionResource
,ExecutionResource
,Executor
,ReferenceCountable
public class FlinkExecutor extends PushExecutorTemplate
Executor
implementation for theFlinkPlatform
.
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.wayang.core.platform.PushExecutorTemplate
PushExecutorTemplate.StageExecution
-
Nested classes/interfaces inherited from interface org.apache.wayang.core.platform.Executor
Executor.Factory
-
-
Field Summary
Fields Modifier and Type Field Description FunctionCompiler
compiler
Compiler to create flink UDFs.org.apache.flink.api.java.ExecutionEnvironment
fee
TheExecutionEnvironment
to be used by this instance.-
Fields inherited from class org.apache.wayang.core.platform.PushExecutorTemplate
job
-
Fields inherited from class org.apache.wayang.core.platform.ExecutorTemplate
logger
-
-
Constructor Summary
Constructors Constructor Description FlinkExecutor(FlinkPlatform flinkPlatform, Job job)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
dispose()
Releases any instances acquired by this instance to executeExecutionStage
s.protected Tuple<java.util.List<ChannelInstance>,PartialExecution>
execute(ExecutionTask task, java.util.List<ChannelInstance> inputChannelInstances, OptimizationContext.OperatorContext producerOperatorContext, boolean isRequestEagerExecution)
Executes the giventask
and return the outputChannelInstance
s.FunctionCompiler
getCompiler()
Provide aFunctionCompiler
.int
getNumDefaultPartitions()
Platform
getPlatform()
-
Methods inherited from class org.apache.wayang.core.platform.PushExecutorTemplate
execute, getJob
-
Methods inherited from class org.apache.wayang.core.platform.ExecutorTemplate
createPartialExecution, disposeUnreferenced, getConfiguration, getCrossPlatformExecutor, register, registerMeasuredCardinalities, registerMeasuredCardinality, toString, unregister
-
Methods inherited from class org.apache.wayang.core.util.AbstractReferenceCountable
disposeIfUnreferenced, getNumReferences, isDisposed, noteDiscardedReference, noteObtainedReference
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
-
Methods inherited from interface org.apache.wayang.core.util.ReferenceCountable
disposeIfUnreferenced, getNumReferences, isDisposed, noteDiscardedReference, noteObtainedReference
-
-
-
-
Field Detail
-
fee
public org.apache.flink.api.java.ExecutionEnvironment fee
TheExecutionEnvironment
to be used by this instance.
-
compiler
public FunctionCompiler compiler
Compiler to create flink UDFs.
-
-
Constructor Detail
-
FlinkExecutor
public FlinkExecutor(FlinkPlatform flinkPlatform, Job job)
-
-
Method Detail
-
execute
protected Tuple<java.util.List<ChannelInstance>,PartialExecution> execute(ExecutionTask task, java.util.List<ChannelInstance> inputChannelInstances, OptimizationContext.OperatorContext producerOperatorContext, boolean isRequestEagerExecution)
Description copied from class:PushExecutorTemplate
Executes the giventask
and return the outputChannelInstance
s.- Specified by:
execute
in classPushExecutorTemplate
- Parameters:
task
- that should be executedinputChannelInstances
- inputs into thetask
isRequestEagerExecution
- whether theExecutionTask
should be executed eagerly if possible- Returns:
- the
ChannelInstance
s created as output oftask
-
dispose
public void dispose()
Description copied from interface:Executor
Releases any instances acquired by this instance to executeExecutionStage
s.- Specified by:
dispose
in interfaceExecutionResource
- Specified by:
dispose
in interfaceExecutor
- Overrides:
dispose
in classExecutorTemplate
-
getCompiler
public FunctionCompiler getCompiler()
Provide aFunctionCompiler
.- Returns:
- the
FunctionCompiler
-
getNumDefaultPartitions
public int getNumDefaultPartitions()
-
-