Package org.apache.wayang.spark.platform
Class SparkPlatform
- java.lang.Object
-
- org.apache.wayang.core.platform.Platform
-
- org.apache.wayang.spark.platform.SparkPlatform
-
-
Field Summary
Fields Modifier and Type Field Description static java.lang.String
INITIALIZATION_MS_CONFIG_KEY
-
Fields inherited from class org.apache.wayang.core.platform.Platform
jsonSerializer
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description void
configureDefaults(Configuration configuration)
Configure default settings for this instance, e.g., to be able to createLoadProfileToTimeConverter
s.LoadProfileToTimeConverter
createLoadProfileToTimeConverter(Configuration configuration)
TimeToCostConverter
createTimeToCostConverter(Configuration configuration)
Creates aTimeToCostConverter
for this instance.Executor.Factory
getExecutorFactory()
long
getInitializeMillis(Configuration configuration)
Get the time necessary to initialize this instance and use it for execution.static SparkPlatform
getInstance()
SparkContextReference
getSparkContext(Job job)
Configures the single maintainedJavaSparkContext
according to thejob
and returns it.void
warmUp(Configuration configuration)
Warm up this instance.-
Methods inherited from class org.apache.wayang.core.platform.Platform
createExecutor, getConfigurationName, getName, isSinglePlatformExecutionPossible, load, toString
-
-
-
-
Field Detail
-
INITIALIZATION_MS_CONFIG_KEY
public static final java.lang.String INITIALIZATION_MS_CONFIG_KEY
- See Also:
- Constant Field Values
-
-
Method Detail
-
getInstance
public static SparkPlatform getInstance()
-
getSparkContext
public SparkContextReference getSparkContext(Job job)
Configures the single maintainedJavaSparkContext
according to thejob
and returns it.- Returns:
- a
SparkContextReference
wrapping theJavaSparkContext
-
configureDefaults
public void configureDefaults(Configuration configuration)
Description copied from class:Platform
Configure default settings for this instance, e.g., to be able to createLoadProfileToTimeConverter
s.- Specified by:
configureDefaults
in classPlatform
- Parameters:
configuration
- that should be configured
-
createLoadProfileToTimeConverter
public LoadProfileToTimeConverter createLoadProfileToTimeConverter(Configuration configuration)
- Specified by:
createLoadProfileToTimeConverter
in classPlatform
- Returns:
- a default
LoadProfileToTimeConverter
-
createTimeToCostConverter
public TimeToCostConverter createTimeToCostConverter(Configuration configuration)
Description copied from class:Platform
Creates aTimeToCostConverter
for this instance.- Specified by:
createTimeToCostConverter
in classPlatform
- Parameters:
configuration
- configures theTimeToCostConverter
- Returns:
- the
TimeToCostConverter
-
getExecutorFactory
public Executor.Factory getExecutorFactory()
- Specified by:
getExecutorFactory
in classPlatform
-
warmUp
public void warmUp(Configuration configuration)
Description copied from class:Platform
Warm up this instance.
-
getInitializeMillis
public long getInitializeMillis(Configuration configuration)
Description copied from class:Platform
Get the time necessary to initialize this instance and use it for execution.- Overrides:
getInitializeMillis
in classPlatform
- Returns:
- the milliseconds required to initialize this instance
-
-