DatabricksSparkPythonActivity Class

public final class DatabricksSparkPythonActivity
extends ExecutionActivity

DatabricksSparkPython activity.

Constructor Summary

Constructor Description
DatabricksSparkPythonActivity()

Creates an instance of DatabricksSparkPythonActivity class.

Method Summary

Modifier and Type Method and Description
static DatabricksSparkPythonActivity fromJson(JsonReader jsonReader)

Reads an instance of DatabricksSparkPythonActivity from the JsonReader.

List<Map<String,Object>> libraries()

Get the libraries property: A list of libraries to be installed on the cluster that will execute the job.

List<Object> parameters()

Get the parameters property: Command line parameters that will be passed to the Python file.

Object pythonFile()

Get the pythonFile property: The URI of the Python file to be executed.

JsonWriter toJson(JsonWriter jsonWriter)
String type()

Get the type property: Type of activity.

void validate()

Validates the instance.

DatabricksSparkPythonActivity withDependsOn(List<ActivityDependency> dependsOn)

Set the dependsOn property: Activity depends on condition.

DatabricksSparkPythonActivity withDescription(String description)

Set the description property: Activity description.

DatabricksSparkPythonActivity withLibraries(List<Map<String,Object>> libraries)

Set the libraries property: A list of libraries to be installed on the cluster that will execute the job.

DatabricksSparkPythonActivity withLinkedServiceName(LinkedServiceReference linkedServiceName)

Set the linkedServiceName property: Linked service reference.

DatabricksSparkPythonActivity withName(String name)

Set the name property: Activity name.

DatabricksSparkPythonActivity withOnInactiveMarkAs(ActivityOnInactiveMarkAs onInactiveMarkAs)

Set the onInactiveMarkAs property: Status result of the activity when the state is set to Inactive.

DatabricksSparkPythonActivity withParameters(List<Object> parameters)

Set the parameters property: Command line parameters that will be passed to the Python file.

DatabricksSparkPythonActivity withPolicy(ActivityPolicy policy)

Set the policy property: Activity policy.

DatabricksSparkPythonActivity withPythonFile(Object pythonFile)

Set the pythonFile property: The URI of the Python file to be executed.

DatabricksSparkPythonActivity withState(ActivityState state)

Set the state property: Activity state.

DatabricksSparkPythonActivity withUserProperties(List<UserProperty> userProperties)

Set the userProperties property: Activity user properties.

Methods inherited from Activity

Methods inherited from ExecutionActivity

Methods inherited from java.lang.Object

Constructor Details

DatabricksSparkPythonActivity

public DatabricksSparkPythonActivity()

Creates an instance of DatabricksSparkPythonActivity class.

Method Details

fromJson

public static DatabricksSparkPythonActivity fromJson(JsonReader jsonReader)

Reads an instance of DatabricksSparkPythonActivity from the JsonReader.

Parameters:

jsonReader - The JsonReader being read.

Returns:

An instance of DatabricksSparkPythonActivity if the JsonReader was pointing to an instance of it, or null if it was pointing to JSON null.

Throws:

IOException

- If the deserialized JSON object was missing any required properties.

libraries

public List<Map<String,Object>> libraries()

Get the libraries property: A list of libraries to be installed on the cluster that will execute the job.

Returns:

the libraries value.

parameters

public List<Object> parameters()

Get the parameters property: Command line parameters that will be passed to the Python file.

Returns:

the parameters value.

pythonFile

public Object pythonFile()

Get the pythonFile property: The URI of the Python file to be executed. DBFS paths are supported. Type: string (or Expression with resultType string).

Returns:

the pythonFile value.

toJson

public JsonWriter toJson(JsonWriter jsonWriter)

Overrides:

DatabricksSparkPythonActivity.toJson(JsonWriter jsonWriter)

Parameters:

jsonWriter

Throws:

type

public String type()

Get the type property: Type of activity.

Overrides:

DatabricksSparkPythonActivity.type()

Returns:

the type value.

validate

public void validate()

Validates the instance.

Overrides:

DatabricksSparkPythonActivity.validate()

withDependsOn

public DatabricksSparkPythonActivity withDependsOn(List<ActivityDependency> dependsOn)

Set the dependsOn property: Activity depends on condition.

Overrides:

DatabricksSparkPythonActivity.withDependsOn(List<ActivityDependency> dependsOn)

Parameters:

dependsOn

withDescription

public DatabricksSparkPythonActivity withDescription(String description)

Set the description property: Activity description.

Overrides:

DatabricksSparkPythonActivity.withDescription(String description)

Parameters:

description

withLibraries

public DatabricksSparkPythonActivity withLibraries(List<Map<String,Object>> libraries)

Set the libraries property: A list of libraries to be installed on the cluster that will execute the job.

Parameters:

libraries - the libraries value to set.

Returns:

the DatabricksSparkPythonActivity object itself.

withLinkedServiceName

public DatabricksSparkPythonActivity withLinkedServiceName(LinkedServiceReference linkedServiceName)

Set the linkedServiceName property: Linked service reference.

Overrides:

DatabricksSparkPythonActivity.withLinkedServiceName(LinkedServiceReference linkedServiceName)

Parameters:

linkedServiceName

withName

public DatabricksSparkPythonActivity withName(String name)

Set the name property: Activity name.

Overrides:

DatabricksSparkPythonActivity.withName(String name)

Parameters:

name

withOnInactiveMarkAs

public DatabricksSparkPythonActivity withOnInactiveMarkAs(ActivityOnInactiveMarkAs onInactiveMarkAs)

Set the onInactiveMarkAs property: Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default.

Overrides:

DatabricksSparkPythonActivity.withOnInactiveMarkAs(ActivityOnInactiveMarkAs onInactiveMarkAs)

Parameters:

onInactiveMarkAs

withParameters

public DatabricksSparkPythonActivity withParameters(List<Object> parameters)

Set the parameters property: Command line parameters that will be passed to the Python file.

Parameters:

parameters - the parameters value to set.

Returns:

the DatabricksSparkPythonActivity object itself.

withPolicy

public DatabricksSparkPythonActivity withPolicy(ActivityPolicy policy)

Set the policy property: Activity policy.

Overrides:

DatabricksSparkPythonActivity.withPolicy(ActivityPolicy policy)

Parameters:

policy

withPythonFile

public DatabricksSparkPythonActivity withPythonFile(Object pythonFile)

Set the pythonFile property: The URI of the Python file to be executed. DBFS paths are supported. Type: string (or Expression with resultType string).

Parameters:

pythonFile - the pythonFile value to set.

Returns:

the DatabricksSparkPythonActivity object itself.

withState

public DatabricksSparkPythonActivity withState(ActivityState state)

Set the state property: Activity state. This is an optional property and if not provided, the state will be Active by default.

Overrides:

DatabricksSparkPythonActivity.withState(ActivityState state)

Parameters:

state

withUserProperties

public DatabricksSparkPythonActivity withUserProperties(List<UserProperty> userProperties)

Set the userProperties property: Activity user properties.

Overrides:

DatabricksSparkPythonActivity.withUserProperties(List<UserProperty> userProperties)

Parameters:

userProperties

Applies to