OnlineRequestSettings Class

Package:
com.azure.resourcemanager.machinelearning.models
Maven Artifact:
com.azure.resourcemanager:azure-resourcemanager-machinelearning:1.1.0
  • java.lang.Object
    • com.azure.resourcemanager.machinelearning.models.OnlineRequestSettings

Implements

JsonSerializable<OnlineRequestSettings>

public final class OnlineRequestSettings
implements JsonSerializable<OnlineRequestSettings>

Online deployment scoring requests configuration.

Constructor Summary

Constructor Description
OnlineRequestSettings()

Creates an instance of OnlineRequestSettings class.

Method Summary

Modifier and Type Method and Description
static OnlineRequestSettings fromJson(JsonReader jsonReader)

Reads an instance of OnlineRequestSettings from the JsonReader.
Integer maxConcurrentRequestsPerInstance()

Get the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment.
Duration maxQueueWait()

Get the maxQueueWait property: (Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format.
Duration requestTimeout()

Get the requestTimeout property: The scoring timeout in ISO 8601 format.
JsonWriter toJson(JsonWriter jsonWriter)
void validate()

Validates the instance.
OnlineRequestSettings withMaxConcurrentRequestsPerInstance(Integer maxConcurrentRequestsPerInstance)

Set the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment.
OnlineRequestSettings withMaxQueueWait(Duration maxQueueWait)

Set the maxQueueWait property: (Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format.
OnlineRequestSettings withRequestTimeout(Duration requestTimeout)

Set the requestTimeout property: The scoring timeout in ISO 8601 format.

Methods inherited from java.lang.Object

clone equals finalize getClass hashCode notify notifyAll toString wait wait wait

Constructor Details

OnlineRequestSettings

public OnlineRequestSettings()

Creates an instance of OnlineRequestSettings class.

Method Details

fromJson

public static OnlineRequestSettings fromJson(JsonReader jsonReader)

Reads an instance of OnlineRequestSettings from the JsonReader.

Parameters:

jsonReader - The JsonReader being read.

Returns:

An instance of OnlineRequestSettings if the JsonReader was pointing to an instance of it, or null if it was pointing to JSON null.

Throws:

IOException

 - If an error occurs while reading the OnlineRequestSettings.

maxConcurrentRequestsPerInstance

public Integer maxConcurrentRequestsPerInstance()

Get the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

Returns:

the maxConcurrentRequestsPerInstance value.

maxQueueWait

public Duration maxQueueWait()

Get the maxQueueWait property: (Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase `request_timeout_ms` to account for any networking/queue delays).

Returns:

the maxQueueWait value.

requestTimeout

public Duration requestTimeout()

Get the requestTimeout property: The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Returns:

the requestTimeout value.

toJson

public JsonWriter toJson(JsonWriter jsonWriter)

Parameters:

jsonWriter

Throws:

validate

public void validate()

Validates the instance.

withMaxConcurrentRequestsPerInstance

public OnlineRequestSettings withMaxConcurrentRequestsPerInstance(Integer maxConcurrentRequestsPerInstance)

Set the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

Parameters:

maxConcurrentRequestsPerInstance - the maxConcurrentRequestsPerInstance value to set.

Returns:

the OnlineRequestSettings object itself.

withMaxQueueWait

public OnlineRequestSettings withMaxQueueWait(Duration maxQueueWait)

Set the maxQueueWait property: (Deprecated for Managed Online Endpoints) The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms. (Now increase `request_timeout_ms` to account for any networking/queue delays).

Parameters:

maxQueueWait - the maxQueueWait value to set.

Returns:

the OnlineRequestSettings object itself.

withRequestTimeout

public OnlineRequestSettings withRequestTimeout(Duration requestTimeout)

Set the requestTimeout property: The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Parameters:

requestTimeout - the requestTimeout value to set.

Returns:

the OnlineRequestSettings object itself.

Applies to