Class InferenceConfiguration

Inheritance
object
InferenceConfiguration
Inherited Members
Namespace: Glitch9.AIDevKit.AmazonAws
Assembly: Glitch9.AIDevKit.Provider.AmazonAws.dll
Syntax
public class InferenceConfiguration

Properties

| Edit this page View Source

MaxTokens

The maximum number of tokens to generate.

Declaration
[JsonProperty("maxTokens")]
public int? MaxTokens { get; set; }
Property Value
Type Description
int?
| Edit this page View Source

StopSequences

Optional. Stop sequences to end generation.

Declaration
[JsonProperty("stopSequences")]
public List<string> StopSequences { get; set; }
Property Value
Type Description
List<string>
| Edit this page View Source

Temperature

Optional. Sampling temperature -higher values produce more random results.

Declaration
[JsonProperty("temperature")]
public double? Temperature { get; set; }
Property Value
Type Description
double?
| Edit this page View Source

TopP

Documentation updated in English.

Declaration
[JsonProperty("topP")]
public double? TopP { get; set; }
Property Value
Type Description
double?

Extension Methods