Class BatchRequest
Creates and executes a batch from an uploaded file of requests
Implements
Inherited Members
Namespace: Glitch9.AIDevKit.OpenAI
Assembly: Glitch9.AIDevKit.Provider.OpenAI.dll
Syntax
public class BatchRequest : OpenAIRequest, IJsonRequest
Properties
| Edit this page View SourceBatchEndpoint
[Required] The endpoint to be used for all requests in the batch. Currently, /v1/chat/completions, /v1/embeddings, and /v1/completions are supported. Note that /v1/embeddings batches are also restricted to a maximum of 50,000 embedding inputs across all requests in the batch.
Declaration
[JsonProperty("endpoint")]
public string BatchEndpoint { get; set; }
Property Value
| Type | Description |
|---|---|
| string |
CompletionWindow
[Required] The time frame within which the batch should be processed. Currently only 24h is supported.
Declaration
[JsonProperty("completion_window")]
public string CompletionWindow { get; set; }
Property Value
| Type | Description |
|---|---|
| string |
InputFileId
[Required] The ID of an uploaded file that contains requests for the new batch.
Declaration
[JsonProperty("input_file_id")]
public string InputFileId { get; set; }
Property Value
| Type | Description |
|---|---|
| string |