Class BatchRequest
Creates and executes a batch from an uploaded file of requests
Namespace: Glitch9.AIDevKit.OpenAI
Assembly: .dll
Syntax
public class BatchRequest : ModelRequest
Properties
BatchEndpoint
[Required] The endpoint to be used for all requests in the batch. Currently, /v1/chat/completions, /v1/embeddings, and /v1/completions are supported. Note that /v1/embeddings batches are also restricted to a maximum of 50,000 embedding inputs across all requests in the batch.
Declaration
public string BatchEndpoint { get; set; }
Property Value
Type | Description |
---|---|
string |
CompletionWindow
[Required] The time frame within which the batch should be processed. Currently only 24h is supported.
Declaration
public string CompletionWindow { get; set; }
Property Value
Type | Description |
---|---|
string |
InputFileId
[Required] The ID of an uploaded file that contains requests for the new batch.
Declaration
public string InputFileId { get; set; }
Property Value
Type | Description |
---|---|
string |