AI Dev Kit
Search Results for

    Show / Hide Table of Contents

    Class BatchRequest

    Creates and executes a batch from an uploaded file of requests

    Inheritance
    object
    RequestBody
    ModelRequest
    BatchRequest
    Inherited Members
    ModelRequest.Model
    ModelRequest.N
    ModelRequest.Metadata
    ModelRequest.User
    Namespace: Glitch9.AIDevKit.OpenAI
    Assembly: .dll
    Syntax
    public class BatchRequest : ModelRequest

    Properties

    BatchEndpoint

    [Required] The endpoint to be used for all requests in the batch. Currently, /v1/chat/completions, /v1/embeddings, and /v1/completions are supported. Note that /v1/embeddings batches are also restricted to a maximum of 50,000 embedding inputs across all requests in the batch.

    Declaration
    public string BatchEndpoint { get; set; }
    Property Value
    Type Description
    string

    CompletionWindow

    [Required] The time frame within which the batch should be processed. Currently only 24h is supported.

    Declaration
    public string CompletionWindow { get; set; }
    Property Value
    Type Description
    string

    InputFileId

    [Required] The ID of an uploaded file that contains requests for the new batch.

    Declaration
    public string InputFileId { get; set; }
    Property Value
    Type Description
    string
    In this article
    Back to top Generated by DocFX