Namespace Glitch9.AIDevKit.ChatCompletions
Classes
- ChatCompletion
Response from a LLM (Large Language Model) for a chat completion request.
This class contains a list of ChatChoice objects, each representing a message generated by the model in response to a chat prompt.
Message can be accessed through the ChatChoice (e.g., Choices[0].Message).
If 'n' used in the request is greater than 1, this can contain multiple choices. Otherwise, it will always contain a single choice.If this is a streamed response, the ChatChoice objects will contain MessageDelta instead of Message.
- ChatCompletionEventHandler
This class has been used with IChatCompletionEventListener, but I have decided to unify the ChatEventListeners to use IResponseEventListener instead. This should mimic the ResponsesAPI event handling.
- ChatCompletionRequest
Task for generating text using an LLM model. Supports instructions and role-based prompts.
- ChatCompletionRequestBase<TSelf, TPrompt, TOutput>
Task for generating text using an LLM model. Supports instructions and role-based prompts.
- LogprobsInfo
Log probability information for the choice.
- TokenLogProb
A list of message content tokens with log probability information.