Package com.google.genkit.plugins.openai

Class OpenAIModel

java.lang.Object

com.google.genkit.plugins.openai.OpenAIModel

All Implemented Interfaces:

Model, Action<ModelRequest,ModelResponse,ModelResponseChunk>, Registerable

public class OpenAIModel
extends Object
implements Model

OpenAI model implementation for Genkit.

Constructor Summary

Constructors

Constructor	Description
OpenAIModel(String modelName, OpenAIPluginOptions options)	Creates a new OpenAIModel.

Method Summary

Modifier and Type	Method	Description
ModelInfo	getInfo()	Gets information about the model's capabilities.
String	getName()	Returns the name of the action.
ModelResponse	run(ActionContext context, ModelRequest request)	Generates a response from the given request.
ModelResponse	run(ActionContext context, ModelRequest request, Consumer<ModelResponseChunk> streamCallback)	Generates a streaming response from the given request.
boolean	supportsStreaming()	Returns whether this model supports streaming.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.google.genkit.ai.Model

getDesc, getInputSchema, getMetadata, getOutputSchema, getType, register, runJson, runJsonWithTelemetry

Constructor Details

OpenAIModel

public OpenAIModel(String modelName,
 OpenAIPluginOptions options)

Creates a new OpenAIModel.

Parameters:

modelName - the model name

options - the plugin options

Method Details

getName

public String getName()

Description copied from interface: Action

Returns the name of the action.

Specified by:

getName in interface Action<ModelRequest,ModelResponse,ModelResponseChunk>

Returns:

the action name

getInfo

public ModelInfo getInfo()

Description copied from interface: Model

Gets information about the model's capabilities.

Specified by:

getInfo in interface Model

Returns:

the model info

supportsStreaming

public boolean supportsStreaming()

Description copied from interface: Model

Returns whether this model supports streaming.

Specified by:

supportsStreaming in interface Model

Returns:

true if streaming is supported

run

public ModelResponse run(ActionContext context,
 ModelRequest request)

Description copied from interface: Model

Generates a response from the given request.

Specified by:

run in interface Action<ModelRequest,ModelResponse,ModelResponseChunk>

Specified by:

run in interface Model

Parameters:

context - the action context

request - the model request

Returns:

the model response

run

public ModelResponse run(ActionContext context,
 ModelRequest request,
 Consumer<ModelResponseChunk> streamCallback)

Description copied from interface: Model

Generates a streaming response from the given request.

Specified by:

run in interface Action<ModelRequest,ModelResponse,ModelResponseChunk>

Specified by:

run in interface Model

Parameters:

context - the action context

request - the model request

streamCallback - callback for streaming chunks

Returns:

the final model response