Package com.google.genkit.plugins.ollama

Class OllamaModel

java.lang.Object

com.google.genkit.plugins.ollama.OllamaModel

All Implemented Interfaces:

Model, Action<ModelRequest,ModelResponse,ModelResponseChunk>, Registerable

public class OllamaModel
extends Object
implements Model

Ollama model implementation for Genkit. Supports local Ollama models with both synchronous and streaming generation. Ollama must be running locally (or at the configured host).

Constructor Summary

Constructors

Constructor	Description
OllamaModel(String modelName, OllamaPluginOptions options)	Creates a new OllamaModel.

Method Summary

Modifier and Type	Method	Description
ModelInfo	getInfo()	Gets information about the model's capabilities.
String	getName()	Returns the name of the action.
ModelResponse	run(ActionContext context, ModelRequest request)	Generates a response from the given request.
ModelResponse	run(ActionContext context, ModelRequest request, Consumer<ModelResponseChunk> streamCallback)	Generates a streaming response from the given request.
boolean	supportsStreaming()	Returns whether this model supports streaming.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.google.genkit.ai.Model

getDesc, getInputSchema, getMetadata, getOutputSchema, getType, register, runJson, runJsonWithTelemetry

Constructor Details

OllamaModel

public OllamaModel(String modelName,
 OllamaPluginOptions options)

Creates a new OllamaModel.

Parameters:

modelName - the model name (e.g., "llama3.2", "mistral")

options - the plugin options

Method Details

getName

public String getName()

Description copied from interface: Action

Returns the name of the action.

Specified by:

getName in interface Action<ModelRequest,ModelResponse,ModelResponseChunk>

Returns:

the action name

getInfo

public ModelInfo getInfo()

Description copied from interface: Model

Gets information about the model's capabilities.

Specified by:

getInfo in interface Model

Returns:

the model info

supportsStreaming

public boolean supportsStreaming()

Description copied from interface: Model

Returns whether this model supports streaming.

Specified by:

supportsStreaming in interface Model

Returns:

true if streaming is supported

run

public ModelResponse run(ActionContext context,
 ModelRequest request)

Description copied from interface: Model

Generates a response from the given request.

Specified by:

run in interface Action<ModelRequest,ModelResponse,ModelResponseChunk>

Specified by:

run in interface Model

Parameters:

context - the action context

request - the model request

Returns:

the model response

run

public ModelResponse run(ActionContext context,
 ModelRequest request,
 Consumer<ModelResponseChunk> streamCallback)

Description copied from interface: Model

Generates a streaming response from the given request.

Specified by:

run in interface Action<ModelRequest,ModelResponse,ModelResponseChunk>

Specified by:

run in interface Model

Parameters:

context - the action context

request - the model request

streamCallback - callback for streaming chunks

Returns:

the final model response