Package com.google.genkit.plugins.middleware

Class RetryMiddleware

java.lang.Object

com.google.genkit.ai.middleware.BaseGenerationMiddleware

com.google.genkit.plugins.middleware.RetryMiddleware

All Implemented Interfaces:

GenerationMiddleware

public class RetryMiddleware
extends BaseGenerationMiddleware

Retries a failed model call with exponential backoff.

Wraps the wrapModel hook: if the underlying model call throws, it is retried up to RetryMiddleware.Options.maxRetries times, sleeping initialDelayMs before the first retry and multiplying the delay by backoffFactor (capped at maxDelayMs) after each attempt.

Mirrors the JS retry middleware in @genkit-ai/middleware and the Go Retry middleware.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	RetryMiddleware.Options	Configuration parameters for RetryMiddleware.

Constructor Summary

Constructors

Constructor	Description
RetryMiddleware(RetryMiddleware.Options options)

Method Summary

Modifier and Type	Method	Description
String	name()	Returns the middleware's unique identifier.
GenerationMiddleware	newInstance()	Returns a fresh instance for each generate() call, enabling per-invocation state.
ModelResponse	wrapModel(ActionContext ctx, ModelParams params, ModelNext next)	Wraps each model API call.

Methods inherited from class com.google.genkit.ai.middleware.BaseGenerationMiddleware

tools, wrapGenerate, wrapTool

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

RetryMiddleware

public RetryMiddleware(RetryMiddleware.Options options)

Method Details

name

public String name()

Description copied from interface: GenerationMiddleware

Returns the middleware's unique identifier.

newInstance

public GenerationMiddleware newInstance()

Description copied from interface: GenerationMiddleware

Returns a fresh instance for each generate() call, enabling per-invocation state.

Stable state (e.g., API keys, configuration) should be preserved. Per-request state (e.g., counters) should be reset.

wrapModel

public ModelResponse wrapModel(ActionContext ctx,
 ModelParams params,
 ModelNext next)
                        throws GenkitException

Description copied from interface: GenerationMiddleware

Wraps each model API call.

Specified by:

wrapModel in interface GenerationMiddleware

Overrides:

wrapModel in class BaseGenerationMiddleware

Parameters:

ctx - the action context

params - the model parameters including the request

next - the next function in the chain

Returns:

the model response

Throws:

GenkitException - if processing fails