Overview

Genkit for Java is the Java implementation of the Genkit framework for building AI-powered applications.

What is Genkit?

Genkit is an open-source framework that helps you build AI-powered applications. It provides:

Unified model API — Call any supported AI model through a single, consistent interface
Flows — Define observable, traceable AI workflows that can be exposed as HTTP endpoints
Tools — Let models call your functions during generation
DotPrompt — Manage prompts as template files with Handlebars support
Structured Output — Generate type-safe outputs with automatic JSON schema generation
RAG — Build retrieval-augmented generation pipelines with indexers and retrievers
Evaluations — Assess AI output quality with custom and pre-built evaluators
Observability — Full OpenTelemetry integration for tracing and metrics
Dev UI — Visual tool for testing and debugging your AI logic

The Java SDK supports a broad range of providers:

Category	Providers
AI Models	OpenAI, Google GenAI (Gemini), Anthropic (Claude), AWS Bedrock, Azure AI Foundry, xAI (Grok), DeepSeek, Cohere, Mistral, Groq, Ollama, any OpenAI-compatible endpoint
Vector Databases	Weaviate, PostgreSQL (pgvector), Pinecone, Firebase Firestore, Local file-based
Server Frameworks	Jetty, Spring Boot
Integrations	Firebase (Firestore, Cloud Functions, Telemetry), MCP, Pre-built evaluators

Module	Description
genkit-core	Core framework: actions, flows, registry, tracing (OpenTelemetry)
genkit-ai	AI abstractions: models, embedders, tools, prompts, retrievers, indexers, evaluators
genkit	Main entry point combining core and AI with reflection server
plugins/	20+ plugin implementations for models, databases, servers, and integrations

Get StartedSet up your first Genkit Java project

Generating ContentLearn the unified model API

Plugin OverviewBrowse all available plugins

SamplesExplore example applications