Package com.google.genkit.plugins.evaluators.metrics

Class AnswerRelevancyMetric

java.lang.Object

com.google.genkit.plugins.evaluators.metrics.AnswerRelevancyMetric

public class AnswerRelevancyMetric
extends Object

Answer Relevancy metric evaluator.

Assesses how pertinent the generated answer is to the given prompt. Uses an LLM judge to analyze the answer and optionally uses embeddings for similarity comparison.

Constructor Summary

Constructors

Constructor	Description
AnswerRelevancyMetric(Registry registry, String judgeName, Map<String,Object> judgeConfig, String embedderName, Map<String,Object> embedderOptions)

Method Summary

Modifier and Type	Method	Description
EvalResponse	evaluate(EvalDataPoint dataPoint)	Evaluates the relevancy of the answer to the question.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AnswerRelevancyMetric

public AnswerRelevancyMetric(Registry registry,
 String judgeName,
 Map<String,Object> judgeConfig,
 String embedderName,
 Map<String,Object> embedderOptions)

Method Details

evaluate

public EvalResponse evaluate(EvalDataPoint dataPoint)
                      throws Exception

Evaluates the relevancy of the answer to the question.

Parameters:

dataPoint - the evaluation data point

Returns:

the evaluation response

Throws:

Exception - if evaluation fails