Package com.google.genkit.plugins.evaluators.metrics

Class AnswerAccuracyMetric

java.lang.Object

com.google.genkit.plugins.evaluators.metrics.AnswerAccuracyMetric

public class AnswerAccuracyMetric
extends Object

Answer Accuracy metric evaluator.

Measures the accuracy of the generated answer against a reference answer. Uses bidirectional comparison for semantic equivalence.

Constructor Summary

Constructors

Constructor	Description
AnswerAccuracyMetric(Registry registry, String judgeName, Map<String,Object> judgeConfig)

Method Summary

Modifier and Type	Method	Description
EvalResponse	evaluate(EvalDataPoint dataPoint)	Evaluates the accuracy of the output against the reference.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AnswerAccuracyMetric

public AnswerAccuracyMetric(Registry registry,
 String judgeName,
 Map<String,Object> judgeConfig)

Method Details

evaluate

public EvalResponse evaluate(EvalDataPoint dataPoint)
                      throws Exception

Evaluates the accuracy of the output against the reference.

Parameters:

dataPoint - the evaluation data point

Returns:

the evaluation response

Throws:

Exception - if evaluation fails