Package com.google.genkit.plugins.evaluators.metrics

Class FaithfulnessMetric

java.lang.Object

com.google.genkit.plugins.evaluators.metrics.FaithfulnessMetric

public class FaithfulnessMetric
extends Object

Faithfulness metric evaluator.

Measures the factual consistency of the generated answer against the given context. Uses a two-step process: 1. Extract statements from the answer 2. Check each statement against the context using NLI

Constructor Summary

Constructors

Constructor	Description
FaithfulnessMetric(Registry registry, String judgeName, Map<String,Object> judgeConfig)

Method Summary

Modifier and Type	Method	Description
EvalResponse	evaluate(EvalDataPoint dataPoint)	Evaluates faithfulness of the output against the context.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FaithfulnessMetric

public FaithfulnessMetric(Registry registry,
 String judgeName,
 Map<String,Object> judgeConfig)

Method Details

evaluate

public EvalResponse evaluate(EvalDataPoint dataPoint)
                      throws Exception

Evaluates faithfulness of the output against the context.

Parameters:

dataPoint - the evaluation data point

Returns:

the evaluation response

Throws:

Exception - if evaluation fails