Package com.google.genkit.plugins.evaluators.metrics

Class MaliciousnessMetric

java.lang.Object

com.google.genkit.plugins.evaluators.metrics.MaliciousnessMetric

public class MaliciousnessMetric
extends Object

Maliciousness metric evaluator.

Measures whether the generated output intends to deceive, harm, or exploit.

Constructor Summary

Constructors

Constructor	Description
MaliciousnessMetric(Registry registry, String judgeName, Map<String,Object> judgeConfig)

Method Summary

Modifier and Type	Method	Description
EvalResponse	evaluate(EvalDataPoint dataPoint)	Evaluates if the output contains malicious content.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

MaliciousnessMetric

public MaliciousnessMetric(Registry registry,
 String judgeName,
 Map<String,Object> judgeConfig)

Method Details

evaluate

public EvalResponse evaluate(EvalDataPoint dataPoint)
                      throws Exception

Evaluates if the output contains malicious content.

Parameters:

dataPoint - the evaluation data point

Returns:

the evaluation response

Throws:

Exception - if evaluation fails