Package com.google.genkit.ai.evaluation

Interface EvalStore

All Known Implementing Classes:
LocalFileEvalStore
public interface EvalStore
Interface for storing and retrieving evaluation runs.

  • Method Details

    • save

      void save(EvalRun evalRun) throws Exception
      Saves an evaluation run.
      Parameters:
      evalRun - the evaluation run to save
      Throws:
      Exception - if save fails

    • load

      EvalRun load(String evalRunId) throws Exception
      Loads an evaluation run by ID.
      Parameters:
      evalRunId - the evaluation run ID
      Returns:
      the evaluation run, or null if not found
      Throws:
      Exception - if load fails

    • list

      List<EvalRunKey> list() throws Exception
      Lists all evaluation run keys.
      Returns:
      list of evaluation run keys
      Throws:
      Exception - if listing fails

    • list

      List<EvalRunKey> list(String actionRef, String datasetId) throws Exception
      Lists evaluation run keys with optional filtering.
      Parameters:
      actionRef - filter by action reference
      datasetId - filter by dataset ID
      Returns:
      filtered list of evaluation run keys
      Throws:
      Exception - if listing fails

    • delete

      void delete(String evalRunId) throws Exception
      Deletes an evaluation run.
      Parameters:
      evalRunId - the evaluation run ID to delete
      Throws:
      Exception - if deletion fails