Zoonk.AI.Evals.EvalRunner (Zoonk v0.1.0-dev)
View SourceA module for running evaluations on AI models.
Summary
Functions
Generate objects for a given task module and eval type for all models.
Generate objects for a given task module and eval type using the specified model.
Functions
@spec generate_object(atom(), Zoonk.AI.Evals.EvalFiles.eval_type()) :: :ok
Generate objects for a given task module and eval type for all models.
@spec generate_object(atom(), Zoonk.AI.Evals.EvalFiles.eval_type(), String.t()) :: :ok
Generate objects for a given task module and eval type using the specified model.