Skip to content

euroeval.metrics.tool_calling

source module euroeval.metrics.tool_calling

Tool calling metric.

Classes

source class ToolCallingAccuracy(name: str, pretty_name: str, postprocessing_fn: t.Callable[[float], tuple[float, str]] | None = None)

Bases : Metric

Metric for tool calling.

Initialise the metric.

Parameters

  • name : str — The name of the metric in snake_case.

  • pretty_name : str — The pretty name of the metric, used for display purposes.

  • postprocessing_fn : t.Callable[[float], tuple[float, str]] | None — A function to apply to the metric scores after they are computed, taking the score to the postprocessed score along with its string representation. Defaults to x -> (100 * x, f"{x:.2%}").