euroeval.dataset_configs

source package euroeval.dataset_configs

All dataset configurations used in EuroEval.

Functions

• get_all_dataset_configs — Get a mapping of all the dataset configurations.

• get_dataset_config — Get the dataset configuration for a dataset.

source get_all_dataset_configs(custom_datasets_file: Path) → dict[str, DatasetConfig]

Get a mapping of all the dataset configurations.

Parameters

• custom_datasets_file : Path — A path to a Python file containing custom dataset configurations.

Returns

• dict[str, DatasetConfig] — A mapping between names of datasets and their configurations.

source get_dataset_config(dataset_name: str, custom_datasets_file: Path) → DatasetConfig

Get the dataset configuration for a dataset.

Parameters

• dataset_name : str — The name of the dataset.

• custom_datasets_file : Path — A path to a Python file containing custom dataset configurations.

Returns

• DatasetConfig — The dataset configuration.

Raises

• ValueError — If the dataset is not found.