clarena.pipelines

Experiment and Evaluation Pipelines

This submodule provides experiment and evaluation pipeline classes that manage the index configs and process of experiments and evaluations.

We provide experiment pipeline classes:

  • CLMainExperiment: Continual Learning Main Experiment.
  • CULMainExperiment: Continual Unlearning Main Experiment.
  • MTLExperiment: Multi-Task Learning Experiment.
  • STLExperiment: Single-Task Learning Experiment.

And evaluation pipeline classes:

  • CLMainEvaluation: Continual Learning Main Evaluation.
  • CLFullEvaluation: Continual Learning Full Evaluation.
  • CULFullEvaluation: Continual Unlearning Full Evaluation.
  • MTLEvaluation: Multi-Task Learning Evaluation.
  • STLEvaluation: Single-Task Learning Evaluation.

Please note that this is an API documantation. Please refer to the main documentation for more information about experiments and evaluations:

 1r"""
 2
 3# Experiment and Evaluation Pipelines
 4
 5This submodule provides **experiment and evaluation pipeline classes** that manage the index configs and process of experiments and evaluations.
 6
 7We provide experiment pipeline classes:
 8
 9- `CLMainExperiment`: Continual Learning Main Experiment.
10- `CULMainExperiment`: Continual Unlearning Main Experiment.
11- `MTLExperiment`: Multi-Task Learning Experiment.
12- `STLExperiment`: Single-Task Learning Experiment.
13
14And evaluation pipeline classes:
15
16- `CLMainEvaluation`: Continual Learning Main Evaluation.
17- `CLFullEvaluation`: Continual Learning Full Evaluation.
18- `CULFullEvaluation`: Continual Unlearning Full Evaluation.
19- `MTLEvaluation`: Multi-Task Learning Evaluation.
20- `STLEvaluation`: Single-Task Learning Evaluation.
21
22Please note that this is an API documantation. Please refer to the main documentation for more information about experiments and evaluations:
23
24- [**Experiments and Evaluations**](https://pengxiang-wang.com/projects/continual-learning-arena/docs/experiments-and-evaluations)
25
26"""
27
28# experiments
29from .cl_main_expr import CLMainExperiment
30from .cul_main_expr import CULMainExperiment
31from .mtl_expr import MTLExperiment
32from .stl_expr import STLExperiment
33
34# evaluations
35from .cl_main_eval import CLMainEvaluation
36from .cl_full_eval import CLFullEvaluation
37from .cul_full_eval import CULFullEvaluation
38from .mtl_eval import MTLEvaluation
39from .stl_eval import STLEvaluation
40
41__all__ = [
42    "cl_main_expr",
43    "cul_main_expr",
44    "mtl_expr",
45    "stl_expr",
46    "cl_main_eval",
47    "cl_full_eval",
48    "cul_full_eval",
49    "mtl_eval",
50    "stl_eval",
51]