Output Results (STL)

This page summarizes the output results of single-task learning experiment and evaluation pipelines. Their existence, file or folder names, and formats can be customized.

The following output results are produced after running single-task learning experiment or single-task learning evaluation.

Folder or File

<output_dir>/

Description

Contains all output results

Customization

  • <output_dir>: Field output_dir in the index config
<acc_save_dir>/ Contains all data and figures of test accuracy metrics

  • To include or exclude these outputs, enable or disable STLAccuracy metric callback (see Configure Metrics)

  • <acc_save_dir>: Field save_dir in STLAccuracy. It is recommended to be set as ${output_dir}/results/ to make sure outputs are under <output_dir>/
<acc_save_dir>/acc.csv The original data of test accuracy metrics, stored as CSV format
  • acc.csv: Field test_acc_csv_name in STLAccuracy. Default is acc.csv
<loss_cls_save_dir>/ Contains all data and figures of test classification loss metrics

  • To include or exclude these outputs, enable or disable STLLoss metric callback (see Configure Metrics)

  • <loss_cls_save_dir>: Field save_dir in STLLoss. It is recommended to be set as ${output_dir}/results/ to make sure outputs are under <output_dir>/
<loss_cls_save_dir>/loss_cls.csv The original data of test classification loss metrics, stored as CSV format
  • loss_cls.csv: Field test_loss_cls_csv_name in STLLoss. Default is loss_cls.csv
<output_dir>/lightning_logs/csv/ Training and validation metrics logged to Lightning CSV logger in real time. Please refer to my article about CL metrics to learn about training and validation metrics in continual learning | - To include or exclude these outputs, enable or disable Lightning CSV logger (see Configure Lightning Loggers)
<output_dir>/lightning_logs/tensorboard Output files for Lightning TensorBoard logger
<output_dir>/lightning_logs/wandb Output files for Lightning Weights & Biases logger
<samples_save_dir>/ Contains input samples of first batch

  • To include or exclude these outputs, enable or disable SaveFirstBatchImages callback (see Configure Callbacks)

  • <samples_save_dir>: Field save_dir in SaveFirstBatchImages. It is recommended to be set as ${output_dir}/samples/ to make sure outputs are under <output_dir>/
<saved_models_dir>/ Contains saved model
  • To include or exclude these outputs, enable or disable SaveModels (see Configure Callbacks)
  • <saved_models_dir>: Field save_dir in SaveModels. It is recommended to be set as ${output_dir}/saved_model/ to make sure outputs are under <output_dir>/
<profile_dir>/ Contains profiling results
  • To include or exclude these outputs, enable or disable profiler in Trainer (see Configure Trainer(s))
config_tree.log Full copy of the experiment config in tree format

  • To include or exclude this output, set save as true or false in config tree config (see Other Configs)

  • config_tree.log: Field save_path in config tree config. It is recommended to be set as ${output_dir}/ to make sure outputs are under <output_dir>/
console.log Full logs of the console log in text format

  • To include or exclude this output, include or exclude the config field below in Hydra config (see Other Configs)

  • console.log: the filename config in the Hydra config. It is recommended to be set as ${hydra.runtime.output_dir}/ to make sure outputs are under <output_dir>/

    job_logging:
 handlers:
    file:
      filename: ${hydra.runtime.output_dir}/console.log
Back to top