S3FileLogger¶
- class S3FileLogger(bucket: str, experiments_folder: str, config: Optional[Dict[str, Any]] = None, gzip: bool = False)[source]¶
Bases:
etna.loggers.file_logger.BaseFileLogger
Logger for logging files into S3 bucket.
This logger is very similar to
LocalFileLogger
, but works with S3 keys instead of paths at local file system.Create instance of S3FileLogger.
- Parameters
bucket (str) – name of the S3 bucket
experiments_folder (str) – path to folder to create experiment in
config (Optional[Dict[str, Any]]) – a dictionary-like object for saving inputs to your job, like hyperparameters for a model or settings for a data preprocessing job
gzip (bool) – indicator whether to use compression during saving tables or not
- Raises
ValueError: – if environment variable
endpoint_url
isn’t setValueError: – if environment variable
aws_access_key_id
isn’t setValueError: – if environment variable
aws_secret_access_key
isn’t setValueError: – if bucket doesn’t exist
- Inherited-members
Methods
finish_experiment
(*args, **kwargs)Finish experiment.
log
(msg, **kwargs)Log any event.
log_backtest_metrics
(ts, metrics_df, ...)Write metrics to logger.
log_backtest_run
(metrics, forecast, test)Backtest metrics from one fold to logger.
set_params
(**params)Return new object instance with modified parameters.
start_experiment
([job_type, group])Start experiment within current experiment, it is used for separate different folds during backtest.
to_dict
()Collect all information about etna object in dict.
- start_experiment(job_type: Optional[str] = None, group: Optional[str] = None, *args, **kwargs)[source]¶
Start experiment within current experiment, it is used for separate different folds during backtest.
As a result,
self.experiment_folder
key is extended withjob_type/group
.If
job_type
orgroup
isn’t set then key is extended with one value.If none of
job_type
andgroup
is set thenself.experiment_folder
is not extended.
- Parameters
job_type (Optional[str]) – Specify the type of run, which is useful when you’re grouping runs together into larger experiments using group.
group (Optional[str]) – Specify a group to organize individual runs into a larger experiment.