Start: 06:08:36 2022/09/06
End: 06:17:22 2022/09/06
Duration: 00:08:46
[06:08:36] [INFO] [mergernet.core.experiment] New experiment created with exp_id = 3 and run_id = 0dbe6ddc
[06:08:36] [INFO] [optuna.storages._rdb.storage] A new study created in RDB with name: exp_3
[06:08:36] [INFO] [mergernet.model.automl] start of optuna optimization
[06:08:36] [INFO] [mergernet.model.automl] Starting trial 0
[06:08:36] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: None
[06:08:38] [INFO] [mergernet.data.dataset] Apply: load_jpg
[06:08:38] [INFO] [mergernet.data.dataset] Apply: one_hot
[06:08:38] [INFO] [mergernet.data.dataset] Apply: cache
[06:08:38] [INFO] [mergernet.data.dataset] Apply: shuffle
[06:08:38] [INFO] [mergernet.data.dataset] Apply: batch
[06:08:38] [INFO] [mergernet.data.dataset] Apply: prefetch
[06:08:38] [INFO] [mergernet.data.dataset] Apply: load_jpg
[06:08:38] [INFO] [mergernet.data.dataset] Apply: one_hot
[06:08:38] [INFO] [mergernet.data.dataset] Apply: cache
[06:08:38] [INFO] [mergernet.data.dataset] Apply: shuffle
[06:08:38] [INFO] [mergernet.data.dataset] Apply: batch
[06:08:38] [INFO] [mergernet.data.dataset] Apply: prefetch
[06:08:42] [DEBUG] [h5py._conv] Creating converter from 3 to 5
[06:08:43] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[06:08:44] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[06:08:44] [INFO] [mergernet.model.baseline] Start of training loop
[06:10:37] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:53.
[06:10:37] [INFO] [mergernet.model.baseline] Start of training loop
[06:11:11] [DEBUG] [h5py._conv] Creating converter from 5 to 3
[06:17:04] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:06:27.
[06:17:04] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:05] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/history_trial_0.csv HTTP/1.1" 404 None
[06:17:05] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:05] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/history_trial_0.csv HTTP/1.1" 201 2235
[06:17:05] [INFO] [mergernet.core.experiment] Artifact history_trial_0.csv was successfully uploaded to github
[06:17:05] [INFO] [optuna.study.study] Trial 0 finished with value: 0.2080993354320526 and parameters: {'dense_1_units': 384, 'dropout_1_rate': 0.4852142919229748, 'dense_2_units': 768, 'dropout_2_rate': 0.379597545259111, 'opt_lr': 2.0513382630874486e-05}. Best is trial 0 with value: 0.2080993354320526.
[06:17:07] [INFO] [mergernet.core.experiment] Artifact model.h5 was successfully uploaded to google drive
[06:17:07] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:08] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/optuna.sqlite HTTP/1.1" 404 None
[06:17:08] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:09] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/optuna.sqlite HTTP/1.1" 201 2196
[06:17:09] [INFO] [mergernet.core.experiment] Artifact optuna.sqlite was successfully uploaded to github
[06:17:09] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:10] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/trials.csv HTTP/1.1" 404 None
[06:17:10] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:10] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/trials.csv HTTP/1.1" 201 2172
[06:17:10] [INFO] [mergernet.core.experiment] Artifact trials.csv was successfully uploaded to github
[06:17:10] [INFO] [mergernet.model.automl] optuna optimization finished in 00:08:34
[06:17:10] [INFO] [mergernet.model.automl] number of finished trials: 1
[06:17:10] [INFO] [mergernet.model.automl] ----- begin of best trial summary -----
[06:17:10] [INFO] [mergernet.model.automl] optimization score: 0.2080993354320526
[06:17:10] [INFO] [mergernet.model.automl] params:
[06:17:10] [INFO] [mergernet.model.automl] dense_1_units: 384
[06:17:10] [INFO] [mergernet.model.automl] dense_2_units: 768
[06:17:10] [INFO] [mergernet.model.automl] dropout_1_rate: 0.4852142919229748
[06:17:10] [INFO] [mergernet.model.automl] dropout_2_rate: 0.379597545259111
[06:17:10] [INFO] [mergernet.model.automl] opt_lr: 2.0513382630874486e-05
[06:17:10] [INFO] [mergernet.model.automl] ----- end of best trial summary -----
[06:17:15] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:15] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/dataset_config.json HTTP/1.1" 404 None
[06:17:15] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:16] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/dataset_config.json HTTP/1.1" 201 2235
[06:17:16] [INFO] [mergernet.core.experiment] Artifact dataset_config.json was successfully uploaded to github
[06:17:17] [INFO] [mergernet.data.dataset] Apply: load_jpg
[06:17:17] [INFO] [mergernet.data.dataset] Apply: cache
[06:17:17] [INFO] [mergernet.data.dataset] Apply: shuffle
[06:17:17] [INFO] [mergernet.data.dataset] Apply: batch
[06:17:17] [INFO] [mergernet.data.dataset] Apply: prefetch
[06:17:20] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:21] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/test_preds_fold_0.csv HTTP/1.1" 404 None
[06:17:21] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:22] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/test_preds_fold_0.csv HTTP/1.1" 201 2252
[06:17:22] [INFO] [mergernet.core.experiment] Artifact test_preds_fold_0.csv was successfully uploaded to github
[06:17:22] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:22] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 200 None
[06:17:22] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:17:23] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 200 None
[06:17:23] [INFO] [mergernet.core.experiment] Artifact exp_metadata.json was successfully uploaded to github