Start: 05:47:37 2022/09/06
End: 05:57:23 2022/09/06
Duration: 00:09:46
[05:47:37] [INFO] [mergernet.core.experiment] New experiment created with exp_id = 3 and run_id = 08195bbd
[05:47:38] [INFO] [optuna.storages._rdb.storage] A new study created in RDB with name: exp_3
[05:47:38] [INFO] [mergernet.model.automl] start of optuna optimization
[05:47:38] [INFO] [mergernet.model.automl] Starting trial 0
[05:47:38] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: None
[05:47:41] [INFO] [mergernet.data.dataset] Apply: load_jpg
[05:47:41] [INFO] [mergernet.data.dataset] Apply: one_hot
[05:47:41] [INFO] [mergernet.data.dataset] Apply: cache
[05:47:41] [INFO] [mergernet.data.dataset] Apply: shuffle
[05:47:41] [INFO] [mergernet.data.dataset] Apply: batch
[05:47:41] [INFO] [mergernet.data.dataset] Apply: prefetch
[05:47:41] [INFO] [mergernet.data.dataset] Apply: load_jpg
[05:47:41] [INFO] [mergernet.data.dataset] Apply: one_hot
[05:47:41] [INFO] [mergernet.data.dataset] Apply: cache
[05:47:41] [INFO] [mergernet.data.dataset] Apply: shuffle
[05:47:41] [INFO] [mergernet.data.dataset] Apply: batch
[05:47:41] [INFO] [mergernet.data.dataset] Apply: prefetch
[05:47:44] [DEBUG] [h5py._conv] Creating converter from 3 to 5
[05:47:44] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[05:47:45] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[05:47:45] [INFO] [mergernet.model.baseline] Start of training loop
[05:50:21] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:35.
[05:50:21] [INFO] [mergernet.model.baseline] Start of training loop
[05:50:56] [DEBUG] [h5py._conv] Creating converter from 5 to 3
[05:57:06] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:06:45.
[05:57:06] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:07] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/history_trial_0.csv HTTP/1.1" 404 None
[05:57:07] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:07] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/history_trial_0.csv HTTP/1.1" 201 2235
[05:57:07] [INFO] [mergernet.core.experiment] Artifact history_trial_0.csv was successfully uploaded to github
[05:57:07] [INFO] [optuna.study.study] Trial 0 finished with value: 0.19539903104305267 and parameters: {'dense_1_units': 384, 'dropout_1_rate': 0.4852142919229748, 'dense_2_units': 768, 'dropout_2_rate': 0.379597545259111, 'opt_lr': 2.0513382630874486e-05}. Best is trial 0 with value: 0.19539903104305267.
[05:57:10] [INFO] [mergernet.core.experiment] Artifact model.h5 was successfully uploaded to google drive
[05:57:10] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:10] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/optuna.sqlite HTTP/1.1" 404 None
[05:57:10] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:11] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/optuna.sqlite HTTP/1.1" 201 2196
[05:57:11] [INFO] [mergernet.core.experiment] Artifact optuna.sqlite was successfully uploaded to github
[05:57:11] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:11] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/trials.csv HTTP/1.1" 404 None
[05:57:11] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:12] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/trials.csv HTTP/1.1" 201 2172
[05:57:12] [INFO] [mergernet.core.experiment] Artifact trials.csv was successfully uploaded to github
[05:57:12] [INFO] [mergernet.model.automl] optuna optimization finished in 00:09:33
[05:57:12] [INFO] [mergernet.model.automl] number of finished trials: 1
[05:57:12] [INFO] [mergernet.model.automl] ----- begin of best trial summary -----
[05:57:12] [INFO] [mergernet.model.automl] optimization score: 0.19539903104305267
[05:57:12] [INFO] [mergernet.model.automl] params:
[05:57:12] [INFO] [mergernet.model.automl] dense_1_units: 384
[05:57:12] [INFO] [mergernet.model.automl] dense_2_units: 768
[05:57:12] [INFO] [mergernet.model.automl] dropout_1_rate: 0.4852142919229748
[05:57:12] [INFO] [mergernet.model.automl] dropout_2_rate: 0.379597545259111
[05:57:12] [INFO] [mergernet.model.automl] opt_lr: 2.0513382630874486e-05
[05:57:12] [INFO] [mergernet.model.automl] ----- end of best trial summary -----
[05:57:16] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:16] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/dataset_config.json HTTP/1.1" 404 None
[05:57:16] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:17] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/dataset_config.json HTTP/1.1" 201 2235
[05:57:17] [INFO] [mergernet.core.experiment] Artifact dataset_config.json was successfully uploaded to github
[05:57:17] [INFO] [mergernet.data.dataset] Apply: load_jpg
[05:57:17] [INFO] [mergernet.data.dataset] Apply: cache
[05:57:17] [INFO] [mergernet.data.dataset] Apply: shuffle
[05:57:17] [INFO] [mergernet.data.dataset] Apply: batch
[05:57:17] [INFO] [mergernet.data.dataset] Apply: prefetch
[05:57:21] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:21] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/test_preds_fold_0.csv HTTP/1.1" 404 None
[05:57:21] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:23] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/test_preds_fold_0.csv HTTP/1.1" 201 2252
[05:57:23] [INFO] [mergernet.core.experiment] Artifact test_preds_fold_0.csv was successfully uploaded to github
[05:57:23] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:23] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 404 None
[05:57:23] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[05:57:24] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 201 2167
[05:57:24] [INFO] [mergernet.core.experiment] Artifact exp_metadata.json was successfully uploaded to github