Start: 05:47:37 2022/09/06
End: 05:57:23 2022/09/06
Duration: 00:09:46
[05:47:37] [INFO] [mergernet.core.experiment] New experiment created with exp_id = 3 and run_id = 08195bbd [05:47:38] [INFO] [optuna.storages._rdb.storage] A new study created in RDB with name: exp_3 [05:47:38] [INFO] [mergernet.model.automl] start of optuna optimization [05:47:38] [INFO] [mergernet.model.automl] Starting trial 0 [05:47:38] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: None [05:47:41] [INFO] [mergernet.data.dataset] Apply: load_jpg [05:47:41] [INFO] [mergernet.data.dataset] Apply: one_hot [05:47:41] [INFO] [mergernet.data.dataset] Apply: cache [05:47:41] [INFO] [mergernet.data.dataset] Apply: shuffle [05:47:41] [INFO] [mergernet.data.dataset] Apply: batch [05:47:41] [INFO] [mergernet.data.dataset] Apply: prefetch [05:47:41] [INFO] [mergernet.data.dataset] Apply: load_jpg [05:47:41] [INFO] [mergernet.data.dataset] Apply: one_hot [05:47:41] [INFO] [mergernet.data.dataset] Apply: cache [05:47:41] [INFO] [mergernet.data.dataset] Apply: shuffle [05:47:41] [INFO] [mergernet.data.dataset] Apply: batch [05:47:41] [INFO] [mergernet.data.dataset] Apply: prefetch [05:47:44] [DEBUG] [h5py._conv] Creating converter from 3 to 5 [05:47:44] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0 [05:47:45] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6 [05:47:45] [INFO] [mergernet.model.baseline] Start of training loop [05:50:21] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:35. [05:50:21] [INFO] [mergernet.model.baseline] Start of training loop [05:50:56] [DEBUG] [h5py._conv] Creating converter from 5 to 3 [05:57:06] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:06:45. [05:57:06] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:07] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/history_trial_0.csv HTTP/1.1" 404 None [05:57:07] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:07] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/history_trial_0.csv HTTP/1.1" 201 2235 [05:57:07] [INFO] [mergernet.core.experiment] Artifact history_trial_0.csv was successfully uploaded to github [05:57:07] [INFO] [optuna.study.study] Trial 0 finished with value: 0.19539903104305267 and parameters: {'dense_1_units': 384, 'dropout_1_rate': 0.4852142919229748, 'dense_2_units': 768, 'dropout_2_rate': 0.379597545259111, 'opt_lr': 2.0513382630874486e-05}. Best is trial 0 with value: 0.19539903104305267. [05:57:10] [INFO] [mergernet.core.experiment] Artifact model.h5 was successfully uploaded to google drive [05:57:10] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:10] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/optuna.sqlite HTTP/1.1" 404 None [05:57:10] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:11] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/optuna.sqlite HTTP/1.1" 201 2196 [05:57:11] [INFO] [mergernet.core.experiment] Artifact optuna.sqlite was successfully uploaded to github [05:57:11] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:11] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/trials.csv HTTP/1.1" 404 None [05:57:11] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:12] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/trials.csv HTTP/1.1" 201 2172 [05:57:12] [INFO] [mergernet.core.experiment] Artifact trials.csv was successfully uploaded to github [05:57:12] [INFO] [mergernet.model.automl] optuna optimization finished in 00:09:33 [05:57:12] [INFO] [mergernet.model.automl] number of finished trials: 1 [05:57:12] [INFO] [mergernet.model.automl] ----- begin of best trial summary ----- [05:57:12] [INFO] [mergernet.model.automl] optimization score: 0.19539903104305267 [05:57:12] [INFO] [mergernet.model.automl] params: [05:57:12] [INFO] [mergernet.model.automl] dense_1_units: 384 [05:57:12] [INFO] [mergernet.model.automl] dense_2_units: 768 [05:57:12] [INFO] [mergernet.model.automl] dropout_1_rate: 0.4852142919229748 [05:57:12] [INFO] [mergernet.model.automl] dropout_2_rate: 0.379597545259111 [05:57:12] [INFO] [mergernet.model.automl] opt_lr: 2.0513382630874486e-05 [05:57:12] [INFO] [mergernet.model.automl] ----- end of best trial summary ----- [05:57:16] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:16] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/dataset_config.json HTTP/1.1" 404 None [05:57:16] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:17] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/dataset_config.json HTTP/1.1" 201 2235 [05:57:17] [INFO] [mergernet.core.experiment] Artifact dataset_config.json was successfully uploaded to github [05:57:17] [INFO] [mergernet.data.dataset] Apply: load_jpg [05:57:17] [INFO] [mergernet.data.dataset] Apply: cache [05:57:17] [INFO] [mergernet.data.dataset] Apply: shuffle [05:57:17] [INFO] [mergernet.data.dataset] Apply: batch [05:57:17] [INFO] [mergernet.data.dataset] Apply: prefetch [05:57:21] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:21] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/test_preds_fold_0.csv HTTP/1.1" 404 None [05:57:21] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:23] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/08195bbd/test_preds_fold_0.csv HTTP/1.1" 201 2252 [05:57:23] [INFO] [mergernet.core.experiment] Artifact test_preds_fold_0.csv was successfully uploaded to github [05:57:23] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:23] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 404 None [05:57:23] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [05:57:24] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 201 2167 [05:57:24] [INFO] [mergernet.core.experiment] Artifact exp_metadata.json was successfully uploaded to github