[06:08:36] [INFO] [mergernet.core.experiment] New experiment created with exp_id = 3 and run_id = 0dbe6ddc [06:08:36] [INFO] [optuna.storages._rdb.storage] A new study created in RDB with name: exp_3 [06:08:36] [INFO] [mergernet.model.automl] start of optuna optimization [06:08:36] [INFO] [mergernet.model.automl] Starting trial 0 [06:08:36] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: None [06:08:38] [INFO] [mergernet.data.dataset] Apply: load_jpg [06:08:38] [INFO] [mergernet.data.dataset] Apply: one_hot [06:08:38] [INFO] [mergernet.data.dataset] Apply: cache [06:08:38] [INFO] [mergernet.data.dataset] Apply: shuffle [06:08:38] [INFO] [mergernet.data.dataset] Apply: batch [06:08:38] [INFO] [mergernet.data.dataset] Apply: prefetch [06:08:38] [INFO] [mergernet.data.dataset] Apply: load_jpg [06:08:38] [INFO] [mergernet.data.dataset] Apply: one_hot [06:08:38] [INFO] [mergernet.data.dataset] Apply: cache [06:08:38] [INFO] [mergernet.data.dataset] Apply: shuffle [06:08:38] [INFO] [mergernet.data.dataset] Apply: batch [06:08:38] [INFO] [mergernet.data.dataset] Apply: prefetch [06:08:42] [DEBUG] [h5py._conv] Creating converter from 3 to 5 [06:08:43] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0 [06:08:44] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6 [06:08:44] [INFO] [mergernet.model.baseline] Start of training loop [06:10:37] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:53. [06:10:37] [INFO] [mergernet.model.baseline] Start of training loop [06:11:11] [DEBUG] [h5py._conv] Creating converter from 5 to 3 [06:17:04] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:06:27. [06:17:04] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:05] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/history_trial_0.csv HTTP/1.1" 404 None [06:17:05] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:05] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/history_trial_0.csv HTTP/1.1" 201 2235 [06:17:05] [INFO] [mergernet.core.experiment] Artifact history_trial_0.csv was successfully uploaded to github [06:17:05] [INFO] [optuna.study.study] Trial 0 finished with value: 0.2080993354320526 and parameters: {'dense_1_units': 384, 'dropout_1_rate': 0.4852142919229748, 'dense_2_units': 768, 'dropout_2_rate': 0.379597545259111, 'opt_lr': 2.0513382630874486e-05}. Best is trial 0 with value: 0.2080993354320526. [06:17:07] [INFO] [mergernet.core.experiment] Artifact model.h5 was successfully uploaded to google drive [06:17:07] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:08] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/optuna.sqlite HTTP/1.1" 404 None [06:17:08] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:09] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/optuna.sqlite HTTP/1.1" 201 2196 [06:17:09] [INFO] [mergernet.core.experiment] Artifact optuna.sqlite was successfully uploaded to github [06:17:09] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:10] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/trials.csv HTTP/1.1" 404 None [06:17:10] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:10] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/trials.csv HTTP/1.1" 201 2172 [06:17:10] [INFO] [mergernet.core.experiment] Artifact trials.csv was successfully uploaded to github [06:17:10] [INFO] [mergernet.model.automl] optuna optimization finished in 00:08:34 [06:17:10] [INFO] [mergernet.model.automl] number of finished trials: 1 [06:17:10] [INFO] [mergernet.model.automl] ----- begin of best trial summary ----- [06:17:10] [INFO] [mergernet.model.automl] optimization score: 0.2080993354320526 [06:17:10] [INFO] [mergernet.model.automl] params: [06:17:10] [INFO] [mergernet.model.automl] dense_1_units: 384 [06:17:10] [INFO] [mergernet.model.automl] dense_2_units: 768 [06:17:10] [INFO] [mergernet.model.automl] dropout_1_rate: 0.4852142919229748 [06:17:10] [INFO] [mergernet.model.automl] dropout_2_rate: 0.379597545259111 [06:17:10] [INFO] [mergernet.model.automl] opt_lr: 2.0513382630874486e-05 [06:17:10] [INFO] [mergernet.model.automl] ----- end of best trial summary ----- [06:17:15] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:15] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/dataset_config.json HTTP/1.1" 404 None [06:17:15] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:16] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/dataset_config.json HTTP/1.1" 201 2235 [06:17:16] [INFO] [mergernet.core.experiment] Artifact dataset_config.json was successfully uploaded to github [06:17:17] [INFO] [mergernet.data.dataset] Apply: load_jpg [06:17:17] [INFO] [mergernet.data.dataset] Apply: cache [06:17:17] [INFO] [mergernet.data.dataset] Apply: shuffle [06:17:17] [INFO] [mergernet.data.dataset] Apply: batch [06:17:17] [INFO] [mergernet.data.dataset] Apply: prefetch [06:17:20] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:21] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/test_preds_fold_0.csv HTTP/1.1" 404 None [06:17:21] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:22] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/0dbe6ddc/test_preds_fold_0.csv HTTP/1.1" 201 2252 [06:17:22] [INFO] [mergernet.core.experiment] Artifact test_preds_fold_0.csv was successfully uploaded to github [06:17:22] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:22] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 200 None [06:17:22] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443 [06:17:23] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 200 None [06:17:23] [INFO] [mergernet.core.experiment] Artifact exp_metadata.json was successfully uploaded to github