[06:29:02] [INFO] [mergernet.core.experiment] New experiment created with exp_id = 3 and run_id = 6bc82d80
[06:29:02] [INFO] [optuna.storages._rdb.storage] A new study created in RDB with name: exp_3
[06:29:02] [INFO] [mergernet.model.automl] start of optuna optimization
[06:29:02] [INFO] [mergernet.model.automl] Starting trial 0
[06:29:02] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: None
[06:29:04] [INFO] [mergernet.data.dataset] Apply: load_jpg
[06:29:04] [INFO] [mergernet.data.dataset] Apply: one_hot
[06:29:04] [INFO] [mergernet.data.dataset] Apply: cache
[06:29:04] [INFO] [mergernet.data.dataset] Apply: shuffle
[06:29:04] [INFO] [mergernet.data.dataset] Apply: batch
[06:29:04] [INFO] [mergernet.data.dataset] Apply: prefetch
[06:29:04] [INFO] [mergernet.data.dataset] Apply: load_jpg
[06:29:04] [INFO] [mergernet.data.dataset] Apply: one_hot
[06:29:04] [INFO] [mergernet.data.dataset] Apply: cache
[06:29:04] [INFO] [mergernet.data.dataset] Apply: shuffle
[06:29:04] [INFO] [mergernet.data.dataset] Apply: batch
[06:29:04] [INFO] [mergernet.data.dataset] Apply: prefetch
[06:29:05] [DEBUG] [h5py._conv] Creating converter from 3 to 5
[06:29:06] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[06:29:07] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[06:29:08] [INFO] [mergernet.model.baseline] Start of training loop
[06:31:24] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:16.
[06:31:24] [INFO] [mergernet.model.baseline] Start of training loop
[06:31:58] [DEBUG] [h5py._conv] Creating converter from 5 to 3
[06:51:44] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:20:19.
[06:51:44] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:51:44] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_0.csv HTTP/1.1" 404 None
[06:51:44] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[06:51:45] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_0.csv HTTP/1.1" 201 2236
[06:51:45] [INFO] [mergernet.core.experiment] Artifact history_trial_0.csv was successfully uploaded to github
[06:51:45] [INFO] [optuna.study.study] Trial 0 finished with value: 0.12654690444469452 and parameters: {'dense_1_units': 384, 'dropout_1_rate': 0.4852142919229748, 'dense_2_units': 768, 'dropout_2_rate': 0.379597545259111, 'opt_lr': 2.0513382630874486e-05}. Best is trial 0 with value: 0.12654690444469452.
[06:51:45] [INFO] [mergernet.model.automl] Starting trial 1
[06:51:45] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.12654690444469452
[06:51:46] [INFO] [mergernet.data.dataset] Apply: load_jpg
[06:51:46] [INFO] [mergernet.data.dataset] Apply: one_hot
[06:51:46] [INFO] [mergernet.data.dataset] Apply: cache
[06:51:46] [INFO] [mergernet.data.dataset] Apply: shuffle
[06:51:46] [INFO] [mergernet.data.dataset] Apply: batch
[06:51:46] [INFO] [mergernet.data.dataset] Apply: prefetch
[06:51:46] [INFO] [mergernet.data.dataset] Apply: load_jpg
[06:51:46] [INFO] [mergernet.data.dataset] Apply: one_hot
[06:51:46] [INFO] [mergernet.data.dataset] Apply: cache
[06:51:46] [INFO] [mergernet.data.dataset] Apply: shuffle
[06:51:46] [INFO] [mergernet.data.dataset] Apply: batch
[06:51:46] [INFO] [mergernet.data.dataset] Apply: prefetch
[06:51:48] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[06:51:48] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[06:51:48] [INFO] [mergernet.model.baseline] Start of training loop
[06:53:26] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:37.
[06:53:26] [INFO] [mergernet.model.baseline] Start of training loop
[07:14:02] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:20:36.
[07:14:02] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[07:14:03] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_1.csv HTTP/1.1" 404 None
[07:14:03] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[07:14:03] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_1.csv HTTP/1.1" 201 2236
[07:14:03] [INFO] [mergernet.core.experiment] Artifact history_trial_1.csv was successfully uploaded to github
[07:14:03] [INFO] [optuna.study.study] Trial 1 finished with value: 0.08303901553153992 and parameters: {'dense_1_units': 192, 'dropout_1_rate': 0.21742508365045984, 'dense_2_units': 896, 'dropout_2_rate': 0.3803345035229626, 'opt_lr': 0.0002607024758370766}. Best is trial 1 with value: 0.08303901553153992.
[07:14:03] [INFO] [mergernet.model.automl] Starting trial 2
[07:14:03] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[07:14:04] [INFO] [mergernet.data.dataset] Apply: load_jpg
[07:14:04] [INFO] [mergernet.data.dataset] Apply: one_hot
[07:14:04] [INFO] [mergernet.data.dataset] Apply: cache
[07:14:04] [INFO] [mergernet.data.dataset] Apply: shuffle
[07:14:04] [INFO] [mergernet.data.dataset] Apply: batch
[07:14:04] [INFO] [mergernet.data.dataset] Apply: prefetch
[07:14:04] [INFO] [mergernet.data.dataset] Apply: load_jpg
[07:14:04] [INFO] [mergernet.data.dataset] Apply: one_hot
[07:14:04] [INFO] [mergernet.data.dataset] Apply: cache
[07:14:04] [INFO] [mergernet.data.dataset] Apply: shuffle
[07:14:04] [INFO] [mergernet.data.dataset] Apply: batch
[07:14:04] [INFO] [mergernet.data.dataset] Apply: prefetch
[07:14:06] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[07:14:07] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[07:14:07] [INFO] [mergernet.model.baseline] Start of training loop
[07:17:16] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:03:09.
[07:17:16] [INFO] [mergernet.model.baseline] Start of training loop
[07:37:00] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:19:43.
[07:37:00] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[07:37:01] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_2.csv HTTP/1.1" 404 None
[07:37:01] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[07:37:01] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_2.csv HTTP/1.1" 201 2236
[07:37:01] [INFO] [mergernet.core.experiment] Artifact history_trial_2.csv was successfully uploaded to github
[07:37:01] [INFO] [optuna.study.study] Trial 2 finished with value: 0.12830819189548492 and parameters: {'dense_1_units': 64, 'dropout_1_rate': 0.4909729556485983, 'dense_2_units': 896, 'dropout_2_rate': 0.26370173320348284, 'opt_lr': 2.3102018878452926e-05}. Best is trial 1 with value: 0.08303901553153992.
[07:37:02] [INFO] [mergernet.model.automl] Starting trial 3
[07:37:02] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[07:37:02] [INFO] [mergernet.data.dataset] Apply: load_jpg
[07:37:02] [INFO] [mergernet.data.dataset] Apply: one_hot
[07:37:02] [INFO] [mergernet.data.dataset] Apply: cache
[07:37:02] [INFO] [mergernet.data.dataset] Apply: shuffle
[07:37:02] [INFO] [mergernet.data.dataset] Apply: batch
[07:37:02] [INFO] [mergernet.data.dataset] Apply: prefetch
[07:37:02] [INFO] [mergernet.data.dataset] Apply: load_jpg
[07:37:02] [INFO] [mergernet.data.dataset] Apply: one_hot
[07:37:02] [INFO] [mergernet.data.dataset] Apply: cache
[07:37:02] [INFO] [mergernet.data.dataset] Apply: shuffle
[07:37:02] [INFO] [mergernet.data.dataset] Apply: batch
[07:37:02] [INFO] [mergernet.data.dataset] Apply: prefetch
[07:37:04] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[07:37:05] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[07:37:05] [INFO] [mergernet.model.baseline] Start of training loop
[07:40:14] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:03:09.
[07:40:14] [INFO] [mergernet.model.baseline] Start of training loop
[08:00:34] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:20:19.
[08:00:34] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[08:00:34] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_3.csv HTTP/1.1" 404 None
[08:00:35] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[08:00:35] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_3.csv HTTP/1.1" 201 2236
[08:00:35] [INFO] [mergernet.core.experiment] Artifact history_trial_3.csv was successfully uploaded to github
[08:00:35] [INFO] [optuna.study.study] Trial 3 finished with value: 0.1564851850271225 and parameters: {'dense_1_units': 192, 'dropout_1_rate': 0.2912726728878613, 'dense_2_units': 576, 'dropout_2_rate': 0.3295835055926347, 'opt_lr': 3.8234752246751835e-05}. Best is trial 1 with value: 0.08303901553153992.
[08:00:35] [INFO] [mergernet.model.automl] Starting trial 4
[08:00:35] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[08:00:36] [INFO] [mergernet.data.dataset] Apply: load_jpg
[08:00:36] [INFO] [mergernet.data.dataset] Apply: one_hot
[08:00:36] [INFO] [mergernet.data.dataset] Apply: cache
[08:00:36] [INFO] [mergernet.data.dataset] Apply: shuffle
[08:00:36] [INFO] [mergernet.data.dataset] Apply: batch
[08:00:36] [INFO] [mergernet.data.dataset] Apply: prefetch
[08:00:36] [INFO] [mergernet.data.dataset] Apply: load_jpg
[08:00:36] [INFO] [mergernet.data.dataset] Apply: one_hot
[08:00:36] [INFO] [mergernet.data.dataset] Apply: cache
[08:00:36] [INFO] [mergernet.data.dataset] Apply: shuffle
[08:00:36] [INFO] [mergernet.data.dataset] Apply: batch
[08:00:36] [INFO] [mergernet.data.dataset] Apply: prefetch
[08:00:38] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[08:00:38] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[08:00:38] [INFO] [mergernet.model.baseline] Start of training loop
[08:02:06] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:27.
[08:02:06] [INFO] [mergernet.model.baseline] Start of training loop
[08:21:54] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:19:47.
[08:21:54] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[08:21:54] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_4.csv HTTP/1.1" 404 None
[08:21:54] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[08:21:55] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_4.csv HTTP/1.1" 201 2236
[08:21:55] [INFO] [mergernet.core.experiment] Artifact history_trial_4.csv was successfully uploaded to github
[08:21:55] [INFO] [optuna.study.study] Trial 4 finished with value: 0.10410043597221375 and parameters: {'dense_1_units': 640, 'dropout_1_rate': 0.24184815819561256, 'dense_2_units': 320, 'dropout_2_rate': 0.3099085529881075, 'opt_lr': 8.168455894760161e-05}. Best is trial 1 with value: 0.08303901553153992.
[08:21:55] [INFO] [mergernet.model.automl] Starting trial 5
[08:21:55] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[08:21:55] [INFO] [mergernet.data.dataset] Apply: load_jpg
[08:21:56] [INFO] [mergernet.data.dataset] Apply: one_hot
[08:21:56] [INFO] [mergernet.data.dataset] Apply: cache
[08:21:56] [INFO] [mergernet.data.dataset] Apply: shuffle
[08:21:56] [INFO] [mergernet.data.dataset] Apply: batch
[08:21:56] [INFO] [mergernet.data.dataset] Apply: prefetch
[08:21:56] [INFO] [mergernet.data.dataset] Apply: load_jpg
[08:21:56] [INFO] [mergernet.data.dataset] Apply: one_hot
[08:21:56] [INFO] [mergernet.data.dataset] Apply: cache
[08:21:56] [INFO] [mergernet.data.dataset] Apply: shuffle
[08:21:56] [INFO] [mergernet.data.dataset] Apply: batch
[08:21:56] [INFO] [mergernet.data.dataset] Apply: prefetch
[08:21:58] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[08:21:59] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[08:21:59] [INFO] [mergernet.model.baseline] Start of training loop
[08:23:36] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:37.
[08:23:36] [INFO] [mergernet.model.baseline] Start of training loop
[08:43:24] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:19:47.
[08:43:24] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[08:43:24] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_5.csv HTTP/1.1" 404 None
[08:43:24] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[08:43:25] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_5.csv HTTP/1.1" 201 2236
[08:43:25] [INFO] [mergernet.core.experiment] Artifact history_trial_5.csv was successfully uploaded to github
[08:43:25] [INFO] [optuna.study.study] Trial 5 finished with value: 0.11254247277975082 and parameters: {'dense_1_units': 832, 'dropout_1_rate': 0.25990213464750794, 'dense_2_units': 576, 'dropout_2_rate': 0.37772437065861275, 'opt_lr': 1.2385137298860926e-05}. Best is trial 1 with value: 0.08303901553153992.
[08:43:25] [INFO] [mergernet.model.automl] Starting trial 6
[08:43:25] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[08:43:25] [INFO] [mergernet.data.dataset] Apply: load_jpg
[08:43:25] [INFO] [mergernet.data.dataset] Apply: one_hot
[08:43:26] [INFO] [mergernet.data.dataset] Apply: cache
[08:43:26] [INFO] [mergernet.data.dataset] Apply: shuffle
[08:43:26] [INFO] [mergernet.data.dataset] Apply: batch
[08:43:26] [INFO] [mergernet.data.dataset] Apply: prefetch
[08:43:26] [INFO] [mergernet.data.dataset] Apply: load_jpg
[08:43:26] [INFO] [mergernet.data.dataset] Apply: one_hot
[08:43:26] [INFO] [mergernet.data.dataset] Apply: cache
[08:43:26] [INFO] [mergernet.data.dataset] Apply: shuffle
[08:43:26] [INFO] [mergernet.data.dataset] Apply: batch
[08:43:26] [INFO] [mergernet.data.dataset] Apply: prefetch
[08:43:27] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[08:43:28] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[08:43:28] [INFO] [mergernet.model.baseline] Start of training loop
[08:45:52] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:24.
[08:45:52] [INFO] [mergernet.model.baseline] Start of training loop
[09:05:49] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:19:57.
[09:05:50] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[09:05:50] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_6.csv HTTP/1.1" 404 None
[09:05:50] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[09:05:51] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_6.csv HTTP/1.1" 201 2236
[09:05:51] [INFO] [mergernet.core.experiment] Artifact history_trial_6.csv was successfully uploaded to github
[09:05:51] [INFO] [optuna.study.study] Trial 6 finished with value: 0.11931059509515762 and parameters: {'dense_1_units': 640, 'dropout_1_rate': 0.2511572371061875, 'dense_2_units': 128, 'dropout_2_rate': 0.48466566117599996, 'opt_lr': 0.0008536189862866829}. Best is trial 1 with value: 0.08303901553153992.
[09:05:51] [INFO] [mergernet.model.automl] Starting trial 7
[09:05:51] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[09:05:51] [INFO] [mergernet.data.dataset] Apply: load_jpg
[09:05:51] [INFO] [mergernet.data.dataset] Apply: one_hot
[09:05:51] [INFO] [mergernet.data.dataset] Apply: cache
[09:05:51] [INFO] [mergernet.data.dataset] Apply: shuffle
[09:05:51] [INFO] [mergernet.data.dataset] Apply: batch
[09:05:51] [INFO] [mergernet.data.dataset] Apply: prefetch
[09:05:51] [INFO] [mergernet.data.dataset] Apply: load_jpg
[09:05:51] [INFO] [mergernet.data.dataset] Apply: one_hot
[09:05:51] [INFO] [mergernet.data.dataset] Apply: cache
[09:05:51] [INFO] [mergernet.data.dataset] Apply: shuffle
[09:05:51] [INFO] [mergernet.data.dataset] Apply: batch
[09:05:51] [INFO] [mergernet.data.dataset] Apply: prefetch
[09:05:53] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[09:05:54] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[09:05:54] [INFO] [mergernet.model.baseline] Start of training loop
[09:07:57] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:03.
[09:07:57] [INFO] [mergernet.model.baseline] Start of training loop
[09:28:17] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:20:19.
[09:28:17] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[09:28:18] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_7.csv HTTP/1.1" 404 None
[09:28:18] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[09:28:18] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_7.csv HTTP/1.1" 201 2236
[09:28:18] [INFO] [mergernet.core.experiment] Artifact history_trial_7.csv was successfully uploaded to github
[09:28:18] [INFO] [optuna.study.study] Trial 7 finished with value: 0.14754663407802582 and parameters: {'dense_1_units': 832, 'dropout_1_rate': 0.2913841307520112, 'dense_2_units': 128, 'dropout_2_rate': 0.40526990795364704, 'opt_lr': 7.591104805282687e-05}. Best is trial 1 with value: 0.08303901553153992.
[09:28:18] [INFO] [mergernet.model.automl] Starting trial 8
[09:28:18] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[09:28:19] [INFO] [mergernet.data.dataset] Apply: load_jpg
[09:28:19] [INFO] [mergernet.data.dataset] Apply: one_hot
[09:28:19] [INFO] [mergernet.data.dataset] Apply: cache
[09:28:19] [INFO] [mergernet.data.dataset] Apply: shuffle
[09:28:19] [INFO] [mergernet.data.dataset] Apply: batch
[09:28:19] [INFO] [mergernet.data.dataset] Apply: prefetch
[09:28:19] [INFO] [mergernet.data.dataset] Apply: load_jpg
[09:28:19] [INFO] [mergernet.data.dataset] Apply: one_hot
[09:28:19] [INFO] [mergernet.data.dataset] Apply: cache
[09:28:19] [INFO] [mergernet.data.dataset] Apply: shuffle
[09:28:19] [INFO] [mergernet.data.dataset] Apply: batch
[09:28:19] [INFO] [mergernet.data.dataset] Apply: prefetch
[09:28:21] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[09:28:22] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[09:28:22] [INFO] [mergernet.model.baseline] Start of training loop
[09:29:53] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:31.
[09:29:53] [INFO] [mergernet.model.baseline] Start of training loop
[09:50:30] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:20:36.
[09:50:30] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[09:50:31] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_8.csv HTTP/1.1" 404 None
[09:50:31] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[09:50:31] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_8.csv HTTP/1.1" 201 2236
[09:50:31] [INFO] [mergernet.core.experiment] Artifact history_trial_8.csv was successfully uploaded to github
[09:50:31] [INFO] [optuna.study.study] Trial 8 finished with value: 0.1535358875989914 and parameters: {'dense_1_units': 128, 'dropout_1_rate': 0.34855307303338107, 'dense_2_units': 64, 'dropout_2_rate': 0.47279612062363463, 'opt_lr': 3.292759134423613e-05}. Best is trial 1 with value: 0.08303901553153992.
[09:50:31] [INFO] [mergernet.model.automl] Starting trial 9
[09:50:31] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[09:50:32] [INFO] [mergernet.data.dataset] Apply: load_jpg
[09:50:32] [INFO] [mergernet.data.dataset] Apply: one_hot
[09:50:32] [INFO] [mergernet.data.dataset] Apply: cache
[09:50:32] [INFO] [mergernet.data.dataset] Apply: shuffle
[09:50:32] [INFO] [mergernet.data.dataset] Apply: batch
[09:50:32] [INFO] [mergernet.data.dataset] Apply: prefetch
[09:50:32] [INFO] [mergernet.data.dataset] Apply: load_jpg
[09:50:32] [INFO] [mergernet.data.dataset] Apply: one_hot
[09:50:32] [INFO] [mergernet.data.dataset] Apply: cache
[09:50:32] [INFO] [mergernet.data.dataset] Apply: shuffle
[09:50:32] [INFO] [mergernet.data.dataset] Apply: batch
[09:50:32] [INFO] [mergernet.data.dataset] Apply: prefetch
[09:50:34] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[09:50:34] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[09:50:34] [INFO] [mergernet.model.baseline] Start of training loop
[09:52:51] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:16.
[09:52:51] [INFO] [mergernet.model.baseline] Start of training loop
[10:13:12] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:20:20.
[10:13:12] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:13:13] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_9.csv HTTP/1.1" 404 None
[10:13:13] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:13:13] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_9.csv HTTP/1.1" 201 2236
[10:13:13] [INFO] [mergernet.core.experiment] Artifact history_trial_9.csv was successfully uploaded to github
[10:13:13] [INFO] [optuna.study.study] Trial 9 finished with value: 0.1460784673690796 and parameters: {'dense_1_units': 704, 'dropout_1_rate': 0.2935133228268233, 'dense_2_units': 576, 'dropout_2_rate': 0.3640130838029839, 'opt_lr': 2.3426581058204037e-05}. Best is trial 1 with value: 0.08303901553153992.
[10:13:13] [INFO] [mergernet.model.automl] Starting trial 10
[10:13:14] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[10:13:14] [INFO] [mergernet.data.dataset] Apply: load_jpg
[10:13:14] [INFO] [mergernet.data.dataset] Apply: one_hot
[10:13:14] [INFO] [mergernet.data.dataset] Apply: cache
[10:13:14] [INFO] [mergernet.data.dataset] Apply: shuffle
[10:13:14] [INFO] [mergernet.data.dataset] Apply: batch
[10:13:14] [INFO] [mergernet.data.dataset] Apply: prefetch
[10:13:14] [INFO] [mergernet.data.dataset] Apply: load_jpg
[10:13:14] [INFO] [mergernet.data.dataset] Apply: one_hot
[10:13:14] [INFO] [mergernet.data.dataset] Apply: cache
[10:13:14] [INFO] [mergernet.data.dataset] Apply: shuffle
[10:13:14] [INFO] [mergernet.data.dataset] Apply: batch
[10:13:14] [INFO] [mergernet.data.dataset] Apply: prefetch
[10:13:16] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[10:13:17] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[10:13:17] [INFO] [mergernet.model.baseline] Start of training loop
[10:15:20] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:02.
[10:15:20] [INFO] [mergernet.model.baseline] Start of training loop
[10:35:50] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:20:29.
[10:35:50] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:35:50] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_10.csv HTTP/1.1" 404 None
[10:35:50] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:35:51] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_10.csv HTTP/1.1" 201 2243
[10:35:51] [INFO] [mergernet.core.experiment] Artifact history_trial_10.csv was successfully uploaded to github
[10:35:51] [INFO] [optuna.study.study] Trial 10 finished with value: 0.13615193963050842 and parameters: {'dense_1_units': 384, 'dropout_1_rate': 0.20179915488674513, 'dense_2_units': 1024, 'dropout_2_rate': 0.20538856268444594, 'opt_lr': 0.00046479701610937753}. Best is trial 1 with value: 0.08303901553153992.
[10:35:51] [INFO] [mergernet.model.automl] Starting trial 11
[10:35:51] [INFO] [mergernet.model.automl] Initial threshold for CheckpointCallback: 0.08303901553153992
[10:35:52] [INFO] [mergernet.data.dataset] Apply: load_jpg
[10:35:52] [INFO] [mergernet.data.dataset] Apply: one_hot
[10:35:52] [INFO] [mergernet.data.dataset] Apply: cache
[10:35:52] [INFO] [mergernet.data.dataset] Apply: shuffle
[10:35:52] [INFO] [mergernet.data.dataset] Apply: batch
[10:35:52] [INFO] [mergernet.data.dataset] Apply: prefetch
[10:35:52] [INFO] [mergernet.data.dataset] Apply: load_jpg
[10:35:52] [INFO] [mergernet.data.dataset] Apply: one_hot
[10:35:52] [INFO] [mergernet.data.dataset] Apply: cache
[10:35:52] [INFO] [mergernet.data.dataset] Apply: shuffle
[10:35:52] [INFO] [mergernet.data.dataset] Apply: batch
[10:35:52] [INFO] [mergernet.data.dataset] Apply: prefetch
[10:35:53] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[10:35:54] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[10:35:54] [INFO] [mergernet.model.baseline] Start of training loop
[10:38:28] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:02:33.
[10:38:28] [INFO] [mergernet.model.baseline] Start of training loop
[10:57:26] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:18:57.
[10:57:26] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:26] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_11.csv HTTP/1.1" 404 None
[10:57:26] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:27] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/history_trial_11.csv HTTP/1.1" 201 2243
[10:57:27] [INFO] [mergernet.core.experiment] Artifact history_trial_11.csv was successfully uploaded to github
[10:57:27] [INFO] [optuna.study.study] Trial 11 finished with value: 0.12360575050115585 and parameters: {'dense_1_units': 448, 'dropout_1_rate': 0.20288527735688902, 'dense_2_units': 320, 'dropout_2_rate': 0.3004385528669709, 'opt_lr': 0.00020238656641536373}. Best is trial 1 with value: 0.08303901553153992.
[10:57:29] [INFO] [mergernet.core.experiment] Artifact model.h5 was successfully uploaded to google drive
[10:57:29] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:30] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/optuna.sqlite HTTP/1.1" 404 None
[10:57:30] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:30] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/optuna.sqlite HTTP/1.1" 201 2196
[10:57:30] [INFO] [mergernet.core.experiment] Artifact optuna.sqlite was successfully uploaded to github
[10:57:30] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:31] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/trials.csv HTTP/1.1" 404 None
[10:57:31] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:31] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/trials.csv HTTP/1.1" 201 2173
[10:57:31] [INFO] [mergernet.core.experiment] Artifact trials.csv was successfully uploaded to github
[10:57:31] [INFO] [mergernet.model.automl] optuna optimization finished in 04:28:29
[10:57:32] [INFO] [mergernet.model.automl] number of finished trials: 12
[10:57:32] [INFO] [mergernet.model.automl] ----- begin of best trial summary -----
[10:57:32] [INFO] [mergernet.model.automl] optimization score: 0.08303901553153992
[10:57:32] [INFO] [mergernet.model.automl] params:
[10:57:32] [INFO] [mergernet.model.automl] dense_1_units: 192
[10:57:32] [INFO] [mergernet.model.automl] dense_2_units: 896
[10:57:32] [INFO] [mergernet.model.automl] dropout_1_rate: 0.21742508365045984
[10:57:32] [INFO] [mergernet.model.automl] dropout_2_rate: 0.3803345035229626
[10:57:32] [INFO] [mergernet.model.automl] opt_lr: 0.0002607024758370766
[10:57:32] [INFO] [mergernet.model.automl] ----- end of best trial summary -----
[10:57:36] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:36] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/dataset_config.json HTTP/1.1" 404 None
[10:57:36] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:37] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/dataset_config.json HTTP/1.1" 201 2235
[10:57:37] [INFO] [mergernet.core.experiment] Artifact dataset_config.json was successfully uploaded to github
[10:57:38] [INFO] [mergernet.data.dataset] Apply: load_jpg
[10:57:38] [INFO] [mergernet.data.dataset] Apply: cache
[10:57:38] [INFO] [mergernet.data.dataset] Apply: shuffle
[10:57:38] [INFO] [mergernet.data.dataset] Apply: batch
[10:57:38] [INFO] [mergernet.data.dataset] Apply: prefetch
[10:57:43] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:43] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/test_preds_fold_0.csv HTTP/1.1" 404 None
[10:57:43] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:45] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/6bc82d80/test_preds_fold_0.csv HTTP/1.1" 201 2252
[10:57:45] [INFO] [mergernet.core.experiment] Artifact test_preds_fold_0.csv was successfully uploaded to github
[10:57:45] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:46] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 200 None
[10:57:46] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[10:57:46] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/3/exp_metadata.json HTTP/1.1" 200 None
[10:57:46] [INFO] [mergernet.core.experiment] Artifact exp_metadata.json was successfully uploaded to github