[02:27:20] [INFO] [mergernet.model.automl] start of optuna optimization
[02:27:20] [INFO] [optuna.storages._rdb.storage] A new study created in RDB with name: exp_1
[02:27:22] [INFO] [mergernet.data.dataset] Apply: load_jpg
[02:27:22] [INFO] [mergernet.data.dataset] Apply: one_hot
[02:27:22] [INFO] [mergernet.data.dataset] Apply: cache
[02:27:22] [INFO] [mergernet.data.dataset] Apply: shuffle
[02:27:22] [INFO] [mergernet.data.dataset] Apply: batch
[02:27:22] [INFO] [mergernet.data.dataset] Apply: prefetch
[02:27:22] [INFO] [mergernet.data.dataset] Apply: load_jpg
[02:27:22] [INFO] [mergernet.data.dataset] Apply: one_hot
[02:27:22] [INFO] [mergernet.data.dataset] Apply: cache
[02:27:22] [INFO] [mergernet.data.dataset] Apply: shuffle
[02:27:22] [INFO] [mergernet.data.dataset] Apply: batch
[02:27:22] [INFO] [mergernet.data.dataset] Apply: prefetch
[02:27:23] [DEBUG] [h5py._conv] Creating converter from 3 to 5
[02:27:23] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[02:27:24] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[02:27:24] [INFO] [mergernet.model.baseline] Start of training loop
[02:29:09] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:45.
[02:29:09] [INFO] [mergernet.model.baseline] Start of training loop
[02:52:39] [INFO] [mergernet.model.callbacks] New best metric detected: val_loss = 0.15934187173843384s
[02:52:39] [DEBUG] [h5py._conv] Creating converter from 5 to 3
[02:52:41] [INFO] [mergernet.model.callbacks] Trial saved at experiments/1/2ee5aef1/exp_1.h5
[02:52:57] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:23:47.
[02:52:57] [INFO] [optuna.study.study] Trial 0 finished with value: 0.15934187173843384 and parameters: {'dense_1_units': 384, 'dropout_1_rate': 0.4852142919229748, 'dense_2_units': 768, 'dropout_2_rate': 0.379597545259111, 'opt_lr': 2.0513382630874486e-05}. Best is trial 0 with value: 0.15934187173843384.
[02:52:57] [INFO] [mergernet.data.dataset] Apply: load_jpg
[02:52:57] [INFO] [mergernet.data.dataset] Apply: one_hot
[02:52:57] [INFO] [mergernet.data.dataset] Apply: cache
[02:52:57] [INFO] [mergernet.data.dataset] Apply: shuffle
[02:52:57] [INFO] [mergernet.data.dataset] Apply: batch
[02:52:57] [INFO] [mergernet.data.dataset] Apply: prefetch
[02:52:57] [INFO] [mergernet.data.dataset] Apply: load_jpg
[02:52:57] [INFO] [mergernet.data.dataset] Apply: one_hot
[02:52:57] [INFO] [mergernet.data.dataset] Apply: cache
[02:52:57] [INFO] [mergernet.data.dataset] Apply: shuffle
[02:52:57] [INFO] [mergernet.data.dataset] Apply: batch
[02:52:57] [INFO] [mergernet.data.dataset] Apply: prefetch
[02:52:59] [INFO] [mergernet.model.baseline] Trainable weights (CONV): 0
[02:52:59] [INFO] [mergernet.model.baseline] Trainable weights (TOTAL): 6
[02:52:59] [INFO] [mergernet.model.baseline] Start of training loop
[02:54:03] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:01:04.
[02:54:04] [INFO] [mergernet.model.baseline] Start of training loop
[02:54:10] [WARNING] [tensorflow] Callback method `on_train_batch_end` is slow compared to the batch time (batch time: 0.0637s vs `on_train_batch_end` time: 0.0690s). Check your callbacks.
[03:17:14] [INFO] [mergernet.model.callbacks] New best metric detected: val_loss = 0.10182197391986847s
[03:17:16] [INFO] [mergernet.model.callbacks] Trial saved at experiments/1/2ee5aef1/exp_1.h5
[03:17:32] [INFO] [mergernet.model.baseline] End of training loop, duration: 00:23:28.
[03:17:32] [INFO] [optuna.study.study] Trial 1 finished with value: 0.10182197391986847 and parameters: {'dense_1_units': 192, 'dropout_1_rate': 0.21742508365045984, 'dense_2_units': 896, 'dropout_2_rate': 0.3803345035229626, 'opt_lr': 0.0002607024758370766}. Best is trial 1 with value: 0.10182197391986847.
[03:17:32] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[03:17:33] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/1/2ee5aef1/optuna.sqlite HTTP/1.1" 404 None
[03:17:33] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[03:17:34] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/1/2ee5aef1/optuna.sqlite HTTP/1.1" 201 2196
[03:17:34] [INFO] [mergernet.model.automl] optuna optimization finished in 00:50:13
[03:17:34] [INFO] [mergernet.model.automl] number of finished trials: 2
[03:17:34] [INFO] [mergernet.model.automl] ----- begin of best trial summary -----
[03:17:34] [INFO] [mergernet.model.automl] optimization score: 0.10182197391986847
[03:17:34] [INFO] [mergernet.model.automl] params:
[03:17:34] [INFO] [mergernet.model.automl] dense_1_units: 192
[03:17:34] [INFO] [mergernet.model.automl] dense_2_units: 896
[03:17:34] [INFO] [mergernet.model.automl] dropout_1_rate: 0.21742508365045984
[03:17:34] [INFO] [mergernet.model.automl] dropout_2_rate: 0.3803345035229626
[03:17:34] [INFO] [mergernet.model.automl] opt_lr: 0.0002607024758370766
[03:17:34] [INFO] [mergernet.model.automl] ----- end of best trial summary -----
[03:17:34] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[03:17:34] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "GET /repos/nmcardoso/mergernet-experiments/contents/experiments/1/exp_metadata.json HTTP/1.1" 404 None
[03:17:34] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): api.github.com:443
[03:17:34] [DEBUG] [urllib3.connectionpool] https://api.github.com:443 "PUT /repos/nmcardoso/mergernet-experiments/contents/experiments/1/exp_metadata.json HTTP/1.1" 201 2167