Specify Hyperparameters Manually

It’s natural that you have some specific sets of hyperparameters to try first such as initial learning rate values and the number of leaves. Also, it’s also possible that you’ve already tried those sets before having Optuna find better sets of hyperparameters.

Optuna provides two APIs to support such cases:

  1. Passing those sets of hyperparameters and let Optuna evaluate them - enqueue_trial()

  2. Adding the results of those sets as completed Trials - add_trial()

First Scenario: Have Optuna evaluate your hyperparameters

In this scenario, let’s assume you have some out-of-box sets of hyperparameters but have not evaluated them yet and decided to use Optuna to find better sets of hyperparameters.

Optuna has optuna.study.Study.enqueue_trial() which lets you pass those sets of hyperparameters to Optuna and Optuna will evaluate them.

This section walks you through how to use this lit API with LightGBM.

import lightgbm as lgb
import numpy as np
import sklearn.datasets
import sklearn.metrics
from sklearn.model_selection import train_test_split

import optuna

Define the objective function.

def objective(trial):
    data, target = sklearn.datasets.load_breast_cancer(return_X_y=True)
    train_x, valid_x, train_y, valid_y = train_test_split(data, target, test_size=0.25)
    dtrain = lgb.Dataset(train_x, label=train_y)
    dvalid = lgb.Dataset(valid_x, label=valid_y)

    param = {
        "objective": "binary",
        "metric": "auc",
        "verbosity": -1,
        "boosting_type": "gbdt",
        "bagging_fraction": min(trial.suggest_float("bagging_fraction", 0.4, 1.0 + 1e-12), 1),
        "bagging_freq": trial.suggest_int("bagging_freq", 0, 7),
        "min_child_samples": trial.suggest_int("min_child_samples", 5, 100),
    }

    # Add a callback for pruning.
    pruning_callback = optuna.integration.LightGBMPruningCallback(trial, "auc")
    gbm = lgb.train(
        param, dtrain, valid_sets=[dvalid], verbose_eval=False, callbacks=[pruning_callback]
    )

    preds = gbm.predict(valid_x)
    pred_labels = np.rint(preds)
    accuracy = sklearn.metrics.accuracy_score(valid_y, pred_labels)
    return accuracy

Then, construct Study for hyperparameter optimization.

study = optuna.create_study(direction="maximize", pruner=optuna.pruners.MedianPruner())

Here, we get Optuna evaluate some sets with larger "bagging_fraq" value and the default values.

study.enqueue_trial(
    {
        "bagging_fraction": 1.0,
        "bagging_freq": 0,
        "min_child_samples": 20,
    }
)

study.enqueue_trial(
    {
        "bagging_fraction": 0.75,
        "bagging_freq": 5,
        "min_child_samples": 20,
    }
)

import logging
import sys

# Add stream handler of stdout to show the messages to see Optuna works expectedly.
optuna.logging.get_logger("optuna").addHandler(logging.StreamHandler(sys.stdout))
study.optimize(objective, n_trials=100, timeout=600)

Out:

/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/tutorial/20_recipes/008_specify_params.py:77: ExperimentalWarning:

enqueue_trial is experimental (supported from v1.2.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/optuna/study/study.py:842: ExperimentalWarning:

create_trial is experimental (supported from v2.0.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/optuna/study/study.py:841: ExperimentalWarning:

add_trial is experimental (supported from v2.0.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/tutorial/20_recipes/008_specify_params.py:85: ExperimentalWarning:

enqueue_trial is experimental (supported from v1.2.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 0 finished with value: 0.972027972027972 and parameters: {'bagging_fraction': 1.0, 'bagging_freq': 0, 'min_child_samples': 20}. Best is trial 0 with value: 0.972027972027972.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 1 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.75, 'bagging_freq': 5, 'min_child_samples': 20}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 2 finished with value: 0.965034965034965 and parameters: {'bagging_fraction': 0.6963234880179837, 'bagging_freq': 4, 'min_child_samples': 62}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 3 finished with value: 0.965034965034965 and parameters: {'bagging_fraction': 0.40428852743077026, 'bagging_freq': 5, 'min_child_samples': 56}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 4 finished with value: 0.951048951048951 and parameters: {'bagging_fraction': 0.5821836156552391, 'bagging_freq': 5, 'min_child_samples': 26}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 5 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 6 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 7 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 8 finished with value: 0.951048951048951 and parameters: {'bagging_fraction': 0.570702845808625, 'bagging_freq': 1, 'min_child_samples': 47}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 9 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 10 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 11 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 12 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 13 finished with value: 0.9790209790209791 and parameters: {'bagging_fraction': 0.8431609768719105, 'bagging_freq': 3, 'min_child_samples': 39}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 14 pruned. Trial was pruned at iteration 31.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 15 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 16 pruned. Trial was pruned at iteration 38.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 17 finished with value: 0.951048951048951 and parameters: {'bagging_fraction': 0.6459728034259606, 'bagging_freq': 2, 'min_child_samples': 18}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 18 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 19 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 20 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 21 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 22 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.9391235706109213, 'bagging_freq': 1, 'min_child_samples': 14}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 23 pruned. Trial was pruned at iteration 12.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 24 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.816711927016736, 'bagging_freq': 3, 'min_child_samples': 32}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 25 finished with value: 0.965034965034965 and parameters: {'bagging_fraction': 0.8072496428228825, 'bagging_freq': 6, 'min_child_samples': 27}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 26 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 27 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 28 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 29 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 30 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.788331702858506, 'bagging_freq': 4, 'min_child_samples': 44}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 31 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 32 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 33 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 34 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 35 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 36 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 37 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 38 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 39 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 40 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 41 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 42 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 43 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 44 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 45 pruned. Trial was pruned at iteration 5.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 46 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 47 finished with value: 0.972027972027972 and parameters: {'bagging_fraction': 0.6984521442277243, 'bagging_freq': 2, 'min_child_samples': 42}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 48 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 49 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 50 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 51 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 52 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 53 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 54 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 55 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.9685989477635366, 'bagging_freq': 1, 'min_child_samples': 9}. Best is trial 1 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 56 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 57 pruned. Trial was pruned at iteration 2.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 58 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 59 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 60 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 61 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 62 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 63 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 64 finished with value: 0.993006993006993 and parameters: {'bagging_fraction': 0.9866890920939825, 'bagging_freq': 0, 'min_child_samples': 18}. Best is trial 64 with value: 0.993006993006993.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 65 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 66 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 67 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 68 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 69 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 70 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 71 finished with value: 0.9790209790209791 and parameters: {'bagging_fraction': 0.9848881403680506, 'bagging_freq': 0, 'min_child_samples': 21}. Best is trial 64 with value: 0.993006993006993.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 72 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 73 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 74 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 75 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 76 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 77 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 78 pruned. Trial was pruned at iteration 2.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 79 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 80 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 81 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 82 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 83 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 84 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 85 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 86 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 87 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 88 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 89 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 90 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 91 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 92 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 93 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 94 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 95 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 96 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 97 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 98 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 99 pruned. Trial was pruned at iteration 2.

Second scenario: Have Optuna utilize already evaluated hyperparameters

In this scenario, let’s assume you have some out-of-box sets of hyperparameters and you have already evaluated them but the results are not desirable so that you are thinking of using Optuna.

Optuna has optuna.study.Study.add_trial() which lets you register those results to Optuna and then Optuna will sample hyperparameters taking them into account.

In this section, the objective is the same as the first scenario.

study = optuna.create_study(direction="maximize", pruner=optuna.pruners.MedianPruner())
study.add_trial(
    optuna.trial.create_trial(
        params={
            "bagging_fraction": 1.0,
            "bagging_freq": 0,
            "min_child_samples": 20,
        },
        distributions={
            "bagging_fraction": optuna.distributions.UniformDistribution(0.4, 1.0 + 1e-12),
            "bagging_freq": optuna.distributions.IntUniformDistribution(0, 7),
            "min_child_samples": optuna.distributions.IntUniformDistribution(5, 100),
        },
        value=0.94,
    )
)
study.add_trial(
    optuna.trial.create_trial(
        params={
            "bagging_fraction": 0.75,
            "bagging_freq": 5,
            "min_child_samples": 20,
        },
        distributions={
            "bagging_fraction": optuna.distributions.UniformDistribution(0.4, 1.0 + 1e-12),
            "bagging_freq": optuna.distributions.IntUniformDistribution(0, 7),
            "min_child_samples": optuna.distributions.IntUniformDistribution(5, 100),
        },
        value=0.95,
    )
)
study.optimize(objective, n_trials=100, timeout=600)

Out:

A new study created in memory with name: no-name-07ad1166-c5d5-4066-906d-c1cb318c05ea
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/tutorial/20_recipes/008_specify_params.py:115: ExperimentalWarning:

create_trial is experimental (supported from v2.0.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/tutorial/20_recipes/008_specify_params.py:114: ExperimentalWarning:

add_trial is experimental (supported from v2.0.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/tutorial/20_recipes/008_specify_params.py:130: ExperimentalWarning:

create_trial is experimental (supported from v2.0.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/tutorial/20_recipes/008_specify_params.py:129: ExperimentalWarning:

add_trial is experimental (supported from v2.0.0). The interface can change in the future.

/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 2 finished with value: 0.965034965034965 and parameters: {'bagging_fraction': 0.4935895694929735, 'bagging_freq': 2, 'min_child_samples': 82}. Best is trial 2 with value: 0.965034965034965.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 3 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.9803892157850834, 'bagging_freq': 2, 'min_child_samples': 89}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 4 finished with value: 0.972027972027972 and parameters: {'bagging_fraction': 0.48812419300402066, 'bagging_freq': 7, 'min_child_samples': 30}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 5 finished with value: 0.965034965034965 and parameters: {'bagging_fraction': 0.6308581511963484, 'bagging_freq': 1, 'min_child_samples': 28}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 6 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 7 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 8 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 9 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 10 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 11 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 12 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 13 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 14 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 15 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 16 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 17 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 18 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 19 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 20 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 21 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 22 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 23 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 24 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 25 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 26 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 27 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 28 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 29 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 30 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 31 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 32 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.4401250348221818, 'bagging_freq': 1, 'min_child_samples': 30}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 33 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 34 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 35 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 36 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 37 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 38 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 39 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 40 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 41 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 42 pruned. Trial was pruned at iteration 2.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 43 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 44 finished with value: 0.9790209790209791 and parameters: {'bagging_fraction': 0.5778622129041748, 'bagging_freq': 1, 'min_child_samples': 14}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 45 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 46 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 47 pruned. Trial was pruned at iteration 3.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 48 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 49 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 50 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 51 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 52 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 53 pruned. Trial was pruned at iteration 28.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 54 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 55 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 56 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 57 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 58 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 59 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 60 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 61 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 62 pruned. Trial was pruned at iteration 7.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 63 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 64 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 65 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 66 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 67 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 68 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 69 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 70 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 71 finished with value: 0.972027972027972 and parameters: {'bagging_fraction': 0.973657277514139, 'bagging_freq': 0, 'min_child_samples': 20}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 72 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 73 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 74 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.9066781046792352, 'bagging_freq': 0, 'min_child_samples': 28}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 75 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 76 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 77 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 78 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 79 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 80 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 81 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 82 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 83 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 84 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 85 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 86 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 87 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 88 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 89 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 90 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 91 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 92 pruned. Trial was pruned at iteration 1.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 93 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 94 pruned. Trial was pruned at iteration 13.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 95 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 96 pruned. Trial was pruned at iteration 16.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 97 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 98 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 99 pruned. Trial was pruned at iteration 0.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 100 finished with value: 0.986013986013986 and parameters: {'bagging_fraction': 0.8981913635285088, 'bagging_freq': 1, 'min_child_samples': 5}. Best is trial 3 with value: 0.986013986013986.
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.8/site-packages/lightgbm/engine.py:240: UserWarning:

'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.

Trial 101 pruned. Trial was pruned at iteration 1.

Total running time of the script: ( 0 minutes 5.908 seconds)

Gallery generated by Sphinx-Gallery