Note

Go to the end to download the full example code.

plot_terminator_improvement

optuna.visualization.matplotlib.plot_terminator_improvement(study, plot_error=False, improvement_evaluator=None, error_evaluator=None, min_n_trials=20)[source]

Plot the potentials for future objective improvement.

This function visualizes the objective improvement potentials, evaluated with improvement_evaluator. It helps to determine whether we should continue the optimization or not. You can also plot the error evaluated with error_evaluator if the plot_error argument is set to True. Note that this function may take some time to compute the improvement potentials.

See also

Please refer to optuna.visualization.plot_terminator_improvement().

Parameters:

  • study (Study) – A Study object whose trials are plotted for their improvement.

  • plot_error (bool) – A flag to show the error. If it is set to True, errors evaluated by error_evaluator are also plotted as line graph. Defaults to False.

  • improvement_evaluator (BaseImprovementEvaluator | None) – An object that evaluates the improvement of the objective function. Default to RegretBoundEvaluator.

  • error_evaluator (BaseErrorEvaluator | None) – An object that evaluates the error inherent in the objective function. Default to CrossValidationErrorEvaluator.

  • min_n_trials (int) – The minimum number of trials before termination is considered. Terminator improvements for trials below this value are shown in a lighter color. Defaults to 20.

Returns:

A matplotlib.axes.Axes object.

Return type:

Axes

Note

Added in v3.2.0 as an experimental feature. The interface may change in newer versions without prior notice. See https://github.com/optuna/optuna/releases/tag/v3.2.0.

The following code snippet shows how to plot improvement potentials, together with cross-validation errors.

Terminator Improvement Plot
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/sklearn/utils/validation.py:2827: UserWarning: X does not have valid feature names, but LGBMClassifier was fitted with feature names
  warnings.warn(
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:34: FutureWarning: `optuna.terminator` module has been deprecated in v4.9.0. This feature will be removed in v6.0.0. See https://github.com/optuna/optuna/releases/tag/v4.9.0.
  report_cross_validation_scores(trial, scores)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/latest/docs/visualization_matplotlib_examples/optuna.visualization.matplotlib.terminator_improvement.py:41: ExperimentalWarning: optuna.visualization.matplotlib._terminator_improvement.plot_terminator_improvement is experimental (supported from v3.2.0). The interface can change in the future.
  plot_terminator_improvement(study, plot_error=True)
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/optuna/visualization/_terminator_improvement.py:97: ExperimentalWarning: RegretBoundEvaluator is experimental (supported from v3.2.0). The interface can change in the future.
  improvement_evaluator = RegretBoundEvaluator()
/home/docs/checkouts/readthedocs.org/user_builds/optuna/envs/latest/lib/python3.12/site-packages/optuna/visualization/_terminator_improvement.py:102: ExperimentalWarning: CrossValidationErrorEvaluator is experimental (supported from v3.2.0). The interface can change in the future.
  error_evaluator = CrossValidationErrorEvaluator()

  0%|          | 0/30 [00:00<?, ?it/s]
 27%|██▋       | 8/30 [00:00<00:00, 74.54it/s]
 53%|█████▎    | 16/30 [00:00<00:00, 58.43it/s]
 77%|███████▋  | 23/30 [00:00<00:00, 59.30it/s]
100%|██████████| 30/30 [00:00<00:00, 49.83it/s]
100%|██████████| 30/30 [00:00<00:00, 53.73it/s]

<Axes: title={'center': 'Terminator Improvement Plot'}, xlabel='Trial', ylabel='Terminator Improvement'>


from lightgbm import LGBMClassifier
from sklearn.datasets import load_wine
from sklearn.model_selection import cross_val_score
from sklearn.model_selection import KFold
import optuna
from optuna.terminator import report_cross_validation_scores
from optuna.visualization.matplotlib import plot_terminator_improvement


def objective(trial):
    X, y = load_wine(return_X_y=True)
    clf = LGBMClassifier(
        reg_alpha=trial.suggest_float("reg_alpha", 1e-8, 10.0, log=True),
        reg_lambda=trial.suggest_float("reg_lambda", 1e-8, 10.0, log=True),
        num_leaves=trial.suggest_int("num_leaves", 2, 256),
        colsample_bytree=trial.suggest_float("colsample_bytree", 0.4, 1.0),
        subsample=trial.suggest_float("subsample", 0.4, 1.0),
        subsample_freq=trial.suggest_int("subsample_freq", 1, 7),
        min_child_samples=trial.suggest_int("min_child_samples", 5, 100),
    )
    scores = cross_val_score(clf, X, y, cv=KFold(n_splits=5, shuffle=True))
    report_cross_validation_scores(trial, scores)
    return scores.mean()


study = optuna.create_study()
study.optimize(objective, n_trials=30)

plot_terminator_improvement(study, plot_error=True)

Total running time of the script: (0 minutes 2.438 seconds)

Gallery generated by Sphinx-Gallery