1. Lightweight, versatile, and platform agnostic architecture

Optuna is entirely written in Python and has few dependencies. This means that we can quickly move to the real example once you get interested in Optuna.

Quadratic Function Example

Usually, Optuna is used to optimize hyperparameters, but as an example, let’s optimize a simple quadratic function: \((x - 2)^2\).

First of all, import optuna.

import optuna

In optuna, conventionally functions to be optimized are named objective.

def objective(trial):
    x = trial.suggest_float("x", -10, 10)
    return (x - 2) ** 2

This function returns the value of \((x - 2)^2\). Our goal is to find the value of x that minimizes the output of the objective function. This is the “optimization.” During the optimization, Optuna repeatedly calls and evaluates the objective function with different values of x.

A Trial object corresponds to a single execution of the objective function and is internally instantiated upon each invocation of the function.

The suggest APIs (for example, suggest_float()) are called inside the objective function to obtain parameters for a trial. suggest_float() selects parameters uniformly within the range provided. In our example, from \(-10\) to \(10\).

To start the optimization, we create a study object and pass the objective function to method optimize() as follows.

study = optuna.create_study()
study.optimize(objective, n_trials=100)

You can get the best parameter as follows.

best_params = study.best_params
found_x = best_params["x"]
print("Found x: {}, (x - 2)^2: {}".format(found_x, (found_x - 2) ** 2))
Found x: 1.9976391144712637, (x - 2)^2: 5.573780479796272e-06

We can see that the x value found by Optuna is close to the optimal value of 2.

Note

When used to search for hyperparameters in machine learning, usually the objective function would return the loss or accuracy of the model.

Study Object

Let us clarify the terminology in Optuna as follows:

  • Trial: A single call of the objective function

  • Study: An optimization session, which is a set of trials

  • Parameter: A variable whose value is to be optimized, such as x in the above example

In Optuna, we use the study object to manage optimization. Method create_study() returns a study object. A study object has useful properties for analyzing the optimization outcome.

To get the dictionary of parameter name and parameter values:

{'x': 1.9976391144712637}

To get the best observed value of the objective function:

study.best_value
5.573780479796272e-06

To get the best trial:

study.best_trial
FrozenTrial(number=73, state=TrialState.COMPLETE, values=[5.573780479796272e-06], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 693014), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 694595), params={'x': 1.9976391144712637}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=73, value=None)

To get all trials:

study.trials
[FrozenTrial(number=0, state=TrialState.COMPLETE, values=[30.83285277685175], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 570144), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 570601), params={'x': 7.552733811092672}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=0, value=None), FrozenTrial(number=1, state=TrialState.COMPLETE, values=[20.768935958109235], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 571080), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 571382), params={'x': 6.55729480702195}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=1, value=None), FrozenTrial(number=2, state=TrialState.COMPLETE, values=[60.205508537555644], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 571762), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 572024), params={'x': -5.759220871811528}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=2, value=None), FrozenTrial(number=3, state=TrialState.COMPLETE, values=[69.87341858815475], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 572400), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 572664), params={'x': -6.35903215618619}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=3, value=None), FrozenTrial(number=4, state=TrialState.COMPLETE, values=[3.919064896956381], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 573037), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 573301), params={'x': 0.020337175942231056}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=4, value=None), FrozenTrial(number=5, state=TrialState.COMPLETE, values=[8.092551011243167], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 573676), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 573947), params={'x': -0.84474093921453}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=5, value=None), FrozenTrial(number=6, state=TrialState.COMPLETE, values=[0.17139988865107783], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 574317), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 574589), params={'x': 1.5859953035881382}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=6, value=None), FrozenTrial(number=7, state=TrialState.COMPLETE, values=[45.6776883757172], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 574982), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 575273), params={'x': -4.758527086260527}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=7, value=None), FrozenTrial(number=8, state=TrialState.COMPLETE, values=[0.4610562805297569], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 575643), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 575921), params={'x': 2.67901125213781}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=8, value=None), FrozenTrial(number=9, state=TrialState.COMPLETE, values=[1.4001655468578997], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 576291), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 576579), params={'x': 3.1832859108676566}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=9, value=None), FrozenTrial(number=10, state=TrialState.COMPLETE, values=[52.49375106319643], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 576951), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 578623), params={'x': 9.245257142655216}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=10, value=None), FrozenTrial(number=11, state=TrialState.COMPLETE, values=[0.1539177521881719], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 579208), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 580423), params={'x': 2.3923235299955534}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=11, value=None), FrozenTrial(number=12, state=TrialState.COMPLETE, values=[10.391753920312855], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 580849), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 582049), params={'x': -1.2236243454088838}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=12, value=None), FrozenTrial(number=13, state=TrialState.COMPLETE, values=[1.5068547167344843], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 582472), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 583697), params={'x': 3.2275401079942294}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=13, value=None), FrozenTrial(number=14, state=TrialState.COMPLETE, values=[9.418172340578886], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 584121), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 585310), params={'x': 5.068904094392473}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=14, value=None), FrozenTrial(number=15, state=TrialState.COMPLETE, values=[116.9680397173087], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 585737), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 586964), params={'x': -8.815176360897159}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=15, value=None), FrozenTrial(number=16, state=TrialState.COMPLETE, values=[23.83932571212771], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 587442), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 588631), params={'x': -2.8825531960366506}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=16, value=None), FrozenTrial(number=17, state=TrialState.COMPLETE, values=[0.006107636687872495], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 589057), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 590254), params={'x': 1.921848629648147}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=17, value=None), FrozenTrial(number=18, state=TrialState.COMPLETE, values=[11.246815996639043], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 590679), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 591940), params={'x': 5.353627289464207}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=18, value=None), FrozenTrial(number=19, state=TrialState.COMPLETE, values=[1.2611036605657684], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 592366), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 593575), params={'x': 0.8770112820843798}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=19, value=None), FrozenTrial(number=20, state=TrialState.COMPLETE, values=[26.378320135800266], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 593999), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 595246), params={'x': -3.1359828792355087}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=20, value=None), FrozenTrial(number=21, state=TrialState.COMPLETE, values=[0.13735978373031238], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 595675), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 596917), params={'x': 1.6293791914499236}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=21, value=None), FrozenTrial(number=22, state=TrialState.COMPLETE, values=[5.905517320880151], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 597348), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 598581), params={'x': 4.430127017437597}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=22, value=None), FrozenTrial(number=23, state=TrialState.COMPLETE, values=[0.1857914401713906], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 599046), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 600305), params={'x': 1.5689646880226742}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=23, value=None), FrozenTrial(number=24, state=TrialState.COMPLETE, values=[9.007877455392737], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 600731), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 601988), params={'x': -1.00131262206934}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=24, value=None), FrozenTrial(number=25, state=TrialState.COMPLETE, values=[1.3375223068984863], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 602416), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 603772), params={'x': 3.1565129946950385}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=25, value=None), FrozenTrial(number=26, state=TrialState.COMPLETE, values=[20.89301833803861], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 604209), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 605455), params={'x': -2.5708881344918746}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=26, value=None), FrozenTrial(number=27, state=TrialState.COMPLETE, values=[24.169633031811202], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 605881), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 607195), params={'x': 6.916262099584521}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=27, value=None), FrozenTrial(number=28, state=TrialState.COMPLETE, values=[0.8674693120032109], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 607625), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 608936), params={'x': 1.0686196738156797}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=28, value=None), FrozenTrial(number=29, state=TrialState.COMPLETE, values=[40.70784866738025], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 609366), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 610702), params={'x': 8.380270266013834}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=29, value=None), FrozenTrial(number=30, state=TrialState.COMPLETE, values=[15.791507635495726], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 611169), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 612507), params={'x': 5.973852996211074}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=30, value=None), FrozenTrial(number=31, state=TrialState.COMPLETE, values=[0.1365669681128703], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 612933), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 614278), params={'x': 1.6304503171251932}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=31, value=None), FrozenTrial(number=32, state=TrialState.COMPLETE, values=[3.960265750062871], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 614713), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 616093), params={'x': 3.990041645308678}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=32, value=None), FrozenTrial(number=33, state=TrialState.COMPLETE, values=[0.03897149772779672], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 616527), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 617859), params={'x': 2.1974119999589607}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=33, value=None), FrozenTrial(number=34, state=TrialState.COMPLETE, values=[2.8078764145968327], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 618289), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 619663), params={'x': 0.32432807071406944}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=34, value=None), FrozenTrial(number=35, state=TrialState.COMPLETE, values=[14.400003351720322], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 620093), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 621441), params={'x': -1.7947336338299587}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=35, value=None), FrozenTrial(number=36, state=TrialState.COMPLETE, values=[5.5026849593280085], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 621872), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 623281), params={'x': -0.3457802453188168}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=36, value=None), FrozenTrial(number=37, state=TrialState.COMPLETE, values=[0.0016277356657226185], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 623719), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 625071), params={'x': 1.9596547937702307}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=37, value=None), FrozenTrial(number=38, state=TrialState.COMPLETE, values=[6.43142853507452], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 625505), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 626879), params={'x': 4.536026130597735}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=38, value=None), FrozenTrial(number=39, state=TrialState.COMPLETE, values=[38.26066869807651], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 627348), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 628728), params={'x': -4.185520891410562}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=39, value=None), FrozenTrial(number=40, state=TrialState.COMPLETE, values=[3.9898153661315097], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 629159), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 630552), params={'x': 0.0025477812644654207}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=40, value=None), FrozenTrial(number=41, state=TrialState.COMPLETE, values=[0.383895849593405], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 631010), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 632425), params={'x': 2.6195932936962802}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=41, value=None), FrozenTrial(number=42, state=TrialState.COMPLETE, values=[0.003098351703478151], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 632859), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 634257), params={'x': 1.944337160479561}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=42, value=None), FrozenTrial(number=43, state=TrialState.COMPLETE, values=[0.05747178800772284], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 634703), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 636127), params={'x': 1.7602672571221802}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=43, value=None), FrozenTrial(number=44, state=TrialState.COMPLETE, values=[4.323655082491586], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 636561), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 637982), params={'x': 4.079340059367776}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=44, value=None), FrozenTrial(number=45, state=TrialState.COMPLETE, values=[0.09678981493074457], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 638417), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 639875), params={'x': 2.3111106152652856}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=45, value=None), FrozenTrial(number=46, state=TrialState.COMPLETE, values=[2.848299164108613], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 640310), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 641714), params={'x': 0.3123095176814521}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=46, value=None), FrozenTrial(number=47, state=TrialState.COMPLETE, values=[0.028093816764653702], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 642201), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 643666), params={'x': 2.1676121020829155}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=47, value=None), FrozenTrial(number=48, state=TrialState.COMPLETE, values=[2.2124243247997932], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 644104), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 645552), params={'x': 3.4874220399065603}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=48, value=None), FrozenTrial(number=49, state=TrialState.COMPLETE, values=[15.513286732324618], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 645993), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 647486), params={'x': 5.938690992236459}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=49, value=None), FrozenTrial(number=50, state=TrialState.COMPLETE, values=[12.66694213233067], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 647923), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 649368), params={'x': -1.5590647833849092}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=50, value=None), FrozenTrial(number=51, state=TrialState.COMPLETE, values=[0.09299973776905633], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 649805), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 651279), params={'x': 2.3049585836946656}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=51, value=None), FrozenTrial(number=52, state=TrialState.COMPLETE, values=[0.7003831816759681], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 651716), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 653169), params={'x': 1.1631110099445876}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=52, value=None), FrozenTrial(number=53, state=TrialState.COMPLETE, values=[1.7292438195820636], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 653603), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 655096), params={'x': 0.6849928442848443}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=53, value=None), FrozenTrial(number=54, state=TrialState.COMPLETE, values=[6.881882551083547], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 655545), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 656991), params={'x': -0.6233342431119118}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=54, value=None), FrozenTrial(number=55, state=TrialState.COMPLETE, values=[1.9898658523622323], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 657432), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 658928), params={'x': 3.410626049795704}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=55, value=None), FrozenTrial(number=56, state=TrialState.COMPLETE, values=[0.011604244303627926], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 659374), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 660931), params={'x': 1.892277001974379}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=56, value=None), FrozenTrial(number=57, state=TrialState.COMPLETE, values=[98.01066324271831], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 661372), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 662858), params={'x': -7.900033497050317}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=57, value=None), FrozenTrial(number=58, state=TrialState.COMPLETE, values=[10.554407184822637], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 663307), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 664761), params={'x': 5.24875471293581}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=58, value=None), FrozenTrial(number=59, state=TrialState.COMPLETE, values=[0.024162324707286905], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 665198), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 666690), params={'x': 2.155442351716921}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=59, value=None), FrozenTrial(number=60, state=TrialState.COMPLETE, values=[1.5413910856842914], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 667159), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 668664), params={'x': 3.2415277224791605}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=60, value=None), FrozenTrial(number=61, state=TrialState.COMPLETE, values=[0.10746376718085417], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 669104), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 670624), params={'x': 2.327816667027249}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=61, value=None), FrozenTrial(number=62, state=TrialState.COMPLETE, values=[0.021912378802787354], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 671092), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 672599), params={'x': 1.8519716959403123}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=62, value=None), FrozenTrial(number=63, state=TrialState.COMPLETE, values=[0.4935751400737541], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 673037), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 674553), params={'x': 1.297450969630052}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=63, value=None), FrozenTrial(number=64, state=TrialState.COMPLETE, values=[3.3550658010530285], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 675013), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 676539), params={'x': 3.8316838703916756}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=64, value=None), FrozenTrial(number=65, state=TrialState.COMPLETE, values=[1.889639764453472], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 676991), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 678529), params={'x': 0.6253583141583869}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=65, value=None), FrozenTrial(number=66, state=TrialState.COMPLETE, values=[7.172526259681259], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 678991), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 680519), params={'x': 4.6781572507381375}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=66, value=None), FrozenTrial(number=67, state=TrialState.COMPLETE, values=[0.7479915132773854], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 680959), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 682508), params={'x': 2.864865026045906}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=67, value=None), FrozenTrial(number=68, state=TrialState.COMPLETE, values=[0.0041025494293244], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 682981), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 684520), params={'x': 1.9359488530210083}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=68, value=None), FrozenTrial(number=69, state=TrialState.COMPLETE, values=[5.4495004321876035], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 684989), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 686526), params={'x': -0.33441650786392496}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=69, value=None), FrozenTrial(number=70, state=TrialState.COMPLETE, values=[0.053922795082162335], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 686990), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 688537), params={'x': 1.767787177179721}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=70, value=None), FrozenTrial(number=71, state=TrialState.COMPLETE, values=[0.713709780482607], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 688987), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 690544), params={'x': 2.8448134589852407}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=71, value=None), FrozenTrial(number=72, state=TrialState.COMPLETE, values=[1.096214557951645], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 691015), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 692569), params={'x': 0.9529973457762179}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=72, value=None), FrozenTrial(number=73, state=TrialState.COMPLETE, values=[5.573780479796272e-06], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 693014), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 694595), params={'x': 1.9976391144712637}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=73, value=None), FrozenTrial(number=74, state=TrialState.COMPLETE, values=[0.05013180077690811], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 695069), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 696947), params={'x': 1.7760986807164636}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=74, value=None), FrozenTrial(number=75, state=TrialState.COMPLETE, values=[2.6479045030336015], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 697396), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 698987), params={'x': 0.3727616944548038}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=75, value=None), FrozenTrial(number=76, state=TrialState.COMPLETE, values=[3.5617050115463194], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 699448), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 701017), params={'x': 3.88724799948134}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=76, value=None), FrozenTrial(number=77, state=TrialState.COMPLETE, values=[0.8296663517619894], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 701475), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 703103), params={'x': 2.910860226248786}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=77, value=None), FrozenTrial(number=78, state=TrialState.COMPLETE, values=[9.779812841777526], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 703564), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 705151), params={'x': -1.1272692307790717}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=78, value=None), FrozenTrial(number=79, state=TrialState.COMPLETE, values=[0.6502100143568292], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 705604), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 707296), params={'x': 1.1936439903139375}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=79, value=None), FrozenTrial(number=80, state=TrialState.COMPLETE, values=[3.946654540343132], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 707750), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 709335), params={'x': 0.013381128564632805}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=80, value=None), FrozenTrial(number=81, state=TrialState.COMPLETE, values=[7.962611121724742e-05], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 709787), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 711442), params={'x': 2.008923346413608}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=81, value=None), FrozenTrial(number=82, state=TrialState.COMPLETE, values=[0.001800785893379763], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 711901), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 713506), params={'x': 1.9575643322972318}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=82, value=None), FrozenTrial(number=83, state=TrialState.COMPLETE, values=[0.26989742291105484], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 713958), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 715622), params={'x': 1.4804834719558435}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=83, value=None), FrozenTrial(number=84, state=TrialState.COMPLETE, values=[0.010926402352656262], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 716075), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 717729), params={'x': 1.8954705670509198}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=84, value=None), FrozenTrial(number=85, state=TrialState.COMPLETE, values=[0.4746078714129883], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 718184), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 719869), params={'x': 2.688917898891434}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=85, value=None), FrozenTrial(number=86, state=TrialState.COMPLETE, values=[1.5294482920002657], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 720324), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 721958), params={'x': 0.7632913471636638}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=86, value=None), FrozenTrial(number=87, state=TrialState.COMPLETE, values=[6.202990801010123], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 722416), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 724098), params={'x': 4.490580414483765}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=87, value=None), FrozenTrial(number=88, state=TrialState.COMPLETE, values=[2.119345016269015], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 724560), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 726198), params={'x': 3.455797038144059}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=88, value=None), FrozenTrial(number=89, state=TrialState.COMPLETE, values=[60.93775561810666], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 726655), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 728347), params={'x': 9.806263870643027}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=89, value=None), FrozenTrial(number=90, state=TrialState.COMPLETE, values=[4.756707644772147], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 728801), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 730443), params={'x': -0.1809877681390486}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=90, value=None), FrozenTrial(number=91, state=TrialState.COMPLETE, values=[0.08343110864626438], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 730917), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 732592), params={'x': 1.7111555632416224}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=91, value=None), FrozenTrial(number=92, state=TrialState.COMPLETE, values=[0.07080279422262789], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 733048), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 734919), params={'x': 2.266087944527045}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=92, value=None), FrozenTrial(number=93, state=TrialState.COMPLETE, values=[0.015739787494124725], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 735462), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 737106), params={'x': 1.8745416902149374}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=93, value=None), FrozenTrial(number=94, state=TrialState.COMPLETE, values=[0.7255468361887507], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 737562), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 739287), params={'x': 1.1482096289645258}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=94, value=None), FrozenTrial(number=95, state=TrialState.COMPLETE, values=[2.71609247154827], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 739743), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 741772), params={'x': 0.3519428190902265}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=95, value=None), FrozenTrial(number=96, state=TrialState.COMPLETE, values=[0.4251136979076649], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 742229), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 743952), params={'x': 2.6520074370033404}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=96, value=None), FrozenTrial(number=97, state=TrialState.COMPLETE, values=[1.4958105746930468], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 744412), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 746119), params={'x': 3.223033349787751}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=97, value=None), FrozenTrial(number=98, state=TrialState.COMPLETE, values=[7.120252125315532], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 746576), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 749156), params={'x': -0.6683800563854339}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=98, value=None), FrozenTrial(number=99, state=TrialState.COMPLETE, values=[3.1607106733004318], datetime_start=datetime.datetime(2022, 12, 22, 7, 12, 7, 749620), datetime_complete=datetime.datetime(2022, 12, 22, 7, 12, 7, 751377), params={'x': 3.7778387647085525}, user_attrs={}, system_attrs={}, intermediate_values={}, distributions={'x': FloatDistribution(high=10.0, log=False, low=-10.0, step=None)}, trial_id=99, value=None)]

To get the number of trials:

len(study.trials)
100

By executing optimize() again, we can continue the optimization.

study.optimize(objective, n_trials=100)

To get the updated number of trials:

len(study.trials)
200

As the objective function is so easy that the last 100 trials don’t improve the result. However, we can check the result again:

best_params = study.best_params
found_x = best_params["x"]
print("Found x: {}, (x - 2)^2: {}".format(found_x, (found_x - 2) ** 2))
Found x: 1.998393982004431, (x - 2)^2: 2.5792938020915687e-06

Total running time of the script: ( 0 minutes 0.457 seconds)

Gallery generated by Sphinx-Gallery