(File-based) Journal Storage

Optuna provides JournalStorage. With this feature, you can easily run a distributed optimization over network using NFS as the shared storage, without need for setting up RDB or Redis.

import logging
import sys

import optuna


# Add stream handler of stdout to show the messages
optuna.logging.get_logger("optuna").addHandler(logging.StreamHandler(sys.stdout))
study_name = "example-study"  # Unique identifier of the study.
storage = optuna.storages.JournalStorage(
    optuna.storages.JournalFileStorage("./journal.log"),  # NFS path for distributed optimization
)

study = optuna.create_study(study_name=study_name, storage=storage)


def objective(trial):
    x = trial.suggest_float("x", -10, 10)
    return (x - 2) ** 2


study.optimize(objective, n_trials=3)

/home/docs/checkouts/readthedocs.org/user_builds/optuna/checkouts/v3.6.0/tutorial/20_recipes/011_journal_storage.py:22: ExperimentalWarning:

JournalStorage is experimental (supported from v3.1.0). The interface can change in the future.

A new study created in Journal with name: example-study
Trial 0 finished with value: 40.99828218190336 and parameters: {'x': 8.402990096970584}. Best is trial 0 with value: 40.99828218190336.
Trial 1 finished with value: 21.363387802744267 and parameters: {'x': -2.6220545001919078}. Best is trial 1 with value: 21.363387802744267.
Trial 2 finished with value: 19.892239454866644 and parameters: {'x': 6.460071687189192}. Best is trial 2 with value: 19.892239454866644.

Although the optimization in this example is too short to run in parallel, you can extend this example to write a optimization script which can be run in parallel.

Note

In a Windows environment, an error message “A required privilege is not held by the client” may appear. In this case, you can solve the problem with creating storage by specifying JournalFileOpenLock. See the reference of JournalStorage for any details.