Abstract optuna.samplers.BruteForceSampler explores a define-by-run search space as a tree: each internal node is a parameter, and a path from the root to a leaf is one trial’s complete params. This package renders that tree as an interactive icicle chart, so you can see which branches have been sampled, how each trial’s parameters relate to one another, and how much of a finite (grid-like) search space is still unexplored.
Leaves are colored by trial state (complete/pruned/failed/running); hovering over a complete trial’s leaf shows its objective value(s).
Class or Function Names MESSampler Installation pip install scipy torch Overview Optuna’s acquisition functions all score a candidate by improvement over the incumbent (LogEI, LogPI) or by a posterior quantile (UCB, LCB). Max-value entropy search scores it instead by information: how much observing f(x) is expected to reduce the entropy of the distribution of the maximum value y* = max_x f(x).
Writing mu(x), sigma(x) for the posterior mean and standard deviation, phi and Psi for the standard normal PDF and CDF, and gamma = (y* - mu(x)) / sigma(x), the acquisition is
Abstract The original motivation can be found here.
HPO is often iterative: a range that looked reasonable at the start can turn out to be too narrow once a few trials complete. For example, if reg_alpha for an XGBoost model is first searched over [0, 1] and the best trials keep landing near 0.99, the natural next step is to widen it to, say, [0, 2] and keep optimizing on the same study.
Installation pip install trackio Abstract This callback enables tracking of Optuna studies in Trackio. By default, the study is tracked as a single experiment run, where all suggested hyperparameters and optimized metrics are logged and visualized as a function of optimizer steps.
Trackio is offline-first and does not require authentication for local experiment tracking. Optionally, tracked experiments can be synchronized to Hugging Face Spaces for remote visualization and sharing.
The callback also supports multi-run mode, where each Optuna trial is tracked as an independent Trackio run.