« Back to top page

Conformal

Conformal

Conformal Pruner

Abstract Every built-in pruner is a heuristic, and none states how often it prunes a trial that would have ended well. This pruner does. You pick alpha, and the expected fraction of trials that were good and pruned stays at or below alpha, under one condition: the trials it calibrates on and the trials it judges must come from the same random process. It runs the first n_calibration completed trials unpruned, calibrates a threshold on their learning curves by conformal risk control, then freezes and prunes.