Skip to contents

Batch/checkpoint decay helper

Source: R/optimizer.R
batch_decay.Rd

Batch/checkpoint decay helper

Usage

batch_decay(
  patience = 3,
  gamma = 0.5,
  min_delta = 0,
  warmup = 0,
  min_stepsize = 0
)

Arguments

patience

number of consecutive checkpoints without improvement before decay.

gamma

decay factor in \((0,1)\).

min_delta

minimum required decrease to count as improvement.

warmup

number of initial checkpoints to skip.

min_stepsize

lower bound for absolute stepsize.

Value

a stepsize_control() object.

Details

Convenience helper that enables grad-norm plateau decay and keeps iteration schedule constant.