lightning_template.utils.optim.warmup_lr_scheduler#

Module Contents#

Classes#

WarmupScheduler

Warm-up(increasing) learning rate in optimizer.
class lightning_template.utils.optim.warmup_lr_scheduler.WarmupScheduler(optimizer, warmup_iters, warmup_ratio=0.1, warmup_mode='linear', last_epoch=-1, verbose=False)#

Bases: torch.optim.lr_scheduler._LRScheduler

Warm-up(increasing) learning rate in optimizer.

Parameters:

  • optimizer (Optimizer) – Wrapped optimizer.

  • warmup_iters – target warm up epoch.

get_lr()#