lightning_template.utils.optim.warmup_lr_scheduler

Module Contents

Classes

WarmupScheduler

Warm-up(increasing) learning rate in optimizer.

class lightning_template.utils.optim.warmup_lr_scheduler.WarmupScheduler(optimizer, warmup_iters, warmup_ratio=0.1, warmup_mode='linear', last_epoch=-1, verbose=False)

Bases: torch.optim.lr_scheduler._LRScheduler

Warm-up(increasing) learning rate in optimizer.

Parameters:

• optimizer (Optimizer) – Wrapped optimizer.

• warmup_iters – target warm up epoch.

get_lr()