lightning_template.utils.optim.warmup_lr_scheduler

Classes

WarmupScheduler

Warm-up(increasing) learning rate in optimizer.

Module Contents

class lightning_template.utils.optim.warmup_lr_scheduler.WarmupScheduler(*args, warmup_iters, warmup_ratio=0.1, warmup_mode='linear', **kwargs)

Bases: torch.optim.lr_scheduler._LRScheduler

Warm-up(increasing) learning rate in optimizer.

Parameters:

• optimizer (Optimizer) – Wrapped optimizer.

• warmup_iters – target warm up epoch.

warmup_iters

warmup_ratio = 0.1

warmup_mode = 'linear'

get_lr()

Compute learning rate using chainable form of the scheduler.