lightning_template.utils.optim

Submodules

• lightning_template.utils.optim.configure_optimizers
• lightning_template.utils.optim.keep_and_linearly_decay_lr_scheduler
• lightning_template.utils.optim.warmup_lr_scheduler

Package Contents

Classes

KeepAndLinearlyDecayLrScheduler	Keep lr first then decay learning rate linearly in optimizer.
WarmupScheduler	Warm-up(increasing) learning rate in optimizer.

Functions

get_configure_optimizers_method(optim_config)

lightning_template.utils.optim.get_configure_optimizers_method(optim_config)

class lightning_template.utils.optim.KeepAndLinearlyDecayLrScheduler(optimizer, keep_epochs, decay_epochs, last_epoch=-1, verbose=False)

Bases: torch.optim.lr_scheduler._LRScheduler

Keep lr first then decay learning rate linearly in optimizer.

Parameters:

• optimizer (Optimizer) – Wrapped optimizer.

• keep_epochs – target keep epoch.

• decay_epochs – target decay epoch.

get_lr()

class lightning_template.utils.optim.WarmupScheduler(optimizer, warmup_iters, warmup_ratio=0.1, warmup_mode='linear', last_epoch=-1, verbose=False)

Bases: torch.optim.lr_scheduler._LRScheduler

Warm-up(increasing) learning rate in optimizer.

Parameters:

• optimizer (Optimizer) – Wrapped optimizer.

• warmup_iters – target warm up epoch.

get_lr()