Schedulers

Name Venue Year Paper URL
BaseScheduler
AutoCyclic IEEE Access 2024 AutoCyclic: Deep Learning Optimizer for Time Series Data Prediction IEEEXplore - REF
CAWR ICLR 2017 SGDR: Stochastic Gradient Descent with Warm Restarts Arxiv
CosineAnnealingLR
ExpHyperbolicLR HyperbolicLR: Epoch Insensitive Learning Rate Scheduler Arxiv - REF
HyperbolicLR HyperbolicLR: Epoch Insensitive Learning Rate Scheduler Arxiv - REF
OneCycleLR arXiv 2017 Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates Arxiv
ResetStepLR
StepLR