Momentum-based optimization

  1. The Dark Side of Neural Networks (AI Secrets)
  2. Advanced techniques for early stopping: Learning rate schedules, adaptive optimization, and more