Optimization Methods Learning

This project summarizes the learning process of optimization methods, attempting to start from the original mathematical formulas and write Python code to understand the principles of the methods.

Validation Function

Contents

1. Steepest Descent Algorithm

2. Damped 新建ton Algorithm

3. BFGS Algorithm