Gradient Descent

Compute deterministic and stochastic updates and diagnose step-size behavior.

Use https://mlprep.iwase.dev/practice/machine-learning/gradient-descent/. This is a Practice set, not a Screening result. If window.mlPrepAgent is available, read local attempt history before planning. Help me work through the set without revealing full answers first, and save each real attempt through the bridge with recorded_by agent and agent_session_id when available.

Recommended resources

Machine Learning Crash Course — Google for Developers
MIT 6.036 Introduction to Machine Learning Exams — Massachusetts Institute of Technology

Instructions

Write the gradient at the current iterate before updating.

Ordered items

Gradient descent on a quadraticGradient Descent · Easy · 7 min · Original
Full gradient versus stochastic gradientGradient Descent · Easy · 7 min · Original
Linear regression objective and gradientRegression · Easy · 8 min · Original

Completion

Explain learning-rate and gradient-variance effects.

Next

Optimization