Gradient descent on a quadratic

Problem

For $f(w)=(w-3)^2$ , start at $w_0=0$ . Compute $w_1$ for learning rates $0.1$ and $1.1$ . Explain which update moves toward the minimizer and why overly large learning rates can diverge.

Reveal answer or reference solution

The gradient at $0$ is $-6$ . With $\eta=0.1$ , $w_1=0.6$ . With $\eta=1.1$ , $w_1=6.6$ , overshooting $3$ . For this quadratic, convergence requires $0<\eta<1$ ; larger steps amplify error.

Local history

Loading attempts saved in this browser…

Use with your agent

Share this URL and your attempt. Ask the agent to start with a clarifying question or the smallest useful hint.

Tutor me on https://mlprep.iwase.dev/machine-learning/diagnostic/original-ml-gd/. If window.mlPrepAgent is available, read attempts for item original-ml-gd before tutoring. Inspect my attempt, keep the item ID, and do not reveal the full answer first. After a real attempt, append its record and read it back.

Appears in

Machine Learning Diagnostic
Gradient Descent Practice
Optimization Practice