Tag: gradient descent

by Sanksshep Mahendra Updated May 30, 2026 at 7:01 pm

Univariate Linear Regression

Why it matters: Univariate linear regression explained: the formula, cost function, a Python example, and where this simple model still powers real AI.

by Sanksshep Mahendra Updated May 31, 2026 at 4:25 pm

Adam Optimizer

Why it matters: The Adam optimizer powers most deep learning today. See how it works, the formula, default betas, PyTorch code, AdamW, and when SGD wins.