410.30 a

Description: Let's learn the basics of calculus. In general, we use differentiation to reduce dimensionality, and integration to use stacked values. Calculus is especially important in optimization. It is used to understand and analyze how changes in certain parameters affect the model.

#400 #ML_Engineer_Basic#410 #Mathematics#410.30 #Calculus#410.30 a #Fundamental_Calculus

Methods for Optimization

Derivative, Minimum, and Least Error in Quadratic Functions

Derivative
Instantaneous rate of change, lim deltax -> 0

Partial differentiation
Treat values other than specific variables as constants

Derivative Laws
ref: https://en.wikipedia.org/wiki/Derivative

Backpropagation
Laws and Multiplication Rules
When the output changes by 1, what happens to the input?
The legal rule flows as it is, while the multiplicative rule flows into the changed value