stochastic gradient descent
Related Words
algorithmoptimizationgradientderivativecalculuscost functionloss functionlearning rateconvergenceweightbiasparameteriterationepochbatchstochasticityrandomnessprobabilitysamplingconvexitylocal minimumglobal minimumsaddle pointplateaumomentumoptimizerbackpropagationneural networkdeep learningmachine learningregressionclassificationlinear regressionlogistic regressionactivation functiontensormatrixvectorscalarpartial derivativechain ruleoverfittingunderfittingregularizationdropoutnormalizationlearning curvehyperparameterdecayobjective functionerrorresidualgradient descentheuristicapproximationstabilitydivergencemanifoldcurvaturevariance