Fig. 1From: Adaptive initial step size selection for Simultaneous Perturbation Stochastic ApproximationObjective value minimization using gradient descent (one variable): if gradient g is positive at \(\theta _k\) then move to \(\theta _{k+1}<\theta _k\), if gradient g is negative then move to \(\theta _{k+1}>\theta _k\) Back to article page