Adaptive initial step size selection for Simultaneous Perturbation Stochastic Approximation
A difficulty in using Simultaneous Perturbation Stochastics Approximation (SPSA) is its performance sensitivity to the step sizes chosen at the initial stage of the iteration. If the step size is too large, t...