The best replacement for gradient descent is hill climbing.

The best alternatives to gradient descent are rated as following:
★★★★★  hill climbing
★★★★  newton method
★★★★  least squares
★★★  stochastic gradient descent
★★  genetic algorithm
★★  simulated annealing
★  backpropagation
★  normal equation
★  batch

Your alternative for gradient descent is not listed? Suggest!


No companions for gradient descent have been suggested so far.
You have in mind a companion for gradient descent and it is not yet here? Propose!



Google Trends

Scale is based on the average worldwide traffic of gradient descent in all years. Click on graph for more.
gradient descent
hill climbing
newton method