"Using a highly simplified language, we might state at this point that adaptive algorithms are nothing but iterative search algorithms derived for minimizing the underlying cost function with the true statistics replaced by their estimates obtained in some manner."

Chapter 5, Search Methods - B. Farhang-Boroujeny