← Knowledge map∇ Algorithms & Optimization

Optimization

3 concepts, 1 written; shares concepts or relations with 2 other subjects. Earlier ideas sit to the left, a region holds one chapter, and relations that leave the subject hang on the cards as tags.

12 earlierlater ∇Optimization applied in StochasticGradient Methods MDPs & ValueFunctions Policy Gradient
Relationsposition is order: read along the rail, left to right
NodesConceptMethodwrittenplanned1 / 3 written

Select a concept to see its summary and relations1 / 3 written

Optimization1/3

Select a node to see its summary and how it relates to the others.

Relations in this subject, in words2
  • MDPs & Value FunctionsrequiresPolicy Gradient

    The objective J(θ) is defined over the MDP's trajectory distribution.

  • Stochastic Gradient Methodsapplied inPolicy Gradient

    The update is stochastic gradient ascent on J(θ); its convergence analysis is that of stochastic nonconvex optimization.