RL-赵-(七)-不基于模型2-计算Q/ActionValue-TD算法02:Expected Sarsa【Sarsa的变形:将qₜ(sₜ₊₁,aₜ₊₁)改为E[qₜ(sₜ₊₁,A)]】
二、Sarsa变形:Expected Sarsa Expected Sarsa算法: {qt1(st,at)qt(st,at)−αt(st,at)[qt(st,at)−(rt1γE[qt(st1,A)])],qt1(s,a)qt(s,a),∀(s,a)≠(st,at),\color{red}{ \begin{cases} q_{t1}(s_t,a_t)q_t(s_t,a_t)-\alpha_t(s_t,a_t)\Big[q_t(s_t,a_…
2026/9/27 22:29:41