> For the complete documentation index, see [llms.txt](https://hujian.gitbook.io/deep-reinforcement-learning/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu.md).

# 附录

- [Distributional RL](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/distributional-rl.md)
- [QR-DQN](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/distributional-rl/qr-dqn.md)
- [Policy Gradient](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/policy-gradient.md)
- [Off-Policy Actor-Critic](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/policy-gradient/off-policy-actor-critic.md)
- [Generalized Advantage Estimation](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/policy-gradient/advantage-estimation.md)
- [Soft Actor-Critic](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/policy-gradient/soft-actor-critic.md)
- [PPO-Penalty](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/policy-gradient/ppo-penalty.md)
- [Model-Based RL](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/model-based-rl.md)
- [I2A](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/model-based-rl/i2a.md)
- [MBMF](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/model-based-rl/mbmf.md)
- [MBVE](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/model-based-rl/mbve.md)
- [World Models](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/model-based-rl/world-models.md)
- [Imitation Learning and Inverse Reinforcement Learning](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/imitation-learning-and-inverse-reinforcement-learning.md)
- [GAIL](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/imitation-learning-and-inverse-reinforcement-learning/gail.md)
- [Transfer and Multitask RL](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/transfer-and-multitask-rl.md)
- [HER](https://hujian.gitbook.io/deep-reinforcement-learning/fu-lu/transfer-and-multitask-rl/her.md)