In model-based RL, we first build the entire dynamics of the environment:

• Policy and/or value function
• Model

After going through all the above categories, the following Venn diagram shows the entire landscape of the taxonomy of an RL agent at one single place. If you pick up any paper related to reinforcement learning, those methods can fit in within any section of this landscape.