Nearly every book on reinforcement learning contains a chapter that explains the differences between model-free and model-based reinforcement learning.