Foundations of Artificial Intelligence Agents — Part 2: AI Agents
The second volume of the Foundations of Artificial Intelligence Agents series moves from language-model agents to the full agentic frontier: reinforcement learning, reasoning models, deep research agents, AI coding, AI scientists, and the vision-language-action models now driving a new generation of robotics.
It closes on the path toward Artificial General Intelligence — and what remains to be solved.
Table of Contents
- Chapter 1Fundamentals of Reinforcement Learning
- Chapter 2Deep Reinforcement Learning
- Chapter 3Multi-RL Agents
- Chapter 4AI Reasoning Models
- Chapter 5Deep Research Agents
- Chapter 6AI Coding and Vibe Coding
- Chapter 7AI Scientists Transforming Scientific Discovery
- Chapter 8VLA Models and Robotics
- Chapter 9The Path of Artificial General Intelligence
- Chapter 10Conclusion: The Horizon Ahead
- References
Related lectures
Foundations of Artificial Intelligence Agents — Part 2: AI Agents
Reinforcement Learning in Reasoning Models
VLA Models and the New Robotics
More books
LLM Agents
The foundational volume — covering large language model agents, prompting, reasoning, and the building blocks of autonomous AI.
Artificial Intelligence Finance
AI applications in financial markets, risk, trading, and quantitative analysis.
The AI Project Handbook
End-to-end guidance for planning, executing, and delivering AI projects in the enterprise.
The AI Model Handbook
A practical guide to understanding, selecting, and deploying AI models across real-world use cases.



