Agentic RL / RLVR
T1 Agentic reinforcement learning
Multi-turn training driven by verifiable rewards
In one sentenceTreats the model as a multi-turn decision policy and trains it end to end with automatically verifiable rewards inside the think → call tool → observe loop, optimizing task completion rather than next-token likelihood.
How it works
- Verifiable rewards (RLVR)Objective signals — tests passed, correct answers, tasks completed — replace human preference scores, curbing reward hacking at the source.
- The GRPO familyGroup-relative advantages replace the value network; DAPO, GSPO and GiGPO handle long sequences, MoE models and hierarchical credit assignment respectively.
- Agentic mid-trainingContinued training on large volumes of synthetic trajectories between pre-training and post-training, extending context from 32K to 128K.
- Asynchronous rollout infrastructureParallel environment interaction plus a dynamic data curriculum; open-source frameworks such as verl and AReaL have sharply lowered the bar to reproduce results.
Why it matters: the training signal widens from “is this single answer right?” to “does this multi-turn tool trajectory reach the goal?” — the common engine behind the simultaneous 2025 inflection on three major benchmarks.
Representative work
- Kimi K2Open-source 1T MoE
- Tongyi DeepResearch30.5B, fully open
- DeepSeek-R1Nature cover
- Agentic RL survey 2509.02547500+ papers
For banks
Much of banking work comes with verifiable rewards built in — was the ticket resolved, does the ledger balance, did the message pass validation. Train first in a de-identified simulation environment, then deploy, turning in-house business rules into reward functions.
Takeaway
Not teaching the model to talk, but training it to get things done — the reward only counts verifiable outcomes.
SourcesAgentic RL survey arXiv:2509.02547; Kimi K2 arXiv:2507.20534; Tongyi DeepResearch arXiv:2510.24701; DeepSeek-R1 arXiv:2501.12948




