Multi-Turn On-Policy Distillation with Prefix Replay

The proposed Replayed-Prefix On-Policy Distillation method aims to reduce the computational costs associated with training agentic LLMs by using off-environment data.

Firefly links to the original publisher. The summary above is AI-generated for orientation and may differ from the source. The “current rank score” decays over time so newer significant stories surface first.