weaning_schedule
Compute QDagger teacher-distillation coefficient schedules for weaning a value student off a suboptimal teacher.
Files1
View on GitHubSKILL.mdbasicagent-skill/skill_library/paperbench/ftrl/skill/reincarnating_rl/weaning_schedule/SKILL.md
GitHubWeaning Schedule
When To Use
Use this skill when a PVRL or QDagger implementation needs the current coefficient on teacher-policy distillation. It is specifically for methods that should reduce teacher dependence over training. Do not use a fixed positive coefficient when the experiment claims QDagger-style weaning.
Inputs
lambda_0: initial nonnegative teacher-distillation coefficient.- Linear schedule inputs:
stepanddecay_steps. - Performance schedule inputs:
student_scoreandteacher_score.
Outputs
lambda_t: current nonnegative coefficient.progress: clipped progress or performance ratio.schedule: selected schedule type.
Workflow
- Choose
linear_decayfor step-based experiments orperformance_decaywhen student and teacher scores are available. - Clip progress to
[0, 1]. - Return
lambda_0 * (1 - progress). - Record the schedule diagnostics in recovery traces.
Validation
Run:
python scripts/weaning_schedule.py --self-test
python tests/test_weaning_schedule.py
Limitations
The skill only computes coefficients. It does not decide when a teacher query is available or evaluate the RL policy.