offline_recovery_harness
Execute a bounded D4RL-style offline recovery proxy with fixed-dataset training and normalized-score evidence.
Files1
View on GitHubSKILL.mdbasicagent-skill/skill_library/paperbench/fre/skill/d4rl_offline_rl/offline_recovery_harness/SKILL.md
GitHubOffline Recovery Harness
Use this skill when full D4RL packages or datasets are unavailable but soft-mode recovery permits a declared mechanism-faithful proxy. The harness should still perform executable work: validate a fixed transition dataset, run a parameter update from that dataset, compute normalized scores, and save mechanism evidence.
Inputs
module_plan.jsoncontaining the fast recovery target.environment/runtime_handoff.jsondescribing package blockers and allowed sources.- Generated skill root containing dataset validation, score normalization, and taxonomy skills.
- An output recovery directory.
Outputs
recovery_result.jsonwith numeric metrics and target metadata.logs/generated_data_item.jsonwith transition content and provenance.logs/training_trace.jsonwithloss_before,loss_after,params_before, andparams_after.- Invocation logs proving generated skills were used.
Workflow
- Read the module plan target and runtime handoff.
- Build a tiny fixed offline chain dataset with explicit synthetic-proxy provenance.
- Validate the dataset through
offline_dataset_protocol. - Classify proxy metadata through
benchmark_property_taxonomy. - Fit a one-parameter linear Q approximation with a deterministic gradient update.
- Compute raw and normalized return through
d4rl_score_normalization. - Save mechanism checks: no online collection, fixed dataset consumed, reduced training executed, optimizer step changed parameters, full D4RL packages unavailable, and normalized scoring used.
- Keep full-runtime flags false when the runtime handoff reports missing packages.
Validation
Run the harness script used by the recovery attempt, then run Distiller's validate_recovery_experiment.py on the attempt directory.
Limitations
This harness is a reduced proxy, not a full D4RL benchmark run. It should be accepted only in soft mode after full recovery is blocked and the experiment gate passes.