reinforcement-learningarxiv

Sequential Recovery Updates for Learned Controllers under Successful-Trajectory Preservation

A competent learned controller already recovers from many disturbances. Improving it means learning a correction, and learning when not to apply it.

Zongtan Li / Tianming Liu / Ye Zhao

用途
原典で確認
難易度の目安
Hard
実装コストの目安
Medium

概要

A competent learned controller already recovers from many disturbances. Improving it means learning a correction, and learning when not to apply it. Freezing a skill's parameters does not settle the second half. In a controller that routes among frozen skills, a new entry rule can redirect the states an old skill succeeded on. We therefore constrain entry instead of parameters. Each update searches for a feedback skill at a measured failure. It fits an entry rule that reads observations and rejects every state on an accumulated successful trajectory. The skill is admitted only if the composed controller reproduces the new recovery on its own and replays every protected trajectory exactly. A finite-trajectory condition states when this preserves the previous controller. One mechanism runs on four streams: two motions on each of two humanoid systems. Two updates per stream add 62 recoveries over 192 withheld perturbations, and lose none of the base controller's successes. We then price that guarantee. Removing the constraint recovers 33 more conditions but stops eight protected ones from completing at all, and excluding only what admission proves necessary recovers none of that cost.

参考リンク

リンク先のライセンス・再現性・データ条件をご確認ください。自動分類や実装の目安は保証ではありません。

実装を始めるプロンプト

参考リンクを確認したうえで、次の内容をコピーして利用できます。

# 論文・記事
Sequential Recovery Updates for Learned Controllers under Successful-Trajectory Preservation

# 概要
A competent learned controller already recovers from many disturbances. Improving it means learning a correction, and learning when not to apply it.

# 原典
https://arxiv.org/abs/2611.02555

上記の手法を実装してください。実行前に依存関係とライセンスを確認してください。

関連する記事

arxiv実装リンクあり

FineCraft: Enhancing VLA Models for Fine-Grained Manipulation

Fine-grained manipulation couples instruction grounding, local visual precision, and sustained execution. We present FineCraft, a framework that adapts pretrained models for fine-grained manipulation…

reinforcement-learning