computer-visionarxiv

On Stochastic Continuous-Time Linear System Identification for Adaptive Stabilization

Learning to stabilize an unknown continuous-time stochastic linear system is a central problem in control theory and reinforcement learning. This paper numerically studies data-driven identification…

Reza Sadeghi Hafshejani / Mohamad Kazem Shirani Faradonbeh

用途
原典で確認
難易度の目安
Hard
実装コストの目安
Medium

概要

Learning to stabilize an unknown continuous-time stochastic linear system is a central problem in control theory and reinforcement learning. This paper numerically studies data-driven identification of such systems with possibly unstable dynamics for the purpose of stabilization. We present a method that learns a stabilizing gain from observed trajectories, and examine how the failure probability, namely the probability that the learned gain does not stabilize the system, depends on the amount of data, dimension, noise intensity, excitation, and controllability. Numerical experiments on an unstable batch-reactor benchmark show that the squared identification error decays inversely with the aggregate observation time, that is, the combined length of all trajectories, while the failure probability decays exponentially in the same quantity. Hence, despite instability, a single long trajectory can achieve similar stabilization performance to that of many short trajectories of the same total length. We also observe \emph{signal saturation}: stronger excitation improves stabilization only logarithmically with the excitation strength. Finally, we show experimentally that accurate identification of the full dynamics is \emph{not} necessary for successful stabilization.

参考リンク

リンク先のライセンス・再現性・データ条件をご確認ください。自動分類や実装の目安は保証ではありません。

実装を始めるプロンプト

参考リンクを確認したうえで、次の内容をコピーして利用できます。

# 論文・記事
On Stochastic Continuous-Time Linear System Identification for Adaptive Stabilization

# 概要
Learning to stabilize an unknown continuous-time stochastic linear system is a central problem in control theory and reinforcement learning. This paper numerically studies data-driven identification…

# 原典
https://arxiv.org/abs/2611.02340

上記の手法を実装してください。実行前に依存関係とライセンスを確認してください。

関連する記事