电信学部海外学者在线报告第十三期-Reinforcement Learning-Based Control of Uncertain Nonlinear Systems 基于强化学习的非线性不确定系统控制-大连理工大学电子信息与电气工程学部
学术科研活动
学术科研活动
当前位置: 首页 学术科研活动 >> Content

电信学部海外学者在线报告第十三期-Reinforcement Learning-Based Control of Uncertain Nonlinear Systems 基于强化学习的非线性不确定系统控制

2021-08-03点击:[]

电信学部海外学者在线报告第十三期

Reinforcement Learning-Based Control of Uncertain Nonlinear Systems

基于强化学习的非线性不确定系统控制

Lihua Xie

Nanyang Technological University, Singapore

https://dr.ntu.edu.sg/cris/rp/rp00784

Abstract: Reinforcement learning (RL), inspired by learning behaviour in nature, is a goal-oriented learning strategy wherein the agent learns the policy to optimize a pre-defined reward by interacting with the environment. For being data-driven, effectiveness in reaching optimal behavior, and adaptiveness to uncertain environment, RL has undergone rapid progress in control community. In this talk, we shall first discuss RL based disturbance rejection control for uncertain nonlinear systems with known nominal part. An extended state observer is first designed to estimate the system state and the total uncertainty. Based on the output of the observer, the control compensates for the total uncertainty in real time, and simultaneously, online approximates the optimal policy for the compensated system using a simulation of experience based RL technique. The approach does not require PE condition or probing signals. We further extend the study to systems with unknown nominal part, where a novel concurrent adaptive extended observer is developed to jointly estimate the parameters of the systems and the state, and a simulation of experience based RL is used to approximate the optimal policy.

Short Bio:

Lihua Xie received the Ph.D. degree in electrical engineering from the University of Newcastle, Australia, in 1992. Since then, he has been with the School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore. He served as the Head of Division of Control and Instrumentation from July 2011 to June 2014. His research areas include robust control, networked control, compressive sensing, localization and unmanned systems. In these areas, he has co-authored 9 books, over 480 journal articles and 20 patents/technical disclosures. He has been listed as a highly cited researcher by Thomson Routers and Clarivate Analytics annually since 2014. He was an IEEE Distinguished Lecturer (2011-2014) and an elected member of the Board of Governors of IEEE Control System Society (Jan. 2016- Dec. 2018). He is a member of Academy of Engineering Singapore and Fellow of IEEE, IFAC and CAA.



校内邀请人:隋天举,电信学部控制科学与工程学院

报告时间:20218514:00-16:00

参会方式:腾讯会议 ID549 924 226

会议二维码


活动简介:

“电信学部海外学者在线报告”是电信学部为促进学部师生与国际学者的学术交流所举办的系列在线讲座活动,内容涵盖电信学部下属所有学院的科研方向,每周聘请一名海外知名学者分享学术成果,碰撞思想火花。活动信息敬请关注“电子信息与电气工程学部”公众号和电信学部官网左上角的“学术科研活动”栏目, 期待广大师生积极参与!