DESIGN OF AN ONLINE ADAPTIVE CONTROLLER FOR ACTIVE DISTURBANCE REJECTION IN A FIXED WING UAV USING REINFORCEMENT LEARNING AND DIFFERENTIAL GAMES

Show simple item record

dc.contributor.author Kimathi, Stephen Muchai
dc.date.accessioned 2018-05-11T07:31:10Z
dc.date.available 2018-05-11T07:31:10Z
dc.date.issued 2018-05-11
dc.identifier.uri http://hdl.handle.net/123456789/4543
dc.description degree of Master of Science in Electrical and Electronic Engineering en_US
dc.description.abstract The challenge of coping with highly nonlinear and rapidly time-varying dynamics is a prevailing factor when designing controllers for next-generation Unmanned Aerial Vehicles (UAVs). Stochastic disturbances such as wind gusts and atmo- spheric turbulence form the biggest challenge which the control structure must be capable of minimizing, while handling the errors in \dynamic modelling". This work presents an online adaptive controller for active disturbance rejection in a xed wing UAV using reinforcement learning. The approach is based on modelling the UAV system dynamics as a two player zero-sum di erential game against nature, which will represent external disturbances a ecting the UAV such as wind. Then an online learning algorithm using reinforcement learning is devel- oped to solve the continuous-time two-player di erential game. Game theoretic methods together with SARSA, a reinforcement learning technique were used to calculate a cost function for each state action pair. A one step gradient search of the cost function was done which was implemented as the reinforcement signal in the di erential game. Back propagation technique was used to update the feed forward neural network weights in real time to compensate for the tracking errors in the heading from a commanded reference for each time step. The simulation tests carried out under various disturbances in MATLAB and X- Plane, showed satisfactory performance of the proposed method to eliminate the disturbances and maintain the UAV in the desired target path. The responses got were compared with responses from of a well tuned PID controller both in MATLAB and X-Plane platforms. The adaptive method responses were better. en_US
dc.description.sponsorship Prof. Samuel Kang'ethe, PhD JKUAT, Kenya Dr. Peter Kihato, PhD JKUAT, Kenya en_US
dc.language.iso en en_US
dc.publisher JKUAT-COETEC en_US
dc.subject Active Disturbance en_US
dc.subject Online Adaptive Controller en_US
dc.subject Design en_US
dc.subject UAV en_US
dc.subject Reinforcement Learning en_US
dc.title DESIGN OF AN ONLINE ADAPTIVE CONTROLLER FOR ACTIVE DISTURBANCE REJECTION IN A FIXED WING UAV USING REINFORCEMENT LEARNING AND DIFFERENTIAL GAMES en_US
dc.type Thesis en_US


Files in this item

This item appears in the following Collection(s)

Show simple item record

Search DSpace


Browse

My Account