Novel method for using Q-learning in small microcontrollers

Samantha Jacobs, Fernando Rios-Gutierrez

Research output: Contribution to book or proceedingConference articlepeer-review

2 Scopus citations

Abstract

A novel method for the utilizations of the Q-learning algorithm for small robot navigation is presented in this paper. The Q-learning algorithm usually requires a large amount of memory for its implementation. In this paper a novel method for implementing the Q-learning algorithm is proposed in order to reduce the amount of memory required. The benefit of using less memory is so that the algorithm can be implemented in systems with reduced amount of memory available, such as small mobile robots or robots that need a large size of memory devoted to other applications besides navigation. The Q-learning algorithm generates a map of the surrounding area by using inputs to sensors attached to the robot. The Q-learning algorithm developed makes a map of a static surrounding, the algorithm was developed using a BASIC Stamp.

Original languageEnglish
Title of host publicationProceedings of the 51st ACM Southeast Conference, ACMSE 2013
DOIs
StatePublished - 2013
Event51st ACM Southeast Conference, ACMSE 2013 - Savannah, GA, United States
Duration: Apr 4 2013Apr 6 2013

Publication series

NameProceedings of the Annual Southeast Conference

Conference

Conference51st ACM Southeast Conference, ACMSE 2013
Country/TerritoryUnited States
CitySavannah, GA
Period04/4/1304/6/13

Keywords

  • Algorithms
  • Memory optimization
  • Microprocessor applications
  • Q-learning

Fingerprint

Dive into the research topics of 'Novel method for using Q-learning in small microcontrollers'. Together they form a unique fingerprint.

Cite this