Reinforcement Learning and Artificial Intelligence (RLAI)
	RL Toolkit Development

The ambition of this page is to keep track of the development of the RLtoolkit. It contains the current status of each tool, including what tasks remain to be done. Tasks can be added, checked off, or put off for later versions.

---

RL toolkit tasks remaining for each tool (links are to development pages):
   

• Tile coding:
• Develop regression/progression tests
• Test python version
• Update lisp version
• Test lisp version
• Update c version
• Test c version
• Create version where python calls c
• Test python calling c version
• Do comparison timings between all versions
• Update external documentation
• Develop simple examples for users
• Develop visual tool for learning/teaching?
• G:
• Final check of external documentation
• Polish code
• Try to get new window to be on top
• Try to get color picker to display without user clicking on icon
  
• Develop regression/progression tests
• Test on mac
• Test on linux
• Test on windows (?)
• Do comparison timings on different platforms?
• Develop examples for users
• RLinterface:
• Modify to use 2 functions for each of agent and env: start and step
  
• Develop regression/progression tests
• Develop simple examples for users
• Polish code
• Get timing information
• Try to increase efficiency
• Test
• Graph:
• Update external documentation
• Polish code
• Develop regression/progression tests
• Test
• Develop examples for users
• Graph3d:
• Develop external documentation
• Polish code
• Develop regression/progression tests
• Test
• Develop examples for users
• Eligibility Traces:
• Create external documentation
• Develop regression/progression tests
• Test
• Get timing information
• Polish code
• Develop examples for users
• Tabular Eligibility Traces:
• Develop version of eligibility traces for tabular case
• Create external documentation
• Develop regression/progression tests
• Test
• Get timing information
• Polish code
• Develop examples for users
• Simulation Window tool:
• Create external documentation
• Polish code
• Develop regression/progression tests
• Create simple examples for user
• Add timing/statistics functions?
  
• Test
• Gridworld Tool:
• Separate basic gridworld tools from demo
• Separate object gridworld demo from regular demo
• Separate agents into independent agents (available outside gridworld)
• Create external documentation
• Develop regression/progression tests
• Create simple examples for user
• Test nongui version
• Test GUI version
• Get timing information
• Add sound to demos
• Mountain Car Demo:
• Create external documentation
• Develop regression/progression tests
• Separate into tools and demo?
• Add menus to allow changes of epsilon, etc?
  
• Test
• Get timing information
• Show traces on GUI version?
• Function Approximation Demo:
• Separate function approximation tools from demo
• Create external documentation
• Develop regression/progression tests
• Polish code
• Test
• Other function approximation representations and methods (besides tiles)