Reinforcement Learning and
Artificial
Intelligence (RLAI)
Tile
coding development page
The ambition of this
page is to provide the development versions of the various
implementations and reference manual for tiles, and to be a place to
discuss development issues for tiles.
Issues:
Testing code to ensure that the tiles code works correctly
Timing comparisons between the python, lisp and c versions, as
well as a version where python calls c
Maybe a visual learning interface for tiles? (like the fa demo)
Tasks:
Develop regression/progression tests
Test python version
Update lisp version
Test lisp version
Update c version
Test c version
Create version where python calls c
Test python calling c version
Do comparison timings between all versions
Update external documentation
Develop simple examples for users
Develop visual tool for learning/teaching?
The latest version has been uploaded on the main Tiles page January 25,
2005.
Further issues:
The fancytiles routines - are the calling sequences for these
appropriate? Are the transformations correct? Are these routines useful?
The tilesdemo - is this visual tool useful? How can it be
improved?
Is there a better way to test correctness than using the
tilesdemo?
The timing shows that the load versions of the Python->C tiles
code are very slow. Can this be improved?