Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there currently an elegant way of adding an RNN or LSTM to an agent? #112

Open
chokosabe opened this issue Sep 5, 2020 · 3 comments
Open
Labels
question Further information is requested

Comments

@chokosabe
Copy link

Looking at custom networks and LSTMs and RNNs in particulat. It isn't very clear how these might be added to an agent.

It may just be a case of additions being made to the docs.

@christianhidber christianhidber added the question Further information is requested label Sep 6, 2020
@christianhidber
Copy link
Owner

christianhidber commented Sep 6, 2020

Actually we were contemplating about an extension to EasyAgents where you could easily provide an "arbitrary" nn, eg defined in keras or so. However it wasn't obvious to us how this might be done in an elegant fashion while still supporting all the rl libraries EasyAgents sits on top of (see also #25 ). So currently we only support fully connected networks. Did you try to integrate rnns or lstms ? In our uses cases so far the fully connected architecture was sufficient. Do you have a real life uses case which benefits from LSTMs or RNNs ? We are always very grateful for new, concrete applications.

@chokosabe
Copy link
Author

Thanks for the reply. For a real life use case I was thinking about about some language/text and time series problems (where there are a few LSTM papers claiming performance). Haven't tried to integrate any with easyagents so far but very impressed with all the work on it so far, prob the easiest library out there for this.

@christianhidber
Copy link
Owner

:-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants