Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model: "Sequential RNN with attention" SNLI-based models #8

Open
pasky opened this issue Feb 27, 2016 · 0 comments
Open

Model: "Sequential RNN with attention" SNLI-based models #8

pasky opened this issue Feb 27, 2016 · 0 comments

Comments

@pasky
Copy link
Member

pasky commented Feb 27, 2016

For the SNLI task, models

are doing well. The basic idea is that we have two RNNs for the two sentences, but the second one is initialized by the output of the first one. Plus there is one-direction attention.

The models seem to be pretty incremental tweaks of each other, so it would be probably easiest to implement this as a single model with configurable features. Not sure how to coerce Keras to perform the initialization of the second RNN, though, might require Keras modifications.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant