Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support IPA-based refiner #28

Open
wants to merge 12 commits into
base: rgn2_and_subprojects
Choose a base branch
from

Conversation

hushuangwei
Copy link

What?

Instead of En-transformer refiner, IPA (https://github.com/lucidrains/invariant-point-attention) refiner has been integrated.

Why?

To see the effectiveness of different experiments. IPA has lied in the core of AF2 structure module. It is worthy to give a try.

How?

Simply follow existing RGN2_transformer implementation. The difference is output of coordinates instead of angles. However, the compatibility of angles (used by losses) has been done via discrete Frenet-Serret equations.

Testing?

dRMSD can reach around 5. Experimental hyper-para's include "structure_module_depth" and other IPA parameters. Running script has been included.

Screenshots

At the moment the xtension branch of mp_nerf repo has been integrated via source code. Some functions (e.g. mp_nerf.ml_utils.backbone_forcefield()) has not been implemented. Not a big deal. I leave it for further improvement.

Anything Else?

Integrate LSTM output of 4 angles has been discussed but not implemented. LSTM can give nice prediction of secondary structures. Worthy to give a trial.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant