Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pad_token_id question #59

Open
jwang-580 opened this issue Oct 1, 2024 · 0 comments
Open

pad_token_id question #59

jwang-580 opened this issue Oct 1, 2024 · 0 comments

Comments

@jwang-580
Copy link

position_gene_ids, _ = gatherData(data_gene_ids, value_labels, pretrainconfig['pad_token_id'])

I notice the pad_token_id is 103 in model_config. Would it conflict with the gene with the index of 103, when getting the gene name (or position) embedding? Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant