Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change model call default arg values to None instead of bool vals #1218

Merged
merged 3 commits into from
Nov 1, 2023

Conversation

oliverholworthy
Copy link
Member

This fixes an issue with model saving where the concrete function cannot be matched correctly

Fixes #1217

Goals ⚽

Enable transformer-based retrieval models can be saved an reloaded multiple times across different processes

Implementation Details 🚧

When saving and reloading and then saving a model again in a different python process, we encounder some issues with the optional arguments to the call method of the model.

Chaning these to None instead of the boolean default value of False seems to avoid the error.

Testing Details 🔍

Tested reload and save of model from gist in #1217

This fixes an issue with model saving where the concrete function
cannot be matched correctly
@oliverholworthy oliverholworthy added the bug Something isn't working label Oct 17, 2023
@oliverholworthy oliverholworthy self-assigned this Oct 17, 2023
@github-actions
Copy link

Documentation preview

https://nvidia-merlin.github.io/models/review/pr-1218

@rnyak rnyak requested a review from sararb October 17, 2023 13:09
@rnyak rnyak self-requested a review October 24, 2023 16:10
@rnyak rnyak merged commit fcc55c2 into NVIDIA-Merlin:main Nov 1, 2023
40 of 42 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Getting error when serving a reloaded session-based model on Triton
2 participants