model in ddp #5238
-
Hi, I have a general question (not specific to allennlp), in this case, can we make sure the two versions of model share the same parameters? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 9 replies
-
Yes, they share the same parameters since the |
Beta Was this translation helpful? Give feedback.
Yes, they share the same parameters since the
_pytorch_model
is just a thin wrapper around themodel
. In other words,_pytorch_model
just holds a (mutable) reference tomodel
, it doesn't clone the parameters.