NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.

[sunyclj]

环境：
accelerate 0.34.2
aiohappyeyeballs 2.4.2
aiohttp 3.10.8
aiosignal 1.3.1
annotated-types 0.7.0
anyio 4.6.0
async-timeout 4.0.3
attrs 24.2.0
av 13.0.0
certifi 2024.8.30
charset-normalizer 3.3.2
click 8.1.7
datasets 2.16.1
decord 0.6.0
deepspeed 0.14.2
dill 0.3.7
docker-pycreds 0.4.0
docstring_parser 0.16
einops 0.6.1
exceptiongroup 1.2.2
fastapi 0.115.0
filelock 3.16.1
flash-attn 2.6.3
frozenlist 1.4.1
fsspec 2023.10.0
ftfy 6.2.3
gitdb 4.0.11
GitPython 3.1.43
gradio_client 0.2.9
h11 0.14.0
hf_transfer 0.1.8
hjson 3.1.0
httpcore 1.0.5
httpx 0.27.2
huggingface-hub 0.25.1
idna 3.10
Jinja2 3.1.4
llava 1.7.0.dev0
markdown-it-py 3.0.0
MarkupSafe 2.1.5
mdurl 0.1.2
mpmath 1.3.0
multidict 6.1.0
multiprocess 0.70.15
networkx 3.3
ninja 1.11.1.1
numpy 1.26.1
nvidia-cublas-cu12 12.1.3.1
nvidia-cuda-cupti-cu12 12.1.105
nvidia-cuda-nvrtc-cu12 12.1.105
nvidia-cuda-runtime-cu12 12.1.105
nvidia-cudnn-cu12 9.1.0.70
nvidia-cufft-cu12 11.0.2.54
nvidia-curand-cu12 10.3.2.106
nvidia-cusolver-cu12 11.4.5.107
nvidia-cusparse-cu12 12.1.0.106
nvidia-nccl-cu12 2.20.5
nvidia-nvjitlink-cu12 12.6.68
nvidia-nvtx-cu12 12.1.105
open_clip_torch 2.26.1
opencv-python 4.10.0.84
packaging 24.1
pandas 2.2.3
peft 0.4.0
pillow 10.4.0
pip 24.2
platformdirs 4.3.6
protobuf 5.28.2
psutil 6.0.0
py-cpuinfo 9.0.0
pyarrow 17.0.0
pyarrow-hotfix 0.6
pydantic 1.10.8
pydantic_core 2.23.4
Pygments 2.18.0
pynvml 11.5.3
python-dateutil 2.9.0.post0
pytz 2024.2
PyYAML 6.0.2
regex 2024.9.11
requests 2.32.3
rich 13.8.1
safetensors 0.4.5
scipy 1.14.1
sentencepiece 0.2.0
sentry-sdk 2.14.0
setproctitle 1.3.3
setuptools 75.1.0
shtab 1.7.1
six 1.16.0
smmap 5.0.1
sniffio 1.3.1
starlette 0.38.6
sympy 1.13.3
timm 1.0.9
tokenizers 0.15.2
torch 2.4.1
torchvision 0.19.1
tqdm 4.66.5
transformers 4.39.3
triton 3.0.0
typing_extensions 4.12.2
tyro 0.8.11
tzdata 2024.2
urllib3 1.26.20
uvicorn 0.31.0
wandb 0.18.2
wcwidth 0.2.13
websockets 13.1
wheel 0.44.0
xxhash 3.5.0
yarl 1.13.1
加载模型语句：
tokenizer, model, image_processor, max_length = load_pretrained_model(pretrained, None, model_name, device_map=device_map)
其中pretrained=./ocr/llama3-llava-next-8b