address the error ValueError: The device map has weights saved to the folder. Please specify the folder location or provide additional information.
发布时间
阅读量:
阅读量
大模型部署ChatGLM3-6B时遇见报错:
ValueError: The device_map encountered an error message indicating that its weights have been moved to disk storage. To resolve this issue, please specify the offload_folder where they should be retrieved from. Additionally, ensure that you have installed safetensors if your model's weights are in safetensors format.
ValueError occurred: The device_map currently has model parameters moved from the disk. To resolve this issue, please ensure that an offload_folder is provided for these parameters. Additionally, verify that your model includes safetensors instal
全部评论 (0)
还没有任何评论哟~
