@mubsi@nilosreesengupta@elirod@Passos Hi, I am trying to create my Gradio Chatbot App in HF Spaces. However, I am encountering the below error (I tried both Falcon 40B and 7B model and used use_safetensors=True, etc as parameters)
ValueError: The current device_map had weights offloaded to the disk. Please provide an offload_folder for them. Alternatively, make sure you have safetensors installed if the model you are using offers the weights in this format.
I guess the reasons for the error are Spaces does not provide disk space to offload weights and the Falcon weights are not available as Safetensors.
Appreciate if you can kindly guide me how can I overcome this issue.
Finally I could overcome the above referred value error by using offload_folder and trust_remote_code in model initiation (I was earlier using offload_folder wrongly in pipeline object). However, now I encounter a new problem shown below.
No. I did not try again. I guess Falcon has now fully integrated its models with Huggingface and they work well with latest transformers version. I need to try again. Thank you.
