Great course. really loved it. Thoroughly enjoyed building the apps.
Thank you for sharing these!
@mubsi @nilosreesengupta @elirod @Passos Hi, I am trying to create my Gradio Chatbot App in HF Spaces. However, I am encountering the below error (I tried both Falcon 40B and 7B model and used use_safetensors=True, etc as parameters)
ValueError: The current device_map
had weights offloaded to the disk. Please provide an offload_folder
for them. Alternatively, make sure you have safetensors
installed if the model you are using offers the weights in this format.
I guess the reasons for the error are Spaces does not provide disk space to offload weights and the Falcon weights are not available as Safetensors.
Appreciate if you can kindly guide me how can I overcome this issue.
Finally I could overcome the above referred value error by using
model initiation (I was earlier using
offload_folder wrongly in
pipeline object). However, now I encounter a new problem shown below.
Appreciate receiving any inputs to solve this error. It seems a memory constraint in spaces.
@vsrinivas Hey did you resolve this?
No. I did not try again. I guess Falcon has now fully integrated its models with Huggingface and they work well with latest transformers version. I need to try again. Thank you.