Passing Bulk text data to OpenAI

Passing Bulk text data to OpenAI, I have been passing bulk reviews data to OPENAI API requests it throws an error out of tokens size, when i try for smaller length i get the response but when i try for bulk data it doesnt seems to respond throws an error, i tried handling this by sending the reviews in smaller chunks still error

Anybody could suggest how to pass bulk data to AI Context(- I have a product reviews which is bulk and i want to generate insights out of it, works for smalller chunks not for all)

The langchain course we have here is helpful towards that, check it out, its the first langchain course as far as I remember.

1 Like