How much context data one can submit for prompt?

Short Course Q&A Building Systems with the ChatGPT API
1

Hi Folks,

In the course, we see that they submit the product data along with instructions and questions (Lesson: Chaining the Prompt and also during Evaluation). I was wondering about the limit on the size of prompt that can be submitted to GPT. I’ve read that it is around 4096 characters. If that is the case, then how would I feed it a longer products list to answer the questions from?

Thanks
ZeeKay

2

Yes there is a limit, its probably that one. One way I can think to overcome that is to use LangChain framework and there are some free courses in here about it, check them out!