Continuous stream of output


Is there a way to get continuous stream of output similar to chatgpt UI from open ai module using flask api, it takes on an average 10 seconds through api to get the reply which is not good for user experience in a bigger project

That’s a good question.

I’ve been working with the API for several months now and I have not found a way to get an immediate response, like the one we get when using ChatGPT directly. I don’t think that’s an option currently.

Lets see if someone has another opinion on this.