RocketChat/Rocket.Chat.OpenAI.Completions.App: Rocket.Chat OpenAI ChatGPT Integration App (github.com)
This gpt bot returns a null after an api response timeout of more than 60 seconds, and I can’t seem to find a setting for that.
I have been having this problem after calling this bot to the gpt4 model because of slow generation, and after exporting the api response results I found that the api response was null.
This problem occurs whenever the response time is longer than 60 seconds, also in gpt3.5.
58 seconds to get a normal response, and 62 seconds to get an null response.