Description
Hello guys, i’m implementing a bot in a RocketChat server that communicates with a local LLM.
As you know one of the feature of almost all LLMs is the real time streaming of messages making it look like it’s actually writing in real time.
I’m trying to implement that in RocketChat using the existing APIs but i couldn’t find what i’m looking for. I also tried checking RealTime APIs.
The only option i found that it could maybe work is constantly updating the message using:
https://developer.rocket.chat/apidocs/update-livechat-message
Do you have any advice on how could i implement what i’m looking for?
Thanks all