Is it possible to implement a ChatGPT like streaming of messages on RocketChat?

Community Support
1

Description

Hello guys, i’m implementing a bot in a RocketChat server that communicates with a local LLM.
As you know one of the feature of almost all LLMs is the real time streaming of messages making it look like it’s actually writing in real time.
I’m trying to implement that in RocketChat using the existing APIs but i couldn’t find what i’m looking for. I also tried checking RealTime APIs.

The only option i found that it could maybe work is constantly updating the message using:
https://developer.rocket.chat/apidocs/update-livechat-message

Do you have any advice on how could i implement what i’m looking for?

Thanks all

2

I’d go to open.rocket.chat and look for

#Open-Source-AI-Club

Also several GSoC projects in Rocket.Chat github.

3

Thank you reetp, i’ll also try post there.

If someone else have other ideas please write it down.