I noticed that the LiveChat widget is only about Clients talking to the Users.
I want to know if its possible to integrate the ability of existing users to communicate with each other through a third party website.
Absolutely! Lots of people do this. Here is one way:
https://rocket.chat/docs/developer-guides/embedded-layout/#embedded-layout