is it possible to create and integrate bot with existing zoom meeting that will interact with zoom with the help of openAI
when meeting is hoisted the bot automatically initialize
Hey @sourabh.patole, creating a bot that joins a Zoom meeting and leverages OpenAI to interact with participants is definitely possible!
To do this, you can:
- Spin up a server. We recommend AWS, GCP, or Digital Ocean.
- Use either the Linux Zoom SDK to launch an instance of the Zoom client.
- Once you have the Zoom SDK launched, and use the Raw Data functionality to extract the video and audio streams.
- This will return the audio in PCM 16LE raw format, so you’ll need to encode the audio, feed it to OpenAI, and then output the response through your bot using the SDK.
- At this point, you can automate this using Zoom webhooks to know when meetings are created to automatically spin up bots and have them join.
- Once you have one instance of this working, you’ll need to scale this across several servers if you want to run multiple bots simultaneously, which is required to have bots available to join multiple meetings.
If you don’t want to build and maintain this yourself, an alternative is to use Recall.ai instead.
It’s a simple 3rd party API that lets you use meeting bots to get raw audio/video from meetings without you needing to spend months to build, scale and maintain these bots.
We actually have a demo app that uses OpenAI to create a real-time AI voice agent that interacts with you on the call. GitHub - recallai/voice-agent-demo
Let me know if you have questions!