Getting real-time (or recorded) video of each participant in a meeting

API and Webhooks
, ,
1

Hi everyone,

I am trying to access the video of each participant in a zoom meeting. I am currently developing a machine-learning algorithm to do a sentimental analysis of the class by their facial expressions.

Is it possible to get the video of each participant by Zoom API or SDK.?

If it is possible to get it in real-time, it would be better; if not, a recorded video of each individual would also be great.

Thanks guys!!

2

Hi @alvaromila9 , you can try using our native (macOS, iOS, Android, Windows) Meeting or Video SDKs raw data capabilities to capture this behavior.

Check out this thread and our docs for Meeting SDK across the client types it’s available for.

Here are the docs for Video SDK for iOS, but t’s also available for MacOS, Windows and Android: https://marketplace.zoom.us/docs/sdk/video/ios/advanced/raw-data/

Thank you!

3

@alvaromila9, you can access the video of each participant in a meeting with a bot.

If you’re using the Zoom Raw Data SDK, these are the steps:

  1. Spin up a server. We recommend AWS, GCP, or Digital Ocean.
  2. Use either the Windows or Mac Zoom SDK to launch an instance of the Zoom client.
  3. Once you have the Zoom SDK launched, and use the Raw Data functionality to extract the video and audio streams.
  4. This will return the video in I420 raw frames and audio in PCM 16LE raw format, so you’ll need to encode the audio and video yourself afterwards.
  5. Once you have one instance of this working, you’ll need to scale this across several servers if you want to run multiple bots simultaneously, which is required to have bots for multiple meetings.

Finally, another option is Recall.ai. It’s a simple 3rd party API that lets you use meeting bots to get raw audio/video from meetings without you needing to spend months to build, scale and maintain these bots.

Let me know if you have any questions!

1 Like
4

Thank you for your quick response, Amanda!
I will try it!

5

Thank you, Gianni!
I will definitely try it!

6

Thank you @amanda-recallai for your contributions to the Zoom Developer community!

7

@alvaromila9 dm me here so that we can discuss more. Thanks