Send video from the camera directly to backend

Video SDK
1

I want to get the video of the camera of the users and send it directly to my back-end to analyze the faces of the participants in the call, is that posible with some type of app in zoom? Thank u

2

Looking for similar solution for our mobile and web app.
I want to get the live video and run a ML modal and send the video back to same and different client.

Thanks!

3

@makkadsuhel11 @marcos1 there are a few ways you can capture the video streams of each participant in Zoom calls to run analysis on it. Here are the top 3 most common ways:

1. Use the Zoom live-streaming API

Pros:

  • Doesn’t require any 3rd party services

Cons:

  • Doesn’t get individual video streams per participant
  • Needs to be initiated by the end-user every meeting
  • You need to set up an RTMP server to receive the data, which requires engineering effort to deploy, scale, and monitor
  • Participants can get spooked by the “live” badge that appears in the meeting

2. Build a Zoom bot

Pros:

  • Can get the separate video streams per participant

Cons:

  • It is very heavy-weight as you would need to spin up multiple servers to run the Zoom client for the bot
  • Running infrastructure for a Zoom bot costs more than live streaming.
  • You need to encode the raw video and audio yourself

3. Use Recall.ai

It’s a unified API that lets you send meeting bots to video conferencing platforms to capture the audio and video in real-time.

Pros:

  • Can get the separate video streams per participant
  • Handles spinning up the servers, and providing the real-time raw audio/video so all you interact with is a simple API
  • Works agnostic of meeting platform

Cons:

  • It’s another 3rd party service in your stack

Let me know if you have any questions!