Syncing Send Video and Send Audio in meeting SDK

[donte.zoom (Donte)]

Great question, @purnam-admin! Handling synchronized audio and video data is complex. There’s no one-size-fits-all solution. I suggest using a tool like GStreamer to handle the synchronization of video and audio as mentioned in the post linked below. Please refer to these forum posts on this topic.

Zoom Meeting SDK Headless Bot in Linux - Audio starts ahead of time than video

Hey @chriswuyiming , To ensure audio and video are always in sync, a common solution is to use something like GStreamer. It’s definitely possible to handle the offset yourself and process the media separately, but using GStreamer you can process the media in parallel and ensure it’s always in sync. We actually run meeting bots at scale and leverage GStreamer ourselves, so feel free to let me know if you have any specific questions! Alternatively, if you’re looking for a simple API to interfac…

Lengths of recorded radio and video are not the same, and out of sync while merging them together

@chriswuyiming, we’ve seen GStreamer be more effective when dealing with more complicated real-time audio/video pipelines, especially those that require dynamic reconfiguration at runtime. You’d be able to accomplish this with GStreamer with a pipeline containing two appsrc to ingest the raw audio and video, videorate and videoscale to normalize the framerate and size of the incoming video, audiorate to normalize the sample rate of the audio and x264enc and voaacenc to encode the video (h264) a…