Great question, @purnam-admin ! Handling synchronized audio and video data is complex. There’s no one-size-fits-all solution. I suggest using a tool like GStreamer to handle the synchronization of video and audio as mentioned in the post linked below. Please refer to these forum posts on this topic.
Hey @chriswuyiming ,
To ensure audio and video are always in sync, a common solution is to use something like GStreamer . It’s definitely possible to handle the offset yourself and process the media separately, but using GStreamer you can process the media in parallel and ensure it’s always in sync.
We actually run meeting bots at scale and leverage GStreamer ourselves, so feel free to let me know if you have any specific questions!
Alternatively, if you’re looking for a simple API to interfac…
@chriswuyiming , we’ve seen GStreamer be more effective when dealing with more complicated real-time audio/video pipelines, especially those that require dynamic reconfiguration at runtime.
You’d be able to accomplish this with GStreamer with a pipeline containing two appsrc to ingest the raw audio and video, videorate and videoscale to normalize the framerate and size of the incoming video, audiorate to normalize the sample rate of the audio and x264enc and voaacenc to encode the video (h264) a…