Hey @chriswuyiming ,
To ensure audio and video are always in sync, a common solution is to use something like GStreamer. It’s definitely possible to handle the offset yourself and process the media separately, but using GStreamer you can process the media in parallel and ensure it’s always in sync.
We actually run meeting bots at scale and leverage GStreamer ourselves, so feel free to let me know if you have any specific questions!
Alternatively, if you’re looking for a simple API to interface with the underlying audio/video streams, one other option would be to use Recall.ai for your meeting bots instead. It’s a simple 3rd party API that lets you use meeting bots to get raw audio/video from meetings without you needing to spend months to build, scale and maintain these bots.