Zoom Meeting SDK get live transcription of each user during meeting. JavaScript/Electron.js

Meeting SDK
, , ,
1

Format Your New Topic as Follows:

My Meeting SDK version is: “@zoom/meetingsdk”: “^3.9.0”,

Description
I want to get zoom meeting live transcription of each user, and use these speech-to-text for further analysis. I am using Electron.js for my app, for now I was able to join existing Zoom meeting using Zoom Meeting SDK but I did not find any information on how to get live transcription of users using Zoom Meeting SDK.
I am using Electron.js, but I am reading documentation for Zoom Meeting SDK for Web.

Error?
I tried to use Zoom Video SDK’s getLiveTranscription but it is not what I need. I don’t want to create my own video conference system, I just want to retrieve audio/speech-to-text from regular zoom meetings.

2

Hi @muratbaktur,

The problem here is that the Zoom Meeting SDK for Web doesn’t let you access live transcriptions or raw audio streams directly, which is why you’re stuck. Unfortunately, the Zoom Video SDK isn’t the right fit either since it’s meant for building custom video conferencing apps, not for interacting with standard Zoom meetings.

Here are some options you might consider:

Switch to the Zoom Meeting SDK for Windows or Linux:
These versions of the SDK allow you to access raw audio data from meetings. You can capture the audio stream and use a speech-to-text service like AWS Transcribe to get live transcriptions. Here’s an example Github repo that demonstrates how to access raw video and audio through the Linux Meeting SDK.

Many third-party transcription providers support streaming speech to text, so once you have the raw audio, you can stream it to the provider to receive real-time transcription.

Recall.ai
Another alternative is to use Recall.ai instead. It’s a simple 3rd party API that lets you use meeting bots to get raw audio/video from meetings and generate real-time transcripts in just a few lines of code. This will avoid the challenges associated with scaling your infrastructure to handle multiple large-scale meetings.

3

Hi @amanda-recallai ,

Thank you for your answer! I did not know about that. Can you please send/give the example GitHub repo that demonstrates it?

4

Absolutely! Here’s the example Github repo that I mentioned previously: GitHub - zoom/meetingsdk-linux-raw-recording-sample