How to get the conversation time of the person speaking and real-time transcription data

API and Webhooks
1

Hi!
I would like to get the conversation time of the person speaking and real-time transcription data, is there an API provided that I could use?
If you know of one, I would appreciate it if you could let me know.

2

@Takuya, unfortunately, there are no direct API endpoints to access the real-time transcript. However, here are 4 other ways you could explore to create a real-time transcript from a Zoom meeting.

1. Use the Zoom RTMP live-streaming API

Pros:

  • Doesn’t require any 3rd party services
  • Lighter weight than building and running a Zoom bot

Cons:

  • Needs to initiated on a per-meeting basis
  • You need to set up an RTMP server to receive the data, which requires engineering effort to deploy, scale, and monitor
  • Participants can get spooked by the “live” badge that appears in the meeting (even if it’s a privte meeting)
  • No speaker separation

2. Build a desktop app to capture users’ computer audio

Pros:

  • One of the most cost effective solutions

Cons:

  • You need to build a separate app for Windows, Mac and Linux
  • It is especially difficult to tap into computer audio on Mac
  • App runs on users’ computer so it can slow their computer down/make computer fans go off
  • No speaker separation

3. Build a Zoom bot

Pros:

  • Can get the separate audio streams per participant for perfect diarization / speaker labels

Cons:

  • It is very heavy-weight as you would need to spin up multiple servers to run the Zoom client for the bot
  • Running infrastructure for Zoom bot costs more than live streaming.
  • You need to encode the raw video and audio yourself

4. Use Recall.ai

It’s a unified API that lets you send meeting bots to video conferencing platforms to capture the audio,
video and transcription in real-time.

Pros:

  • Handles spinning up the servers, and providing the real-time raw audio/transcript so all you interact with is a simple API.
  • Works on any Zoom plan (including Free)
  • Gets speaker diarization / speaker labels
  • Works agnostic of meeting platform

Cons:

  • It’s another 3rd party service in your stack

Let me know if you have any questions!

3

@amanda-recallai It’s unfortunate that the API isn’t available, but I will try the alternative solutions you suggested one by one. Thank you for your response!

4

@Takuya , no problem! Let me know if you have any other questions - I’m happy to help.

1 Like
5

This topic was automatically closed 368 days after the last reply. New replies are no longer allowed.