How to receive meeting audio in a third-party Zoom App (side panel) for live transcription / AI

Realtime Media Streams
1

Hi all,

I’m building an in-client Zoom App that runs as a side panel during
regular Zoom Meetings. It’s an AI assistant for the meeting host
(specifically: hiring interviewers). The side panel shows live
question suggestions and a rubric scored against the meeting transcript.

Stack:

  • Zoom Apps SDK (in-client surface, host only)
  • Server-side: Node.js + Deepgram for transcription + Anthropic Claude
    for question suggestions / scoring
  • App ID: EFJql3TVRgOWnNQx_fHnOA (user-managed, currently in dev)

Question: what’s the current path for a third-party Zoom App to access
meeting audio in real time?

What I’ve ruled out / am unsure about:

  • “RTMS” came up but appears to be Zoom Contact Center specific (admins
    assign to queues). My app is not for Contact Center — regular Meetings.
  • Zoom Developer Support pointed me at a “Meetings-specific real-time
    media / audio access feature” but said it’s a limited program/beta
    and they couldn’t tell me where to apply.
  • Zoom Apps SDK getUserMedia inside the side panel iframe captures only
    the host’s local mic, not other participants.

If the answer is “you need to use Meeting SDK as a bot participant” or
“this capability is not available to third-party Zoom Apps,” I’d love to
know that definitively so I can architect accordingly. If there IS a
beta program for Meetings RTMS / in-client audio access, where do I
apply?

Thanks!
Peter

2

@pallgood here are some sample of how to get RTMS in Zoom Meeting, and thereafter sending it to external transcription and translation services. rtms-samples/audio at main · zoom/rtms-samples · GitHub