I am trying to work on a utility for Zoom meetings, that can access Meeting stream data(more specifically audio stream and transcript) and summarise the meeting notes from the meeting transcript/audio and provide it to the participants.
I have seen that the audio data is not accessible if participants have not enabled recording.
I have 2 questions from forum:-
Is there a way to enable me to create an App/Integration/Connector in zoom that can listen to meeting audio data without having to record it, if user have added my app into their meeting? If not then atleast prompt user to start the recording as when they add it to the meeting. And have my app access to meeting stream data for further processing.
What is the best Zoom developer integration to create such app for this use case that will work across Zoom meetings? Zendesk Market place? Zendesk SDKs?
Thanks for reaching out to the Zoom Developer Forum and welcome to our community, I am happy to help here!
Unfortunately, there is no other way to get meeting audio data without recording the meeting.
And the expected behavior is that when you start recording a meeting, a message will be prompted to all participants about the meeting being recorded.
Regarding your second question, if you want this app to only join meetings to record them, you could work with an OAuth app. Feel free to navigate to our Zoom Marketplace where you will find all the different app types available:
This looks like creating a zoom market place app which opens inside zoom client while we are in meeting.
I am looking into that already. I see that the app uses zoomAppSdk to interact with zoom client.
But zoom app sdk has very limited support, For e.g.
Can these Requirements be met using the Zoom Oauth App?
I want to post chat message to the chat using zoomApp SDK is there a way to do that?
Also want to show a bot as a participant for my App.
I want my app to be started by default if the user has joined a meeting, is this possible using Zoom App framework/sdk?
I know that host is the only person that can allow cloud Recordings, but if any participant wants to use my app to start the recording can this be done in a better way using Zoom App framework? Rather than asking for the permission to allow recording, if i dont have recording permission then App can send a prompt to the host in meeting to grant it?
Let me know if these question are confusing, would be happy to explain more.
Hi @kwaku.nyante ,
You mentioned meeting bots using meeting SDK, from what i understood meeting sdk has platform dependency(mac, windows, etc) Is there a way around that? I dont want to develop a separate app for mac and windows to achieve this.
I have a Zoom App which is hosted on my servers(A web app) which is using ZoomAppSDK and can be opened in zoom client.
@nishaantshrm76 , you can access the audio stream and transcript via a meeting bot as you mentioned. You don’t need to develop a separate app for Mac and Windows because the bot would not installed on your user’s local machine.
Happy to break it down how to do it. To build a meeting bot:
Spin up a server. We recommend AWS, GCP, or Digital Ocean.
Use either the Windows or Mac Zoom SDK to launch an instance of the Zoom client.
Once you have the Zoom SDK launched, and use the Raw Data functionality to extract the video and audio streams.
This will return the video in I420 raw frames and audio in PCM 16LE raw format, so you’ll need to encode the audio and video yourself afterwards.
Once you have one instance of this working, you’ll need to scale this across several servers if you want to run multiple bots simultaneously, which is required to have bots for multiple meetings.
Another option is Recall.ai. It’s a simple 3rd party API that lets you use meeting bots to get the raw audio/video from meetings + output video/audio without you needing to spend months to build, scale and maintain these bots.