Description
We have webhooks for meeting start, participant joined, participant left, meeting end that are severely delayed by at least 30 minutes.
Delays seemed to start this morning around 9:30am EST.
Please investigate our app and let us know if there is anything we can do on our end.
Thanks.
Error
severely delayed webhooks
Which App Type (OAuth / Chatbot / JWT / Webhook)?
user-managed oauth app
we are monitoring leave_time for participant left and start_time for participant joined. start_time for meeting start and end_time for meeting end. they are delayed by about 30 minutes.
we do not see any service status issues posted at status.zoom.us. Wondering if our webhook notifications may be delayed by some kind of rate limits? Thank you for any information you can provide
we see that there is a degraded performance status now.
could this status category be related to webhooks being delayed?
our webhooks appear to be working at normal speed again as of 2pm EST
webhooks are starting to be delayed again today. started noticing delays again around 10am EST
I am also seeing delays/participants missed with the dashboard APIs and even in the dashboard of the admin panel since around 14:00 utc.
@Richard21 at least for us, we are working on a polling solution as a stop-gap for unreliable webhooks. see my related follow-up post: Looking for API Endpoint to toggle on/off webhooks
Hey @taylor.hurt, @Richard21,
Apologies for the webhook delays.
Please stay updated on status.zoom.us, we are working to resolve as fast as possible.
Thanks,
Tommy
So, one month and a half later after this ticket, looks like this webhook delay thing is still around.
We are experiencing the same issue with the “participant/host left meeting” webhook which seems to be triggered in a completely unpredictable way, sometimes almost immediately, sometimes after a few minutes, sometimes a few hours, sometimes … never.
On the other hand, the “Participant/Host joined meeting” webhook is almost always triggered immediately. Which makes things event more weird.
Of course, everything is all green on the status.zoom.us page.
Apparently, there are tickets about this issue all the way down to march… Do we have hope it will be resolved one day ?
Hey @JP.Vgl,
Sorry to hear you are having issues with webhooks.
If you send the meetingIDs that had the webhook issues to developersupport@zoom.us we can help investigate the issue.
Also, make sure you are sending a 200 OK response back after receiving a webhook.
Thanks,
Tommy
We are seeing the same thing. Webhooks are often being delayed. Sometimes they don’t arrive at all.
I can post an example today.
We received meeting.started for meeting uuid PC4NnHyWS+uwZs32v2YHYQ==\ at 2020-07-07 15:03:00 UTC
Few minutes later we receive recording.started for the same meeting. Webhook was received at 2020-07-07 15:08:26 UTC
However recording is set to start automatically with the meeting and in this case we saw the recording indicator on but received the webhook 5 minutes later.
I agree with the post above. We receive webhooks a few hours late sometimes. It’s completely unpredictable and unreliable.
Hey @veselin.kulov,
Can you confirm you are sending back a 200 OK response after receiving the webhooks? If not, it could cause delays.
Thanks,
Tommy
I can confirm that we respond with 204 No Content to all webhooks.
Hey @tommy,
Could you please check a meeting for us “f3oNcM40TvWAKQ+23TISXg==”
We didn’t receive the recording.started webhook again. Can you please check if the meeting actually recorded? Do you see the webhook being sent on your end?
Thanks!
Hey @veselin.kulov,
Our engineering team is looking into this. (ZOOM-177897) I will get back to you with updates.
Thanks,
Tommy
Hey @veselin.kulov,
After looking at the logs, the meeting started at 2020-07-08 19:00:25(GMT), and the meeting didn’t ever start recording, so there wasn’t a meeting recoding started event webhook.
Thanks,
Tommy
Thanks for confirming that. It’s very hard to track these issues. We talked to the client and they claim that recording was on and that recording is configured to start automatically for all their meetings.
Hey @veselin.kulov,
From our end we see the recording was never started, so maybe they changed their settings for the meeting. Let us know if you see this issue happen again and we will look into it. 
Thanks,
Tommy
Hey @tommy,
We are also seeing significant delays in our webhooks being fired, specifically for meeting.registration_created, which just took over 7 minutes to fire.
https://marketplace.zoom.us/apps/vE2apLsvS5qt7slbdxmhNQ/
Please let me know if you need more information to debug!
Thank you,
Nicholai
Hey @neecholai,
Can you confirm you are sending back a 200 OK response when you receive a webhook?
Thanks,
Tommy
