Missing recording.started event

API and Webhooks
1

We have seen this happen a few times, but wanted to start to track it here.

Could you see on your end why it never got fired?
The below payload is from meeting started.

[Zoom] Webhook meeting.started {"event":"meeting.started","payload":{"account_id":"bQ2jaYAYSb-HwuqyJoQfIA","object":{"duration":90,"start_time":"2020-06-12T19:27:07Z","timezone":"America/New_York","topic":"zzz","id":"***********","type":2,"uuid":"eRE0sK+AQ2yldnNseLqj8g==","host_id":"1cNnhfjBS9uSv_xsOW237w"}}}

*This post has been edited to remove any meeting / webinar IDs

2

Hey @jimig,

Did you click cloud recording or local recording?

Thanks,
Tommy

3

Hey Tommy, this was cloud recording

4

Thanks @jimig,

Are you still experiencing this issue?

-Tommy

5

Hi, yes we are.

Customer said they paused and resumed the meeting, yet we do not have any record of the webhook incoming.

Here is some of the pause payload we did receive.

Give we have been reporting missing/delayed webhooks for over 6 months now, are there any alternative approaches we can use? Is there an API to poll for recording status?

6

Hey @jimig,

Thanks, we are looking into this. (ZOOM-178643)

I will get back to you with updates.

-Tommy

7

Hey @jimig,

According to our marketplace logs, the recording started event webhook was sent to your https://***/webhook/conference/provider/zoom endpoint successfully.

Thanks,
tommy

8

Hey @tommy,

Can you please post the exact timestamp you have on this from the marketplace logs so we can correspond it with our logs? We still don’t find it being received by our servers.

9

Hey @veselin.kulov,

Sure, 2020:07:14T15:01:08Z

Thanks,
Tommy

10

This must be a mistake @tommy as the meeting started at 2020-06-12T19:27:07Z

11

Based on our logs we received the recording.stopped at 2020-06-12 20:25:59 for meeting uuid “eRE0sK+AQ2yldnNseLqj8g==” but we never received the recording.started for same meeting.

12

Hey @veselin.kulov,

Strange, we will double check.

Thanks,
Tommy

13

Hey @veselin.kulov,

Do you have a more recent meetingUUID? That one is expired in our logs.

Thanks,
Tommy

14

Hey @tommy,

We found a more recent meeting that had a recording.started webhook missing.

Meeting id *********** / uuid lX/8GIT2S8KeNn5h8zBYHw==
We received at meeting.started [2020-08-13 15:02:07 UTC]
recording.paused at [2020-08-13 15:23:44 UTC]
recording.resumed at [2020-08-13 15:25:17 UTC]
recording.stopped at [2020-08-13 15:56:48 UTC]

Can you check if you sent a recording.started and maybe give us the timestamp of that webhook from your logs?

*This post has been edited to remove any meeting / webinar IDs

15

We keep missing recording.started webhooks. Any progress on this?
See meeting id *********** / uuid: DXQujTVWS+SbjL/lcmGJeg==
meeting id *********** / uuid: W/rBjHM6TmOiS5KE9lx81A==

This thread is going on for 3 moths now guys. Can we get a solution please?

*This post has been edited to remove any meeting / webinar IDs

16

Hi @tommy

We have more logs for you to show that webhooks are being delayed by 40 minutes. It’s a fresh log for 18 Aug.
Meeting ID: ***********
UUID: vT91JAlUTWW+k342XEbOBw==

“message”: "[2020-08-18 15:02:13] [Zoom] Webhook meeting.started {“event”:“meeting.started”,“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“duration”:60,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”,“topic”:“This is a calendar meeting”,“id”:“88902589497”,“type”:2,“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”}}} "

“message”: "[2020-08-18 15:32:58] [Zoom] Webhook meeting.ended {“event”:“meeting.ended”,“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“duration”:60,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”,“end_time”:“2020-08-18T15:32:50Z”,“topic”:“This is a calendar meeting”,“id”:“88902589497”,“type”:2,“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”}}} "

“message”: “[2020-08-18 15:38:49] [Zoom] Webhook meeting.sharing_started {“event”:“meeting.sharing_started”,“payload”:{“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“user_id”:“16778240”,“user_name”:“Tom Lavery”,“sharing_details”:{“link_source”:”",“file_link”:"",“source”:"",“date_time”:“2020-08-18T15:14:56Z”,“content”:“desktop”}},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”},“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”}} "

“message”: “[2020-08-18 15:42:16] [Zoom] Webhook recording.started {“event”:“recording.started”,“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“id”:***********,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“topic”:“This is a calendar meeting”,“type”:2,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”,“duration”:60,“recording_file”:{“recording_start”:“2020-08-18T15:01:10Z”,“recording_end”:”"}}}} "

“message”: "[2020-08-18 15:44:56] [Zoom] Webhook meeting.participant_joined {“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“user_id”:“16778240”,“user_name”:“Tom Lavery”,“id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“join_time”:“2020-08-18T15:01:09Z”},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”}},“event”:“meeting.participant_joined”} "

“message”: “[2020-08-18 15:46:09] [Zoom] Webhook meeting.participant_joined {“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“user_id”:“33555456”,“user_name”:“ascott”,“id”:”",“join_time”:“2020-08-18T15:01:50Z”},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”}},“event”:“meeting.participant_joined”} "

“message”: “[2020-08-18 16:09:39] [Zoom] Webhook meeting.sharing_started {“event”:“meeting.sharing_started”,“payload”:{“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“user_id”:“16778240”,“user_name”:“Tom Lavery”,“sharing_details”:{“link_source”:”",“file_link”:"",“source”:"",“date_time”:“2020-08-18T15:12:13Z”,“content”:“desktop”}},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”},“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”}} "

“message”: “[2020-08-18 16:10:59] [Zoom] Webhook meeting.sharing_ended {“event”:“meeting.sharing_ended”,“payload”:{“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“user_id”:“16778240”,“user_name”:“Tom Lavery”,“sharing_details”:{“link_source”:”",“file_link”:"",“source”:"",“date_time”:“2020-08-18T15:13:07Z”,“content”:“desktop”}},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”},“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”}} "

“message”: “[2020-08-18 16:20:27] [Zoom] Webhook meeting.sharing_ended {“event”:“meeting.sharing_ended”,“payload”:{“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“user_id”:“16778240”,“user_name”:“Tom Lavery”,“sharing_details”:{“link_source”:”",“file_link”:"",“source”:"",“date_time”:“2020-08-18T15:18:51Z”,“content”:“desktop”}},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”},“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”}} "

“message”: “[2020-08-18 16:27:23] [Zoom] Webhook meeting.sharing_ended {“event”:“meeting.sharing_ended”,“payload”:{“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“user_id”:“16778240”,“user_name”:“Tom Lavery”,“sharing_details”:{“link_source”:”",“file_link”:"",“source”:"",“date_time”:“2020-08-18T15:22:19Z”,“content”:“desktop”}},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”},“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”}} "

“message”: "[2020-08-18 16:39:37] [Zoom] Webhook meeting.participant_left {“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“leave_time”:“2020-08-18T15:32:50Z”,“user_id”:“16778240”,“user_name”:“Tom Lavery”,“id”:“1fdj-Wn4Q7avbyg52ddQ0w”},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”}},“event”:“meeting.participant_left”} "

“message”: "[2020-08-18 16:40:13] [Zoom] Webhook meeting.participant_left {“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“participant”:{“leave_time”:“2020-08-18T15:32:51Z”,“user_id”:“33555456”,“user_name”:“ascott”},“id”:“88902589497”,“type”:2,“topic”:“This is a calendar meeting”,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“duration”:32,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”}},“event”:“meeting.participant_left”} "

“message”: "[2020-08-18 16:40:58] [Zoom] Webhook recording.stopped {“event”:“recording.stopped”,“payload”:{“account_id”:“SG7cyaTzRoqSEyRnb4Djeg”,“object”:{“uuid”:“vT91JAlUTWW+k342XEbOBw==”,“id”:***********,“host_id”:“1fdj-Wn4Q7avbyg52ddQ0w”,“topic”:“This is a calendar meeting”,“type”:2,“start_time”:“2020-08-18T15:01:09Z”,“timezone”:“America/New_York”,“duration”:32,“recording_file”:{“recording_start”:“2020-08-18T15:01:10Z”,“recording_end”:“2020-08-18T15:32:50Z”}}}} "

*This post has been edited to remove any meeting / webinar IDs

17

Hey @veselin.kulov,

Thanks for the additional data. We are continuing to investigate the issue. I will provide you with an update as soon as I have one.

As for the webhook delays, we are also in progress of fixing that issue. (ZOOM-178685)

-Tommy

18

Hey @veselin.kulov,

Are you still seeing long webhook delays? We have made some improvements to the webhook performance.

Thanks,
Tommy

19

Hi @tommy,

We are now tracking the delays in zoom webhooks. Here’s our result for yesterday 22 Sept.

Screenshot 2020-09-23 at 18.26.56
Screenshot 2020-09-23 at 18.26.561810×684 61.3 KB

The graph measures the time difference between timestamp in event payload and actual time our web server received the webhook. It measures that in seconds. The time zone is UTC+3.

You can see there was about 26 minute delay at its peak.

20

Hey @veselin.kulov,

Thanks for sharing this info. I will pass this to our engineers to investigate, and resolve the issue.

-Tommy