Did not received participant joined event, sometimes do not receive participant left event

API and Webhooks
1

Description
A clear and concise description of what the question is.

Error
Not receiving proper webhook events, I have subscribed with meeting_end, participant_left and participant_joined.
There are multiple cases where participant events are missing and that is breaking things on our side as we are calculating attendance on basis of these events in our training program.

Which App Type (OAuth / Chatbot / JWT / Webhook)?
Oauth App we have created oauth app for admin account and added trainers account under it to receive events of trainers meeting participants

This is the meeting ID - ***********

We also capture events from our side app also, where for this particular we can see, when he connected in our app and when he disconnected.

It’s clearly visible when he connected we did not received any participant_joined event.
But we received participant_left event when he disconnected.

[{“status”:“connected”,“event_ts”:"{$date=1596084361729}"},{“status”:“disconnected”,“event_ts”:"{$date=1596087361091}"},{“status”:“participant_left”,“event_ts”:"{$date=1596087359000}"}]

Please look into it, why this is breaking and buggy??

What can be done here to minimise this issue?

*This post has been edited to remove any meeting / webinar IDs

2

Hey @taushifali,

Can you confirm you are returning a 200 OK response after receiving a webhook?

Thanks,
Tommy

3

Hi @tommy,
Yes we are returning 200 after receiving zoom webhooks.
Some webhooks are not received, else we are receiving most of the webhooks.
But when we don’t receive webhook things at our end break.

Please check.

4

Hi @tommy,
Adding one more weird case related to webhooks, in this case there is no gap between 1st participant_left event and 2nd participant_joined event, how is this possible, not event of 1 microsecond, exact same time?

Adding details for the issue below. Adding my app side events also if that helps in debugging these issues.

[{“status”:“connected”,“event_ts”:"{$date=1596515874221}","_id":“5f28e6229444bb250065208e”},{“status”:“participant_joined”,“event_ts”:"{$date=1596515872000}","_id":“5f28e624b2d5f1240091cb71”},{“status”:“reconnecting”,“event_ts”:"{$date=1596518554837}","_id":“5f28f09a9444bb25006521a8”},{“status”:“idle”,“event_ts”:"{$date=1596518560262}","_id":“5f28f0a09444bb25006521a9”},{“status”:“connecting”,“event_ts”:"{$date=1596518563630}","_id":“5f28f0a36457cf260011380a”},{“status”:“connected”,“event_ts”:"{$date=1596518569252}","_id":“5f28f0a94b64772a00080b2f”},{“status”:“participant_joined”,“event_ts”:"{$date=1596518565000}","_id":“5f28f0aaaf094224001dabd6”},{“status”:“participant_left”,“event_ts”:"{$date=1596518565000}","_id":“5f28f0ae4b64772a00080b30”},{“status”:“disconnected”,“event_ts”:"{$date=1596518994455}","_id":“5f28f252af094224001dac07”},{“status”:“participant_left”,“event_ts”:"{$date=1596518993000}","_id":“5f28f2574b64772a00080b54”}]

Meeting Id ***********

1st participant_joined - 1596515872000

2nd participant_joined - 1596518565000

1st participant_left - 1596518565000

2nd participant_left - 1596518993000

*This post has been edited to remove any meeting / webinar IDs

5

Thanks for the additional details @taushifali!

Our engineering team is looking into this. (ZOOM-184141) I will provide you an update as soon as I get one.

-Tommy

6

Thanks @tommy, I hope it will be resolved soon, cause it must be happening not only for me, but with many others too.

7

Hey @taushifali,

According to our logs, we sent the Participant Joined and Left Webhooks to the endpoint https://www.{yourdomain}.com/api/v2/supply/videoConference/saveZoomEvent, it returned “200” status, which means it sent successfully. That being said, the whole response time of the request was 2210 ms so it was a little delayed.

Thanks,
Tommy

8

Hey @tommy,
There were 3 participants in the meeting - 93206758891.
Attaching my side event logs for each user. For 2 users we got events but for Mithun participant_joined event doesn’t come.
You can check by full username here => Mithun(mithun50240)

  1. Mithun(mithun50240)

[{“status”:“connecting”,“event_ts”:"{$date=1596084323487}","_id":“5f225063f51d052500cac35d”},{“status”:“waiting_for_host”,“event_ts”:"{$date=1596084325485}","_id":“5f2250657e2937250023075e”},{“status”:“connecting”,“event_ts”:"{$date=1596084358479}","_id":“5f2250867e29372500230767”},{“status”:“connected”,“event_ts”:"{$date=1596084361729}","_id":“5f225089f51d052500cac360”},{“status”:“disconnected”,“event_ts”:"{$date=1596087361091}","_id":“5f225c41d9637a2400da973d”},{“status”:“participant_left”,“event_ts”:"{$date=1596087359000}","_id":“5f225c4d272fe725008c3f35”}]

  1. Komal(komal74619)
    [{“status”:“connecting”,“event_ts”:"{$date=1596086564461}","_id":“5f225924f51d052500cac3f6”},{“status”:“connected”,“event_ts”:"{$date=1596086568040}","_id":“5f2259283fcb442600f0ae03”},{“status”:“participant_joined”,“event_ts”:"{$date=1596086566000}","_id":“5f22592be9c4ba2500caded1”},{“status”:“disconnected”,“event_ts”:"{$date=1596086592394}","_id":“5f225940f51d052500cac3fa”},{“status”:“participant_left”,“event_ts”:"{$date=1596086591000}","_id":“5f2259467ec9d828002305c5”}]

  2. Md Akil(md-akil92242)
    [{“status”:“connecting”,“event_ts”:"{$date=1596084980200}","_id":“5f2252f4d9637a2400da966c”},{“status”:“connected”,“event_ts”:"{$date=1596084984403}","_id":“5f2252f8d57dae2400fed0a5”},{“status”:“participant_joined”,“event_ts”:"{$date=1596084982000}","_id":“5f2252fb21783f25009ebb97”},{“status”:“in_waiting_room”,“event_ts”:"{$date=1596085138646}","_id":“5f225392e9c4ba2500cade6e”},{“status”:“connected”,“event_ts”:"{$date=1596085151924}","_id":“5f22539fa4292e24004a7bf1”},{“status”:“reconnecting”,“event_ts”:"{$date=1596085151944}","_id":“5f22539fd57dae2400fed0b0”},{“status”:“idle”,“event_ts”:"{$date=1596085153044}","_id":“5f2253a1272fe725008c3e8f”},{“status”:“participant_left”,“event_ts”:"{$date=1596085152000}","_id":“5f2253a8272fe725008c3e91”},{“status”:“connecting”,“event_ts”:"{$date=1596085160456}","_id":“5f2253a8d57dae2400fed0b2”},{“status”:“connected”,“event_ts”:"{$date=1596085161478}","_id":“5f2253a92fb4f62500c1863f”},{“status”:“participant_joined”,“event_ts”:"{$date=1596085160000}","_id":“5f2253ae2fb4f62500c18640”},{“status”:“participant_left”,“event_ts”:"{$date=1596087198000}","_id":“5f225ba37e29372500230837”}]

9

Hi @tommy,
Providing you more scenarios for faster debugging of issue
In this case did not received meeting left event for user => Ashok Kumar(ashok78704)

only received his participant_joined event

[{“status”:“connecting”,“event_ts”:“{$date=1596779667477}”,“_id”:“5f2cec93d8d1cc26001eff9d”},{“status”:“in_waiting_room”,“event_ts”:“{$date=1596779684884}”,“_id”:“5f2ceca4ca309c2700452065”},{“status”:“disconnected”,“event_ts”:“{$date=1596779701707}”,“_id”:“5f2cecb5ca309c2700452067”},{“status”:“connecting”,“event_ts”:“{$date=1596779707332}”,“_id”:“5f2cecbb91680d26001070df”},{“status”:“in_waiting_room”,“event_ts”:“{$date=1596779719198}”,“_id”:“5f2cecc77fe4f4250022844a”},{“status”:“connecting”,“event_ts”:“{$date=1596780235885}”,“_id”:“5f2ceecbd8d1cc26001efffd”},{“status”:“in_waiting_room”,“event_ts”:“{$date=1596780241059}”,“_id”:“5f2ceed17fe4f425002284a8”},{“status”:“connected”,“event_ts”:“{$date=1596780256953}”,“_id”:“5f2ceee03fdd4c24001cfc2e”},{“status”:“reconnecting”,“event_ts”:“{$date=1596780257287}”,“_id”:“5f2ceee1371a3d2400dafd8e”},{“status”:“idle”,“event_ts”:“{$date=1596780259296}”,“_id”:“5f2ceee3371a3d2400dafd8f”},{“status”:“connecting”,“event_ts”:“{$date=1596780266448}”,“_id”:“5f2ceeea91680d260010713d”},{“status”:“connected”,“event_ts”:“{$date=1596780268521}”,“_id”:“5f2ceeec371a3d2400dafd90”},{“status”:“participant_joined”,“event_ts”:“{$date=1596780267000}”,“_id”:“5f2ceef3ca309c2700452102”},{“status”:“in_waiting_room”,“event_ts”:“{$date=1596780401073}”,“_id”:“5f2cef71ca309c2700452107”}]

Participant joined logs

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“sy0140yXSE+TjLAJkvKIeQ==”,“participant”:{“user_id”:“16781312”,“user_name”:“Ashok Kumar(ashok78704)”,“id”:“”,“join_time”:“2020-08-07T06:04:27Z”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“3tgG21AFQ0-rHz4jzIk0zA”,“duration”:60,“start_time”:“2020-08-07T05:32:07Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_joined”}

Meeting ended event logs

{“event”:“meeting.ended”,“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“duration”:60,“start_time”:“2020-08-07T05:32:07Z”,“timezone”:“Asia/Calcutta”,“end_time”:“2020-08-07T06:30:12Z”,“topic”:“Event meeting”,“id”:“***********”,“type”:1,“uuid”:“sy0140yXSE+TjLAJkvKIeQ==”,“host_id”:“3tgG21AFQ0-rHz4jzIk0zA”}}}

Hoping resolution for this as soon as possible :frowning:

*This post has been edited to remove any meeting / webinar IDs

10

Thanks for the additional info @taushifali.

We are looking into this. I will provide you with an update shortly.

-Tommy

11

Hey @taushifali,

We have confirmed this is a bug and are working to find the root cause. Do you have another meetingID of a meeting where the participant joined webhook did not send?

Thanks,
Tommy

12

Hi @tommy,
Not only participant_joined as well as participant_left events are also missing.
As provided above.
For meeting *********** - did not received participant_left event for user Ashok Kumar(ashok78704).

For meeting *********** - did not received participant_joined event for user Mithun(mithun50240).

In today’s meeting also:
***********, for user Muniraj(muniraj79753), in this meeting id received 2 consecutive participant_joined events, did not received participant_left after first participant_joined.

[{“status”:“participant_joined”,“event_ts”:"{$date=1597211033000}","_id":“5f3381a07877e82500e263d8”},{“status”:“participant_joined”,“event_ts”:"{$date=1597212381000}","_id":“5f3386e30ed5a0250031a7a6”},{“status”:“participant_left”,“event_ts”:"{$date=1597213327000}","_id":“5f338a9646d45c2700ec7d3f”}]

*This post has been edited to remove any meeting / webinar IDs

13

Hi @tommy,
Meeting Id - ***********
There is one more issue with webhoks, where events order is not correct, we have received 2nd participant_joined event before 1st participant_left. Even there is gap of 2 seconds between first participant_left and 2nd participant_joined event and as per times received from zoom are lagging.
Please check this case also, suggest what can be done here.

Order of events received at our end.

1st participant_joined:

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“6uciMSC0TcO/Yot7W09GdQ==”,“participant”:{“user_id”:“117441536”,“user_name”:“Md Abid(md-abid19486)”,“id”:“”,“join_time”:“2020-08-12T06:49:50Z”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“3tgG21AFQ0-rHz4jzIk0zA”,“duration”:60,“start_time”:“2020-08-12T06:46:22Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_joined”}

2nd participant_joined
{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“6uciMSC0TcO/Yot7W09GdQ==”,“participant”:{“user_id”:“117443584”,“user_name”:“Md Abid(md-abid19486)”,“id”:“”,“join_time”:“2020-08-12T06:58:40Z”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“3tgG21AFQ0-rHz4jzIk0zA”,“duration”:60,“start_time”:“2020-08-12T06:46:22Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_joined”}

1st participant_left:

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“6uciMSC0TcO/Yot7W09GdQ==”,“participant”:{“leave_time”:“2020-08-12T06:58:42Z”,“user_id”:“117441536”,“user_name”:“Md Abid(md-abid19486)”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“3tgG21AFQ0-rHz4jzIk0zA”,“duration”:60,“start_time”:“2020-08-12T06:46:22Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_left”}

2nd participant_left
{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“6uciMSC0TcO/Yot7W09GdQ==”,“participant”:{“leave_time”:“2020-08-12T07:31:48Z”,“user_id”:“117443584”,“user_name”:“Md Abid(md-abid19486)”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“3tgG21AFQ0-rHz4jzIk0zA”,“duration”:60,“start_time”:“2020-08-12T06:46:22Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_left”}

*This post has been edited to remove any meeting / webinar IDs

14

Thanks for the additional details @taushifali,

We are looking into this issue and will get back to you.

-Tommy

15

Hi @tommy,
Adding one more meeting id with issue where received 2nd participant_joined event before 1st participant_left.

Meeting Id - ***********
Below is the order of events and we can see that we received 2 participant_joined events together and 2 participant_left events together.

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“user_id”:“67110912”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”,“id”:“”,“join_time”:“2020-08-17T04:30:25Z”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_joined”}

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“user_id”:“33556480”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”,“id”:“”,“join_time”:“2020-08-17T04:32:08Z”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_joined”}

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“leave_time”:“2020-08-17T04:32:36Z”,“user_id”:“67110912”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_left”}

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“leave_time”:“2020-08-17T04:59:04Z”,“user_id”:“33556480”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_left”}

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“user_id”:“150995968”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”,“id”:“”,“join_time”:“2020-08-17T04:59:14Z”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_joined”}

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“leave_time”:“2020-08-17T05:06:25Z”,“user_id”:“150995968”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_left”}

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“user_id”:“218104832”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”,“id”:“”,“join_time”:“2020-08-17T05:25:54Z”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_joined”}

{“payload”:{“account_id”:“WxALpvKiQ0K-mPH3AxL6aw”,“object”:{“uuid”:“zypwYaiaRJSHCKIbX0kk+g==”,“participant”:{“leave_time”:“2020-08-17T05:27:54Z”,“user_id”:“218104832”,“user_name”:“Rupendra Meghwal(rupendra-meghwal)”},“id”:“***********”,“type”:1,“topic”:“Event meeting”,“host_id”:“WEYPb4GCSUyNjLuMYngDjA”,“duration”:60,“start_time”:“2020-08-17T04:28:20Z”,“timezone”:“Asia/Calcutta”}},“event”:“meeting.participant_left”}

*This post has been edited to remove any meeting / webinar IDs

16

Hi @tommy,
Any update on this?

17

Hey @taushifali,

Our engineers are still looking into this. I will have an update for you once we find the reason behind the out of order webhooks.

Thanks for your patience,
Tommy

18

Hey @taushifali,

We checked the logs of the meeting, and we found the attendee in question joined the meeting many times. The attendee’s networks was not stable, and joined the meeting many times, hence causing the webhook inconstancies.

Thanks,
Tommy

19

Hi @tommy,
How come network instability leads so webhook inconsistencies?

I believe if he is dropping off or joining in, then his events must be captured properly why there is lag or incorrect order in webhooks?

20

Hey @taushifali,

Because the network instability is causing the user to join / leave sporadically and not send the webhooks in order.

Thanks,
Tommy