client.leaveMeeting() asking user to re-join breakout room

I use client.joinBreakoutRoom(roomId.value) and client.leaveBreakoutRoom() intermittently in my app to join users to a breakout room. When the users login they are automatically assigned to a BreakoutRoom.

However, whenever the app issues client.leaveMeeting() , the user is then issued the following message:

I this case I need users to select (Not Now), but how to not ask the user after client.leaveMeeting() ? I just want them back in the main room.