Lose voice when plugging in my headphone

Hey GUys,
When I plugin my headphone in the middle of a call, the session gets muted and plugging in/out again does not fix it. Do I need to handle that ? I though the stream will be automatically updated for device changes.