VideoSDK AI avatar

Video SDK
1

Hello,
i would like to ask if it is possible to build AI avatar that will be able to communicate real time with other participant and will have access to the audio/video? Is there any api in video sdk to create such converstational bot that will be meeting participant?

Thank you

2

Hi @Piotr At the moment, there is no AI avatar for Video SDK . We do have feature raw data that you could use to implement that feature in your application.

3

@Piotr Hi,

Thank you for your question!

Video SDK’s native SDKs (Linux, Windows, macOS) support raw data access for remote participants, so you can process audio/video streams directly for your AI avatar.

For the Web SDK, direct raw data access isn’t provided. You’ll need to apply alternatives — for example, access the underlying <video> and <audio> tags or their media stream objects, and then pipe or process those streams as needed.

In both native and web cases, I suggest you:

  • Create virtual audio and video devices and pipe input/output streams to and from these devices.
    On Linux, for example, you can use tools like v4l2loopback (for virtual video devices) and snd-aloop (for virtual audio devices) to route and process streams cleanly.
  • Optionally explore third-party avatar/AI APIs that provide conversational or visual avatars, such as HeyGen, Tavus, or similar platforms that can integrate with your media streams.

Let me know if you’d like guidance on setting up virtual devices or integrating external avatar APIs!

Best,
Naeem Ahmed

4

We will implement solution with Web VideoSDK. Do you have any tutorial on how to set up a poc of Avatar with raw data usage?

5

Here is the raw data tutorial. Is this proper way to implement avatar in webSDK? Video SDK - web - Raw data

6

Thats correct @Piotr you can also view the raw data sample app here

7

Thanks a lot! Maybe do you have any example on how to integrate avatar using raw wideo?

8

This topic was automatically closed 25 hours after the last reply. New replies are no longer allowed.

9

At the moment, we do not a sample app for that.