# Converting Zoom Video Raw data into video frames **URL:** \ **Category:** Video SDK\ **Created:** [August 27, 2024, 12:05pm UTC](https://devforum.zoom.us/t/converting-zoom-video-raw-data-into-video-frames/116459 "2024-08-27T12:05:00Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![nikunj.ramani](https://sea2.discourse-cdn.com/flex016/user_avatar/devforum.zoom.us/nikunj.ramani/32/62560_2.png) [@nikunj.ramani](https://devforum.zoom.us/u/nikunj.ramani)\ **Post date:** [August 27, 2024, 12:05pm UTC](https://devforum.zoom.us/t/converting-zoom-video-raw-data-into-video-frames/116459/1 "2024-08-27T12:05:00Z")
I’m working on a macOS application using the Zoom Video SDK, and as per the SDK documentation, the user video is received in the `ZMVideoSDKYUVRawDataI420` format from onRawDataFrameReceived which is mention on here([Video SDK - macOS - Video](https://developers.zoom.us/docs/video-sdk/macos/video/#render-video)) However, the documentation doesn’t explain how to convert this I420 raw data into video frames for display in a view. How to achieve this and show the user video in a view? I am using following code to convert it into frames ```auto func renderVideoFrame(_ frame: ZMVideoSDKYUVRawDataI420) { let width = Int(frame.streamWidth) let height = Int(frame.streamHeight) let yPlane = frame.yBuffer let uPlane = frame.uBuffer let vPlane = frame.vBuffer guard let rgbData = convertYUVtoRGB(yPlane: yPlane, uPlane: uPlane, vPlane: vPlane, width: width, height: height) else { return } let bitmapInfo = CGBitmapInfo(rawValue: CGImageAlphaInfo.noneSkipFirst.rawValue) let colorSpace = CGColorSpaceCreateDeviceRGB() let context = CGContext(data: rgbData, width: width, height: height, bitsPerComponent: 8, bytesPerRow: width * 4, space: colorSpace, bitmapInfo: bitmapInfo.rawValue) if let cgImage = context?.makeImage() { let nsImage = NSImage(cgImage: cgImage, size: NSSize(width: width, height: height)) DispatchQueue.main.async { self.viewController.displayImage(nsImage: nsImage) } } } func convertYUVtoRGB(yPlane: UnsafeMutablePointer?, uPlane: UnsafeMutablePointer?, vPlane: UnsafeMutablePointer?, width: Int, height: Int) -> UnsafeMutablePointer? { guard let yPlane = yPlane, let uPlane = uPlane, let vPlane = vPlane else { return nil } let rgbSize = width * height * 4 let rgbData = UnsafeMutablePointer.allocate(capacity: rgbSize) DispatchQueue.concurrentPerform(iterations: height) { y in for x in stride(from: 0, to: width, by: 2) { let yIndex = y * width + x // Calculate chroma indices for the subsampled U and V planes let chromaX = x / 2 let chromaY = y / 2 let uIndex = chromaY * (width / 2) + chromaX let vIndex = uIndex // Fetch U, V values let U = Int(UInt8(bitPattern: uPlane[uIndex])) - 128 let V = Int(UInt8(bitPattern: vPlane[vIndex])) - 128 // Precompute UV components let v1 = 5727 * V let uv1 = -(1617 * U) - (2378 * V) let u1 = 8324 * U // Process even pixel var Y = Int(UInt8(bitPattern: yPlane[yIndex])) << 12 var R = (Y + v1) >> 12 var G = (Y + uv1) >> 12 var B = (Y + u1) >> 12 // Clamp RGB values to valid range [0, 255] R = min(max(R, 0), 255) G = min(max(G, 0), 255) B = min(max(B, 0), 255) // Store the RGB values in the output buffer var rgbIndex = yIndex * 4 rgbData[rgbIndex] = UInt8(R) rgbData[rgbIndex + 1] = UInt8(G) rgbData[rgbIndex + 2] = UInt8(B) rgbData[rgbIndex + 3] = 0 // Alpha value // Process odd pixel Y = Int(UInt8(bitPattern: yPlane[yIndex + 1])) << 12 R = (Y + v1) >> 12 G = (Y + uv1) >> 12 B = (Y + u1) >> 12 // Clamp RGB values to valid range [0, 255] R = min(max(R, 0), 255) G = min(max(G, 0), 255) B = min(max(B, 0), 255) // Store the RGB values in the output buffer rgbIndex = (yIndex + 1) * 4 rgbData[rgbIndex] = UInt8(R) rgbData[rgbIndex + 1] = UInt8(G) rgbData[rgbIndex + 2] = UInt8(B) rgbData[rgbIndex + 3] = 0 // Alpha value } } return rgbData } ``` ---
**Author:** ![kellyjandrews](https://sea2.discourse-cdn.com/flex016/user_avatar/devforum.zoom.us/kellyjandrews/32/51599_2.png) [@kellyjandrews](https://devforum.zoom.us/u/kellyjandrews)\ **Post date:** [August 27, 2024, 12:17pm UTC](https://devforum.zoom.us/t/converting-zoom-video-raw-data-into-video-frames/116459/2 "2024-08-27T12:17:35Z")
I _think_ what you are looking for is here - [Video SDK - macOS - Raw data](https://developers.zoom.us/docs/video-sdk/macos/raw-data/#receive-raw-video-data) ```auto // Used to receive video's YUV420 data. - (void)onRawDataFrameReceived:(ZMVideoSDKYUVRawDataI420*)data { // Access the raw data for each of the 3 components. char *yBuffer = [data yBuffer]; char *uBuffer = [data uBuffer]; char *vBuffer = [data vBuffer]; // Get format of raw data. bool isVideoFormatLimitedI420 = [data isLimitedI420]; // Get rotation of raw data video stream. unsigned int rotation = [data rotation]; } // Called when the raw data has been toggled. - (void)onRawDataStatusChanged:(ZMVideoSDKRawDataStatus)status { switch (status) { case ZMVideoSDKRawData_On: // User's raw data is now on. break; case ZMVideoSDKRawData_Off: // User's raw data is now off. break; } } // Pass the delegate into the video pipe of a specific user (e.g. myself) ZMVideoSDKUser *user = [session getMySelf]; [user.getVideoPipe subscribe:ZMVideoSDKResolution_720P listener :delegate]; ``` ---
**Author:** ![nikunj.ramani](https://sea2.discourse-cdn.com/flex016/user_avatar/devforum.zoom.us/nikunj.ramani/32/62560_2.png) [@nikunj.ramani](https://devforum.zoom.us/u/nikunj.ramani)\ **Post date:** [August 27, 2024, 12:25pm UTC](https://devforum.zoom.us/t/converting-zoom-video-raw-data-into-video-frames/116459/3 "2024-08-27T12:25:27Z")
Hey @kellyjandrews What I was asking is how I can convert `ZMVideoSDKYUVRawDataI420` raw data into video frames or RGB values to show to the user. Basically, I am creating a video call application where I need to display the user’s video on the screen. ---
**Author:** ![kellyjandrews](https://sea2.discourse-cdn.com/flex016/user_avatar/devforum.zoom.us/kellyjandrews/32/51599_2.png) [@kellyjandrews](https://devforum.zoom.us/u/kellyjandrews)\ **Post date:** [August 27, 2024, 3:01pm UTC](https://devforum.zoom.us/t/converting-zoom-video-raw-data-into-video-frames/116459/4 "2024-08-27T15:01:40Z")
Ok - I may not be an expert here - but I will see if I can find out before someone who is answers first 🙂