Decoding documentation needed

[SpencerKaiser]

The DJIWidget is a delightful DJI library includes VideoPreviewer for video decoding

Where is the documentation for this feature? I need to use the video feed from DJIVideoFeedListener's delegate method func videoFeed(_ videoFeed: DJIVideoFeed, didUpdateVideoData rawData: Data) and convert it into something I can use with VNImageRequestHandler, but I don't see any docs on how to use the decoder to turn the raw data into something meaningful.

EDIT: Stack Overflow question I created for more support

[lijia6745]

The steps ：

1. Call DJIVideoPreviewer’s push:length: method Input the rawData.Inside DJIVideoPrviewer, If you have used VideoPreviewerSDKAdapter please skip this. H.264 parsing and decoding steps are performed.
2. Conforms the VideoFrameProcessor protocol and call DJIVideoPrviewer.registFrameProcessor register the VideoFrameProcessor protocol object.
3. VideoFrameProcessor protocol’s videoProcessFrame: method will output the VideoFrameYUV data.
4. Get the CVPixelBuffer data. VideoFrameYUV struct has a cv_pixelbuffer_fastupload field, this data is actually CVPixelBuffer when the hardware decoding is turned on.
   if use software decoding, then you need to create a CVPixelBuffer data and copy the data from the VideoFrameYUV's luma chromaB chromaR field.

[SpencerKaiser]

@lijia6745 thanks for the response! It looks like my VideoFrameProcessor methods are never being called... any idea why that might be? And about the software decoding, how would I know which (hardware/software) is enabled??

[talobin]

Please continue the discussion on StackOverflow. @SpencerKaiser

[SpencerKaiser]

@talobin why was this issue closed? Other than the README, this SDK has no documentation... I would expect this issue to be closed once documentation has been added to support at least the component I described above

[sansha]

I have similar problems where the delegate method func videoProcessFrame(_ frame: UnsafeMutablePointer<VideoFrameYUV>!) is never called even though I've registered the delegate:

DJIVideoPreviewer.instance()?.enableHardwareDecode = true
DJIVideoPreviewer.instance().registFrameProcessor(self)

[nguyenminhkhmt]

I have similar problems, but when I set enableHardwareDecode = true, cv_pixelbuffer_fastupload always return nil.

[SpencerKaiser]

@sansha @nguyenminhkhmt I'm going to open a new issue for that, this issue was primarily just for documentation around the whole process. What the three of us are seeing is definitely a bug.

[SpencerKaiser]

@sansha @nguyenminhkhmt here's the new issue, feel free to add additional comments there. Hopefully they'll actually respond via GitHub.

[sansha]

Alright! Could you please post a link to that new issue here?
Edit: you're faster!

[dji-dev]

Hi @SpencerKaiser @sansha @nguyenminhkhmt , we just update the iOS SDK Github Sample to demonstrate how to use VideoFrameProcessor, please check if it helps.

dji-sdk/Mobile-SDK-iOS@8137760